2024-04-30T22:54:56.019 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-30T22:54:56.020 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031 --verbose --name mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi --owner scheduled_mchangir@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/orig.config.yaml 2024-04-30T22:54:56.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-30T22:54:56.168 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031 branch: wip-mchangir-testing-20240429.064231-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} email: mchangir@redhat.com first_in_suite: false job_id: '7680031' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240429.064231-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240429.064231-main-debug sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed owner: scheduled_mchangir@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9473 sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed sleep_before_teardown: 0 subset: 187/1024 suite: fs suite_branch: wip-mchangir-testing-20240429.064231-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfQLgs72vvWJ3tRAdCeuQRQZwsNDZUdgu9NSxHk5JE2FcZufPbXrjUuRhejKzHsvntTYl/mB8/3PQzBd5qF42g= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuKLalUctquPm5dFgVhaXTTQ1GlR3Ub9Zy7Z7YYWVkGC+P40zKo+Qr53k2YqfcDGQge3HdonczUCa0PD95eqtY= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6VRe94YamuiWeIET8Hz0J0MPkv0I799W/q6xDkVb3SVpVKRIr+O65e7rFzmAC0v/PI1g4zjsBnPq0LsFT0qCo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-30_01:08:25 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-30T22:54:56.168 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa; will attempt to use it 2024-04-30T22:54:56.169 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks 2024-04-30T22:54:56.169 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-30T22:54:56.170 INFO:teuthology.task.internal:Checking packages... 2024-04-30T22:54:56.194 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8505bf412a33fc9b7838e91f3a227044bc06f5ed' 2024-04-30T22:54:56.195 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-30T22:54:56.195 INFO:teuthology.packaging:ref: None 2024-04-30T22:54:56.195 INFO:teuthology.packaging:tag: None 2024-04-30T22:54:56.195 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240429.064231-main-debug 2024-04-30T22:54:56.195 INFO:teuthology.packaging:sha1: 8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T22:54:56.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240429.064231-main-debug 2024-04-30T22:54:56.348 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3308.g8505bf41 2024-04-30T22:54:56.350 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-30T22:54:56.356 INFO:teuthology.task.internal:no buildpackages task found 2024-04-30T22:54:56.357 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-30T22:54:56.362 INFO:teuthology.task.internal:Saving configuration 2024-04-30T22:54:56.396 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-30T22:54:56.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T22:54:56.430 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.537772', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfQLgs72vvWJ3tRAdCeuQRQZwsNDZUdgu9NSxHk5JE2FcZufPbXrjUuRhejKzHsvntTYl/mB8/3PQzBd5qF42g='} 2024-04-30T22:54:56.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.535224', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuKLalUctquPm5dFgVhaXTTQ1GlR3Ub9Zy7Z7YYWVkGC+P40zKo+Qr53k2YqfcDGQge3HdonczUCa0PD95eqtY='} 2024-04-30T22:54:56.476 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.536767', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6VRe94YamuiWeIET8Hz0J0MPkv0I799W/q6xDkVb3SVpVKRIr+O65e7rFzmAC0v/PI1g4zjsBnPq0LsFT0qCo='} 2024-04-30T22:54:56.476 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-30T22:54:56.482 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-30T22:54:56.482 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-30T22:54:56.482 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-30T22:54:56.482 INFO:teuthology.run_tasks:Running task console_log... 2024-04-30T22:54:56.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1cd2884f70>, signals=[15]) 2024-04-30T22:54:56.584 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-30T22:54:56.589 INFO:teuthology.task.internal:Opening connections... 2024-04-30T22:54:56.590 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T22:54:56.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:54:56.669 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-04-30T22:54:56.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:54:56.784 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-04-30T22:54:56.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:54:56.859 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-30T22:54:56.865 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-04-30T22:54:56.884 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-04-30T22:54:56.884 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-04-30T22:54:56.942 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-30T22:54:56.943 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-04-30T22:54:56.943 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-30T22:54:56.943 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-30T22:54:56.943 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-30T22:54:56.943 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-04-30T22:54:56.969 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-30T22:54:56.988 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-30T22:54:57.045 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-30T22:54:57.046 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-30T22:54:57.046 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-30T22:54:57.046 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-30T22:54:57.046 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-30T22:54:57.069 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-04-30T22:54:57.087 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-04-30T22:54:57.087 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-04-30T22:54:57.143 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-30T22:54:57.144 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-30T22:54:57.145 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-04-30T22:54:57.169 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-30T22:54:57.180 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-30T22:54:57.185 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-30T22:54:57.186 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-04-30T22:54:57.188 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-04-30T22:54:57.190 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-04-30T22:54:57.206 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-30T22:54:57.212 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-30T22:54:57.212 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-04-30T22:54:57.245 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-04-30T22:54:57.247 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-04-30T22:54:57.270 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-30T22:54:57.353 INFO:teuthology.run_tasks:Running task kernel... 2024-04-30T22:54:57.368 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-30T22:54:57.368 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-30T22:54:57.368 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-30T22:54:57.368 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-30T22:54:57.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:54:57.385 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-04-30T22:54:57.443 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-437.el9.x86_64 2024-04-30T22:54:57.443 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-437.el9.x86_64 2024-04-30T22:54:57.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-04-30T22:54:59.694 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-30T22:55:03.279 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 19 MB 00:02 2024-04-30T22:55:07.271 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-30T22:55:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-30T22:55:11.426 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-30T22:55:16.615 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 9.9 kB/s | 1.7 kB 00:00 2024-04-30T22:55:18.488 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-30T22:55:18.488 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-30T22:55:18.583 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-30T22:55:18.584 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-30T22:55:18.584 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-30T22:55:18.680 DEBUG:teuthology.orchestra.run.smithi100:> echo no | sudo yum reinstall kernel || true 2024-04-30T22:55:19.180 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:03 ago on Tue 30 Apr 2024 10:55:16 PM UTC. 2024-04-30T22:55:19.301 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-30T22:55:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.318 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-30T22:55:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 255 k 2024-04-30T22:55:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2024-04-30T22:55:19.320 INFO:teuthology.orchestra.run.smithi100.stderr:Operation aborted. 2024-04-30T22:55:19.373 INFO:teuthology.orchestra.run.smithi100.stdout:Is this ok [y/N]: 2024-04-30T22:55:19.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum reinstall -y kernel || true 2024-04-30T22:55:19.868 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:03 ago on Tue 30 Apr 2024 10:55:16 PM UTC. 2024-04-30T22:55:19.983 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-30T22:55:19.984 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.984 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-30T22:55:19.984 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.984 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2024-04-30T22:55:19.984 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 255 k 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2024-04-30T22:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-30T22:55:20.709 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-437.el9.x86_64.rpm 584 kB/s | 255 kB 00:00 2024-04-30T22:55:20.709 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-30T22:55:20.709 INFO:teuthology.orchestra.run.smithi100.stdout:Total 352 kB/s | 255 kB 00:00 2024-04-30T22:55:20.729 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-30T22:55:20.904 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-30T22:55:20.904 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-30T22:55:20.909 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-30T22:55:20.910 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-30T22:55:21.041 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-30T22:55:21.135 INFO:teuthology.orchestra.run.smithi100.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T22:55:21.135 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T22:55:21.890 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T22:55:21.891 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalled: 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T22:55:22.577 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-30T22:55:22.752 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-04-30T22:55:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-30T22:55:22.798 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-30T22:55:22.799 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-30T22:55:22.799 DEBUG:teuthology.parallel:result is None 2024-04-30T22:55:22.799 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-30T22:55:22.805 INFO:teuthology.task.internal:Creating test directory... 2024-04-30T22:55:22.805 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-30T22:55:22.807 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-30T22:55:22.810 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-30T22:55:22.827 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-30T22:55:22.833 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-30T22:55:22.839 INFO:teuthology.task.internal:Creating archive directory... 2024-04-30T22:55:22.839 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-30T22:55:22.862 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-30T22:55:22.867 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-30T22:55:22.968 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-30T22:55:22.976 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-30T22:55:22.976 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-30T22:55:22.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:55:22.992 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-30T22:55:23.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:55:23.009 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-30T22:55:23.011 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-30T22:55:23.035 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-30T22:55:23.055 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.066 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.073 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.081 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.092 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.101 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T22:55:23.102 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-30T22:55:23.109 INFO:teuthology.task.internal:Configuring sudo... 2024-04-30T22:55:23.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-30T22:55:23.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-30T22:55:23.136 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-30T22:55:23.167 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-30T22:55:23.176 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-30T22:55:23.176 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-30T22:55:23.178 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-30T22:55:23.203 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-30T22:55:23.223 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.324 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:23.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:23.445 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T22:55:23.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-30T22:55:23.508 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.553 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.597 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:23.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:23.721 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T22:55:23.721 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-30T22:55:23.787 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.831 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T22:55:23.875 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:23.959 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T22:55:24.000 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T22:55:24.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-30T22:55:24.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-04-30T22:55:24.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-04-30T22:55:24.071 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-04-30T22:55:24.098 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T22:55:24.115 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T22:55:24.146 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T22:55:24.595 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-30T22:55:24.602 INFO:teuthology.task.internal:Starting timer... 2024-04-30T22:55:24.602 INFO:teuthology.run_tasks:Running task pcp... 2024-04-30T22:55:24.612 INFO:teuthology.run_tasks:Running task selinux... 2024-04-30T22:55:24.620 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-30T22:55:24.620 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-04-30T22:55:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-04-30T22:55:24.709 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-04-30T22:55:24.765 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-04-30T22:55:24.767 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-04-30T22:55:24.844 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-04-30T22:55:24.845 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-30T22:55:24.846 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-04-30T22:55:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-04-30T22:55:24.872 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-04-30T22:55:24.897 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-04-30T22:55:24.897 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-04-30T22:55:24.916 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-04-30T22:55:24.916 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-04-30T22:55:24.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T22:55:24.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:55:24.943 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T22:55:24.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:55:24.972 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T22:55:24.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T22:55:25.000 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-30T22:55:25.000 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-04-30T22:55:25.041 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-04-30T22:55:25.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-04-30T22:55:25.094 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-30T22:55:25.107 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-30T22:55:25.113 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-30T22:55:25.245 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-30T22:55:25.265 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-30T22:55:25.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi104.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-30T22:59:57.419 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-04-30T22:59:57.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-30T22:59:57.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:59:57.499 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-04-30T22:59:57.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-30T22:59:57.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-30T22:59:57.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:59:57.672 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-30T22:59:57.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-30T22:59:57.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-30T22:59:57.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T22:59:57.826 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-04-30T22:59:57.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-30T22:59:57.913 INFO:teuthology.run_tasks:Running task clock... 2024-04-30T22:59:57.924 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-30T22:59:57.924 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-30T22:59:57.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T22:59:57.927 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-30T22:59:57.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T22:59:57.929 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-30T22:59:57.930 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T22:59:57.954 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-30T22:59:57.956 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-30T22:59:57.968 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-30T22:59:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-30T22:59:57.982 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-30T22:59:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-04-30T22:59:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-04-30T22:59:57.995 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-30T22:59:58.001 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-04-30T22:59:58.002 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-04-30T22:59:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-30T22:59:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-30T22:59:58.018 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-04-30T22:59:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-30T22:59:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-30T22:59:58.028 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-04-30T22:59:58.041 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-30T22:59:58.054 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-30T22:59:58.077 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.081 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.086 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.090 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.108 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.112 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T22:59:58.112 INFO:teuthology.run_tasks:Running task install... 2024-04-30T22:59:58.122 DEBUG:teuthology.task.install:project ceph 2024-04-30T22:59:58.123 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed'}} 2024-04-30T22:59:58.123 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed'} 2024-04-30T22:59:58.123 INFO:teuthology.task.install:Using flavor: default 2024-04-30T22:59:58.131 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-30T22:59:58.131 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-30T22:59:58.132 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'tag': None, 'wait_for_package': False} 2024-04-30T22:59:58.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T22:59:58.134 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'tag': None, 'wait_for_package': False} 2024-04-30T22:59:58.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T22:59:58.135 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'tag': None, 'wait_for_package': False} 2024-04-30T22:59:58.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T22:59:58.292 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/ 2024-04-30T22:59:58.292 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3308.g8505bf41 2024-04-30T22:59:58.351 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/ 2024-04-30T22:59:58.352 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3308.g8505bf41 2024-04-30T22:59:58.367 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/ 2024-04-30T22:59:58.367 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3308.g8505bf41 2024-04-30T22:59:58.410 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-30T22:59:58.411 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T22:59:58.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-30T22:59:58.436 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-30T22:59:58.436 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8505bf412a33fc9b7838e91f3a227044bc06f5ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-30T22:59:58.485 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-30T22:59:58.485 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T22:59:58.485 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-30T22:59:58.499 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-30T22:59:58.510 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-30T22:59:58.510 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8505bf412a33fc9b7838e91f3a227044bc06f5ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-30T22:59:58.521 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-30T22:59:58.521 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T22:59:58.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-30T22:59:58.546 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-30T22:59:58.546 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8505bf412a33fc9b7838e91f3a227044bc06f5ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-30T22:59:58.572 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-30T22:59:58.575 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-30T22:59:58.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-30T22:59:58.634 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-04-30T22:59:58.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-04-30T22:59:58.648 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-30T22:59:58.684 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-30T22:59:58.710 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-04-30T22:59:58.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-04-30T22:59:58.748 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-04-30T22:59:58.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-04-30T22:59:58.860 INFO:teuthology.orchestra.run.smithi104.stdout:50 files removed 2024-04-30T22:59:58.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-30T22:59:58.936 INFO:teuthology.orchestra.run.smithi183.stdout:50 files removed 2024-04-30T22:59:58.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-30T22:59:58.974 INFO:teuthology.orchestra.run.smithi100.stdout:50 files removed 2024-04-30T22:59:59.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-30T22:59:59.554 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 207 kB/s | 84 kB 00:00 2024-04-30T22:59:59.569 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 245 kB/s | 84 kB 00:00 2024-04-30T22:59:59.624 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 230 kB/s | 84 kB 00:00 2024-04-30T22:59:59.894 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-04-30T22:59:59.911 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-04-30T22:59:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-30T23:00:00.320 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-30T23:00:00.328 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-30T23:00:00.402 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-04-30T23:00:00.854 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-30T23:00:01.303 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.0 MB 00:00 2024-04-30T23:00:02.605 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-30T23:00:03.450 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.0 MB 00:03 2024-04-30T23:00:05.209 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-30T23:00:06.614 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-30T23:00:08.506 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-04-30T23:00:10.408 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-30T23:00:15.483 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-30T23:00:16.918 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 801 kB/s | 6.2 MB 00:07 2024-04-30T23:00:17.584 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:17.585 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:17.595 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-30T23:00:17.596 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-30T23:00:17.597 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-30T23:00:17.598 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-30T23:00:17.600 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-30T23:00:17.602 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-30T23:00:17.602 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-30T23:00:17.662 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-30T23:00:17.681 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 6.6 k 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.4 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 863 k 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 147 k 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 1.5 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 142 k 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 3.5 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 7.4 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 49 k 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 10 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 43 M 2024-04-30T23:00:17.682 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 273 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 762 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 224 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 27 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 18 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 32 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 756 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 127 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-30T23:00:17.683 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 161 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 321 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 299 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 99 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 86 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.0 M 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 170 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-04-30T23:00:17.684 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.3 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.1 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 20 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 34 k 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 2.3 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 249 k 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 4.9 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 18 M 2024-04-30T23:00:17.685 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 16 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 25 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 157 k 2024-04-30T23:00:17.686 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 497 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.2 M 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-30T23:00:17.687 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 45 k 2024-04-30T23:00:17.688 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 135 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-30T23:00:17.689 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-30T23:00:17.690 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-30T23:00:17.691 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-30T23:00:17.692 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-04-30T23:00:17.693 INFO:teuthology.orchestra.run.smithi183.stdout:Install 148 Packages 2024-04-30T23:00:17.694 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 4 Packages 2024-04-30T23:00:17.694 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:00:17.694 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 214 M 2024-04-30T23:00:17.694 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-04-30T23:00:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-30T23:00:18.894 INFO:teuthology.orchestra.run.smithi183.stdout:(1/152): ceph-19.0.0-3308.g8505bf41.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-04-30T23:00:19.210 INFO:teuthology.orchestra.run.smithi183.stdout:(2/152): ceph-base-19.0.0-3308.g8505bf41.el9.x8 10 MB/s | 5.4 MB 00:00 2024-04-30T23:00:19.260 INFO:teuthology.orchestra.run.smithi183.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.9 MB/s | 147 kB 00:00 2024-04-30T23:00:19.427 INFO:teuthology.orchestra.run.smithi183.stdout:(4/152): ceph-mds-19.0.0-3308.g8505bf41.el9.x86 14 MB/s | 2.3 MB 00:00 2024-04-30T23:00:19.452 INFO:teuthology.orchestra.run.smithi183.stdout:(5/152): ceph-fuse-19.0.0-3308.g8505bf41.el9.x8 1.5 MB/s | 863 kB 00:00 2024-04-30T23:00:19.561 INFO:teuthology.orchestra.run.smithi183.stdout:(6/152): ceph-mgr-19.0.0-3308.g8505bf41.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-30T23:00:20.562 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-30T23:00:21.011 INFO:teuthology.orchestra.run.smithi183.stdout:(7/152): ceph-osd-19.0.0-3308.g8505bf41.el9.x86 12 MB/s | 18 MB 00:01 2024-04-30T23:00:21.086 INFO:teuthology.orchestra.run.smithi183.stdout:(8/152): ceph-mon-19.0.0-3308.g8505bf41.el9.x86 3.0 MB/s | 4.9 MB 00:01 2024-04-30T23:00:21.170 INFO:teuthology.orchestra.run.smithi183.stdout:(9/152): ceph-selinux-19.0.0-3308.g8505bf41.el9 302 kB/s | 25 kB 00:00 2024-04-30T23:00:21.420 INFO:teuthology.orchestra.run.smithi183.stdout:(10/152): ceph-common-19.0.0-3308.g8505bf41.el9 7.1 MB/s | 20 MB 00:02 2024-04-30T23:00:21.495 INFO:teuthology.orchestra.run.smithi183.stdout:(11/152): cephfs-mirror-19.0.0-3308.g8505bf41.e 2.9 MB/s | 224 kB 00:00 2024-04-30T23:00:21.562 INFO:teuthology.orchestra.run.smithi183.stdout:(12/152): cephfs-shell-19.0.0-3308.g8505bf41.el 407 kB/s | 27 kB 00:00 2024-04-30T23:00:21.704 INFO:teuthology.orchestra.run.smithi183.stdout:(13/152): ceph-radosgw-19.0.0-3308.g8505bf41.el 15 MB/s | 10 MB 00:00 2024-04-30T23:00:21.729 INFO:teuthology.orchestra.run.smithi183.stdout:(14/152): libcephfs-devel-19.0.0-3308.g8505bf41 190 kB/s | 32 kB 00:00 2024-04-30T23:00:21.780 INFO:teuthology.orchestra.run.smithi183.stdout:(15/152): libcephfs2-19.0.0-3308.g8505bf41.el9. 9.8 MB/s | 756 kB 00:00 2024-04-30T23:00:21.813 INFO:teuthology.orchestra.run.smithi183.stdout:(16/152): libcephsqlite-19.0.0-3308.g8505bf41.e 1.8 MB/s | 157 kB 00:00 2024-04-30T23:00:21.838 INFO:teuthology.orchestra.run.smithi183.stdout:(17/152): librados-devel-19.0.0-3308.g8505bf41. 2.1 MB/s | 127 kB 00:00 2024-04-30T23:00:21.880 INFO:teuthology.orchestra.run.smithi183.stdout:(18/152): libradosstriper1-19.0.0-3308.g8505bf4 7.3 MB/s | 497 kB 00:00 2024-04-30T23:00:22.006 INFO:teuthology.orchestra.run.smithi183.stdout:(19/152): python3-ceph-argparse-19.0.0-3308.g85 361 kB/s | 45 kB 00:00 2024-04-30T23:00:22.081 INFO:teuthology.orchestra.run.smithi183.stdout:(20/152): python3-ceph-common-19.0.0-3308.g8505 1.8 MB/s | 135 kB 00:00 2024-04-30T23:00:22.165 INFO:teuthology.orchestra.run.smithi183.stdout:(21/152): librgw2-19.0.0-3308.g8505bf41.el9.x86 16 MB/s | 5.2 MB 00:00 2024-04-30T23:00:22.190 INFO:teuthology.orchestra.run.smithi183.stdout:(22/152): python3-cephfs-19.0.0-3308.g8505bf41. 1.5 MB/s | 161 kB 00:00 2024-04-30T23:00:22.215 INFO:teuthology.orchestra.run.smithi183.stdout:(23/152): python3-rados-19.0.0-3308.g8505bf41.e 6.3 MB/s | 321 kB 00:00 2024-04-30T23:00:22.257 INFO:teuthology.orchestra.run.smithi183.stdout:(24/152): python3-rbd-19.0.0-3308.g8505bf41.el9 4.4 MB/s | 299 kB 00:00 2024-04-30T23:00:22.283 INFO:teuthology.orchestra.run.smithi183.stdout:(25/152): python3-rgw-19.0.0-3308.g8505bf41.el9 1.4 MB/s | 99 kB 00:00 2024-04-30T23:00:22.325 INFO:teuthology.orchestra.run.smithi183.stdout:(26/152): rbd-fuse-19.0.0-3308.g8505bf41.el9.x8 1.2 MB/s | 86 kB 00:00 2024-04-30T23:00:22.408 INFO:teuthology.orchestra.run.smithi183.stdout:(27/152): rbd-nbd-19.0.0-3308.g8505bf41.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-30T23:00:22.517 INFO:teuthology.orchestra.run.smithi183.stdout:(28/152): rbd-mirror-19.0.0-3308.g8505bf41.el9. 13 MB/s | 3.0 MB 00:00 2024-04-30T23:00:22.542 INFO:teuthology.orchestra.run.smithi183.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3308.g 256 kB/s | 34 kB 00:00 2024-04-30T23:00:22.568 INFO:teuthology.orchestra.run.smithi183.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3308.g8505bf4 2.8 MB/s | 142 kB 00:00 2024-04-30T23:00:22.826 INFO:teuthology.orchestra.run.smithi183.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3308.g8505b 12 MB/s | 3.5 MB 00:00 2024-04-30T23:00:22.902 INFO:teuthology.orchestra.run.smithi183.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3308.g85 3.2 MB/s | 249 kB 00:00 2024-04-30T23:00:23.018 INFO:teuthology.orchestra.run.smithi183.stdout:(33/152): ceph-mgr-rook-19.0.0-3308.g8505bf41.e 423 kB/s | 49 kB 00:00 2024-04-30T23:00:23.026 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 943 kB/s | 19 MB 00:20 2024-04-30T23:00:23.077 INFO:teuthology.orchestra.run.smithi183.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3308.g8 281 kB/s | 16 kB 00:00 2024-04-30T23:00:23.194 INFO:teuthology.orchestra.run.smithi183.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-04-30T23:00:23.219 INFO:teuthology.orchestra.run.smithi183.stdout:(36/152): ceph-volume-19.0.0-3308.g8505bf41.el9 1.9 MB/s | 273 kB 00:00 2024-04-30T23:00:23.269 INFO:teuthology.orchestra.run.smithi183.stdout:(37/152): cephadm-19.0.0-3308.g8505bf41.el9.noa 9.9 MB/s | 762 kB 00:00 2024-04-30T23:00:23.294 INFO:teuthology.orchestra.run.smithi183.stdout:(38/152): cephfs-top-19.0.0-3308.g8505bf41.el9. 242 kB/s | 18 kB 00:00 2024-04-30T23:00:23.495 INFO:teuthology.orchestra.run.smithi183.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 357 kB/s | 80 kB 00:00 2024-04-30T23:00:23.587 INFO:teuthology.orchestra.run.smithi183.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-04-30T23:00:23.612 INFO:teuthology.orchestra.run.smithi183.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-04-30T23:00:23.654 INFO:teuthology.orchestra.run.smithi183.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-30T23:00:23.713 INFO:teuthology.orchestra.run.smithi183.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-04-30T23:00:23.738 INFO:teuthology.orchestra.run.smithi183.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-30T23:00:23.780 INFO:teuthology.orchestra.run.smithi183.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-30T23:00:23.805 INFO:teuthology.orchestra.run.smithi183.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-30T23:00:23.847 INFO:teuthology.orchestra.run.smithi183.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-30T23:00:23.889 INFO:teuthology.orchestra.run.smithi183.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 8.0 MB/s | 689 kB 00:00 2024-04-30T23:00:23.956 INFO:teuthology.orchestra.run.smithi183.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-30T23:00:23.990 INFO:teuthology.orchestra.run.smithi183.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-04-30T23:00:24.023 INFO:teuthology.orchestra.run.smithi183.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 322 kB/s | 21 kB 00:00 2024-04-30T23:00:24.057 INFO:teuthology.orchestra.run.smithi183.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-30T23:00:24.090 INFO:teuthology.orchestra.run.smithi183.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-04-30T23:00:24.183 INFO:teuthology.orchestra.run.smithi183.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-30T23:00:24.200 INFO:teuthology.orchestra.run.smithi183.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-04-30T23:00:24.233 INFO:teuthology.orchestra.run.smithi183.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-30T23:00:24.259 INFO:teuthology.orchestra.run.smithi183.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-30T23:00:24.300 INFO:teuthology.orchestra.run.smithi183.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-04-30T23:00:24.334 INFO:teuthology.orchestra.run.smithi183.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-30T23:00:24.385 INFO:teuthology.orchestra.run.smithi183.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-30T23:00:24.410 INFO:teuthology.orchestra.run.smithi183.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-30T23:00:24.452 INFO:teuthology.orchestra.run.smithi183.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-04-30T23:00:24.477 INFO:teuthology.orchestra.run.smithi183.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-30T23:00:24.519 INFO:teuthology.orchestra.run.smithi183.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-30T23:00:24.544 INFO:teuthology.orchestra.run.smithi183.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-04-30T23:00:24.703 INFO:teuthology.orchestra.run.smithi183.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-30T23:00:24.770 INFO:teuthology.orchestra.run.smithi183.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-30T23:00:24.837 INFO:teuthology.orchestra.run.smithi183.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-30T23:00:24.870 INFO:teuthology.orchestra.run.smithi183.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-30T23:00:24.912 INFO:teuthology.orchestra.run.smithi183.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-30T23:00:25.063 INFO:teuthology.orchestra.run.smithi183.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-04-30T23:00:25.104 INFO:teuthology.orchestra.run.smithi183.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-04-30T23:00:25.146 INFO:teuthology.orchestra.run.smithi183.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-04-30T23:00:25.230 INFO:teuthology.orchestra.run.smithi183.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-30T23:00:25.314 INFO:teuthology.orchestra.run.smithi183.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-30T23:00:25.356 INFO:teuthology.orchestra.run.smithi183.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-04-30T23:00:25.381 INFO:teuthology.orchestra.run.smithi183.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-30T23:00:25.423 INFO:teuthology.orchestra.run.smithi183.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 285 kB/s | 19 kB 00:00 2024-04-30T23:00:25.448 INFO:teuthology.orchestra.run.smithi183.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-30T23:00:25.491 INFO:teuthology.orchestra.run.smithi183.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-04-30T23:00:25.599 INFO:teuthology.orchestra.run.smithi183.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-30T23:00:25.624 INFO:teuthology.orchestra.run.smithi183.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-04-30T23:00:25.666 INFO:teuthology.orchestra.run.smithi183.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-04-30T23:00:25.691 INFO:teuthology.orchestra.run.smithi183.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-30T23:00:25.733 INFO:teuthology.orchestra.run.smithi183.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-04-30T23:00:25.754 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-30T23:00:25.758 INFO:teuthology.orchestra.run.smithi183.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-30T23:00:25.801 INFO:teuthology.orchestra.run.smithi183.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-30T23:00:25.826 INFO:teuthology.orchestra.run.smithi183.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-30T23:00:25.868 INFO:teuthology.orchestra.run.smithi183.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-04-30T23:00:25.893 INFO:teuthology.orchestra.run.smithi183.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 801 kB/s | 54 kB 00:00 2024-04-30T23:00:25.977 INFO:teuthology.orchestra.run.smithi183.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2024-04-30T23:00:26.044 INFO:teuthology.orchestra.run.smithi183.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 664 kB/s | 44 kB 00:00 2024-04-30T23:00:26.236 INFO:teuthology.orchestra.run.smithi183.stdout:(93/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-04-30T23:00:26.261 INFO:teuthology.orchestra.run.smithi183.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-04-30T23:00:26.295 INFO:teuthology.orchestra.run.smithi183.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-04-30T23:00:26.311 INFO:teuthology.orchestra.run.smithi183.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-30T23:00:26.353 INFO:teuthology.orchestra.run.smithi183.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-30T23:00:26.370 INFO:teuthology.orchestra.run.smithi183.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 984 kB/s | 58 kB 00:00 2024-04-30T23:00:26.427 INFO:teuthology.orchestra.run.smithi183.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.3 MB/s | 94 kB 00:00 2024-04-30T23:00:26.454 INFO:teuthology.orchestra.run.smithi183.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-04-30T23:00:26.497 INFO:teuthology.orchestra.run.smithi183.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 648 kB/s | 45 kB 00:00 2024-04-30T23:00:26.722 INFO:teuthology.orchestra.run.smithi183.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-04-30T23:00:26.980 INFO:teuthology.orchestra.run.smithi183.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-30T23:00:27.072 INFO:teuthology.orchestra.run.smithi183.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-04-30T23:00:27.114 INFO:teuthology.orchestra.run.smithi183.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-04-30T23:00:27.356 INFO:teuthology.orchestra.run.smithi183.stdout:(106/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-04-30T23:00:27.456 INFO:teuthology.orchestra.run.smithi183.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-04-30T23:00:27.520 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.2 MB 00:00 2024-04-30T23:00:27.548 INFO:teuthology.orchestra.run.smithi183.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-04-30T23:00:27.607 INFO:teuthology.orchestra.run.smithi183.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-30T23:00:27.673 INFO:teuthology.orchestra.run.smithi183.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-30T23:00:27.863 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:27.864 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:27.874 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-30T23:00:27.875 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-30T23:00:27.876 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-30T23:00:27.877 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-30T23:00:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-30T23:00:27.881 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-30T23:00:27.881 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-30T23:00:27.890 INFO:teuthology.orchestra.run.smithi183.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-04-30T23:00:27.943 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 6.6 k 2024-04-30T23:00:27.952 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.4 M 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 863 k 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 147 k 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 1.5 M 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 142 k 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 3.5 M 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 7.4 M 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 49 k 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 10 M 2024-04-30T23:00:27.953 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 43 M 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 273 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 762 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 224 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 27 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 18 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-30T23:00:27.954 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 32 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 756 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 127 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-30T23:00:27.955 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 161 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 321 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 299 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 99 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 86 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.0 M 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 170 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-30T23:00:27.956 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.3 M 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.1 M 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-30T23:00:27.957 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 20 M 2024-04-30T23:00:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 34 k 2024-04-30T23:00:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 2.3 M 2024-04-30T23:00:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 249 k 2024-04-30T23:00:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 4.9 M 2024-04-30T23:00:27.958 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 18 M 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 16 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 25 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-30T23:00:27.959 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 157 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 497 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.2 M 2024-04-30T23:00:27.960 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-30T23:00:27.961 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 45 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 135 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-30T23:00:27.962 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-30T23:00:27.963 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-30T23:00:27.964 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-30T23:00:27.965 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-30T23:00:27.966 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-30T23:00:27.967 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-30T23:00:27.968 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-04-30T23:00:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 4 Packages 2024-04-30T23:00:27.970 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:00:27.970 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 214 M 2024-04-30T23:00:27.970 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-30T23:00:28.016 INFO:teuthology.orchestra.run.smithi183.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-30T23:00:28.058 INFO:teuthology.orchestra.run.smithi183.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-30T23:00:28.100 INFO:teuthology.orchestra.run.smithi183.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 771 kB/s | 32 kB 00:00 2024-04-30T23:00:28.142 INFO:teuthology.orchestra.run.smithi183.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-04-30T23:00:28.201 INFO:teuthology.orchestra.run.smithi183.stdout:(116/152): libarrow-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-04-30T23:00:28.242 INFO:teuthology.orchestra.run.smithi183.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-30T23:00:28.660 INFO:teuthology.orchestra.run.smithi183.stdout:(118/152): ceph-test-19.0.0-3308.g8505bf41.el9. 5.8 MB/s | 43 MB 00:07 2024-04-30T23:00:28.685 INFO:teuthology.orchestra.run.smithi183.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 741 kB/s | 358 kB 00:00 2024-04-30T23:00:28.710 INFO:teuthology.orchestra.run.smithi183.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 649 kB/s | 303 kB 00:00 2024-04-30T23:00:28.752 INFO:teuthology.orchestra.run.smithi183.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 384 kB/s | 35 kB 00:00 2024-04-30T23:00:28.777 INFO:teuthology.orchestra.run.smithi183.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-30T23:00:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-04-30T23:00:28.845 INFO:teuthology.orchestra.run.smithi183.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-30T23:00:28.870 INFO:teuthology.orchestra.run.smithi183.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-04-30T23:00:28.895 INFO:teuthology.orchestra.run.smithi183.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-30T23:00:28.905 INFO:teuthology.orchestra.run.smithi100.stdout:(1/152): ceph-19.0.0-3308.g8505bf41.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-04-30T23:00:28.920 INFO:teuthology.orchestra.run.smithi183.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-30T23:00:28.946 INFO:teuthology.orchestra.run.smithi183.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-30T23:00:28.951 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-30T23:00:28.996 INFO:teuthology.orchestra.run.smithi183.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 930 kB/s | 46 kB 00:00 2024-04-30T23:00:29.046 INFO:teuthology.orchestra.run.smithi183.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-30T23:00:29.088 INFO:teuthology.orchestra.run.smithi183.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-30T23:00:29.172 INFO:teuthology.orchestra.run.smithi183.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-04-30T23:00:29.214 INFO:teuthology.orchestra.run.smithi183.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-04-30T23:00:29.239 INFO:teuthology.orchestra.run.smithi183.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-30T23:00:29.281 INFO:teuthology.orchestra.run.smithi183.stdout:(135/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-04-30T23:00:29.298 INFO:teuthology.orchestra.run.smithi183.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-30T23:00:29.306 INFO:teuthology.orchestra.run.smithi100.stdout:(2/152): ceph-base-19.0.0-3308.g8505bf41.el9.x8 8.5 MB/s | 5.4 MB 00:00 2024-04-30T23:00:29.323 INFO:teuthology.orchestra.run.smithi183.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-04-30T23:00:29.348 INFO:teuthology.orchestra.run.smithi183.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-04-30T23:00:29.372 INFO:teuthology.orchestra.run.smithi100.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.2 MB/s | 147 kB 00:00 2024-04-30T23:00:29.374 INFO:teuthology.orchestra.run.smithi183.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-30T23:00:29.400 INFO:teuthology.orchestra.run.smithi183.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-04-30T23:00:29.424 INFO:teuthology.orchestra.run.smithi183.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-30T23:00:29.450 INFO:teuthology.orchestra.run.smithi183.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 673 kB/s | 51 kB 00:00 2024-04-30T23:00:29.475 INFO:teuthology.orchestra.run.smithi183.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-30T23:00:29.500 INFO:teuthology.orchestra.run.smithi183.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-30T23:00:29.526 INFO:teuthology.orchestra.run.smithi183.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-04-30T23:00:29.606 INFO:teuthology.orchestra.run.smithi100.stdout:(4/152): ceph-mds-19.0.0-3308.g8505bf41.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-04-30T23:00:29.726 INFO:teuthology.orchestra.run.smithi183.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 1.5 MB/s | 427 kB 00:00 2024-04-30T23:00:29.749 INFO:teuthology.orchestra.run.smithi100.stdout:(5/152): ceph-mgr-19.0.0-3308.g8505bf41.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-30T23:00:29.773 INFO:teuthology.orchestra.run.smithi100.stdout:(6/152): ceph-fuse-19.0.0-3308.g8505bf41.el9.x8 994 kB/s | 863 kB 00:00 2024-04-30T23:00:29.810 INFO:teuthology.orchestra.run.smithi183.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 620 kB/s | 192 kB 00:00 2024-04-30T23:00:30.143 INFO:teuthology.orchestra.run.smithi183.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-04-30T23:00:30.157 INFO:teuthology.orchestra.run.smithi100.stdout:(7/152): ceph-mon-19.0.0-3308.g8505bf41.el9.x86 12 MB/s | 4.9 MB 00:00 2024-04-30T23:00:30.343 INFO:teuthology.orchestra.run.smithi183.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.8 MB/s | 1.3 MB 00:00 2024-04-30T23:00:30.374 INFO:teuthology.orchestra.run.smithi100.stdout:(8/152): ceph-common-19.0.0-3308.g8505bf41.el9. 12 MB/s | 20 MB 00:01 2024-04-30T23:00:30.460 INFO:teuthology.orchestra.run.smithi183.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-30T23:00:30.466 INFO:teuthology.orchestra.run.smithi100.stdout:(9/152): ceph-selinux-19.0.0-3308.g8505bf41.el9 275 kB/s | 25 kB 00:00 2024-04-30T23:00:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:(151/152): librbd1-19.0.0-3308.g8505bf41.el9.x8 4.4 MB/s | 3.1 MB 00:00 2024-04-30T23:00:30.952 INFO:teuthology.orchestra.run.smithi183.stdout:(152/152): librados2-19.0.0-3308.g8505bf41.el9. 2.7 MB/s | 3.3 MB 00:01 2024-04-30T23:00:30.957 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-04-30T23:00:30.957 INFO:teuthology.orchestra.run.smithi183.stdout:Total 16 MB/s | 214 MB 00:13 2024-04-30T23:00:30.958 INFO:teuthology.orchestra.run.smithi100.stdout:(10/152): ceph-radosgw-19.0.0-3308.g8505bf41.el 13 MB/s | 10 MB 00:00 2024-04-30T23:00:31.033 INFO:teuthology.orchestra.run.smithi100.stdout:(11/152): cephfs-mirror-19.0.0-3308.g8505bf41.e 2.9 MB/s | 224 kB 00:00 2024-04-30T23:00:31.092 INFO:teuthology.orchestra.run.smithi100.stdout:(12/152): cephfs-shell-19.0.0-3308.g8505bf41.el 465 kB/s | 27 kB 00:00 2024-04-30T23:00:31.200 INFO:teuthology.orchestra.run.smithi100.stdout:(13/152): libcephfs-devel-19.0.0-3308.g8505bf41 292 kB/s | 32 kB 00:00 2024-04-30T23:00:31.284 INFO:teuthology.orchestra.run.smithi100.stdout:(14/152): libcephfs2-19.0.0-3308.g8505bf41.el9. 8.9 MB/s | 756 kB 00:00 2024-04-30T23:00:31.351 INFO:teuthology.orchestra.run.smithi100.stdout:(15/152): libcephsqlite-19.0.0-3308.g8505bf41.e 2.3 MB/s | 157 kB 00:00 2024-04-30T23:00:31.419 INFO:teuthology.orchestra.run.smithi100.stdout:(16/152): librados-devel-19.0.0-3308.g8505bf41. 1.8 MB/s | 127 kB 00:00 2024-04-30T23:00:31.502 INFO:teuthology.orchestra.run.smithi100.stdout:(17/152): libradosstriper1-19.0.0-3308.g8505bf4 5.8 MB/s | 497 kB 00:00 2024-04-30T23:00:31.936 INFO:teuthology.orchestra.run.smithi100.stdout:(18/152): librgw2-19.0.0-3308.g8505bf41.el9.x86 12 MB/s | 5.2 MB 00:00 2024-04-30T23:00:32.003 INFO:teuthology.orchestra.run.smithi100.stdout:(19/152): python3-ceph-argparse-19.0.0-3308.g85 677 kB/s | 45 kB 00:00 2024-04-30T23:00:32.066 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-04-30T23:00:32.070 INFO:teuthology.orchestra.run.smithi100.stdout:(20/152): python3-ceph-common-19.0.0-3308.g8505 2.0 MB/s | 135 kB 00:00 2024-04-30T23:00:32.137 INFO:teuthology.orchestra.run.smithi100.stdout:(21/152): python3-cephfs-19.0.0-3308.g8505bf41. 2.4 MB/s | 161 kB 00:00 2024-04-30T23:00:32.208 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-04-30T23:00:32.208 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-04-30T23:00:32.220 INFO:teuthology.orchestra.run.smithi100.stdout:(22/152): python3-rados-19.0.0-3308.g8505bf41.e 3.8 MB/s | 321 kB 00:00 2024-04-30T23:00:32.296 INFO:teuthology.orchestra.run.smithi100.stdout:(23/152): python3-rbd-19.0.0-3308.g8505bf41.el9 3.9 MB/s | 299 kB 00:00 2024-04-30T23:00:32.363 INFO:teuthology.orchestra.run.smithi100.stdout:(24/152): python3-rgw-19.0.0-3308.g8505bf41.el9 1.5 MB/s | 99 kB 00:00 2024-04-30T23:00:32.421 INFO:teuthology.orchestra.run.smithi100.stdout:(25/152): rbd-fuse-19.0.0-3308.g8505bf41.el9.x8 1.4 MB/s | 86 kB 00:00 2024-04-30T23:00:32.678 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 21 MB 00:03 2024-04-30T23:00:32.688 INFO:teuthology.orchestra.run.smithi100.stdout:(26/152): rbd-mirror-19.0.0-3308.g8505bf41.el9. 11 MB/s | 3.0 MB 00:00 2024-04-30T23:00:32.755 INFO:teuthology.orchestra.run.smithi100.stdout:(27/152): rbd-nbd-19.0.0-3308.g8505bf41.el9.x86 2.5 MB/s | 170 kB 00:00 2024-04-30T23:00:32.822 INFO:teuthology.orchestra.run.smithi100.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3308.g 513 kB/s | 34 kB 00:00 2024-04-30T23:00:32.898 INFO:teuthology.orchestra.run.smithi100.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3308.g8505bf4 1.9 MB/s | 142 kB 00:00 2024-04-30T23:00:33.231 INFO:teuthology.orchestra.run.smithi100.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3308.g8505b 11 MB/s | 3.5 MB 00:00 2024-04-30T23:00:33.715 INFO:teuthology.orchestra.run.smithi100.stdout:(31/152): ceph-test-19.0.0-3308.g8505bf41.el9.x 13 MB/s | 43 MB 00:03 2024-04-30T23:00:33.774 INFO:teuthology.orchestra.run.smithi100.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3308.g85 4.2 MB/s | 249 kB 00:00 2024-04-30T23:00:33.841 INFO:teuthology.orchestra.run.smithi100.stdout:(33/152): ceph-mgr-rook-19.0.0-3308.g8505bf41.e 741 kB/s | 49 kB 00:00 2024-04-30T23:00:33.933 INFO:teuthology.orchestra.run.smithi100.stdout:(34/152): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-30T23:00:33.958 INFO:teuthology.orchestra.run.smithi100.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3308.g8 141 kB/s | 16 kB 00:00 2024-04-30T23:00:33.983 INFO:teuthology.orchestra.run.smithi100.stdout:(36/152): ceph-volume-19.0.0-3308.g8505bf41.el9 5.3 MB/s | 273 kB 00:00 2024-04-30T23:00:34.032 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-04-30T23:00:34.032 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-04-30T23:00:34.033 INFO:teuthology.orchestra.run.smithi100.stdout:(37/152): cephfs-top-19.0.0-3308.g8505bf41.el9. 365 kB/s | 18 kB 00:00 2024-04-30T23:00:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:(38/152): cephadm-19.0.0-3308.g8505bf41.el9.noa 6.8 MB/s | 762 kB 00:00 2024-04-30T23:00:34.501 INFO:teuthology.orchestra.run.smithi100.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 172 kB/s | 80 kB 00:00 2024-04-30T23:00:35.202 INFO:teuthology.orchestra.run.smithi100.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 708 kB/s | 803 kB 00:01 2024-04-30T23:00:35.227 INFO:teuthology.orchestra.run.smithi100.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 269 kB/s | 195 kB 00:00 2024-04-30T23:00:36.585 INFO:teuthology.orchestra.run.smithi100.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 183 kB/s | 253 kB 00:01 2024-04-30T23:00:36.686 INFO:teuthology.orchestra.run.smithi100.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 861 kB/s | 1.2 MB 00:01 2024-04-30T23:00:37.128 INFO:teuthology.orchestra.run.smithi100.stdout:(44/152): ceph-osd-19.0.0-3308.g8505bf41.el9.x8 2.4 MB/s | 18 MB 00:07 2024-04-30T23:00:37.153 INFO:teuthology.orchestra.run.smithi100.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 188 kB/s | 106 kB 00:00 2024-04-30T23:00:37.278 INFO:teuthology.orchestra.run.smithi100.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 228 kB/s | 135 kB 00:00 2024-04-30T23:00:37.453 INFO:teuthology.orchestra.run.smithi100.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-04-30T23:00:37.554 INFO:teuthology.orchestra.run.smithi100.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 9.2 MB/s | 943 kB 00:00 2024-04-30T23:00:37.579 INFO:teuthology.orchestra.run.smithi100.stdout:(49/152): python3-requests-2.25.1-8.el9.noarch. 277 kB/s | 125 kB 00:00 2024-04-30T23:00:37.604 INFO:teuthology.orchestra.run.smithi100.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-30T23:00:37.663 INFO:teuthology.orchestra.run.smithi100.stdout:(51/152): python3-urllib3-1.26.5-5.el9.noarch.r 421 kB/s | 215 kB 00:00 2024-04-30T23:00:37.688 INFO:teuthology.orchestra.run.smithi100.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-30T23:00:37.722 INFO:teuthology.orchestra.run.smithi100.stdout:(53/152): elfutils-libelf-devel-0.190-2.el9.x86 151 kB/s | 21 kB 00:00 2024-04-30T23:00:37.764 INFO:teuthology.orchestra.run.smithi100.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-04-30T23:00:37.789 INFO:teuthology.orchestra.run.smithi100.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-04-30T23:00:37.827 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-30T23:00:37.848 INFO:teuthology.orchestra.run.smithi100.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-30T23:00:37.873 INFO:teuthology.orchestra.run.smithi100.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-04-30T23:00:37.899 INFO:teuthology.orchestra.run.smithi100.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-04-30T23:00:37.987 INFO:teuthology.orchestra.run.smithi100.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 6.5 MB/s | 582 kB 00:00 2024-04-30T23:00:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:(60/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 708 kB/s | 160 kB 00:00 2024-04-30T23:00:38.041 INFO:teuthology.orchestra.run.smithi100.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 475 kB/s | 25 kB 00:00 2024-04-30T23:00:38.066 INFO:teuthology.orchestra.run.smithi100.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-30T23:00:38.092 INFO:teuthology.orchestra.run.smithi100.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-30T23:00:38.117 INFO:teuthology.orchestra.run.smithi100.stdout:(64/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-04-30T23:00:38.142 INFO:teuthology.orchestra.run.smithi100.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-30T23:00:38.168 INFO:teuthology.orchestra.run.smithi100.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 464 kB/s | 35 kB 00:00 2024-04-30T23:00:38.285 INFO:teuthology.orchestra.run.smithi100.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-04-30T23:00:38.360 INFO:teuthology.orchestra.run.smithi100.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-30T23:00:38.402 INFO:teuthology.orchestra.run.smithi100.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-04-30T23:00:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-04-30T23:00:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-30T23:00:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-30T23:00:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-30T23:00:38.654 INFO:teuthology.orchestra.run.smithi100.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-30T23:00:38.737 INFO:teuthology.orchestra.run.smithi100.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-04-30T23:00:38.763 INFO:teuthology.orchestra.run.smithi100.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-30T23:00:38.788 INFO:teuthology.orchestra.run.smithi100.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-04-30T23:00:38.813 INFO:teuthology.orchestra.run.smithi100.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-30T23:00:38.839 INFO:teuthology.orchestra.run.smithi100.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-30T23:00:38.864 INFO:teuthology.orchestra.run.smithi100.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-04-30T23:00:38.948 INFO:teuthology.orchestra.run.smithi100.stdout:(81/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-04-30T23:00:38.973 INFO:teuthology.orchestra.run.smithi100.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-30T23:00:39.040 INFO:teuthology.orchestra.run.smithi100.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-30T23:00:39.074 INFO:teuthology.orchestra.run.smithi100.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-04-30T23:00:39.099 INFO:teuthology.orchestra.run.smithi100.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-04-30T23:00:39.124 INFO:teuthology.orchestra.run.smithi100.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-30T23:00:39.149 INFO:teuthology.orchestra.run.smithi100.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-30T23:00:39.218 INFO:teuthology.orchestra.run.smithi100.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-04-30T23:00:39.242 INFO:teuthology.orchestra.run.smithi100.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-04-30T23:00:39.276 INFO:teuthology.orchestra.run.smithi100.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-04-30T23:00:39.384 INFO:teuthology.orchestra.run.smithi100.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-04-30T23:00:39.409 INFO:teuthology.orchestra.run.smithi100.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-04-30T23:00:39.518 INFO:teuthology.orchestra.run.smithi100.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-30T23:00:39.569 INFO:teuthology.orchestra.run.smithi100.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-04-30T23:00:39.594 INFO:teuthology.orchestra.run.smithi100.stdout:(95/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 211 kB/s | 44 kB 00:00 2024-04-30T23:00:39.619 INFO:teuthology.orchestra.run.smithi100.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-30T23:00:39.653 INFO:teuthology.orchestra.run.smithi100.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-30T23:00:39.728 INFO:teuthology.orchestra.run.smithi100.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-04-30T23:00:39.753 INFO:teuthology.orchestra.run.smithi100.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 935 kB/s | 94 kB 00:00 2024-04-30T23:00:39.937 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:39.938 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T23:00:39.949 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-30T23:00:39.949 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-30T23:00:39.950 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-30T23:00:39.951 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-30T23:00:39.953 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-30T23:00:39.955 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-30T23:00:39.956 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-30T23:00:40.016 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 6.6 k 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.4 M 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 863 k 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 147 k 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 1.5 M 2024-04-30T23:00:40.035 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 142 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 3.5 M 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 7.4 M 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 49 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 10 M 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 43 M 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 273 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 762 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 224 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 27 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 18 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-30T23:00:40.036 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 32 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 756 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 127 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 161 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 321 k 2024-04-30T23:00:40.037 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 299 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 99 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 86 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.0 M 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 170 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.3 M 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 3.1 M 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-30T23:00:40.038 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 20 M 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 34 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 2.3 M 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 249 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 4.9 M 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 18 M 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3308.g8505bf41.el9 ceph-noarch 16 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 25 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-30T23:00:40.039 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 157 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 497 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 5.2 M 2024-04-30T23:00:40.040 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-30T23:00:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 45 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.0.0-3308.g8505bf41.el9 ceph 135 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-30T23:00:40.042 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-30T23:00:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-30T23:00:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-30T23:00:40.045 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-30T23:00:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout:Install 148 Packages 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 4 Packages 2024-04-30T23:00:40.047 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:00:40.048 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 214 M 2024-04-30T23:00:40.048 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-30T23:00:40.079 INFO:teuthology.orchestra.run.smithi100.stdout:(100/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-04-30T23:00:40.104 INFO:teuthology.orchestra.run.smithi100.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 128 kB/s | 45 kB 00:00 2024-04-30T23:00:40.130 INFO:teuthology.orchestra.run.smithi100.stdout:(102/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 159 kB/s | 64 kB 00:00 2024-04-30T23:00:40.193 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-04-30T23:00:40.290 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-30T23:00:40.313 INFO:teuthology.orchestra.run.smithi100.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-04-30T23:00:40.386 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-30T23:00:40.422 INFO:teuthology.orchestra.run.smithi100.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-04-30T23:00:40.505 INFO:teuthology.orchestra.run.smithi100.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-30T23:00:40.549 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-30T23:00:40.589 INFO:teuthology.orchestra.run.smithi100.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2024-04-30T23:00:40.599 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-30T23:00:40.623 INFO:teuthology.orchestra.run.smithi100.stdout:(107/152): gperftools-libs-2.9.1-2.el9.x86_64.r 998 kB/s | 309 kB 00:00 2024-04-30T23:00:40.625 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-30T23:00:40.656 INFO:teuthology.orchestra.run.smithi100.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-04-30T23:00:40.668 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-30T23:00:40.681 INFO:teuthology.orchestra.run.smithi100.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-04-30T23:00:40.740 INFO:teuthology.orchestra.run.smithi100.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 807 kB/s | 67 kB 00:00 2024-04-30T23:00:40.765 INFO:teuthology.orchestra.run.smithi100.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-30T23:00:40.833 INFO:teuthology.orchestra.run.smithi100.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-30T23:00:40.883 INFO:teuthology.orchestra.run.smithi100.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 870 kB/s | 43 kB 00:00 2024-04-30T23:00:40.908 INFO:teuthology.orchestra.run.smithi100.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-04-30T23:00:40.942 INFO:teuthology.orchestra.run.smithi100.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-04-30T23:00:40.967 INFO:teuthology.orchestra.run.smithi100.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-04-30T23:00:41.003 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-30T23:00:41.009 INFO:teuthology.orchestra.run.smithi100.stdout:(117/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-04-30T23:00:41.037 INFO:teuthology.orchestra.run.smithi104.stdout:(1/152): ceph-19.0.0-3308.g8505bf41.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-04-30T23:00:41.072 INFO:teuthology.orchestra.run.smithi100.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-04-30T23:00:41.102 INFO:teuthology.orchestra.run.smithi100.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-30T23:00:41.109 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:00:41.127 INFO:teuthology.orchestra.run.smithi100.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 650 kB/s | 35 kB 00:00 2024-04-30T23:00:41.161 INFO:teuthology.orchestra.run.smithi100.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-30T23:00:41.219 INFO:teuthology.orchestra.run.smithi100.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-30T23:00:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:00:41.260 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:00:41.270 INFO:teuthology.orchestra.run.smithi100.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-04-30T23:00:41.295 INFO:teuthology.orchestra.run.smithi100.stdout:(124/152): python3-cheroot-8.6.0-4.el9.noarch.r 487 kB/s | 172 kB 00:00 2024-04-30T23:00:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-04-30T23:00:41.329 INFO:teuthology.orchestra.run.smithi104.stdout:(2/152): ceph-fuse-19.0.0-3308.g8505bf41.el9.x8 2.9 MB/s | 863 kB 00:00 2024-04-30T23:00:41.345 INFO:teuthology.orchestra.run.smithi100.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-30T23:00:41.350 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:00:41.387 INFO:teuthology.orchestra.run.smithi100.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-04-30T23:00:41.389 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:00:41.413 INFO:teuthology.orchestra.run.smithi100.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-30T23:00:41.421 INFO:teuthology.orchestra.run.smithi104.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.6 MB/s | 147 kB 00:00 2024-04-30T23:00:41.438 INFO:teuthology.orchestra.run.smithi100.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-04-30T23:00:41.488 INFO:teuthology.orchestra.run.smithi100.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 927 kB/s | 46 kB 00:00 2024-04-30T23:00:41.513 INFO:teuthology.orchestra.run.smithi100.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-30T23:00:41.547 INFO:teuthology.orchestra.run.smithi100.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-04-30T23:00:41.565 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-30T23:00:41.572 INFO:teuthology.orchestra.run.smithi100.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-04-30T23:00:41.596 INFO:teuthology.orchestra.run.smithi104.stdout:(4/152): ceph-base-19.0.0-3308.g8505bf41.el9.x8 7.4 MB/s | 5.4 MB 00:00 2024-04-30T23:00:41.598 INFO:teuthology.orchestra.run.smithi100.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-30T23:00:41.611 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-30T23:00:41.623 INFO:teuthology.orchestra.run.smithi100.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-30T23:00:41.639 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:00:41.648 INFO:teuthology.orchestra.run.smithi100.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-30T23:00:41.674 INFO:teuthology.orchestra.run.smithi100.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-04-30T23:00:41.699 INFO:teuthology.orchestra.run.smithi100.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-04-30T23:00:41.724 INFO:teuthology.orchestra.run.smithi100.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-30T23:00:41.727 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:00:41.757 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:00:41.766 INFO:teuthology.orchestra.run.smithi100.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-04-30T23:00:41.791 INFO:teuthology.orchestra.run.smithi100.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 503 kB/s | 59 kB 00:00 2024-04-30T23:00:41.817 INFO:teuthology.orchestra.run.smithi100.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-04-30T23:00:41.819 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:00:41.841 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:00:41.850 INFO:teuthology.orchestra.run.smithi100.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-30T23:00:41.861 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:00:41.876 INFO:teuthology.orchestra.run.smithi100.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-30T23:00:41.893 INFO:teuthology.orchestra.run.smithi100.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-04-30T23:00:41.896 INFO:teuthology.orchestra.run.smithi104.stdout:(5/152): ceph-mds-19.0.0-3308.g8505bf41.el9.x86 4.8 MB/s | 2.3 MB 00:00 2024-04-30T23:00:41.938 INFO:teuthology.orchestra.run.smithi104.stdout:(6/152): ceph-mgr-19.0.0-3308.g8505bf41.el9.x86 4.4 MB/s | 1.5 MB 00:00 2024-04-30T23:00:41.960 INFO:teuthology.orchestra.run.smithi100.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-04-30T23:00:41.985 INFO:teuthology.orchestra.run.smithi100.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-30T23:00:42.052 INFO:teuthology.orchestra.run.smithi100.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.9 MB/s | 1.6 MB 00:00 2024-04-30T23:00:42.091 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:00:42.124 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:00:42.236 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-30T23:00:42.346 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-30T23:00:42.382 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-30T23:00:42.417 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-30T23:00:42.492 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-30T23:00:42.533 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-30T23:00:42.577 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-30T23:00:42.609 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-30T23:00:42.637 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-30T23:00:42.705 INFO:teuthology.orchestra.run.smithi104.stdout:(7/152): ceph-common-19.0.0-3308.g8505bf41.el9. 11 MB/s | 20 MB 00:01 2024-04-30T23:00:42.707 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-30T23:00:42.736 INFO:teuthology.orchestra.run.smithi100.stdout:(149/152): librbd1-19.0.0-3308.g8505bf41.el9.x8 4.1 MB/s | 3.1 MB 00:00 2024-04-30T23:00:42.767 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-30T23:00:42.798 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-30T23:00:42.842 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-30T23:00:42.918 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-30T23:00:42.952 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 31/156 2024-04-30T23:00:42.996 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 32/156 2024-04-30T23:00:43.005 INFO:teuthology.orchestra.run.smithi104.stdout:(8/152): ceph-mon-19.0.0-3308.g8505bf41.el9.x86 4.4 MB/s | 4.9 MB 00:01 2024-04-30T23:00:43.024 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 33/156 2024-04-30T23:00:43.072 INFO:teuthology.orchestra.run.smithi104.stdout:(9/152): ceph-selinux-19.0.0-3308.g8505bf41.el9 379 kB/s | 25 kB 00:00 2024-04-30T23:00:43.094 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-30T23:00:43.139 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-30T23:00:43.214 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-30T23:00:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-30T23:00:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-30T23:00:43.431 INFO:teuthology.orchestra.run.smithi104.stdout:(10/152): ceph-osd-19.0.0-3308.g8505bf41.el9.x8 12 MB/s | 18 MB 00:01 2024-04-30T23:00:43.498 INFO:teuthology.orchestra.run.smithi104.stdout:(11/152): cephfs-mirror-19.0.0-3308.g8505bf41.e 3.3 MB/s | 224 kB 00:00 2024-04-30T23:00:43.553 INFO:teuthology.orchestra.run.smithi100.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 921 kB/s | 1.3 MB 00:01 2024-04-30T23:00:43.556 INFO:teuthology.orchestra.run.smithi104.stdout:(12/152): cephfs-shell-19.0.0-3308.g8505bf41.el 463 kB/s | 27 kB 00:00 2024-04-30T23:00:43.615 INFO:teuthology.orchestra.run.smithi104.stdout:(13/152): libcephfs-devel-19.0.0-3308.g8505bf41 544 kB/s | 32 kB 00:00 2024-04-30T23:00:43.670 INFO:teuthology.orchestra.run.smithi100.stdout:(151/152): librados2-19.0.0-3308.g8505bf41.el9. 1.9 MB/s | 3.3 MB 00:01 2024-04-30T23:00:43.699 INFO:teuthology.orchestra.run.smithi104.stdout:(14/152): libcephfs2-19.0.0-3308.g8505bf41.el9. 8.9 MB/s | 756 kB 00:00 2024-04-30T23:00:43.765 INFO:teuthology.orchestra.run.smithi104.stdout:(15/152): libcephsqlite-19.0.0-3308.g8505bf41.e 2.3 MB/s | 157 kB 00:00 2024-04-30T23:00:43.833 INFO:teuthology.orchestra.run.smithi104.stdout:(16/152): librados-devel-19.0.0-3308.g8505bf41. 1.9 MB/s | 127 kB 00:00 2024-04-30T23:00:43.908 INFO:teuthology.orchestra.run.smithi104.stdout:(17/152): libradosstriper1-19.0.0-3308.g8505bf4 6.5 MB/s | 497 kB 00:00 2024-04-30T23:00:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-30T23:00:44.021 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-30T23:00:44.049 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-30T23:00:44.075 INFO:teuthology.orchestra.run.smithi104.stdout:(18/152): ceph-radosgw-19.0.0-3308.g8505bf41.el 7.4 MB/s | 10 MB 00:01 2024-04-30T23:00:44.092 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-30T23:00:44.130 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 43/156 2024-04-30T23:00:44.150 INFO:teuthology.orchestra.run.smithi104.stdout:(19/152): python3-ceph-argparse-19.0.0-3308.g85 605 kB/s | 45 kB 00:00 2024-04-30T23:00:44.172 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-30T23:00:44.217 INFO:teuthology.orchestra.run.smithi104.stdout:(20/152): python3-ceph-common-19.0.0-3308.g8505 2.0 MB/s | 135 kB 00:00 2024-04-30T23:00:44.300 INFO:teuthology.orchestra.run.smithi104.stdout:(21/152): librgw2-19.0.0-3308.g8505bf41.el9.x86 13 MB/s | 5.2 MB 00:00 2024-04-30T23:00:44.326 INFO:teuthology.orchestra.run.smithi104.stdout:(22/152): python3-cephfs-19.0.0-3308.g8505bf41. 1.5 MB/s | 161 kB 00:00 2024-04-30T23:00:44.326 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-30T23:00:44.359 INFO:teuthology.orchestra.run.smithi104.stdout:(23/152): python3-rados-19.0.0-3308.g8505bf41.e 5.4 MB/s | 321 kB 00:00 2024-04-30T23:00:44.384 INFO:teuthology.orchestra.run.smithi104.stdout:(24/152): python3-rbd-19.0.0-3308.g8505bf41.el9 5.0 MB/s | 299 kB 00:00 2024-04-30T23:00:44.391 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-30T23:00:44.410 INFO:teuthology.orchestra.run.smithi104.stdout:(25/152): python3-rgw-19.0.0-3308.g8505bf41.el9 1.9 MB/s | 99 kB 00:00 2024-04-30T23:00:44.435 INFO:teuthology.orchestra.run.smithi104.stdout:(26/152): rbd-fuse-19.0.0-3308.g8505bf41.el9.x8 1.7 MB/s | 86 kB 00:00 2024-04-30T23:00:44.446 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-30T23:00:44.503 INFO:teuthology.orchestra.run.smithi104.stdout:(27/152): rbd-nbd-19.0.0-3308.g8505bf41.el9.x86 2.5 MB/s | 170 kB 00:00 2024-04-30T23:00:44.519 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-30T23:00:44.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-30T23:00:44.561 INFO:teuthology.orchestra.run.smithi104.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3308.g 587 kB/s | 34 kB 00:00 2024-04-30T23:00:44.586 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-30T23:00:44.628 INFO:teuthology.orchestra.run.smithi104.stdout:(29/152): rbd-mirror-19.0.0-3308.g8505bf41.el9. 14 MB/s | 3.0 MB 00:00 2024-04-30T23:00:44.633 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-30T23:00:44.653 INFO:teuthology.orchestra.run.smithi104.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3308.g8505bf4 1.5 MB/s | 142 kB 00:00 2024-04-30T23:00:44.669 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-30T23:00:44.712 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-30T23:00:44.744 INFO:teuthology.orchestra.run.smithi100.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.2 MB/s | 2.4 MB 00:02 2024-04-30T23:00:44.752 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-30T23:00:44.753 INFO:teuthology.orchestra.run.smithi100.stdout:Total 13 MB/s | 214 MB 00:16 2024-04-30T23:00:44.754 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-30T23:00:44.891 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-30T23:00:44.912 INFO:teuthology.orchestra.run.smithi104.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3308.g8505b 12 MB/s | 3.5 MB 00:00 2024-04-30T23:00:44.935 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-30T23:00:44.962 INFO:teuthology.orchestra.run.smithi104.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3308.g85 4.9 MB/s | 249 kB 00:00 2024-04-30T23:00:44.964 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-30T23:00:45.006 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-30T23:00:45.012 INFO:teuthology.orchestra.run.smithi104.stdout:(33/152): ceph-mgr-rook-19.0.0-3308.g8505bf41.e 986 kB/s | 49 kB 00:00 2024-04-30T23:00:45.054 INFO:teuthology.orchestra.run.smithi104.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3308.g8 394 kB/s | 16 kB 00:00 2024-04-30T23:00:45.101 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-30T23:00:45.112 INFO:teuthology.orchestra.run.smithi104.stdout:(35/152): ceph-volume-19.0.0-3308.g8505bf41.el9 4.6 MB/s | 273 kB 00:00 2024-04-30T23:00:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-30T23:00:45.171 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-30T23:00:45.197 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-30T23:00:45.204 INFO:teuthology.orchestra.run.smithi104.stdout:(36/152): cephadm-19.0.0-3308.g8505bf41.el9.noa 8.1 MB/s | 762 kB 00:00 2024-04-30T23:00:45.221 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-30T23:00:45.272 INFO:teuthology.orchestra.run.smithi104.stdout:(37/152): cephfs-top-19.0.0-3308.g8505bf41.el9. 273 kB/s | 18 kB 00:00 2024-04-30T23:00:45.288 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-30T23:00:45.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-30T23:00:45.447 INFO:teuthology.orchestra.run.smithi104.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 9.3 MB/s | 7.4 MB 00:00 2024-04-30T23:00:45.454 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-30T23:00:45.472 INFO:teuthology.orchestra.run.smithi104.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-04-30T23:00:45.481 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-30T23:00:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-30T23:00:45.556 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-30T23:00:45.556 INFO:teuthology.orchestra.run.smithi104.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-04-30T23:00:45.588 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-30T23:00:45.599 INFO:teuthology.orchestra.run.smithi104.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-04-30T23:00:45.618 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-30T23:00:45.623 INFO:teuthology.orchestra.run.smithi104.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-30T23:00:45.651 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-30T23:00:45.665 INFO:teuthology.orchestra.run.smithi104.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-30T23:00:45.685 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-30T23:00:45.691 INFO:teuthology.orchestra.run.smithi104.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-30T23:00:45.716 INFO:teuthology.orchestra.run.smithi104.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-30T23:00:45.726 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-30T23:00:45.741 INFO:teuthology.orchestra.run.smithi104.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-30T23:00:45.766 INFO:teuthology.orchestra.run.smithi104.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-30T23:00:45.769 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-30T23:00:45.841 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-30T23:00:45.856 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-30T23:00:45.983 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-30T23:00:45.983 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-30T23:00:46.075 INFO:teuthology.orchestra.run.smithi104.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-04-30T23:00:46.142 INFO:teuthology.orchestra.run.smithi104.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-30T23:00:46.144 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-30T23:00:46.190 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-30T23:00:46.200 INFO:teuthology.orchestra.run.smithi104.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-30T23:00:46.239 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-30T23:00:46.275 INFO:teuthology.orchestra.run.smithi104.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-04-30T23:00:46.310 INFO:teuthology.orchestra.run.smithi104.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-30T23:00:46.343 INFO:teuthology.orchestra.run.smithi104.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-04-30T23:00:46.349 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-30T23:00:46.399 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-30T23:00:46.401 INFO:teuthology.orchestra.run.smithi104.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-04-30T23:00:46.469 INFO:teuthology.orchestra.run.smithi104.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-04-30T23:00:46.577 INFO:teuthology.orchestra.run.smithi104.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-30T23:00:46.628 INFO:teuthology.orchestra.run.smithi104.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-04-30T23:00:46.853 INFO:teuthology.orchestra.run.smithi104.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.5 MB/s | 3.0 MB 00:00 2024-04-30T23:00:46.886 INFO:teuthology.orchestra.run.smithi104.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-04-30T23:00:46.937 INFO:teuthology.orchestra.run.smithi104.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-30T23:00:46.962 INFO:teuthology.orchestra.run.smithi104.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-30T23:00:46.987 INFO:teuthology.orchestra.run.smithi104.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-30T23:00:47.029 INFO:teuthology.orchestra.run.smithi104.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-30T23:00:47.088 INFO:teuthology.orchestra.run.smithi104.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-30T23:00:47.113 INFO:teuthology.orchestra.run.smithi104.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 421 kB/s | 35 kB 00:00 2024-04-30T23:00:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-30T23:00:47.170 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-30T23:00:47.204 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-30T23:00:47.306 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-30T23:00:47.354 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-30T23:00:47.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-30T23:00:47.482 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-30T23:00:47.659 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-30T23:00:47.688 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-30T23:00:47.708 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-30T23:00:47.709 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-30T23:00:47.755 INFO:teuthology.orchestra.run.smithi104.stdout:(66/152): ceph-test-19.0.0-3308.g8505bf41.el9.x 9.2 MB/s | 43 MB 00:04 2024-04-30T23:00:47.765 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-30T23:00:47.889 INFO:teuthology.orchestra.run.smithi104.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-04-30T23:00:47.989 INFO:teuthology.orchestra.run.smithi104.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-30T23:00:48.048 INFO:teuthology.orchestra.run.smithi104.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.9 MB/s | 4.7 MB 00:00 2024-04-30T23:00:48.073 INFO:teuthology.orchestra.run.smithi104.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-30T23:00:48.173 INFO:teuthology.orchestra.run.smithi104.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-30T23:00:48.232 INFO:teuthology.orchestra.run.smithi104.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-30T23:00:48.265 INFO:teuthology.orchestra.run.smithi104.stdout:(73/152): postgresql-13.14-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-04-30T23:00:48.357 INFO:teuthology.orchestra.run.smithi104.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-30T23:00:48.412 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-30T23:00:48.458 INFO:teuthology.orchestra.run.smithi104.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-30T23:00:48.516 INFO:teuthology.orchestra.run.smithi104.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-04-30T23:00:48.536 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-30T23:00:48.600 INFO:teuthology.orchestra.run.smithi104.stdout:(77/152): postgresql-server-13.14-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-04-30T23:00:48.625 INFO:teuthology.orchestra.run.smithi104.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-04-30T23:00:48.701 INFO:teuthology.orchestra.run.smithi104.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-30T23:00:48.725 INFO:teuthology.orchestra.run.smithi104.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-04-30T23:00:48.751 INFO:teuthology.orchestra.run.smithi104.stdout:(81/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-30T23:00:48.784 INFO:teuthology.orchestra.run.smithi104.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-30T23:00:48.893 INFO:teuthology.orchestra.run.smithi104.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-30T23:00:48.918 INFO:teuthology.orchestra.run.smithi104.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 576 kB/s | 77 kB 00:00 2024-04-30T23:00:48.960 INFO:teuthology.orchestra.run.smithi104.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-04-30T23:00:49.027 INFO:teuthology.orchestra.run.smithi104.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-30T23:00:49.053 INFO:teuthology.orchestra.run.smithi104.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-30T23:00:49.128 INFO:teuthology.orchestra.run.smithi104.stdout:(88/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-30T23:00:49.153 INFO:teuthology.orchestra.run.smithi104.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-04-30T23:00:49.178 INFO:teuthology.orchestra.run.smithi104.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-04-30T23:00:49.203 INFO:teuthology.orchestra.run.smithi104.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-04-30T23:00:49.246 INFO:teuthology.orchestra.run.smithi104.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-04-30T23:00:49.271 INFO:teuthology.orchestra.run.smithi104.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 659 kB/s | 44 kB 00:00 2024-04-30T23:00:49.321 INFO:teuthology.orchestra.run.smithi104.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-30T23:00:49.346 INFO:teuthology.orchestra.run.smithi104.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-04-30T23:00:49.380 INFO:teuthology.orchestra.run.smithi104.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-30T23:00:49.414 INFO:teuthology.orchestra.run.smithi104.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-30T23:00:49.439 INFO:teuthology.orchestra.run.smithi104.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-04-30T23:00:49.481 INFO:teuthology.orchestra.run.smithi104.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-30T23:00:49.498 INFO:teuthology.orchestra.run.smithi104.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-30T23:00:49.540 INFO:teuthology.orchestra.run.smithi104.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-04-30T23:00:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-04-30T23:00:49.769 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-30T23:00:49.799 INFO:teuthology.orchestra.run.smithi104.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-04-30T23:00:49.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-30T23:00:49.877 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-30T23:00:49.910 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-30T23:00:50.082 INFO:teuthology.orchestra.run.smithi104.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-04-30T23:00:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-30T23:00:50.273 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:00:50.349 INFO:teuthology.orchestra.run.smithi104.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-30T23:00:50.363 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:00:50.403 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 100/156 2024-04-30T23:00:50.432 INFO:teuthology.orchestra.run.smithi104.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 487 kB/s | 309 kB 00:00 2024-04-30T23:00:50.438 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-30T23:00:50.541 INFO:teuthology.orchestra.run.smithi104.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-04-30T23:00:50.609 INFO:teuthology.orchestra.run.smithi104.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 552 kB/s | 548 kB 00:00 2024-04-30T23:00:50.658 INFO:teuthology.orchestra.run.smithi104.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-04-30T23:00:50.767 INFO:teuthology.orchestra.run.smithi104.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-04-30T23:00:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-30T23:00:50.927 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-30T23:00:50.951 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:00:51.022 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:00:51.034 INFO:teuthology.orchestra.run.smithi104.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-04-30T23:00:51.044 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 104/156 2024-04-30T23:00:51.143 INFO:teuthology.orchestra.run.smithi104.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 402 kB/s | 43 kB 00:00 2024-04-30T23:00:51.243 INFO:teuthology.orchestra.run.smithi104.stdout:(114/152): libarrow-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-04-30T23:00:51.260 INFO:teuthology.orchestra.run.smithi104.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 274 kB/s | 32 kB 00:00 2024-04-30T23:00:51.352 INFO:teuthology.orchestra.run.smithi104.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-30T23:00:51.386 INFO:teuthology.orchestra.run.smithi104.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-04-30T23:00:51.470 INFO:teuthology.orchestra.run.smithi104.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-30T23:00:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:(119/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.1 MB/s | 839 kB 00:00 2024-04-30T23:00:51.545 INFO:teuthology.orchestra.run.smithi104.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-04-30T23:00:51.578 INFO:teuthology.orchestra.run.smithi104.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-04-30T23:00:51.687 INFO:teuthology.orchestra.run.smithi104.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-30T23:00:51.762 INFO:teuthology.orchestra.run.smithi104.stdout:(123/152): python3-google-auth-2.29.0-1.el9.noa 849 kB/s | 206 kB 00:00 2024-04-30T23:00:51.796 INFO:teuthology.orchestra.run.smithi104.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-30T23:00:51.846 INFO:teuthology.orchestra.run.smithi104.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-04-30T23:00:51.871 INFO:teuthology.orchestra.run.smithi104.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-30T23:00:51.905 INFO:teuthology.orchestra.run.smithi104.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-04-30T23:00:51.955 INFO:teuthology.orchestra.run.smithi104.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-30T23:00:51.989 INFO:teuthology.orchestra.run.smithi104.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-04-30T23:00:52.039 INFO:teuthology.orchestra.run.smithi104.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-30T23:00:52.064 INFO:teuthology.orchestra.run.smithi104.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 425 kB/s | 46 kB 00:00 2024-04-30T23:00:52.140 INFO:teuthology.orchestra.run.smithi104.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 523 kB/s | 79 kB 00:00 2024-04-30T23:00:52.165 INFO:teuthology.orchestra.run.smithi104.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 459 kB/s | 58 kB 00:00 2024-04-30T23:00:52.190 INFO:teuthology.orchestra.run.smithi104.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-30T23:00:52.249 INFO:teuthology.orchestra.run.smithi104.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-04-30T23:00:52.274 INFO:teuthology.orchestra.run.smithi104.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 827 kB/s | 90 kB 00:00 2024-04-30T23:00:52.299 INFO:teuthology.orchestra.run.smithi104.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 259 kB/s | 28 kB 00:00 2024-04-30T23:00:52.366 INFO:teuthology.orchestra.run.smithi104.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-04-30T23:00:52.391 INFO:teuthology.orchestra.run.smithi104.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-30T23:00:52.417 INFO:teuthology.orchestra.run.smithi104.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-04-30T23:00:52.492 INFO:teuthology.orchestra.run.smithi104.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 285 kB/s | 36 kB 00:00 2024-04-30T23:00:52.517 INFO:teuthology.orchestra.run.smithi104.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2024-04-30T23:00:52.542 INFO:teuthology.orchestra.run.smithi104.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-30T23:00:52.626 INFO:teuthology.orchestra.run.smithi104.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-30T23:00:52.651 INFO:teuthology.orchestra.run.smithi104.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-04-30T23:00:52.677 INFO:teuthology.orchestra.run.smithi104.stdout:(146/152): python3-websocket-client-1.2.3-2.el9 485 kB/s | 90 kB 00:00 2024-04-30T23:00:52.727 INFO:teuthology.orchestra.run.smithi104.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-30T23:00:53.242 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:00:53.282 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:00:53.411 INFO:teuthology.orchestra.run.smithi104.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-30T23:00:53.569 INFO:teuthology.orchestra.run.smithi104.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 8.5 MB/s | 1.3 MB 00:00 2024-04-30T23:00:53.589 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-30T23:00:53.653 INFO:teuthology.orchestra.run.smithi104.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-30T23:00:53.732 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-30T23:00:53.841 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:00:53.902 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:00:53.990 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-30T23:00:53.993 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:00:53.993 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-30T23:00:53.993 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-30T23:00:53.993 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:00:54.020 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:00:54.043 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-30T23:00:54.092 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-30T23:00:54.117 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-30T23:00:54.161 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-30T23:00:54.499 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-30T23:00:54.619 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:00:54.743 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:00:54.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:00:54.862 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:00:54.890 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:00:55.043 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-30T23:00:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-30T23:00:55.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:00:55.212 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:00:55.242 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:00:55.304 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:00:55.326 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:00:55.346 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:00:55.535 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:00:55.568 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:00:55.569 INFO:teuthology.orchestra.run.smithi104.stdout:(151/152): librbd1-19.0.0-3308.g8505bf41.el9.x8 1.1 MB/s | 3.1 MB 00:02 2024-04-30T23:00:55.619 INFO:teuthology.orchestra.run.smithi104.stdout:(152/152): librados2-19.0.0-3308.g8505bf41.el9. 1.1 MB/s | 3.3 MB 00:02 2024-04-30T23:00:55.622 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-30T23:00:55.623 INFO:teuthology.orchestra.run.smithi104.stdout:Total 14 MB/s | 214 MB 00:15 2024-04-30T23:00:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-30T23:00:55.782 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-30T23:00:55.826 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-30T23:00:55.870 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-30T23:00:55.952 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-30T23:00:56.003 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-30T23:00:56.046 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-30T23:00:56.079 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-30T23:00:56.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-30T23:00:56.176 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-30T23:00:56.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-30T23:00:56.268 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-30T23:00:56.311 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-30T23:00:56.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-30T23:00:56.439 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 31/156 2024-04-30T23:00:56.482 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 32/156 2024-04-30T23:00:56.511 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 33/156 2024-04-30T23:00:56.581 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-30T23:00:56.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-30T23:00:56.709 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-30T23:00:56.738 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-30T23:00:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-30T23:00:56.881 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-30T23:00:56.882 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-30T23:00:56.912 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-30T23:00:57.442 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-30T23:00:57.533 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-30T23:00:57.562 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-30T23:00:57.604 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-30T23:00:57.642 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 43/156 2024-04-30T23:00:57.684 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-30T23:00:57.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-30T23:00:57.904 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-30T23:00:57.959 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-30T23:00:58.040 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-30T23:00:58.079 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-30T23:00:58.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-30T23:00:58.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-30T23:00:58.208 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-30T23:00:58.251 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-30T23:00:58.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-30T23:00:58.429 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-30T23:00:58.473 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-30T23:00:58.504 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-30T23:00:58.554 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-30T23:00:58.608 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-30T23:00:58.609 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-30T23:00:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-30T23:00:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-30T23:00:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-30T23:00:58.744 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-30T23:00:58.769 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-30T23:00:58.844 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-30T23:00:58.971 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-30T23:00:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-30T23:00:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-30T23:00:59.072 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-30T23:00:59.112 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-30T23:00:59.143 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-30T23:00:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-30T23:00:59.208 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-30T23:00:59.241 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-30T23:00:59.282 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-30T23:00:59.418 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-30T23:00:59.506 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-30T23:00:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-30T23:00:59.596 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-30T23:00:59.643 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-30T23:00:59.741 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-30T23:00:59.806 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-30T23:01:00.534 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-30T23:01:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-30T23:01:00.611 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-30T23:01:00.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-30T23:01:00.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-30T23:01:00.858 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-30T23:01:00.889 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-30T23:01:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-30T23:01:01.095 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-30T23:01:01.181 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-30T23:01:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-30T23:01:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-30T23:01:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-30T23:01:03.500 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-30T23:01:03.528 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-30T23:01:03.561 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-30T23:01:03.881 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-30T23:01:03.932 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:01:04.023 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:01:04.054 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 100/156 2024-04-30T23:01:04.090 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-30T23:01:04.580 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-30T23:01:04.619 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:01:04.690 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:01:04.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 104/156 2024-04-30T23:01:04.790 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-30T23:01:04.873 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-30T23:01:04.912 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-30T23:01:04.965 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-30T23:01:04.999 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-30T23:01:05.025 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-30T23:01:05.067 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-30T23:01:05.394 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-30T23:01:05.501 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-04-30T23:01:05.571 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:01:05.660 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:01:05.743 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:05.752 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:01:05.758 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:05.758 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:05.758 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-30T23:01:05.759 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:05.781 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:01:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-30T23:01:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-30T23:01:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:01:06.127 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:01:06.156 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:01:06.219 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 14/156 2024-04-30T23:01:06.249 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:01:06.275 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T23:01:06.473 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:01:06.507 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T23:01:06.613 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-30T23:01:06.709 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-30T23:01:06.881 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-30T23:01:06.966 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-30T23:01:06.979 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:07.017 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-30T23:01:07.064 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-30T23:01:07.108 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-30T23:01:07.140 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-30T23:01:07.168 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-30T23:01:07.238 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-30T23:01:07.291 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-30T23:01:07.329 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:07.330 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-30T23:01:07.354 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:07.354 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:07.354 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-30T23:01:07.354 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:07.354 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:07.355 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:07.364 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-30T23:01:07.442 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-30T23:01:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 31/156 2024-04-30T23:01:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 32/156 2024-04-30T23:01:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 33/156 2024-04-30T23:01:07.573 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:07.579 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:07.602 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:07.602 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:07.603 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-30T23:01:07.603 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:07.603 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:07.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:07.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:01:07.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-30T23:01:07.662 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-30T23:01:07.704 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:01:07.704 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-30T23:01:07.704 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-30T23:01:07.704 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-30T23:01:07.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:01:07.877 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-30T23:01:07.930 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-30T23:01:08.063 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:08.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:08.193 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-30T23:01:08.250 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-30T23:01:08.305 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-30T23:01:08.451 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-30T23:01:08.490 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-30T23:01:08.534 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-30T23:01:08.538 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-30T23:01:08.564 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-30T23:01:08.606 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-30T23:01:08.617 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-30T23:01:08.644 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 43/156 2024-04-30T23:01:08.686 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-30T23:01:08.705 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-30T23:01:08.844 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:08.880 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-30T23:01:08.881 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-30T23:01:08.912 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-30T23:01:08.935 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-30T23:01:08.939 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-30T23:01:09.007 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-30T23:01:09.047 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-30T23:01:09.084 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-30T23:01:09.130 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-30T23:01:09.167 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-30T23:01:09.210 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-30T23:01:09.251 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-30T23:01:09.325 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:09.355 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:09.387 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 124/156 2024-04-30T23:01:09.388 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-30T23:01:09.440 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-30T23:01:09.457 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 125/156 2024-04-30T23:01:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-30T23:01:09.486 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-30T23:01:09.606 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-30T23:01:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-30T23:01:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-30T23:01:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-30T23:01:09.735 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-30T23:01:09.810 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-30T23:01:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-30T23:01:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-30T23:01:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-30T23:01:10.038 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-30T23:01:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-30T23:01:10.108 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-30T23:01:10.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-30T23:01:10.173 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-30T23:01:10.206 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-30T23:01:10.247 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-30T23:01:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-30T23:01:10.453 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-30T23:01:10.516 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:10.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:10.580 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-30T23:01:10.610 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-30T23:01:10.658 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-30T23:01:10.756 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-30T23:01:10.812 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-30T23:01:11.515 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:11.535 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-30T23:01:11.538 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-30T23:01:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-30T23:01:11.639 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:11.723 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-30T23:01:11.774 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-30T23:01:11.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 129/156 2024-04-30T23:01:11.832 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:11.854 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:11.855 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:11.855 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-30T23:01:11.855 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:11.855 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:11.855 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:11.861 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-30T23:01:11.894 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-30T23:01:11.899 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:11.910 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:12.011 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 132/156 2024-04-30T23:01:12.064 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 133/156 2024-04-30T23:01:12.070 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-30T23:01:12.091 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-30T23:01:12.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-30T23:01:12.815 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-30T23:01:12.939 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-30T23:01:12.999 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-30T23:01:13.027 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:13.050 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:13.050 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:13.050 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-30T23:01:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:13.051 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:13.051 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:13.093 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:13.116 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:13.116 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:13.116 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-30T23:01:13.116 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:13.161 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:13.183 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:13.183 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:13.184 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-30T23:01:13.184 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:13.184 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:13.184 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:13.495 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:13.517 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:13.517 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:13.517 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-30T23:01:13.517 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:13.517 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:13.518 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:14.160 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-30T23:01:14.236 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-30T23:01:14.264 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-30T23:01:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-30T23:01:14.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-30T23:01:14.652 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:01:14.742 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 99/156 2024-04-30T23:01:14.773 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 100/156 2024-04-30T23:01:14.809 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-30T23:01:15.296 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-30T23:01:15.321 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:01:15.378 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 103/156 2024-04-30T23:01:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 104/156 2024-04-30T23:01:17.648 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:17.677 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:17.790 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 139/156 2024-04-30T23:01:17.831 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 140/156 2024-04-30T23:01:17.872 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 141/156 2024-04-30T23:01:17.904 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-30T23:01:17.931 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-30T23:01:18.119 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 144/156 2024-04-30T23:01:18.160 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-30T23:01:18.190 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 146/156 2024-04-30T23:01:18.233 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 105/156 2024-04-30T23:01:18.272 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:01:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 106/156 2024-04-30T23:01:18.360 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-30T23:01:18.360 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-30T23:01:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:18.389 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:01:18.823 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:18.862 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:18.882 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:19.336 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-04-30T23:01:19.337 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:19.506 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:19.522 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:19.522 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-30T23:01:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:19.715 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 148/156 2024-04-30T23:01:19.808 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-30T23:01:19.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-30T23:01:19.932 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-30T23:01:19.962 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-30T23:01:19.962 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:20.045 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:20.079 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:20.079 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:20.167 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:20.235 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:21.109 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:21.135 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:21.368 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:21.390 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:21.390 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:21.391 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-30T23:01:21.391 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:21.391 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:21.391 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:21.852 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:21.874 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:21.875 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:21.875 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-30T23:01:21.875 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:21.875 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:21.875 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:21.983 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-30T23:01:22.039 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-30T23:01:22.094 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-30T23:01:22.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-30T23:01:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-30T23:01:22.406 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-30T23:01:22.495 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:22.634 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:22.679 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-30T23:01:22.711 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-30T23:01:22.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-30T23:01:23.139 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:23.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:23.210 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 124/156 2024-04-30T23:01:23.280 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 125/156 2024-04-30T23:01:23.310 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:24.354 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:24.395 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:25.365 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:25.395 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:25.498 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 129/156 2024-04-30T23:01:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:25.712 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:25.712 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:25.712 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-30T23:01:25.712 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:25.713 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:25.713 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:25.764 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:25.776 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:25.874 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 132/156 2024-04-30T23:01:25.922 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 133/156 2024-04-30T23:01:26.088 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:26.088 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 1/156 2024-04-30T23:01:26.088 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2/156 2024-04-30T23:01:26.088 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 3/156 2024-04-30T23:01:26.088 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 4/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 5/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 6/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 7/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 11/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 12/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 14/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 15/156 2024-04-30T23:01:26.089 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 16/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 17/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 18/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 19/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 20/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 21/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 22/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 23/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 24/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 25/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 26/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 27/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 28/156 2024-04-30T23:01:26.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 29/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 30/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 31/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 32/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 33/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 34/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 35/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 36/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 37/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 38/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 39/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-30T23:01:26.091 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-30T23:01:26.092 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-30T23:01:26.093 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-30T23:01:26.094 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-30T23:01:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-30T23:01:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-30T23:01:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-30T23:01:26.098 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-30T23:01:26.099 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 149/156 2024-04-30T23:01:26.100 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-30T23:01:26.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 151/156 2024-04-30T23:01:26.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-30T23:01:26.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-30T23:01:26.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:26.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-30T23:01:26.860 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-30T23:01:26.892 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:26.915 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:26.915 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:26.915 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-30T23:01:26.915 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:26.916 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:26.916 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:26.959 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:26.981 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:26.982 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:26.982 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-30T23:01:26.982 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:27.027 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:27.049 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:27.049 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:27.049 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-30T23:01:27.049 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:27.049 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:27.050 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:27.360 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:27.383 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:28.182 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:28.182 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:28.182 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.183 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.184 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-30T23:01:28.185 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-30T23:01:28.186 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-30T23:01:28.187 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.14-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-30T23:01:28.188 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-30T23:01:28.189 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-30T23:01:28.190 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-30T23:01:28.191 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-30T23:01:28.191 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-30T23:01:28.192 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.193 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-30T23:01:28.194 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-30T23:01:28.195 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-30T23:01:28.196 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-30T23:01:28.197 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-30T23:01:28.197 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:01:28.197 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-04-30T23:01:28.553 DEBUG:teuthology.parallel:result is None 2024-04-30T23:01:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 107/156 2024-04-30T23:01:30.085 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-04-30T23:01:30.085 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-04-30T23:01:30.085 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-04-30T23:01:30.086 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-04-30T23:01:30.086 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-04-30T23:01:30.086 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-04-30T23:01:30.086 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-04-30T23:01:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:30.259 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:30.275 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 108/156 2024-04-30T23:01:30.275 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:30.275 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-30T23:01:30.275 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:31.648 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 139/156 2024-04-30T23:01:31.689 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 140/156 2024-04-30T23:01:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 141/156 2024-04-30T23:01:31.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-30T23:01:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-30T23:01:31.854 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 109/156 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T23:01:31.880 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:31.976 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 144/156 2024-04-30T23:01:32.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-30T23:01:32.048 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 146/156 2024-04-30T23:01:32.104 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 110/156 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T23:01:32.128 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:32.588 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 111/156 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T23:01:32.611 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:32.672 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:32.704 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:32.721 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-30T23:01:32.724 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:32.777 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-30T23:01:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-30T23:01:33.035 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-30T23:01:33.091 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-30T23:01:33.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-30T23:01:33.259 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-30T23:01:33.473 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-30T23:01:33.501 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-30T23:01:33.548 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 148/156 2024-04-30T23:01:33.634 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-30T23:01:33.675 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-30T23:01:33.758 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-30T23:01:33.788 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-30T23:01:33.788 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:33.872 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:33.878 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:33.897 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:33.897 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:33.908 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 123/156 2024-04-30T23:01:33.940 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 124/156 2024-04-30T23:01:34.010 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 125/156 2024-04-30T23:01:34.013 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:34.039 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:34.078 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:35.073 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 126/156 2024-04-30T23:01:35.107 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:36.072 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 127/156 2024-04-30T23:01:36.108 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:36.209 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 128/156 2024-04-30T23:01:36.375 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 129/156 2024-04-30T23:01:36.410 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:36.433 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 130/156 2024-04-30T23:01:36.433 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:36.434 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-30T23:01:36.434 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:36.434 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T23:01:36.434 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:36.477 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:36.489 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 131/156 2024-04-30T23:01:36.588 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 132/156 2024-04-30T23:01:36.642 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 133/156 2024-04-30T23:01:37.576 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-30T23:01:37.604 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:37.627 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 135/156 2024-04-30T23:01:37.627 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:37.627 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-30T23:01:37.628 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:37.628 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T23:01:37.628 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:37.672 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:37.694 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3308.g8505b 136/156 2024-04-30T23:01:37.694 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:37.694 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-30T23:01:37.694 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:37.739 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:37.761 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 137/156 2024-04-30T23:01:37.762 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:37.762 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-30T23:01:37.762 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:37.762 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T23:01:37.762 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:38.065 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:38.087 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 138/156 2024-04-30T23:01:38.087 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T23:01:38.087 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-30T23:01:38.088 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:38.088 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T23:01:38.088 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:40.257 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 1/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 3/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 4/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 5/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 6/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 7/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:01:40.258 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 11/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 12/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 14/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 15/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 16/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 17/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 18/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 19/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 20/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 21/156 2024-04-30T23:01:40.259 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 22/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 23/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 24/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 25/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 26/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 27/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 28/156 2024-04-30T23:01:40.260 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 29/156 2024-04-30T23:01:40.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 30/156 2024-04-30T23:01:40.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 31/156 2024-04-30T23:01:40.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 32/156 2024-04-30T23:01:40.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 33/156 2024-04-30T23:01:40.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 34/156 2024-04-30T23:01:40.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 35/156 2024-04-30T23:01:40.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 36/156 2024-04-30T23:01:40.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 37/156 2024-04-30T23:01:40.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 38/156 2024-04-30T23:01:40.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 39/156 2024-04-30T23:01:40.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-30T23:01:40.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-30T23:01:40.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-30T23:01:40.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-30T23:01:40.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-30T23:01:40.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-30T23:01:40.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-30T23:01:40.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-30T23:01:40.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-30T23:01:40.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-30T23:01:40.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-30T23:01:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-30T23:01:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-30T23:01:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-30T23:01:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-30T23:01:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-30T23:01:40.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-30T23:01:40.292 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-30T23:01:40.293 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-30T23:01:40.294 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-30T23:01:40.294 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-30T23:01:40.294 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-30T23:01:40.294 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-30T23:01:40.294 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-30T23:01:40.295 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-30T23:01:40.296 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-30T23:01:40.296 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-30T23:01:40.296 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-30T23:01:40.296 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-30T23:01:40.296 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-30T23:01:40.297 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-30T23:01:40.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:40.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-30T23:01:40.300 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-30T23:01:40.301 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-30T23:01:40.302 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-30T23:01:40.303 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 149/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 151/156 2024-04-30T23:01:40.304 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-30T23:01:40.305 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-30T23:01:40.305 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:40.305 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-30T23:01:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 139/156 2024-04-30T23:01:42.409 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 140/156 2024-04-30T23:01:42.442 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:42.443 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.444 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.445 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.446 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-04-30T23:01:42.447 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.448 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.449 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-30T23:01:42.450 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.14-1.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.451 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-30T23:01:42.452 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-30T23:01:42.453 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-04-30T23:01:42.454 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-30T23:01:42.455 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-30T23:01:42.456 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-30T23:01:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-30T23:01:42.458 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-30T23:01:42.458 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-30T23:01:42.458 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 141/156 2024-04-30T23:01:42.458 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-30T23:01:42.458 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:01:42.459 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-30T23:01:42.482 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-30T23:01:42.509 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-30T23:01:42.688 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 144/156 2024-04-30T23:01:42.739 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-30T23:01:42.768 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 146/156 2024-04-30T23:01:42.846 DEBUG:teuthology.parallel:result is None 2024-04-30T23:01:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T23:01:44.250 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 148/156 2024-04-30T23:01:44.337 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-30T23:01:44.378 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-30T23:01:44.458 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-30T23:01:44.491 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-30T23:01:44.491 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:44.567 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T23:01:44.600 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:44.600 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:44.690 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T23:01:44.756 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 1/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 3/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 4/156 2024-04-30T23:01:50.447 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3308.g8505b 5/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 6/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 7/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 8/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 9/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 10/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 11/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 12/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 13/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 14/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_ 15/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 16/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 17/156 2024-04-30T23:01:50.448 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_6 18/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86 19/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 20/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el 21/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.0.0-3308.g8505bf41.el9. 22/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_6 23/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 24/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 25/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 26/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 27/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 28/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 29/156 2024-04-30T23:01:50.449 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41. 30/156 2024-04-30T23:01:50.460 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noa 31/156 2024-04-30T23:01:50.460 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.n 32/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3308.g850 33/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el 34/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 35/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.e 36/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 37/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 38/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 39/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-30T23:01:50.461 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-30T23:01:50.462 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-30T23:01:50.463 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-30T23:01:50.464 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-30T23:01:50.465 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-30T23:01:50.466 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-30T23:01:50.467 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-30T23:01:50.468 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 149/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 151/156 2024-04-30T23:01:50.469 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-30T23:01:50.470 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-30T23:01:50.470 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T23:01:50.470 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-30T23:01:52.640 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.641 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.0.0-3308.g8505bf41.el9.noarch 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-04-30T23:01:52.643 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-30T23:01:52.644 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-30T23:01:52.645 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.14-1.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-30T23:01:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-30T23:01:52.647 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-30T23:01:52.648 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-30T23:01:52.649 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-30T23:01:52.650 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.0.0-3308.g8505bf41.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-30T23:01:52.651 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-30T23:01:52.652 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-30T23:01:53.033 DEBUG:teuthology.parallel:result is None 2024-04-30T23:01:53.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:53.175 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-30T23:01:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.202 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.202 INFO:teuthology.task.install:The correct ceph version 19.0.0-3308.g8505bf41 is installed. 2024-04-30T23:01:53.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:53.343 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-30T23:01:53.367 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.367 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.367 INFO:teuthology.task.install:The correct ceph version 19.0.0-3308.g8505bf41 is installed. 2024-04-30T23:01:53.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:53.511 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-30T23:01:53.537 INFO:teuthology.orchestra.run.smithi183.stdout:19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.537 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3308.g8505bf41.el9 2024-04-30T23:01:53.537 INFO:teuthology.task.install:The correct ceph version 19.0.0-3308.g8505bf41 is installed. 2024-04-30T23:01:53.539 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-30T23:01:53.539 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:01:53.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-30T23:01:53.571 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:01:53.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-30T23:01:53.597 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:01:53.597 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-30T23:01:53.627 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-30T23:01:53.628 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:01:53.628 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-04-30T23:01:53.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-30T23:01:53.722 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:01:53.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-04-30T23:01:53.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-30T23:01:53.810 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:01:53.811 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-04-30T23:01:53.839 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-30T23:01:53.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-30T23:01:53.907 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:01:53.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-30T23:01:53.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-30T23:01:53.997 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:01:53.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-30T23:01:54.022 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-30T23:01:54.086 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:01:54.086 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-30T23:01:54.110 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-30T23:01:54.174 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-30T23:01:54.174 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:01:54.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-04-30T23:01:54.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-30T23:01:54.264 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:01:54.264 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-04-30T23:01:54.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-30T23:01:54.351 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:01:54.351 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-04-30T23:01:54.375 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-30T23:01:54.439 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-30T23:01:54.545 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-30T23:01:54.546 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:54.546 INFO:tasks.cephadm:Cluster fsid is a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:01:54.546 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-30T23:01:54.547 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.100', 'mon.b': '172.21.15.104', 'mon.c': '172.21.15.183'} 2024-04-30T23:01:54.547 INFO:tasks.cephadm:First mon is mon.a on smithi100 2024-04-30T23:01:54.547 INFO:tasks.cephadm:First mgr is x 2024-04-30T23:01:54.547 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-30T23:01:54.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-04-30T23:01:54.573 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname $(hostname -s) 2024-04-30T23:01:54.597 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname $(hostname -s) 2024-04-30T23:01:54.620 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-30T23:01:54.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:54.845 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3308-g8505bf41', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3308.g8505bf41'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-29 08:17:16.856953', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240429.064231-main-debug', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '8505bf412a33fc9b7838e91f3a227044bc06f5ed', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78936/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3308-g8505bf41', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3308.g8505bf41'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-29 07:58:36.640418', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240429.064231-main-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-30T23:01:54.993 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-mchangir-testing-20240429.064231-main-debug, sha1 8505bf412a33fc9b7838e91f3a227044bc06f5ed from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:01:54.995 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/x86_64/flavors/default/cephadm 2024-04-30T23:01:54.995 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:55.600 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 781495 Apr 30 23:01 /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:55.601 DEBUG:teuthology.orchestra.run.smithi104:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.035 INFO:teuthology.orchestra.run.smithi104.stdout:-rw-r--r--. 1 ubuntu ubuntu 781495 Apr 30 23:01 /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.035 DEBUG:teuthology.orchestra.run.smithi183:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240429.064231-main-debug/8505bf412a33fc9b7838e91f3a227044bc06f5ed/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r--. 1 ubuntu ubuntu 781495 Apr 30 23:01 /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.419 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.434 DEBUG:teuthology.orchestra.run.smithi104:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.452 DEBUG:teuthology.orchestra.run.smithi183:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-30T23:01:56.486 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed on all hosts... 2024-04-30T23:01:56.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed pull 2024-04-30T23:01:56.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed pull 2024-04-30T23:01:56.496 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed pull 2024-04-30T23:01:58.078 INFO:teuthology.orchestra.run.smithi183.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed... 2024-04-30T23:01:58.143 INFO:teuthology.orchestra.run.smithi104.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed... 2024-04-30T23:01:58.151 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed... 2024-04-30T23:02:26.656 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev)", 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3", 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd" 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:02:26.657 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:02:38.932 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev)", 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout: "image_id": "9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3", 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout: "repo_digests": [ 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd" 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-04-30T23:02:38.933 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev)", 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "image_id": "9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3", 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "repo_digests": [ 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd" 2024-04-30T23:02:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-30T23:02:48.539 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-30T23:02:48.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-04-30T23:02:48.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph 2024-04-30T23:02:48.621 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph 2024-04-30T23:02:48.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-04-30T23:02:48.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /etc/ceph 2024-04-30T23:02:48.705 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /etc/ceph 2024-04-30T23:02:48.732 INFO:tasks.cephadm:Writing seed config... 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-30T23:02:48.733 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-30T23:02:48.734 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-30T23:02:48.735 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-30T23:02:48.736 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-30T23:02:48.737 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:02:48.737 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-30T23:02:48.754 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a34a4a58-0745-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-30T23:02:48.755 DEBUG:teuthology.orchestra.run.smithi100:mon.a> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service 2024-04-30T23:02:48.797 DEBUG:teuthology.orchestra.run.smithi100:mgr.x> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x.service 2024-04-30T23:02:48.839 INFO:tasks.cephadm:Bootstrapping... 2024-04-30T23:02:48.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed -v bootstrap --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.100 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:02:49.031 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-30T23:02:49.031 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed', '-v', 'bootstrap', '--fsid', 'a34a4a58-0745-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.100', '--skip-admin-label'] 2024-04-30T23:02:49.031 INFO:teuthology.orchestra.run.smithi100.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-30T23:02:49.032 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying podman|docker is present... 2024-04-30T23:02:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-30T23:02:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying lvm2 is present... 2024-04-30T23:02:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying time synchronization is in place... 2024-04-30T23:02:49.086 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-30T23:02:49.086 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-30T23:02:49.092 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-30T23:02:49.092 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:02:49.098 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-04-30T23:02:49.104 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-04-30T23:02:49.104 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-04-30T23:02:49.104 INFO:teuthology.orchestra.run.smithi100.stdout:Repeating the final host check... 2024-04-30T23:02:49.127 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-30T23:02:49.127 INFO:teuthology.orchestra.run.smithi100.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-30T23:02:49.127 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl is present 2024-04-30T23:02:49.128 INFO:teuthology.orchestra.run.smithi100.stdout:lvcreate is present 2024-04-30T23:02:49.133 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-30T23:02:49.133 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-30T23:02:49.139 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-30T23:02:49.139 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:02:49.145 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-04-30T23:02:49.151 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-04-30T23:02:49.151 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-04-30T23:02:49.151 INFO:teuthology.orchestra.run.smithi100.stdout:Host looks OK 2024-04-30T23:02:49.152 INFO:teuthology.orchestra.run.smithi100.stdout:Cluster fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:02:49.152 INFO:teuthology.orchestra.run.smithi100.stdout:Acquiring lock 139652438851536 on /run/cephadm/a34a4a58-0745-11ef-bc93-c7b262605968.lock 2024-04-30T23:02:49.152 INFO:teuthology.orchestra.run.smithi100.stdout:Lock 139652438851536 acquired on /run/cephadm/a34a4a58-0745-11ef-bc93-c7b262605968.lock 2024-04-30T23:02:49.152 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 3300 ... 2024-04-30T23:02:49.152 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 6789 ... 2024-04-30T23:02:49.153 INFO:teuthology.orchestra.run.smithi100.stdout:Base mon IP(s) is [172.21.15.100:3300, 172.21.15.100:6789], mon addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-04-30T23:02:49.156 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2024-04-30T23:02:49.156 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 metric 100 2024-04-30T23:02:49.158 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-30T23:02:49.158 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-30T23:02:49.158 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-30T23:02:49.160 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 fe80::9f2f:e944:c89b:fa12/64 scope link noprefixroute 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-04-30T23:02:49.161 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-04-30T23:02:49.162 INFO:teuthology.orchestra.run.smithi100.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-30T23:02:49.162 INFO:teuthology.orchestra.run.smithi100.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-30T23:02:49.163 INFO:teuthology.orchestra.run.smithi100.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed... 2024-04-30T23:02:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 2024-04-30T23:02:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed... 2024-04-30T23:02:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Getting image source signatures 2024-04-30T23:02:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:fbc6fbc2c0a4985ed73b8ae934e40fcb30302156f25b43b32ea663895ea5a574 2024-04-30T23:02:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-30T23:02:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying config sha256:9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 2024-04-30T23:02:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-30T23:02:54.199 INFO:teuthology.orchestra.run.smithi100.stdout:ceph: stdout ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev) 2024-04-30T23:02:54.200 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph version: ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev) 2024-04-30T23:02:54.200 INFO:teuthology.orchestra.run.smithi100.stdout:Extracting ceph user uid/gid from container image... 2024-04-30T23:02:55.195 INFO:teuthology.orchestra.run.smithi100.stdout:stat: stdout 167 167 2024-04-30T23:02:55.196 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial keys... 2024-04-30T23:02:56.143 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCfeDFmPT49IBAAQQ4j+JBQsiRDdOBa/7ojpg== 2024-04-30T23:02:57.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCgeDFmMSLyGxAAQdee1/5AgkfJ2s7MHNCZXg== 2024-04-30T23:02:58.104 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCheDFmrEpUGRAARwU6pmxmi/gbdi9Nyl4A/Q== 2024-04-30T23:02:58.105 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial monmap... 2024-04-30T23:02:59.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool for a [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: set fsid to a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:02:59.522 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mon... 2024-04-30T23:03:00.444 INFO:teuthology.orchestra.run.smithi100.stdout:create mon.a on 2024-04-30T23:03:00.646 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-30T23:03:00.784 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-30T23:03:00.963 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target. 2024-04-30T23:03:00.963 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target. 2024-04-30T23:03:01.203 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a 2024-04-30T23:03:01.203 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-30T23:03:01.370 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target.wants/ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968@.service. 2024-04-30T23:03:01.868 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-30T23:03:01.869 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-04-30T23:03:01.875 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-30T23:03:01.875 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:03:01.875 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-04-30T23:03:01.875 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-04-30T23:03:01.876 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon to start... 2024-04-30T23:03:01.876 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon... 2024-04-30T23:03:02.006 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:01 smithi100 ceph-mon[29372]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout cluster: 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout id: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout services: 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.559978s) 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-30T23:03:02.953 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout data: 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pgs: 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.337+0000 7fb65397f700 1 Processor -- start 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.337+0000 7fb65397f700 1 -- start start 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.337+0000 7fb65397f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.337+0000 7fb65397f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c1091b0 con 0x7fb64c1087b0 2024-04-30T23:03:02.954 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb65171b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb65171b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51126/0 (socket says 172.21.15.100:51126) 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb65171b700 1 -- 172.21.15.100:0/3015063272 learned_addr learned my addr 172.21.15.100:0/3015063272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb65171b700 1 -- 172.21.15.100:0/3015063272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c109980 con 0x7fb64c1087b0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb65171b700 1 --2- 172.21.15.100:0/3015063272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098a0 tx=0x7fb63c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db955beae754f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb64bfff700 1 -- 172.21.15.100:0/3015063272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c004160 con 0x7fb64c1087b0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb64bfff700 1 -- 172.21.15.100:0/3015063272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c004300 con 0x7fb64c1087b0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.338+0000 7fb64bfff700 1 -- 172.21.15.100:0/3015063272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c0036a0 con 0x7fb64c1087b0 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 -- 172.21.15.100:0/3015063272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 msgr2=0x7fb64c108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 --2- 172.21.15.100:0/3015063272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098a0 tx=0x7fb63c009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 -- 172.21.15.100:0/3015063272 shutdown_connections 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 --2- 172.21.15.100:0/3015063272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c108bc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:02.955 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 -- 172.21.15.100:0/3015063272 >> 172.21.15.100:0/3015063272 conn(0x7fb64c103e30 msgr2=0x7fb64c1062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 -- 172.21.15.100:0/3015063272 shutdown_connections 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.339+0000 7fb65397f700 1 -- 172.21.15.100:0/3015063272 wait complete. 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65397f700 1 Processor -- start 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65397f700 1 -- start start 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65397f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65397f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c109eb0 con 0x7fb64c1087b0 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65171b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65171b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51130/0 (socket says 172.21.15.100:51130) 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65171b700 1 -- 172.21.15.100:0/1120810122 learned_addr learned my addr 172.21.15.100:0/1120810122 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65171b700 1 -- 172.21.15.100:0/1120810122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c19d920 con 0x7fb64c1087b0 2024-04-30T23:03:02.956 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.340+0000 7fb65171b700 1 --2- 172.21.15.100:0/1120810122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c003db0 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c011630 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c19dbb0 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c011950 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c1a07c0 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb63c011af0 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.341+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb63c01c450 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.342+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c064d30 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.344+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb63c032020 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.413+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb64c02e900 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.414+0000 7fb64a7fc700 1 -- 172.21.15.100:0/1120810122 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb63c004260 con 0x7fb64c1087b0 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.414+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 msgr2=0x7fb64c19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:02.957 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.414+0000 7fb65397f700 1 --2- 172.21.15.100:0/1120810122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c004750 comp rx=0 tx=0).stop 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.415+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 shutdown_connections 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.415+0000 7fb65397f700 1 --2- 172.21.15.100:0/1120810122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb64c1087b0 0x7fb64c19d3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.415+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 >> 172.21.15.100:0/1120810122 conn(0x7fb64c103e30 msgr2=0x7fb64c193ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.415+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 shutdown_connections 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:02.415+0000 7fb65397f700 1 -- 172.21.15.100:0/1120810122 wait complete. 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:mon is available 2024-04-30T23:03:02.958 INFO:teuthology.orchestra.run.smithi100.stdout:Assimilating anything we can from ceph.conf... 2024-04-30T23:03:03.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-30T23:03:03.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: monmap epoch 1 2024-04-30T23:03:03.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:03.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: last_changed 2024-04-30T23:02:58.443888+0000 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: min_mon_release 19 (squid) 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: election_strategy: 1 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: fsmap 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: osdmap e1: 0 total, 0 up, 0 in 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: mgrmap e1: no daemons active 2024-04-30T23:03:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:02 smithi100 ceph-mon[29372]: from='client.? 172.21.15.100:0/1120810122' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-30T23:03:04.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:03 smithi100 ceph-mon[29372]: from='client.? 172.21.15.100:0/556001174' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-30T23:03:04.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:03 smithi100 ceph-mon[29372]: from='client.? 172.21.15.100:0/556001174' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-30T23:03:04.118 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:04.118 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-30T23:03:04.119 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.395+0000 7f3d0a753700 1 Processor -- start 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.395+0000 7f3d0a753700 1 -- start start 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.395+0000 7f3d0a753700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.395+0000 7f3d0a753700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d041091b0 con 0x7f3d041087b0 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.395+0000 7f3d03fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d03fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51142/0 (socket says 172.21.15.100:51142) 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d03fff700 1 -- 172.21.15.100:0/4059787292 learned_addr learned my addr 172.21.15.100:0/4059787292 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d03fff700 1 -- 172.21.15.100:0/4059787292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d04109980 con 0x7f3d041087b0 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d03fff700 1 --2- 172.21.15.100:0/4059787292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098a0 tx=0x7f3cf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979091d24a6b455c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d02ffd700 1 -- 172.21.15.100:0/4059787292 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf4004160 con 0x7f3d041087b0 2024-04-30T23:03:04.120 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d02ffd700 1 -- 172.21.15.100:0/4059787292 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf4004300 con 0x7f3d041087b0 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.396+0000 7f3d02ffd700 1 -- 172.21.15.100:0/4059787292 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf40036a0 con 0x7f3d041087b0 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 -- 172.21.15.100:0/4059787292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 msgr2=0x7f3d04108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 --2- 172.21.15.100:0/4059787292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098a0 tx=0x7f3cf4009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 -- 172.21.15.100:0/4059787292 shutdown_connections 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 --2- 172.21.15.100:0/4059787292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d04108bc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 -- 172.21.15.100:0/4059787292 >> 172.21.15.100:0/4059787292 conn(0x7f3d04103df0 msgr2=0x7f3d041062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 -- 172.21.15.100:0/4059787292 shutdown_connections 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 -- 172.21.15.100:0/4059787292 wait complete. 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.397+0000 7f3d0a753700 1 Processor -- start 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d0a753700 1 -- start start 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d0a753700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d0a753700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d04109eb0 con 0x7f3d041087b0 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d03fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:04.121 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d03fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51158/0 (socket says 172.21.15.100:51158) 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d03fff700 1 -- 172.21.15.100:0/556001174 learned_addr learned my addr 172.21.15.100:0/556001174 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.398+0000 7f3d03fff700 1 -- 172.21.15.100:0/556001174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0419d950 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d03fff700 1 --2- 172.21.15.100:0/556001174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4000c00 tx=0x7f3cf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf4003db0 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf4011630 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0419dbe0 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf4011950 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d041a07f0 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3cf4011af0 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.399+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3cf401c450 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.400+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d04064d30 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.402+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3cf4004260 con 0x7f3d041087b0 2024-04-30T23:03:04.122 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.469+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3d0402e850 con 0x7f3d041087b0 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.473+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+467 (secure 0 0 0) 0x7f3cf401b450 con 0x7f3d041087b0 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 msgr2=0x7f3d0419d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 --2- 172.21.15.100:0/556001174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4000c00 tx=0x7f3cf4004750 comp rx=0 tx=0).stop 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d017fa700 1 -- 172.21.15.100:0/556001174 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3cf401b630 con 0x7f3d041087b0 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 shutdown_connections 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 --2- 172.21.15.100:0/556001174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d041087b0 0x7f3d0419d410 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 >> 172.21.15.100:0/556001174 conn(0x7f3d04103df0 msgr2=0x7f3d04193ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 shutdown_connections 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:03.474+0000 7f3d0a753700 1 -- 172.21.15.100:0/556001174 wait complete. 2024-04-30T23:03:04.123 INFO:teuthology.orchestra.run.smithi100.stdout:Generating new minimal ceph.conf... 2024-04-30T23:03:05.224 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:04 smithi100 ceph-mon[29372]: from='client.? 172.21.15.100:0/290072534' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:03:05.226 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.573+0000 7f313aa39700 1 Processor -- start 2024-04-30T23:03:05.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.573+0000 7f313aa39700 1 -- start start 2024-04-30T23:03:05.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.573+0000 7f313aa39700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:05.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.573+0000 7f313aa39700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31341091b0 con 0x7f31341087b0 2024-04-30T23:03:05.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3133fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:05.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3133fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37928/0 (socket says 172.21.15.100:37928) 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3133fff700 1 -- 172.21.15.100:0/1979762239 learned_addr learned my addr 172.21.15.100:0/1979762239 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3133fff700 1 -- 172.21.15.100:0/1979762239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3134109980 con 0x7f31341087b0 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3133fff700 1 --2- 172.21.15.100:0/1979762239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f31240098a0 tx=0x7f3124009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c3177f616e8272 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3132ffd700 1 -- 172.21.15.100:0/1979762239 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3124004160 con 0x7f31341087b0 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3132ffd700 1 -- 172.21.15.100:0/1979762239 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3124004300 con 0x7f31341087b0 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.574+0000 7f3132ffd700 1 -- 172.21.15.100:0/1979762239 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3124011af0 con 0x7f31341087b0 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 -- 172.21.15.100:0/1979762239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 msgr2=0x7f3134108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 --2- 172.21.15.100:0/1979762239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f31240098a0 tx=0x7f3124009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 -- 172.21.15.100:0/1979762239 shutdown_connections 2024-04-30T23:03:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 --2- 172.21.15.100:0/1979762239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f3134108bc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 -- 172.21.15.100:0/1979762239 >> 172.21.15.100:0/1979762239 conn(0x7f3134103df0 msgr2=0x7f31341062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 -- 172.21.15.100:0/1979762239 shutdown_connections 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.575+0000 7f313aa39700 1 -- 172.21.15.100:0/1979762239 wait complete. 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f313aa39700 1 Processor -- start 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f313aa39700 1 -- start start 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f313aa39700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f313aa39700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f313410cd30 con 0x7f31341087b0 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f3133fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f3133fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37930/0 (socket says 172.21.15.100:37930) 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f3133fff700 1 -- 172.21.15.100:0/290072534 learned_addr learned my addr 172.21.15.100:0/290072534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.576+0000 7f3133fff700 1 -- 172.21.15.100:0/290072534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313419e8b0 con 0x7f31341087b0 2024-04-30T23:03:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f3133fff700 1 --2- 172.21.15.100:0/290072534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3124011890 tx=0x7f3124011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31240039e0 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313407d680 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3124003b80 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31240246e0 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341a3170 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3124022020 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.577+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f312402dca0 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.578+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3134064d30 con 0x7f31341087b0 2024-04-30T23:03:05.235 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.580+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f312401aa70 con 0x7f31341087b0 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.647+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f31341a3580 con 0x7f31341087b0 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.647+0000 7f31317fa700 1 -- 172.21.15.100:0/290072534 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f31341a3580 con 0x7f31341087b0 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 msgr2=0x7f313407d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 --2- 172.21.15.100:0/290072534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3124011890 tx=0x7f3124011970 comp rx=0 tx=0).stop 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 shutdown_connections 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 --2- 172.21.15.100:0/290072534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31341087b0 0x7f313407d140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 >> 172.21.15.100:0/290072534 conn(0x7f3134103df0 msgr2=0x7f31341046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 shutdown_connections 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:04.648+0000 7f313aa39700 1 -- 172.21.15.100:0/290072534 wait complete. 2024-04-30T23:03:05.236 INFO:teuthology.orchestra.run.smithi100.stdout:Restarting the monitor... 2024-04-30T23:03:05.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 systemd[1]: Stopping Ceph mon.a for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:03:05.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a[29368]: 2024-04-30T23:03:05.507+0000 7f135d02d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:03:05.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a[29368]: 2024-04-30T23:03:05.507+0000 7f135d02d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-30T23:03:05.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 podman[29617]: 2024-04-30 23:03:05.630533391 +0000 UTC m=+0.218618444 container died 1280788e54e8bb05e73286b23529e05f0632018750bbeb66d618ed519038112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-30T23:03:06.144 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 podman[29617]: 2024-04-30 23:03:05.932602474 +0000 UTC m=+0.520687526 container cleanup 1280788e54e8bb05e73286b23529e05f0632018750bbeb66d618ed519038112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-30T23:03:06.145 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:05 smithi100 bash[29617]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a 2024-04-30T23:03:06.480 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 podman[29631]: 2024-04-30 23:03:06.150308125 +0000 UTC m=+0.512652305 container remove 1280788e54e8bb05e73286b23529e05f0632018750bbeb66d618ed519038112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:03:06.480 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 systemd[1]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-30T23:03:06.480 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 systemd[1]: Stopped Ceph mon.a for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:03:06.481 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 systemd[1]: Starting Ceph mon.a for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:03:06.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 podman[29725]: 2024-04-30 23:03:06.389204658 +0000 UTC m=+0.017873846 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:03:06.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 podman[29725]: 2024-04-30 23:03:06.492783734 +0000 UTC m=+0.121452950 container create 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-30T23:03:06.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 podman[29725]: 2024-04-30 23:03:06.737425534 +0000 UTC m=+0.366094707 container init 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-30T23:03:06.836 INFO:teuthology.orchestra.run.smithi100.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 podman[29725]: 2024-04-30 23:03:06.740349721 +0000 UTC m=+0.369018896 container start 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: set uid:gid to 167:167 (ceph:ceph) 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev), process ceph-mon, pid 2 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: pidfile_write: ignore empty --pid-file 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: load: jerasure load: lrc 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: RocksDB version: 7.9.2 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Git sha 0 2024-04-30T23:03:07.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Compile date 2024-04-29 07:05:04 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: DB SUMMARY 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: DB Session ID: N3Z4MAGGA6C8UT9MJK21 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: CURRENT file: CURRENT 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: IDENTITY file: IDENTITY 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103514 ; 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.error_if_exists: 0 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.create_if_missing: 0 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.paranoid_checks: 1 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-30T23:03:07.032 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.env: 0x55f755a79500 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.fs: PosixFileSystem 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.info_log: 0x55f757c9ffe0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_file_opening_threads: 16 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.statistics: (nil) 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.use_fsync: 0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_log_file_size: 0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.keep_log_file_num: 1000 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.recycle_log_file_num: 0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_fallocate: 1 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_mmap_reads: 0 2024-04-30T23:03:07.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_mmap_writes: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.use_direct_reads: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.create_missing_column_families: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.db_log_dir: 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.wal_dir: 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.advise_random_on_open: 1 2024-04-30T23:03:07.034 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.db_write_buffer_size: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.write_buffer_manager: 0x55f757c708c0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.rate_limiter: (nil) 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.wal_recovery_mode: 2 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enable_thread_tracking: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enable_pipelined_write: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.unordered_write: 0 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-30T23:03:07.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.row_cache: None 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.wal_filter: None 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_ingest_behind: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.two_write_queues: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.manual_wal_flush: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.wal_compression: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.atomic_flush: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-30T23:03:07.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.log_readahead_size: 0 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.best_efforts_recovery: 0 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.allow_data_in_errors: 0 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.db_host_id: __hostname__ 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_background_jobs: 2 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_background_compactions: -1 2024-04-30T23:03:07.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_subcompactions: 1 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_total_wal_size: 0 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_open_files: -1 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bytes_per_sync: 0 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-30T23:03:07.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_readahead_size: 0 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_background_flushes: -1 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Compression algorithms supported: 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kZSTD supported: 0 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kXpressCompression supported: 0 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kLZ4HCCompression supported: 1 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kZlibCompression supported: 1 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kSnappyCompression supported: 1 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kLZ4Compression supported: 1 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: kBZip2Compression supported: 0 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-30T23:03:07.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.merge_operator: 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_filter: None 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_filter_factory: None 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.sst_partitioner_factory: None 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f757da61c0) 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-30T23:03:07.041 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_type: 0 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_index_type: 0 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_shortening: 1 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: checksum: 4 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: no_block_cache: 0 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache: 0x55f757ca31f0 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_options: 2024-04-30T23:03:07.042 INFO:journalctl@ceph.mon.a.smithi100.stdout: capacity : 536870912 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_shard_bits : 4 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: strict_capacity_limit : 0 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_compressed: (nil) 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: persistent_cache: (nil) 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size: 4096 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size_deviation: 10 2024-04-30T23:03:07.043 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_restart_interval: 16 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_block_restart_interval: 1 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: metadata_block_size: 4096 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: partition_filters: 0 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: use_delta_encoding: 1 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: filter_policy: bloomfilter 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: whole_key_filtering: 1 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: verify_compression: 0 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: format_version: 5 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_index_compression: 1 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_align: 0 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: max_auto_readahead_size: 262144 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: prepopulate_block_cache: 0 2024-04-30T23:03:07.044 INFO:journalctl@ceph.mon.a.smithi100.stdout: initial_auto_readahead_size: 8192 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.write_buffer_size: 33554432 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_write_buffer_number: 2 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression: NoCompression 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression: Disabled 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.prefix_extractor: nullptr 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.num_levels: 7 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-30T23:03:07.045 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.level: 32767 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.strategy: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:03:07.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.enabled: false 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.target_file_size_base: 67108864 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-30T23:03:07.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-30T23:03:07.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.arena_block_size: 1048576 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.disable_auto_compactions: 0 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-30T23:03:07.049 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.inplace_update_support: 0 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-30T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.bloom_locality: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.max_successive_merges: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.paranoid_file_checks: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.force_consistency_checks: 1 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.report_bg_io_stats: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.ttl: 2592000 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-30T23:03:07.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enable_blob_files: false 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.min_blob_size: 0 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_file_size: 268435456 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-30T23:03:07.052 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.blob_file_starting_level: 0 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2c7e895d-68cc-4444-93f1-c02b416258d0 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518186780458, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518186781517, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98767, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 96720, "index_size": 303, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13786, "raw_average_key_size": 49, "raw_value_size": 89203, "raw_average_value_size": 319, "num_data_blocks": 12, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714518186, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2c7e895d-68cc-4444-93f1-c02b416258d0", "db_session_id": "N3Z4MAGGA6C8UT9MJK21", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518186781604, "job": 1, "event": "recovery_finished"} 2024-04-30T23:03:07.053 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f757c87c00 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: DB pointer 0x55f75ca7a000 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** DB Stats ** 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:03:07.054 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: L0 2/0 98.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: Sum 2/0 98.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-30T23:03:07.055 INFO:journalctl@ceph.mon.a.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 152.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative compaction: 0.00 GB write, 29.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval compaction: 0.00 GB write, 29.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache BinnedLRUCache@0x55f757ca31f0#2 capacity: 512.00 MB usage: 1.41 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-30T23:03:07.056 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.91 KB,0.000172853%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: starting mon.a rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???) e1 preinit fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).mds e1 new map 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).mds e1 print_map 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: e1 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: legacy client fscid: -1 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout: No filesystems configured 2024-04-30T23:03:07.057 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 bash[29725]: 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 systemd[1]: Started Ceph mon.a for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: monmap epoch 1 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:07.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: last_changed 2024-04-30T23:02:58.443888+0000 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: min_mon_release 19 (squid) 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: election_strategy: 1 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: fsmap 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: osdmap e1: 0 total, 0 up, 0 in 2024-04-30T23:03:07.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:06 smithi100 ceph-mon[29745]: mgrmap e1: no daemons active 2024-04-30T23:03:07.882 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.249+0000 7fdef7fed700 1 Processor -- start 2024-04-30T23:03:07.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef7fed700 1 -- start start 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef7fed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef7fed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdef007d610 con 0x7fdef010a3f0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef5d89700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef5d89700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37934/0 (socket says 172.21.15.100:37934) 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef5d89700 1 -- 172.21.15.100:0/2887355600 learned_addr learned my addr 172.21.15.100:0/2887355600 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.250+0000 7fdef5d89700 1 -- 172.21.15.100:0/2887355600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef010cd50 con 0x7fdef010a3f0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.251+0000 7fdef5d89700 1 --2- 172.21.15.100:0/2887355600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098a0 tx=0x7fdee0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb39d8e138b7e984 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.251+0000 7fdef4d87700 1 -- 172.21.15.100:0/2887355600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdee0004160 con 0x7fdef010a3f0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.251+0000 7fdef4d87700 1 -- 172.21.15.100:0/2887355600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdee0004300 con 0x7fdef010a3f0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.251+0000 7fdef4d87700 1 -- 172.21.15.100:0/2887355600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdee0011af0 con 0x7fdef010a3f0 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.251+0000 7fdef7fed700 1 -- 172.21.15.100:0/2887355600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 msgr2=0x7fdef010c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 --2- 172.21.15.100:0/2887355600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098a0 tx=0x7fdee0009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:07.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 -- 172.21.15.100:0/2887355600 shutdown_connections 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 --2- 172.21.15.100:0/2887355600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef010c810 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 -- 172.21.15.100:0/2887355600 >> 172.21.15.100:0/2887355600 conn(0x7fdef0103e10 msgr2=0x7fdef01062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 -- 172.21.15.100:0/2887355600 shutdown_connections 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 -- 172.21.15.100:0/2887355600 wait complete. 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 Processor -- start 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 -- start start 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.252+0000 7fdef7fed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef7fed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdef010dcb0 con 0x7fdef010a3f0 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef5d89700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef5d89700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37942/0 (socket says 172.21.15.100:37942) 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef5d89700 1 -- 172.21.15.100:0/2973815834 learned_addr learned my addr 172.21.15.100:0/2973815834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:07.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef5d89700 1 -- 172.21.15.100:0/2973815834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef019e270 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef5d89700 1 --2- 172.21.15.100:0/2973815834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009fb0 tx=0x7fdee0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdee0011bc0 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdee0024440 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef019e500 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdee001a5c0 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef01a1100 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.253+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdee001ac10 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.254+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdee0019700 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.254+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef0064d30 con 0x7fdef010a3f0 2024-04-30T23:03:07.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.257+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdee002ddf0 con 0x7fdef010a3f0 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.325+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fdef01a12d0 con 0x7fdef010a3f0 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.328+0000 7fdee6ffd700 1 -- 172.21.15.100:0/2973815834 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fdee00245f0 con 0x7fdef010a3f0 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 msgr2=0x7fdef019dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 --2- 172.21.15.100:0/2973815834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009fb0 tx=0x7fdee0011890 comp rx=0 tx=0).stop 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 shutdown_connections 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 --2- 172.21.15.100:0/2973815834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdef010a3f0 0x7fdef019dd30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 >> 172.21.15.100:0/2973815834 conn(0x7fdef0103e10 msgr2=0x7fdef01048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 shutdown_connections 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:07.329+0000 7fdef7fed700 1 -- 172.21.15.100:0/2973815834 wait complete. 2024-04-30T23:03:07.891 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-30T23:03:07.913 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:03:07.913 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mgr... 2024-04-30T23:03:07.913 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-30T23:03:07.914 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-30T23:03:08.167 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x 2024-04-30T23:03:08.167 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-30T23:03:08.313 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968.target.wants/ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-a34a4a58-0745-11ef-bc93-c7b262605968@.service. 2024-04-30T23:03:08.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:08 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2973815834' entity='client.admin' 2024-04-30T23:03:08.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 systemd[1]: Starting Ceph mgr.x for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:03:08.793 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 podman[29965]: 2024-04-30 23:03:08.537509458 +0000 UTC m=+0.098269311 container create 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-30T23:03:08.793 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 podman[29965]: 2024-04-30 23:03:08.456938012 +0000 UTC m=+0.017697894 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:03:08.793 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 podman[29965]: 2024-04-30 23:03:08.723131278 +0000 UTC m=+0.283891132 container init 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-30T23:03:08.793 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 podman[29965]: 2024-04-30 23:03:08.725516729 +0000 UTC m=+0.286276583 container start 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:03:08.793 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 bash[29965]: 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 2024-04-30T23:03:08.806 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-30T23:03:08.806 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-04-30T23:03:08.813 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-30T23:03:08.813 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:03:08.814 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-04-30T23:03:08.814 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-04-30T23:03:08.822 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-30T23:03:08.822 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr to start... 2024-04-30T23:03:08.829 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr... 2024-04-30T23:03:09.043 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 systemd[1]: Started Ceph mgr.x for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:03:09.043 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:08 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:08.890+0000 7f594626d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T23:03:09.301 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:09 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:09.076+0000 7f594626d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:09.301 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:09 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:09.181+0000 7f594626d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T23:03:09.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:09 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2857681742' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-30T23:03:09.567 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:09 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:09.498+0000 7f594626d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T23:03:09.857 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:09 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:09.585+0000 7f594626d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T23:03:09.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:09.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-30T23:03:09.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-30T23:03:09.873 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-30T23:03:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-04-30T23:03:01.858231+0000", 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efef03700 1 Processor -- start 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efef03700 1 -- start start 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efef03700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efef03700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef810a750 con 0x7f0ef8109d70 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efcc9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efcc9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37970/0 (socket says 172.21.15.100:37970) 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.227+0000 7f0efcc9f700 1 -- 172.21.15.100:0/148796648 learned_addr learned my addr 172.21.15.100:0/148796648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.228+0000 7f0efcc9f700 1 -- 172.21.15.100:0/148796648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81089f0 con 0x7f0ef8109d70 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.228+0000 7f0efcc9f700 1 --2- 172.21.15.100:0/148796648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00bb40 tx=0x7f0eec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d87c7bf0477e0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.228+0000 7f0ef77fe700 1 -- 172.21.15.100:0/148796648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eec00dbe0 con 0x7f0ef8109d70 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.228+0000 7f0ef77fe700 1 -- 172.21.15.100:0/148796648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0eec0044c0 con 0x7f0ef8109d70 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.228+0000 7f0ef77fe700 1 -- 172.21.15.100:0/148796648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eec010470 con 0x7f0ef8109d70 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 -- 172.21.15.100:0/148796648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 msgr2=0x7f0ef810a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 --2- 172.21.15.100:0/148796648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00bb40 tx=0x7f0eec00be50 comp rx=0 tx=0).stop 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 -- 172.21.15.100:0/148796648 shutdown_connections 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 --2- 172.21.15.100:0/148796648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef810a180 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 -- 172.21.15.100:0/148796648 >> 172.21.15.100:0/148796648 conn(0x7f0ef8103570 msgr2=0x7f0ef81059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 -- 172.21.15.100:0/148796648 shutdown_connections 2024-04-30T23:03:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.229+0000 7f0efef03700 1 -- 172.21.15.100:0/148796648 wait complete. 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efef03700 1 Processor -- start 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efef03700 1 -- start start 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efef03700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efef03700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef81078e0 con 0x7f0ef8109d70 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efcc9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efcc9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37986/0 (socket says 172.21.15.100:37986) 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efcc9f700 1 -- 172.21.15.100:0/2857681742 learned_addr learned my addr 172.21.15.100:0/2857681742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efcc9f700 1 -- 172.21.15.100:0/2857681742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef819bfb0 con 0x7f0ef8109d70 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0efcc9f700 1 --2- 172.21.15.100:0/2857681742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0eec003b90 tx=0x7f0eec003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.230+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eec027070 con 0x7f0ef8109d70 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0eec010c00 con 0x7f0ef8109d70 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef819c240 con 0x7f0ef8109d70 2024-04-30T23:03:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eec022be0 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef819ee50 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0eec02a070 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.231+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0eec01f070 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.232+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef8064d30 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.234+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0eec031030 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.305+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0ef8194c80 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.305+0000 7f0ef5ffb700 1 -- 172.21.15.100:0/2857681742 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0eec015070 con 0x7f0ef8109d70 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.306+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 msgr2=0x7f0ef819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.306+0000 7f0efef03700 1 --2- 172.21.15.100:0/2857681742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0eec003b90 tx=0x7f0eec003dc0 comp rx=0 tx=0).stop 2024-04-30T23:03:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.306+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 shutdown_connections 2024-04-30T23:03:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.306+0000 7f0efef03700 1 --2- 172.21.15.100:0/2857681742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ef8109d70 0x7f0ef819ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.306+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 >> 172.21.15.100:0/2857681742 conn(0x7f0ef8103570 msgr2=0x7f0ef8191d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.307+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 shutdown_connections 2024-04-30T23:03:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:09.307+0000 7f0efef03700 1 -- 172.21.15.100:0/2857681742 wait complete. 2024-04-30T23:03:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (1/15)... 2024-04-30T23:03:11.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:10 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:10.779+0000 7f594626d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T23:03:11.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:10 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:10.946+0000 7f594626d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:11.401 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:11.114+0000 7f594626d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T23:03:11.401 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:11.404+0000 7f594626d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T23:03:11.691 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:11.495+0000 7f594626d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T23:03:11.691 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:11.695+0000 7f594626d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T23:03:11.983 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:11.886+0000 7f594626d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:12.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:12 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1621437257' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-30T23:03:12.817 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:12 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:12.515+0000 7f594626d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T23:03:13.002 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-30T23:03:13.003 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-30T23:03:13.004 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-30T23:03:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-30T23:03:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-04-30T23:03:01.858231+0000", 2024-04-30T23:03:13.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.274+0000 7f63b5d69700 1 Processor -- start 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.274+0000 7f63b5d69700 1 -- start start 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.274+0000 7f63b5d69700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.274+0000 7f63b5d69700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0109170 con 0x7f63b0108770 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37992/0 (socket says 172.21.15.100:37992) 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63af7fe700 1 -- 172.21.15.100:0/568580798 learned_addr learned my addr 172.21.15.100:0/568580798 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:13.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63af7fe700 1 -- 172.21.15.100:0/568580798 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0109940 con 0x7f63b0108770 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63af7fe700 1 --2- 172.21.15.100:0/568580798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63a40098a0 tx=0x7f63a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0d59552493041b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63ae7fc700 1 -- 172.21.15.100:0/568580798 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a4004160 con 0x7f63b0108770 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63ae7fc700 1 -- 172.21.15.100:0/568580798 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f63a4004300 con 0x7f63b0108770 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.275+0000 7f63ae7fc700 1 -- 172.21.15.100:0/568580798 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a4011af0 con 0x7f63b0108770 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 -- 172.21.15.100:0/568580798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 msgr2=0x7f63b0108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 --2- 172.21.15.100:0/568580798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63a40098a0 tx=0x7f63a4009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 -- 172.21.15.100:0/568580798 shutdown_connections 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 --2- 172.21.15.100:0/568580798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b0108b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 -- 172.21.15.100:0/568580798 >> 172.21.15.100:0/568580798 conn(0x7f63b0103e10 msgr2=0x7f63b0106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 -- 172.21.15.100:0/568580798 shutdown_connections 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.276+0000 7f63b5d69700 1 -- 172.21.15.100:0/568580798 wait complete. 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63b5d69700 1 Processor -- start 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63b5d69700 1 -- start start 2024-04-30T23:03:13.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63b5d69700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63b5d69700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63b010ccf0 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38002/0 (socket says 172.21.15.100:38002) 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.277+0000 7f63af7fe700 1 -- 172.21.15.100:0/1621437257 learned_addr learned my addr 172.21.15.100:0/1621437257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63af7fe700 1 -- 172.21.15.100:0/1621437257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0193e10 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63af7fe700 1 --2- 172.21.15.100:0/1621437257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011890 tx=0x7f63a4011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40039e0 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f63a4003b80 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63b5d69700 1 -- 172.21.15.100:0/1621437257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b0192060 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40246e0 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63b5d69700 1 -- 172.21.15.100:0/1621437257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b0192540 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.278+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63a4022020 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.279+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63a40193c0 con 0x7f63b0108770 2024-04-30T23:03:13.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.279+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b0064d30 con 0x7f63b0108770 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.284+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f63a401aa70 con 0x7f63b0108770 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.356+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f63b01a5840 con 0x7f63b0108770 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.356+0000 7f63acff9700 1 -- 172.21.15.100:0/1621437257 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f63a4024e20 con 0x7f63b0108770 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.357+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 msgr2=0x7f63b01938d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.357+0000 7f63967fc700 1 --2- 172.21.15.100:0/1621437257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011890 tx=0x7f63a4011970 comp rx=0 tx=0).stop 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.357+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 shutdown_connections 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.357+0000 7f63967fc700 1 --2- 172.21.15.100:0/1621437257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0108770 0x7f63b01938d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.357+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 >> 172.21.15.100:0/1621437257 conn(0x7f63b0103e10 msgr2=0x7f63b0104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.358+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 shutdown_connections 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:12.358+0000 7f63967fc700 1 -- 172.21.15.100:0/1621437257 wait complete. 2024-04-30T23:03:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (2/15)... 2024-04-30T23:03:13.231 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:12 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:12.939+0000 7f594626d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T23:03:13.231 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:13 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:13.035+0000 7f594626d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T23:03:13.231 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:13 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:13.235+0000 7f594626d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T23:03:14.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:13 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:13.763+0000 7f594626d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T23:03:14.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:13 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:13.853+0000 7f594626d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T23:03:14.433 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:14.093+0000 7f594626d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T23:03:14.433 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:14.226+0000 7f594626d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T23:03:14.433 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:14.320+0000 7f594626d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T23:03:14.433 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:14.436+0000 7f594626d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:15.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:14.763+0000 7f594626d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T23:03:15.401 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:15 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:15.372+0000 7f594626d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T23:03:15.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2449881702' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-30T23:03:15.817 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:15 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:15.595+0000 7f594626d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T23:03:16.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-30T23:03:16.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-30T23:03:16.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-30T23:03:16.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-30T23:03:16.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-30T23:03:16.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-30T23:03:16.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-30T23:03:16.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-04-30T23:03:01.858231+0000", 2024-04-30T23:03:16.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.405+0000 7fd721cf1700 1 Processor -- start 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.405+0000 7fd721cf1700 1 -- start start 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.405+0000 7fd721cf1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd721cf1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c07cda0 con 0x7fd71c10a390 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34782/0 (socket says 172.21.15.100:34782) 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71b7fe700 1 -- 172.21.15.100:0/741076053 learned_addr learned my addr 172.21.15.100:0/741076053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71b7fe700 1 -- 172.21.15.100:0/741076053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c10ccf0 con 0x7fd71c10a390 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71b7fe700 1 --2- 172.21.15.100:0/741076053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098a0 tx=0x7fd70c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3051def55cc2c854 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71a7fc700 1 -- 172.21.15.100:0/741076053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd70c004160 con 0x7fd71c10a390 2024-04-30T23:03:16.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71a7fc700 1 -- 172.21.15.100:0/741076053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd70c004300 con 0x7fd71c10a390 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.406+0000 7fd71a7fc700 1 -- 172.21.15.100:0/741076053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd70c011af0 con 0x7fd71c10a390 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 -- 172.21.15.100:0/741076053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 msgr2=0x7fd71c10c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 --2- 172.21.15.100:0/741076053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098a0 tx=0x7fd70c009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 -- 172.21.15.100:0/741076053 shutdown_connections 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 --2- 172.21.15.100:0/741076053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c10c7b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 -- 172.21.15.100:0/741076053 >> 172.21.15.100:0/741076053 conn(0x7fd71c103e10 msgr2=0x7fd71c106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 -- 172.21.15.100:0/741076053 shutdown_connections 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.407+0000 7fd721cf1700 1 -- 172.21.15.100:0/741076053 wait complete. 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.408+0000 7fd721cf1700 1 Processor -- start 2024-04-30T23:03:16.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.408+0000 7fd721cf1700 1 -- start start 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.408+0000 7fd721cf1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.408+0000 7fd721cf1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c10dc50 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34784/0 (socket says 172.21.15.100:34784) 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd71b7fe700 1 -- 172.21.15.100:0/2449881702 learned_addr learned my addr 172.21.15.100:0/2449881702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd71b7fe700 1 -- 172.21.15.100:0/2449881702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c10a050 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd71b7fe700 1 --2- 172.21.15.100:0/2449881702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0117b0 tx=0x7fd70c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd70c003af0 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd70c020070 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71c1082a0 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd70c019630 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71c108780 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.409+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd70c019c80 con 0x7fd71c10a390 2024-04-30T23:03:16.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.410+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd70c00b890 con 0x7fd71c10a390 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.410+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71c064d30 con 0x7fd71c10a390 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.412+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd70c01a9c0 con 0x7fd71c10a390 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.485+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd71c108a00 con 0x7fd71c10a390 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.485+0000 7fd718ff9700 1 -- 172.21.15.100:0/2449881702 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd70c01a430 con 0x7fd71c10a390 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.486+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 msgr2=0x7fd71c109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.486+0000 7fd721cf1700 1 --2- 172.21.15.100:0/2449881702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0117b0 tx=0x7fd70c011b70 comp rx=0 tx=0).stop 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.486+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 shutdown_connections 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.486+0000 7fd721cf1700 1 --2- 172.21.15.100:0/2449881702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd71c10a390 0x7fd71c109b10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.486+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 >> 172.21.15.100:0/2449881702 conn(0x7fd71c103e10 msgr2=0x7fd71c104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.487+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 shutdown_connections 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:15.487+0000 7fd721cf1700 1 -- 172.21.15.100:0/2449881702 wait complete. 2024-04-30T23:03:16.070 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (3/15)... 2024-04-30T23:03:16.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: Activating manager daemon x 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: mgrmap e2: x(active, starting, since 0.00341041s) 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: Manager daemon x is now available 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' 2024-04-30T23:03:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:16 smithi100 ceph-mon[29745]: from='mgr.14100 172.21.15.100:0/1308884558' entity='mgr.x' 2024-04-30T23:03:18.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:17 smithi100 ceph-mon[29745]: mgrmap e3: x(active, since 1.00777s) 2024-04-30T23:03:18.768 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:18 smithi100 ceph-mon[29745]: mgrmap e4: x(active, since 2s) 2024-04-30T23:03:19.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:19.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:19.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-30T23:03:19.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-30T23:03:19.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-04-30T23:03:01.858231+0000", 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-30T23:03:19.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed7821700 1 Processor -- start 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed7821700 1 -- start start 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed7821700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed7821700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed007d630 con 0x7f3ed010a430 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed55bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed55bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34838/0 (socket says 172.21.15.100:34838) 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed55bd700 1 -- 172.21.15.100:0/3210066934 learned_addr learned my addr 172.21.15.100:0/3210066934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed55bd700 1 -- 172.21.15.100:0/3210066934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed010cd90 con 0x7f3ed010a430 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ed55bd700 1 --2- 172.21.15.100:0/3210066934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee5175e692fe739 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ec7fff700 1 -- 172.21.15.100:0/3210066934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc004160 con 0x7f3ed010a430 2024-04-30T23:03:19.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ec7fff700 1 -- 172.21.15.100:0/3210066934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ecc004300 con 0x7f3ed010a430 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.484+0000 7f3ec7fff700 1 -- 172.21.15.100:0/3210066934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc011af0 con 0x7f3ed010a430 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- 172.21.15.100:0/3210066934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 msgr2=0x7f3ed010c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 --2- 172.21.15.100:0/3210066934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- 172.21.15.100:0/3210066934 shutdown_connections 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 --2- 172.21.15.100:0/3210066934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed010c850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- 172.21.15.100:0/3210066934 >> 172.21.15.100:0/3210066934 conn(0x7f3ed0103e90 msgr2=0x7f3ed0106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- 172.21.15.100:0/3210066934 shutdown_connections 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- 172.21.15.100:0/3210066934 wait complete. 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 Processor -- start 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.485+0000 7f3ed7821700 1 -- start start 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed7821700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed7821700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed010dc80 con 0x7f3ed010a430 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed55bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed55bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34848/0 (socket says 172.21.15.100:34848) 2024-04-30T23:03:19.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed55bd700 1 -- 172.21.15.100:0/1285510841 learned_addr learned my addr 172.21.15.100:0/1285510841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed55bd700 1 -- 172.21.15.100:0/1285510841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed019e240 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed55bd700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0117b0 tx=0x7f3ecc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0039c0 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ecc003b60 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed019e4d0 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0196a0 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.486+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed01a10e0 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.487+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f3ecc019960 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.487+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed0064d30 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.487+0000 7f3ec67fc700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 0x7f3ebc03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.487+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3ecc04df00 con 0x7f3ed010a430 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.488+0000 7f3ed4dbc700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 0x7f3ebc03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:19.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.488+0000 7f3ed4dbc700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 0x7f3ebc03ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0006fd0 tx=0x7f3ec0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.494+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ecc0042a0 con 0x7f3ed010a430 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.772+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3ed01a13f0 con 0x7f3ed010a430 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.772+0000 7f3ec67fc700 1 -- 172.21.15.100:0/1285510841 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f3ecc02c9f0 con 0x7f3ed010a430 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 msgr2=0x7f3ebc03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 0x7f3ebc03ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0006fd0 tx=0x7f3ec0006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 msgr2=0x7f3ed019dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0117b0 tx=0x7f3ecc011b70 comp rx=0 tx=0).stop 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 shutdown_connections 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3ebc039560 0x7f3ebc03ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 --2- 172.21.15.100:0/1285510841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed010a430 0x7f3ed019dd00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 >> 172.21.15.100:0/1285510841 conn(0x7f3ed0103e90 msgr2=0x7f3ed0104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 shutdown_connections 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:18.776+0000 7f3ed7821700 1 -- 172.21.15.100:0/1285510841 wait complete. 2024-04-30T23:03:19.322 INFO:teuthology.orchestra.run.smithi100.stdout:mgr is available 2024-04-30T23:03:19.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:19 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1285510841' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-30T23:03:20.535 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-30T23:03:20.536 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f749ea00700 1 Processor -- start 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f749ea00700 1 -- start start 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f749ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f749ea00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74981091b0 con 0x7f74981087b0 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f7497fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:20.537 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f7497fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34850/0 (socket says 172.21.15.100:34850) 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.737+0000 7f7497fff700 1 -- 172.21.15.100:0/3881127694 learned_addr learned my addr 172.21.15.100:0/3881127694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.738+0000 7f7497fff700 1 -- 172.21.15.100:0/3881127694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7498109980 con 0x7f74981087b0 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.738+0000 7f7497fff700 1 --2- 172.21.15.100:0/3881127694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74880098a0 tx=0x7f7488009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3499853d438fb588 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.738+0000 7f7496ffd700 1 -- 172.21.15.100:0/3881127694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7488004160 con 0x7f74981087b0 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.738+0000 7f7496ffd700 1 -- 172.21.15.100:0/3881127694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7488004300 con 0x7f74981087b0 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.738+0000 7f7496ffd700 1 -- 172.21.15.100:0/3881127694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7488011af0 con 0x7f74981087b0 2024-04-30T23:03:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- 172.21.15.100:0/3881127694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 msgr2=0x7f7498108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 --2- 172.21.15.100:0/3881127694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74880098a0 tx=0x7f7488009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- 172.21.15.100:0/3881127694 shutdown_connections 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 --2- 172.21.15.100:0/3881127694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f7498108bc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- 172.21.15.100:0/3881127694 >> 172.21.15.100:0/3881127694 conn(0x7f7498103e30 msgr2=0x7f74981062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- 172.21.15.100:0/3881127694 shutdown_connections 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- 172.21.15.100:0/3881127694 wait complete. 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 Processor -- start 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.739+0000 7f749ea00700 1 -- start start 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f749ea00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f749ea00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f749810cd30 con 0x7f74981087b0 2024-04-30T23:03:20.539 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f7497fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f7497fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34862/0 (socket says 172.21.15.100:34862) 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f7497fff700 1 -- 172.21.15.100:0/940856321 learned_addr learned my addr 172.21.15.100:0/940856321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f7497fff700 1 -- 172.21.15.100:0/940856321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749819e270 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f7497fff700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7488011890 tx=0x7f7488011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.740+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74880039e0 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.741+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7488003b80 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.741+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74880246e0 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.741+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749819e500 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.741+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981a1100 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.741+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f7488022020 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.742+0000 7f74957fa700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 0x7f748003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.742+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7498064d30 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.742+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f748804d720 con 0x7f74981087b0 2024-04-30T23:03:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.742+0000 7f74977fe700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 0x7f748003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.742+0000 7f74977fe700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 0x7f748003bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f748c006fd0 tx=0x7f748c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.747+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f748804d480 con 0x7f74981087b0 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.942+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f749802e7c0 con 0x7f74981087b0 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.944+0000 7f74957fa700 1 -- 172.21.15.100:0/940856321 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f7488024950 con 0x7f74981087b0 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 msgr2=0x7f748003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 0x7f748003bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f748c006fd0 tx=0x7f748c006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 msgr2=0x7f749819dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7488011890 tx=0x7f7488011970 comp rx=0 tx=0).stop 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 shutdown_connections 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f74800395b0 0x7f748003bac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 --2- 172.21.15.100:0/940856321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74981087b0 0x7f749819dd30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 >> 172.21.15.100:0/940856321 conn(0x7f7498103e30 msgr2=0x7f74981942e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 shutdown_connections 2024-04-30T23:03:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:19.946+0000 7f749ea00700 1 -- 172.21.15.100:0/940856321 wait complete. 2024-04-30T23:03:20.542 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling cephadm module... 2024-04-30T23:03:20.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:20 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/940856321' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-30T23:03:21.674 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:21 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3905494977' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-30T23:03:21.931 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: ignoring --setuser ceph since I am not root 2024-04-30T23:03:21.931 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: ignoring --setgroup ceph since I am not root 2024-04-30T23:03:21.931 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:21.802+0000 7ffa24c3e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T23:03:22.232 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:21.990+0000 7ffa24c3e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:22.232 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:22.093+0000 7ffa24c3e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T23:03:22.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f818a4f5700 1 Processor -- start 2024-04-30T23:03:22.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f818a4f5700 1 -- start start 2024-04-30T23:03:22.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f818a4f5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:22.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f818a4f5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f818410a2c0 con 0x7f81841098c0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f8183fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f8183fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34876/0 (socket says 172.21.15.100:34876) 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f8183fff700 1 -- 172.21.15.100:0/2793769032 learned_addr learned my addr 172.21.15.100:0/2793769032 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.119+0000 7f8183fff700 1 -- 172.21.15.100:0/2793769032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818410aa90 con 0x7f81841098c0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f8183fff700 1 --2- 172.21.15.100:0/2793769032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81740098a0 tx=0x7f8174009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f947953fb026682 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f8182ffd700 1 -- 172.21.15.100:0/2793769032 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8174004160 con 0x7f81841098c0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f8182ffd700 1 -- 172.21.15.100:0/2793769032 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8174004300 con 0x7f81841098c0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f8182ffd700 1 -- 172.21.15.100:0/2793769032 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8174011af0 con 0x7f81841098c0 2024-04-30T23:03:22.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f818a4f5700 1 -- 172.21.15.100:0/2793769032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 msgr2=0x7f8184109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.120+0000 7f818a4f5700 1 --2- 172.21.15.100:0/2793769032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81740098a0 tx=0x7f8174009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 -- 172.21.15.100:0/2793769032 shutdown_connections 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 --2- 172.21.15.100:0/2793769032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f8184109cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 -- 172.21.15.100:0/2793769032 >> 172.21.15.100:0/2793769032 conn(0x7f8184104f80 msgr2=0x7f81841073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 -- 172.21.15.100:0/2793769032 shutdown_connections 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 -- 172.21.15.100:0/2793769032 wait complete. 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 Processor -- start 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.121+0000 7f818a4f5700 1 -- start start 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f818a4f5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:22.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f818a4f5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f818410de40 con 0x7f81841098c0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f8183fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f8183fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34878/0 (socket says 172.21.15.100:34878) 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f8183fff700 1 -- 172.21.15.100:0/3905494977 learned_addr learned my addr 172.21.15.100:0/3905494977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f8183fff700 1 -- 172.21.15.100:0/3905494977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818419e280 con 0x7f81841098c0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f8183fff700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8174011890 tx=0x7f8174011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81740039e0 con 0x7f81841098c0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8174003b80 con 0x7f81841098c0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818419e510 con 0x7f81841098c0 2024-04-30T23:03:22.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81740246e0 con 0x7f81841098c0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.122+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81841a1110 con 0x7f81841098c0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.123+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f8174022020 con 0x7f81841098c0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.123+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8184064d30 con 0x7f81841098c0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.124+0000 7f81817fa700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 0x7f816c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.124+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f817404d470 con 0x7f81841098c0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.124+0000 7f81837fe700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 0x7f816c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.124+0000 7f81837fe700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 0x7f816c03ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8178006fd0 tx=0x7f8178006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:22.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.129+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f817404d1d0 con 0x7f81841098c0 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.380+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f81841a1790 con 0x7f81841098c0 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.611+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f817402d770 con 0x7f81841098c0 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.612+0000 7f81817fa700 1 -- 172.21.15.100:0/3905494977 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f817401aa70 con 0x7f81841098c0 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 msgr2=0x7f816c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 0x7f816c03ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8178006fd0 tx=0x7f8178006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 msgr2=0x7f818419dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8174011890 tx=0x7f8174011970 comp rx=0 tx=0).stop 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 shutdown_connections 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f816c039560 0x7f816c03ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 --2- 172.21.15.100:0/3905494977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81841098c0 0x7f818419dd40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 >> 172.21.15.100:0/3905494977 conn(0x7f8184104f80 msgr2=0x7f8184106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 shutdown_connections 2024-04-30T23:03:22.246 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:21.614+0000 7f818a4f5700 1 -- 172.21.15.100:0/3905494977 wait complete. 2024-04-30T23:03:22.495 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:22.411+0000 7ffa24c3e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T23:03:22.495 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:22.500+0000 7ffa24c3e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T23:03:22.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:22 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3905494977' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-30T23:03:22.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:22 smithi100 ceph-mon[29745]: mgrmap e5: x(active, since 6s) 2024-04-30T23:03:23.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:23.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-30T23:03:23.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-30T23:03:23.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-30T23:03:23.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f54f2a700 1 Processor -- start 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f54f2a700 1 -- start start 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f54f2a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f54f2a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5010a2c0 con 0x7f1f501098c0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f4e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f4e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34900/0 (socket says 172.21.15.100:34900) 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.658+0000 7f1f4e59c700 1 -- 172.21.15.100:0/2896870785 learned_addr learned my addr 172.21.15.100:0/2896870785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.659+0000 7f1f4e59c700 1 -- 172.21.15.100:0/2896870785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5010aa90 con 0x7f1f501098c0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.659+0000 7f1f4e59c700 1 --2- 172.21.15.100:0/2896870785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098a0 tx=0x7f1f40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b32bc17d2ffca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.659+0000 7f1f4d59a700 1 -- 172.21.15.100:0/2896870785 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f40004160 con 0x7f1f501098c0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.659+0000 7f1f4d59a700 1 -- 172.21.15.100:0/2896870785 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1f40004300 con 0x7f1f501098c0 2024-04-30T23:03:23.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.659+0000 7f1f4d59a700 1 -- 172.21.15.100:0/2896870785 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f40011af0 con 0x7f1f501098c0 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2896870785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 msgr2=0x7f1f50109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2896870785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098a0 tx=0x7f1f40009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2896870785 shutdown_connections 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2896870785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f50109cd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2896870785 >> 172.21.15.100:0/2896870785 conn(0x7f1f50104f20 msgr2=0x7f1f501073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2896870785 shutdown_connections 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.660+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2896870785 wait complete. 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.661+0000 7f1f54f2a700 1 Processor -- start 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.661+0000 7f1f54f2a700 1 -- start start 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.661+0000 7f1f54f2a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.661+0000 7f1f54f2a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5010de40 con 0x7f1f501098c0 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f4e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f4e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34914/0 (socket says 172.21.15.100:34914) 2024-04-30T23:03:23.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f4e59c700 1 -- 172.21.15.100:0/2842563760 learned_addr learned my addr 172.21.15.100:0/2842563760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f4e59c700 1 -- 172.21.15.100:0/2842563760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5019e260 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f4e59c700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f40011890 tx=0x7f1f40011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f400039e0 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1f40003b80 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f400246e0 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5019e4f0 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.662+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f501a10f0 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.663+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f50064d30 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.663+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f1f40022020 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.664+0000 7f1f3f7fe700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 0x7f1f3803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.664+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f4004d4c0 con 0x7f1f501098c0 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.664+0000 7f1f4dd9b700 1 -- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 msgr2=0x7f1f3803bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.664+0000 7f1f4dd9b700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 0x7f1f3803bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:03:23.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.669+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f4004d220 con 0x7f1f501098c0 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.865+0000 7f1f4dd9b700 1 -- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 msgr2=0x7f1f3803bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.865+0000 7f1f4dd9b700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 0x7f1f3803bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.968+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1f501a1310 con 0x7f1f501098c0 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.969+0000 7f1f3f7fe700 1 -- 172.21.15.100:0/2842563760 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1f501a1310 con 0x7f1f501098c0 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 msgr2=0x7f1f3803bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 0x7f1f3803bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 msgr2=0x7f1f5019dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f40011890 tx=0x7f1f40011970 comp rx=0 tx=0).stop 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 shutdown_connections 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f1f380395b0 0x7f1f3803bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 --2- 172.21.15.100:0/2842563760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f501098c0 0x7f1f5019dd20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 >> 172.21.15.100:0/2842563760 conn(0x7f1f50104f20 msgr2=0x7f1f501057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 shutdown_connections 2024-04-30T23:03:23.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:22.971+0000 7f1f54f2a700 1 -- 172.21.15.100:0/2842563760 wait complete. 2024-04-30T23:03:23.526 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-04-30T23:03:23.526 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 5... 2024-04-30T23:03:23.888 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2842563760' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-30T23:03:23.889 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:23 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:23.716+0000 7ffa24c3e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T23:03:23.889 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:23 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:23.893+0000 7ffa24c3e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:24.170 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:24.069+0000 7ffa24c3e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T23:03:24.449 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:24.360+0000 7ffa24c3e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T23:03:24.449 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:24.454+0000 7ffa24c3e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T23:03:24.817 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:24.656+0000 7ffa24c3e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T23:03:25.317 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:24.852+0000 7ffa24c3e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:25.817 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:25.446+0000 7ffa24c3e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T23:03:26.164 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:25.870+0000 7ffa24c3e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T23:03:26.165 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:25.966+0000 7ffa24c3e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T23:03:26.165 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:26.169+0000 7ffa24c3e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T23:03:26.974 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:26.698+0000 7ffa24c3e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T23:03:26.974 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:26.795+0000 7ffa24c3e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T23:03:27.280 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:27.050+0000 7ffa24c3e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T23:03:27.280 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:27.187+0000 7ffa24c3e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T23:03:27.280 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:27.285+0000 7ffa24c3e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T23:03:27.547 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:27.403+0000 7ffa24c3e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:27.817 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:27.707+0000 7ffa24c3e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T23:03:28.567 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:28.306+0000 7ffa24c3e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T23:03:28.567 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:28.522+0000 7ffa24c3e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: Active manager daemon x restarted 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: Activating manager daemon x 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: osdmap e2: 0 total, 0 up, 0 in 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: mgrmap e6: x(active, starting, since 0.00402531s) 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: Manager daemon x is now available 2024-04-30T23:03:29.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:29.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:29.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:29.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:28 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: Found migration_current of "None". Setting to last migration. 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:29.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:29 smithi100 ceph-mon[29745]: mgrmap e7: x(active, since 1.0061s) 2024-04-30T23:03:30.123 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.968+0000 7f3f205f9700 1 Processor -- start 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.968+0000 7f3f205f9700 1 -- start start 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f205f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f205f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18108540 con 0x7f3f18107b60 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1e395700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1e395700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39012/0 (socket says 172.21.15.100:39012) 2024-04-30T23:03:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1e395700 1 -- 172.21.15.100:0/1538284774 learned_addr learned my addr 172.21.15.100:0/1538284774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:30.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1e395700 1 -- 172.21.15.100:0/1538284774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1810ab60 con 0x7f3f18107b60 2024-04-30T23:03:30.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1e395700 1 --2- 172.21.15.100:0/1538284774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f080098a0 tx=0x7f3f08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2195b7485211788f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.969+0000 7f3f1d393700 1 -- 172.21.15.100:0/1538284774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f08004160 con 0x7f3f18107b60 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.970+0000 7f3f1d393700 1 -- 172.21.15.100:0/1538284774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f08004300 con 0x7f3f18107b60 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.970+0000 7f3f1d393700 1 -- 172.21.15.100:0/1538284774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f08011af0 con 0x7f3f18107b60 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 -- 172.21.15.100:0/1538284774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 msgr2=0x7f3f18107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 --2- 172.21.15.100:0/1538284774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f080098a0 tx=0x7f3f08009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 -- 172.21.15.100:0/1538284774 shutdown_connections 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 --2- 172.21.15.100:0/1538284774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f18107f70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 -- 172.21.15.100:0/1538284774 >> 172.21.15.100:0/1538284774 conn(0x7f3f18103570 msgr2=0x7f3f181059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 -- 172.21.15.100:0/1538284774 shutdown_connections 2024-04-30T23:03:30.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.971+0000 7f3f205f9700 1 -- 172.21.15.100:0/1538284774 wait complete. 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f205f9700 1 Processor -- start 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f205f9700 1 -- start start 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f205f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f205f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810dd90 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f1e395700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f1e395700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39014/0 (socket says 172.21.15.100:39014) 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f1e395700 1 -- 172.21.15.100:0/1519364797 learned_addr learned my addr 172.21.15.100:0/1519364797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f1e395700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1810a820 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.972+0000 7f3f1e395700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009fb0 tx=0x7f3f08011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.973+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f080036a0 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.973+0000 7f3f205f9700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f18108a70 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.973+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f08024440 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.973+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0801a5c0 con 0x7f3f18107b60 2024-04-30T23:03:30.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.973+0000 7f3f205f9700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f18108f50 con 0x7f3f18107b60 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f3f0801a880 con 0x7f3f18107b60 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f0f7fe700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3f18064d30 con 0x7f3f04039560 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f0804e4e0 con 0x7f3f18107b60 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f1db94700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:23.974+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:24.175+0000 7f3f1db94700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:24.175+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:24.576+0000 7f3f1db94700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:24.576+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:25.377+0000 7f3f1db94700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:25.377+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-30T23:03:30.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:26.978+0000 7f3f1db94700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2011872270 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:26.978+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:28.526+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f3f0802d910 con 0x7f3f18107b60 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:28.526+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 msgr2=0x7f3f0403ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:28.526+0000 7f3f0f7fe700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.527+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f3f08024980 con 0x7f3f18107b60 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.527+0000 7f3f0f7fe700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 0x7f3f0403f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.527+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3f18064d30 con 0x7f3f0403ccb0 2024-04-30T23:03:30.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.527+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 0x7f3f0403f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.528+0000 7f3f1db94700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 0x7f3f0403f0d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f14003a10 tx=0x7f3f14009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.529+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3f18064d30 con 0x7f3f0403ccb0 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3f1810df10 con 0x7f3f0403ccb0 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0f7fe700 1 -- 172.21.15.100:0/1519364797 <== mgr.14120 v2:172.21.15.100:6800/642565197 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f3f1810df10 con 0x7f3f0403ccb0 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 msgr2=0x7f3f0403f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 0x7f3f0403f0d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f14003a10 tx=0x7f3f14009290 comp rx=0 tx=0).stop 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 msgr2=0x7f3f1810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009fb0 tx=0x7f3f08011890 comp rx=0 tx=0).stop 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 shutdown_connections 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f18107b60 0x7f3f1810a2e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f3f0403ccb0 0x7f3f0403f0d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 --2- 172.21.15.100:0/1519364797 >> [v2:172.21.15.100:6800/2011872270,v1:172.21.15.100:6801/2011872270] conn(0x7f3f04039560 0x7f3f0403ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:30.139 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 >> 172.21.15.100:0/1519364797 conn(0x7f3f18103570 msgr2=0x7f3f18103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:30.139 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.537+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 shutdown_connections 2024-04-30T23:03:30.139 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:29.538+0000 7f3f0d7fa700 1 -- 172.21.15.100:0/1519364797 wait complete. 2024-04-30T23:03:30.139 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 5 is available 2024-04-30T23:03:30.139 INFO:teuthology.orchestra.run.smithi100.stdout:Setting orchestrator backend to cephadm... 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:29] ENGINE Bus STARTING 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:29] ENGINE Serving on https://172.21.15.100:7150 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:29] ENGINE Serving on http://172.21.15.100:8765 2024-04-30T23:03:30.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:29] ENGINE Bus STARTED 2024-04-30T23:03:30.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:30 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:31.360 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.555+0000 7f0413d0b700 1 Processor -- start 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.555+0000 7f0413d0b700 1 -- start start 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0413d0b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0413d0b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f040c07cd60 con 0x7f040c10a3d0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0411aa7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0411aa7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39092/0 (socket says 172.21.15.100:39092) 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0411aa7700 1 -- 172.21.15.100:0/4207542484 learned_addr learned my addr 172.21.15.100:0/4207542484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0411aa7700 1 -- 172.21.15.100:0/4207542484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c10cd30 con 0x7f040c10a3d0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0411aa7700 1 --2- 172.21.15.100:0/4207542484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e80 tx=0x7f040800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0eada7951bea71 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.556+0000 7f0410aa5700 1 -- 172.21.15.100:0/4207542484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408017070 con 0x7f040c10a3d0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0410aa5700 1 -- 172.21.15.100:0/4207542484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f040800b8c0 con 0x7f040c10a3d0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0410aa5700 1 -- 172.21.15.100:0/4207542484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408004490 con 0x7f040c10a3d0 2024-04-30T23:03:31.361 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 -- 172.21.15.100:0/4207542484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 msgr2=0x7f040c10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4207542484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e80 tx=0x7f040800b330 comp rx=0 tx=0).stop 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 -- 172.21.15.100:0/4207542484 shutdown_connections 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4207542484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c10a3d0 0x7f040c10c7f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 -- 172.21.15.100:0/4207542484 >> 172.21.15.100:0/4207542484 conn(0x7f040c103e10 msgr2=0x7f040c106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 -- 172.21.15.100:0/4207542484 shutdown_connections 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.557+0000 7f0413d0b700 1 -- 172.21.15.100:0/4207542484 wait complete. 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0413d0b700 1 Processor -- start 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0413d0b700 1 -- start start 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0413d0b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0413d0b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f040c10dc90 con 0x7f040c19dcd0 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0411aa7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:31.362 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0411aa7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39108/0 (socket says 172.21.15.100:39108) 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.558+0000 7f0411aa7700 1 -- 172.21.15.100:0/4073163391 learned_addr learned my addr 172.21.15.100:0/4073163391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0411aa7700 1 -- 172.21.15.100:0/4073163391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c19e660 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0411aa7700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408021020 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c19e8f0 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f040801d470 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408017040 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.559+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a1490 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.560+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f0408024020 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.560+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c064d30 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.560+0000 7f0402ffd700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 0x7f03f803b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.560+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f040800f050 con 0x7f040c19dcd0 2024-04-30T23:03:31.363 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.560+0000 7f04112a6700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 0x7f03f803b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.561+0000 7f04112a6700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 0x7f03f803b960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03fc006fd0 tx=0x7f03fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.566+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f040802b020 con 0x7f040c19dcd0 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.584+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f0408012ae0 con 0x7f040c19dcd0 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.781+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f040c02e9b0 con 0x7f03f8039450 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.787+0000 7f0402ffd700 1 -- 172.21.15.100:0/4073163391 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f03fc00a040 con 0x7f03f8039450 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 msgr2=0x7f03f803b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 0x7f03f803b960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03fc006fd0 tx=0x7f03fc006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 msgr2=0x7f040c19e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040800bd50 comp rx=0 tx=0).stop 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 shutdown_connections 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f03f8039450 0x7f03f803b960 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 --2- 172.21.15.100:0/4073163391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f040c19dcd0 0x7f040c19e0e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 >> 172.21.15.100:0/4073163391 conn(0x7f040c103e10 msgr2=0x7f040c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 shutdown_connections 2024-04-30T23:03:31.364 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:30.789+0000 7f0413d0b700 1 -- 172.21.15.100:0/4073163391 wait complete. 2024-04-30T23:03:31.671 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:31 smithi100 ceph-mon[29745]: mgrmap e8: x(active, since 2s) 2024-04-30T23:03:31.671 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:31 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:31.671 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:31 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.798+0000 7fd85a306700 1 Processor -- start 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.798+0000 7fd85a306700 1 -- start start 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.798+0000 7fd85a306700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.798+0000 7fd85a306700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd85407d5b0 con 0x7fd85410a450 2024-04-30T23:03:32.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd853fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd853fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39112/0 (socket says 172.21.15.100:39112) 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd853fff700 1 -- 172.21.15.100:0/3607650476 learned_addr learned my addr 172.21.15.100:0/3607650476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd853fff700 1 -- 172.21.15.100:0/3607650476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85410cdb0 con 0x7fd85410a450 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd853fff700 1 --2- 172.21.15.100:0/3607650476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8440098a0 tx=0x7fd844009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f803fb59bac9c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd852ffd700 1 -- 172.21.15.100:0/3607650476 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844004160 con 0x7fd85410a450 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd852ffd700 1 -- 172.21.15.100:0/3607650476 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd844004300 con 0x7fd85410a450 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.799+0000 7fd852ffd700 1 -- 172.21.15.100:0/3607650476 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844011af0 con 0x7fd85410a450 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 -- 172.21.15.100:0/3607650476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 msgr2=0x7fd85410c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 --2- 172.21.15.100:0/3607650476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8440098a0 tx=0x7fd844009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 -- 172.21.15.100:0/3607650476 shutdown_connections 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 --2- 172.21.15.100:0/3607650476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85410c870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 -- 172.21.15.100:0/3607650476 >> 172.21.15.100:0/3607650476 conn(0x7fd854103df0 msgr2=0x7fd8541062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 -- 172.21.15.100:0/3607650476 shutdown_connections 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.800+0000 7fd85a306700 1 -- 172.21.15.100:0/3607650476 wait complete. 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.801+0000 7fd85a306700 1 Processor -- start 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.801+0000 7fd85a306700 1 -- start start 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.801+0000 7fd85a306700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.801+0000 7fd85a306700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410dcb0 con 0x7fd85410a450 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd853fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd853fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39128/0 (socket says 172.21.15.100:39128) 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd853fff700 1 -- 172.21.15.100:0/515830757 learned_addr learned my addr 172.21.15.100:0/515830757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd853fff700 1 -- 172.21.15.100:0/515830757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85419e1d0 con 0x7fd85410a450 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd853fff700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd844009fb0 tx=0x7fd844011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440036a0 con 0x7fd85410a450 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85419e460 con 0x7fd85410a450 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd84401a430 con 0x7fd85410a450 2024-04-30T23:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844019550 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.802+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8541a1070 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.803+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd844019800 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.803+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd854064d30 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.803+0000 7fd8517fa700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 0x7fd83c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.803+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd84404d900 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.803+0000 7fd8537fe700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 0x7fd83c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.804+0000 7fd8537fe700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 0x7fd83c03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:31.809+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd844020240 con 0x7fd85410a450 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.004+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd854104df0 con 0x7fd83c0395b0 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.005+0000 7fd8517fa700 1 -- 172.21.15.100:0/515830757 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd854104df0 con 0x7fd83c0395b0 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 msgr2=0x7fd83c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 0x7fd83c03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 msgr2=0x7fd85419dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:32.569 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd844009fb0 tx=0x7fd844011940 comp rx=0 tx=0).stop 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 shutdown_connections 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd83c0395b0 0x7fd83c03bac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 --2- 172.21.15.100:0/515830757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd85410a450 0x7fd85419dc90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 >> 172.21.15.100:0/515830757 conn(0x7fd854103df0 msgr2=0x7fd8541046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 shutdown_connections 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:32.007+0000 7fd85a306700 1 -- 172.21.15.100:0/515830757 wait complete. 2024-04-30T23:03:32.570 INFO:teuthology.orchestra.run.smithi100.stdout:Generating ssh key... 2024-04-30T23:03:32.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:32 smithi100 ceph-mon[29745]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:33.797 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-mon[29745]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:33.797 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: Generating public/private rsa key pair. 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: Your identification has been saved in /tmp/tmp84f4j1w2/key. 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: Your public key has been saved in /tmp/tmp84f4j1w2/key.pub. 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: The key fingerprint is: 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: SHA256:yRVNQ1jmhjtsmya7K+ZY3bELmejFUCTMi+qtdLlyjM8 ceph-a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: The key's randomart image is: 2024-04-30T23:03:33.798 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: +---[RSA 3072]----+ 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | o. . .** | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | oo .=.. | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | . .. o o | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | . .o + o | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | . . S * | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | . . = = * | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | ..+o o O * | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | .+o+=o. = . | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: | .=Eoo.+o. | 2024-04-30T23:03:33.799 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: +----[SHA256]-----+ 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.008+0000 7f7776c0e700 1 Processor -- start 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.008+0000 7f7776c0e700 1 -- start start 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.008+0000 7f7776c0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.008+0000 7f7776c0e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7770108540 con 0x7f7770107b60 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.008+0000 7f77749aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:34.064 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77749aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39136/0 (socket says 172.21.15.100:39136) 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77749aa700 1 -- 172.21.15.100:0/1174072047 learned_addr learned my addr 172.21.15.100:0/1174072047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77749aa700 1 -- 172.21.15.100:0/1174072047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777010ab60 con 0x7f7770107b60 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77749aa700 1 --2- 172.21.15.100:0/1174072047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f776c0098a0 tx=0x7f776c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa7bd827c77f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77677fe700 1 -- 172.21.15.100:0/1174072047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776c004160 con 0x7f7770107b60 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77677fe700 1 -- 172.21.15.100:0/1174072047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f776c004300 con 0x7f7770107b60 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.009+0000 7f77677fe700 1 -- 172.21.15.100:0/1174072047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776c011af0 con 0x7f7770107b60 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 -- 172.21.15.100:0/1174072047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 msgr2=0x7f7770107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 --2- 172.21.15.100:0/1174072047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f776c0098a0 tx=0x7f776c009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 -- 172.21.15.100:0/1174072047 shutdown_connections 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 --2- 172.21.15.100:0/1174072047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f7770107f70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 -- 172.21.15.100:0/1174072047 >> 172.21.15.100:0/1174072047 conn(0x7f7770103570 msgr2=0x7f77701059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 -- 172.21.15.100:0/1174072047 shutdown_connections 2024-04-30T23:03:34.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.010+0000 7f7776c0e700 1 -- 172.21.15.100:0/1174072047 wait complete. 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7776c0e700 1 Processor -- start 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7776c0e700 1 -- start start 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7776c0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7776c0e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f777010dd90 con 0x7f7770107b60 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f77749aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f77749aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39138/0 (socket says 172.21.15.100:39138) 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f77749aa700 1 -- 172.21.15.100:0/3316357230 learned_addr learned my addr 172.21.15.100:0/3316357230 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f77749aa700 1 -- 172.21.15.100:0/3316357230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777019e460 con 0x7f7770107b60 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f77749aa700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f776c009fb0 tx=0x7f776c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776c0036a0 con 0x7f7770107b60 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.011+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f776c024440 con 0x7f7770107b60 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.012+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777019e6f0 con 0x7f7770107b60 2024-04-30T23:03:34.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.012+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776c01a5c0 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.012+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77701a1300 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.013+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770064d30 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.013+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f776c01a830 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.013+0000 7f7765ffb700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 0x7f775803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.013+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f776c04d7b0 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.013+0000 7f7767fff700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 0x7f775803bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.014+0000 7f7767fff700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 0x7f775803bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7760006fd0 tx=0x7f7760006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.018+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f776c019c70 con 0x7f7770107b60 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.218+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f77701046b0 con 0x7f77580395b0 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.500+0000 7f7765ffb700 1 -- 172.21.15.100:0/3316357230 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f77701046b0 con 0x7f77580395b0 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 msgr2=0x7f775803bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 0x7f775803bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7760006fd0 tx=0x7f7760006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 msgr2=0x7f777019df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:34.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f776c009fb0 tx=0x7f776c011890 comp rx=0 tx=0).stop 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 shutdown_connections 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f77580395b0 0x7f775803bac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 --2- 172.21.15.100:0/3316357230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7770107b60 0x7f777019df20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 >> 172.21.15.100:0/3316357230 conn(0x7f7770103570 msgr2=0x7f7770103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.502+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 shutdown_connections 2024-04-30T23:03:34.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:33.503+0000 7f7776c0e700 1 -- 172.21.15.100:0/3316357230 wait complete. 2024-04-30T23:03:34.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:34 smithi100 ceph-mon[29745]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:34.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:34 smithi100 ceph-mon[29745]: Generating ssh key... 2024-04-30T23:03:35.289 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.523+0000 7f9229571700 1 Processor -- start 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.523+0000 7f9229571700 1 -- start start 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.523+0000 7f9229571700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.523+0000 7f9229571700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9224109170 con 0x7f9224108770 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57948/0 (socket says 172.21.15.100:57948) 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f9222ffd700 1 -- 172.21.15.100:0/1848415474 learned_addr learned my addr 172.21.15.100:0/1848415474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f9222ffd700 1 -- 172.21.15.100:0/1848415474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9224109940 con 0x7f9224108770 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f9222ffd700 1 --2- 172.21.15.100:0/1848415474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9214009e80 tx=0x7f921400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a2eab8f37100f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f92227fc700 1 -- 172.21.15.100:0/1848415474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214017070 con 0x7f9224108770 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f92227fc700 1 -- 172.21.15.100:0/1848415474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f921400b8c0 con 0x7f9224108770 2024-04-30T23:03:35.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.524+0000 7f92227fc700 1 -- 172.21.15.100:0/1848415474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214004490 con 0x7f9224108770 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 -- 172.21.15.100:0/1848415474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 msgr2=0x7f9224108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 --2- 172.21.15.100:0/1848415474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9214009e80 tx=0x7f921400b330 comp rx=0 tx=0).stop 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 -- 172.21.15.100:0/1848415474 shutdown_connections 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 --2- 172.21.15.100:0/1848415474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f9224108b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 -- 172.21.15.100:0/1848415474 >> 172.21.15.100:0/1848415474 conn(0x7f9224103e10 msgr2=0x7f9224106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 -- 172.21.15.100:0/1848415474 shutdown_connections 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.525+0000 7f9229571700 1 -- 172.21.15.100:0/1848415474 wait complete. 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.526+0000 7f9229571700 1 Processor -- start 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.526+0000 7f9229571700 1 -- start start 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.526+0000 7f9229571700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.526+0000 7f9229571700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f922410ccf0 con 0x7f9224108770 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57958/0 (socket says 172.21.15.100:57958) 2024-04-30T23:03:35.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9222ffd700 1 -- 172.21.15.100:0/3157652490 learned_addr learned my addr 172.21.15.100:0/3157652490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9222ffd700 1 -- 172.21.15.100:0/3157652490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922419d110 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9222ffd700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9214009fd0 tx=0x7f921400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214020020 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9214012430 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922419d3a0 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214017040 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.527+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922419ffb0 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.528+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f9214023020 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.528+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224064d30 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.528+0000 7f9220ff9700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 0x7f921003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.528+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f921400f050 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.528+0000 7f921a7fc700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 0x7f921003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.529+0000 7f921a7fc700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 0x7f921003bac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f920c006fd0 tx=0x7f920c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.534+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f921402a020 con 0x7f9224108770 2024-04-30T23:03:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.732+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f9224104d40 con 0x7f92100395b0 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.733+0000 7f9220ff9700 1 -- 172.21.15.100:0/3157652490 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f9224104d40 con 0x7f92100395b0 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 msgr2=0x7f921003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 0x7f921003bac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f920c006fd0 tx=0x7f920c006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 msgr2=0x7f922419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9214009fd0 tx=0x7f921400bd50 comp rx=0 tx=0).stop 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 shutdown_connections 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f92100395b0 0x7f921003bac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 --2- 172.21.15.100:0/3157652490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9224108770 0x7f922419cbd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 >> 172.21.15.100:0/3157652490 conn(0x7f9224103e10 msgr2=0x7f9224104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 shutdown_connections 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:34.735+0000 7f9229571700 1 -- 172.21.15.100:0/3157652490 wait complete. 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:Adding key to root@localhost authorized_keys... 2024-04-30T23:03:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:Adding host smithi100... 2024-04-30T23:03:36.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:35 smithi100 ceph-mon[29745]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:36.931 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:36 smithi100 ceph-mon[29745]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:36.931 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:36 smithi100 ceph-mon[29745]: Deploying cephadm binary to smithi100 2024-04-30T23:03:40.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Added host 'smithi100' with addr '172.21.15.100' 2024-04-30T23:03:40.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c56763700 1 Processor -- start 2024-04-30T23:03:40.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c56763700 1 -- start start 2024-04-30T23:03:40.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c56763700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:40.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c56763700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5010a2c0 con 0x7f5c501098c0 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57972/0 (socket says 172.21.15.100:57972) 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.888+0000 7f5c4ffff700 1 -- 172.21.15.100:0/3490331746 learned_addr learned my addr 172.21.15.100:0/3490331746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.889+0000 7f5c4ffff700 1 -- 172.21.15.100:0/3490331746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5010aa90 con 0x7f5c501098c0 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.889+0000 7f5c4ffff700 1 --2- 172.21.15.100:0/3490331746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c400098a0 tx=0x7f5c40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510ec693fe1be0a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:40.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.889+0000 7f5c4effd700 1 -- 172.21.15.100:0/3490331746 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c40004160 con 0x7f5c501098c0 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.889+0000 7f5c4effd700 1 -- 172.21.15.100:0/3490331746 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5c40004300 con 0x7f5c501098c0 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.889+0000 7f5c4effd700 1 -- 172.21.15.100:0/3490331746 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c40011af0 con 0x7f5c501098c0 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- 172.21.15.100:0/3490331746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 msgr2=0x7f5c50109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 --2- 172.21.15.100:0/3490331746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c400098a0 tx=0x7f5c40009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- 172.21.15.100:0/3490331746 shutdown_connections 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 --2- 172.21.15.100:0/3490331746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c50109cd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- 172.21.15.100:0/3490331746 >> 172.21.15.100:0/3490331746 conn(0x7f5c50104f80 msgr2=0x7f5c501073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- 172.21.15.100:0/3490331746 shutdown_connections 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- 172.21.15.100:0/3490331746 wait complete. 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 Processor -- start 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.890+0000 7f5c56763700 1 -- start start 2024-04-30T23:03:40.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c56763700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c56763700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5010de40 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57988/0 (socket says 172.21.15.100:57988) 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4ffff700 1 -- 172.21.15.100:0/985781546 learned_addr learned my addr 172.21.15.100:0/985781546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4ffff700 1 -- 172.21.15.100:0/985781546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5007f7a0 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4ffff700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c40011890 tx=0x7f5c40011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c400039e0 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5c40003b80 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5007d9f0 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c400246e0 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.891+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5007ded0 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.892+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f5c40022020 con 0x7f5c501098c0 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.892+0000 7f5c4d7fa700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 0x7f5c3803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:40.893 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.892+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c50064d30 con 0x7f5c501098c0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.893+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5c4004daf0 con 0x7f5c501098c0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.893+0000 7f5c4f7fe700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 0x7f5c3803bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.893+0000 7f5c4f7fe700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 0x7f5c3803bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c44006fd0 tx=0x7f5c44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:35.898+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5c400174d0 con 0x7f5c501098c0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:36.104+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}) -- 0x7f5c5007e680 con 0x7f5c380395b0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.169+0000 7f5c4d7fa700 1 -- 172.21.15.100:0/985781546 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5c5007e680 con 0x7f5c380395b0 2024-04-30T23:03:40.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 msgr2=0x7f5c3803bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 0x7f5c3803bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c44006fd0 tx=0x7f5c44006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 msgr2=0x7f5c5007f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c40011890 tx=0x7f5c40011970 comp rx=0 tx=0).stop 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 shutdown_connections 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5c380395b0 0x7f5c3803bac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 --2- 172.21.15.100:0/985781546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c501098c0 0x7f5c5007f260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 >> 172.21.15.100:0/985781546 conn(0x7f5c50104f80 msgr2=0x7f5c50106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 shutdown_connections 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:40.172+0000 7f5c56763700 1 -- 172.21.15.100:0/985781546 wait complete. 2024-04-30T23:03:40.895 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mon service... 2024-04-30T23:03:41.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:41 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:41 smithi100 ceph-mon[29745]: Added host smithi100 2024-04-30T23:03:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:41 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:42.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-30T23:03:42.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.334+0000 7fea0ba98700 1 Processor -- start 2024-04-30T23:03:42.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.334+0000 7fea0ba98700 1 -- start start 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.334+0000 7fea0ba98700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.334+0000 7fea0ba98700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea0407d670 con 0x7fea0410a390 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.334+0000 7fea09834700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea09834700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57994/0 (socket says 172.21.15.100:57994) 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea09834700 1 -- 172.21.15.100:0/530185121 learned_addr learned my addr 172.21.15.100:0/530185121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea09834700 1 -- 172.21.15.100:0/530185121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0410ccf0 con 0x7fea0410a390 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea09834700 1 --2- 172.21.15.100:0/530185121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea000098a0 tx=0x7fea00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaa84db154989b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea08832700 1 -- 172.21.15.100:0/530185121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00004160 con 0x7fea0410a390 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea08832700 1 -- 172.21.15.100:0/530185121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fea00004300 con 0x7fea0410a390 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.335+0000 7fea08832700 1 -- 172.21.15.100:0/530185121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00011af0 con 0x7fea0410a390 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 -- 172.21.15.100:0/530185121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 msgr2=0x7fea0410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 --2- 172.21.15.100:0/530185121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea000098a0 tx=0x7fea00009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 -- 172.21.15.100:0/530185121 shutdown_connections 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 --2- 172.21.15.100:0/530185121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea0410c7b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 -- 172.21.15.100:0/530185121 >> 172.21.15.100:0/530185121 conn(0x7fea04103e30 msgr2=0x7fea041062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 -- 172.21.15.100:0/530185121 shutdown_connections 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.336+0000 7fea0ba98700 1 -- 172.21.15.100:0/530185121 wait complete. 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea0ba98700 1 Processor -- start 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea0ba98700 1 -- start start 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea0ba98700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea0ba98700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea0410dcb0 con 0x7fea0410a390 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea09834700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea09834700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58002/0 (socket says 172.21.15.100:58002) 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea09834700 1 -- 172.21.15.100:0/4100408961 learned_addr learned my addr 172.21.15.100:0/4100408961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea09834700 1 -- 172.21.15.100:0/4100408961 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0410a050 con 0x7fea0410a390 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fea09834700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea00009fb0 tx=0x7fea00011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.337+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea000036a0 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.338+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea041082a0 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.338+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fea0001a430 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.338+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00019550 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.338+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea04108780 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fea00019850 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea04064d30 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fe9faffd700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 0x7fe9f003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea0004db90 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fea09033700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 0x7fe9f003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.339+0000 7fea09033700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 0x7fe9f003ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4006fd0 tx=0x7fe9f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.344+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fea00023c90 con 0x7fea0410a390 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.592+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fea04108f30 con 0x7fe9f0039560 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.600+0000 7fe9faffd700 1 -- 172.21.15.100:0/4100408961 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fea04108f30 con 0x7fe9f0039560 2024-04-30T23:03:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 msgr2=0x7fe9f003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 0x7fe9f003ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4006fd0 tx=0x7fe9f4006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 msgr2=0x7fea04109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea00009fb0 tx=0x7fea00011940 comp rx=0 tx=0).stop 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 shutdown_connections 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fe9f0039560 0x7fe9f003ba70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 --2- 172.21.15.100:0/4100408961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea0410a390 0x7fea04109b10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 >> 172.21.15.100:0/4100408961 conn(0x7fea04103e30 msgr2=0x7fea04104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 shutdown_connections 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:41.602+0000 7fea0ba98700 1 -- 172.21.15.100:0/4100408961 wait complete. 2024-04-30T23:03:42.318 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mgr service... 2024-04-30T23:03:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:42 smithi100 ceph-mon[29745]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:42 smithi100 ceph-mon[29745]: Saving service mon spec with placement count:5 2024-04-30T23:03:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:42 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19fba83700 1 Processor -- start 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19fba83700 1 -- start start 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19fba83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19fba83700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4109170 con 0x7f19f4108770 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19f981f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:43.775 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19f981f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58004/0 (socket says 172.21.15.100:58004) 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19f981f700 1 -- 172.21.15.100:0/1084795255 learned_addr learned my addr 172.21.15.100:0/1084795255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.802+0000 7f19f981f700 1 -- 172.21.15.100:0/1084795255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4109940 con 0x7f19f4108770 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.803+0000 7f19f981f700 1 --2- 172.21.15.100:0/1084795255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19f00098a0 tx=0x7f19f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b4a95f10e4e646 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.803+0000 7f19f881d700 1 -- 172.21.15.100:0/1084795255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0004160 con 0x7f19f4108770 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.803+0000 7f19f881d700 1 -- 172.21.15.100:0/1084795255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f19f0004300 con 0x7f19f4108770 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.803+0000 7f19f881d700 1 -- 172.21.15.100:0/1084795255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0011af0 con 0x7f19f4108770 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- 172.21.15.100:0/1084795255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 msgr2=0x7f19f4108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 --2- 172.21.15.100:0/1084795255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19f00098a0 tx=0x7f19f0009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- 172.21.15.100:0/1084795255 shutdown_connections 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 --2- 172.21.15.100:0/1084795255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f4108b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:43.776 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- 172.21.15.100:0/1084795255 >> 172.21.15.100:0/1084795255 conn(0x7f19f4103e10 msgr2=0x7f19f4106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:43.777 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- 172.21.15.100:0/1084795255 shutdown_connections 2024-04-30T23:03:43.777 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- 172.21.15.100:0/1084795255 wait complete. 2024-04-30T23:03:43.777 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 Processor -- start 2024-04-30T23:03:43.777 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.804+0000 7f19fba83700 1 -- start start 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19fba83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19fba83700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19f410ccf0 con 0x7f19f4108770 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19f981f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19f981f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58010/0 (socket says 172.21.15.100:58010) 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19f981f700 1 -- 172.21.15.100:0/1318265067 learned_addr learned my addr 172.21.15.100:0/1318265067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19f981f700 1 -- 172.21.15.100:0/1318265067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f407ce10 con 0x7f19f4108770 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19f981f700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009fb0 tx=0x7f19f0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:43.778 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f00036a0 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f19f0003cd0 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41a0a80 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f001a430 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.805+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a0f00 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.806+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f19f001a6f0 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.806+0000 7f19eaffd700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 0x7f19e003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.806+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f19f004e770 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.806+0000 7f19f901e700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 0x7f19e003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.806+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f4064d30 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.807+0000 7f19f901e700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 0x7f19e003ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:42.812+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f19f0020240 con 0x7f19f4108770 2024-04-30T23:03:43.779 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.026+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f19f4104d60 con 0x7f19e0039560 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.032+0000 7f19eaffd700 1 -- 172.21.15.100:0/1318265067 <== mgr.14120 v2:172.21.15.100:6800/642565197 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f19f4104d60 con 0x7f19e0039560 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 msgr2=0x7f19e003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 0x7f19e003ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 msgr2=0x7f19f407c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009fb0 tx=0x7f19f0011890 comp rx=0 tx=0).stop 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 shutdown_connections 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f19e0039560 0x7f19e003ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 --2- 172.21.15.100:0/1318265067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19f4108770 0x7f19f407c8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 >> 172.21.15.100:0/1318265067 conn(0x7f19f4103e10 msgr2=0x7f19f4104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 shutdown_connections 2024-04-30T23:03:43.780 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:43.034+0000 7f19fba83700 1 -- 172.21.15.100:0/1318265067 wait complete. 2024-04-30T23:03:44.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:44 smithi100 ceph-mon[29745]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:03:44.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:44 smithi100 ceph-mon[29745]: Saving service mgr spec with placement count:2 2024-04-30T23:03:44.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:44 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:45.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.399+0000 7f8280669700 1 Processor -- start 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.399+0000 7f8280669700 1 -- start start 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f8280669700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f8280669700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8278109170 con 0x7f8278108770 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827e405700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827e405700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57654/0 (socket says 172.21.15.100:57654) 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827e405700 1 -- 172.21.15.100:0/3137837008 learned_addr learned my addr 172.21.15.100:0/3137837008 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827e405700 1 -- 172.21.15.100:0/3137837008 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278109940 con 0x7f8278108770 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827e405700 1 --2- 172.21.15.100:0/3137837008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82680098a0 tx=0x7f8268009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c12cd6b1cc201f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:45.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827d403700 1 -- 172.21.15.100:0/3137837008 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8268004160 con 0x7f8278108770 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827d403700 1 -- 172.21.15.100:0/3137837008 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8268004300 con 0x7f8278108770 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.400+0000 7f827d403700 1 -- 172.21.15.100:0/3137837008 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8268011af0 con 0x7f8278108770 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 -- 172.21.15.100:0/3137837008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 msgr2=0x7f8278108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 --2- 172.21.15.100:0/3137837008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82680098a0 tx=0x7f8268009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 -- 172.21.15.100:0/3137837008 shutdown_connections 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 --2- 172.21.15.100:0/3137837008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f8278108b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:45.303 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 -- 172.21.15.100:0/3137837008 >> 172.21.15.100:0/3137837008 conn(0x7f8278103e10 msgr2=0x7f8278106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 -- 172.21.15.100:0/3137837008 shutdown_connections 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.401+0000 7f8280669700 1 -- 172.21.15.100:0/3137837008 wait complete. 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f8280669700 1 Processor -- start 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f8280669700 1 -- start start 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f8280669700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f8280669700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f827810ccf0 con 0x7f8278108770 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f827e405700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f827e405700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57668/0 (socket says 172.21.15.100:57668) 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f827e405700 1 -- 172.21.15.100:0/768960616 learned_addr learned my addr 172.21.15.100:0/768960616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.402+0000 7f827e405700 1 -- 172.21.15.100:0/768960616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827807ce10 con 0x7f8278108770 2024-04-30T23:03:45.304 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f827e405700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8268009fb0 tx=0x7f8268011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82680036a0 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8268003cd0 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82781a0aa0 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826801a430 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.403+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a0f20 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.404+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f826801a6f0 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.404+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8278064d30 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.404+0000 7f826f7fe700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 0x7f826403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.404+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f826804d7c0 con 0x7f8278108770 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.404+0000 7f827dc04700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 0x7f826403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:45.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.405+0000 7f827dc04700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 0x7f826403ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.409+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f826800fdd0 con 0x7f8278108770 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.608+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f82781a1780 con 0x7f8278108770 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.611+0000 7f826f7fe700 1 -- 172.21.15.100:0/768960616 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f8268024440 con 0x7f8278108770 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 msgr2=0x7f826403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 0x7f826403ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 msgr2=0x7f827807c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8268009fb0 tx=0x7f8268011890 comp rx=0 tx=0).stop 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 shutdown_connections 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f8264039560 0x7f826403ba70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:45.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 --2- 172.21.15.100:0/768960616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8278108770 0x7f827807c8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:45.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 >> 172.21.15.100:0/768960616 conn(0x7f8278103e10 msgr2=0x7f8278104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:45.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 shutdown_connections 2024-04-30T23:03:45.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:44.613+0000 7f8280669700 1 -- 172.21.15.100:0/768960616 wait complete. 2024-04-30T23:03:45.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:45 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/768960616' entity='client.admin' 2024-04-30T23:03:45.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:45 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:45.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:45 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.758+0000 7fd6f6337700 1 Processor -- start 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.758+0000 7fd6f6337700 1 -- start start 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.758+0000 7fd6f6337700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.758+0000 7fd6f6337700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f007cd80 con 0x7fd6f010a3b0 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57680/0 (socket says 172.21.15.100:57680) 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6effff700 1 -- 172.21.15.100:0/2502524783 learned_addr learned my addr 172.21.15.100:0/2502524783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6effff700 1 -- 172.21.15.100:0/2502524783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f010cd10 con 0x7fd6f010a3b0 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6effff700 1 --2- 172.21.15.100:0/2502524783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098a0 tx=0x7fd6e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b21542da5c7cdc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6eeffd700 1 -- 172.21.15.100:0/2502524783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e4004160 con 0x7fd6f010a3b0 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6eeffd700 1 -- 172.21.15.100:0/2502524783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e4004300 con 0x7fd6f010a3b0 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.759+0000 7fd6eeffd700 1 -- 172.21.15.100:0/2502524783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e4011a20 con 0x7fd6f010a3b0 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 -- 172.21.15.100:0/2502524783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 msgr2=0x7fd6f010c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 --2- 172.21.15.100:0/2502524783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098a0 tx=0x7fd6e4009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 -- 172.21.15.100:0/2502524783 shutdown_connections 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 --2- 172.21.15.100:0/2502524783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f010c7d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 -- 172.21.15.100:0/2502524783 >> 172.21.15.100:0/2502524783 conn(0x7fd6f0103e10 msgr2=0x7fd6f0106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 -- 172.21.15.100:0/2502524783 shutdown_connections 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.760+0000 7fd6f6337700 1 -- 172.21.15.100:0/2502524783 wait complete. 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6f6337700 1 Processor -- start 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6f6337700 1 -- start start 2024-04-30T23:03:46.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6f6337700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6f6337700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f010dcb0 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57696/0 (socket says 172.21.15.100:57696) 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.761+0000 7fd6effff700 1 -- 172.21.15.100:0/3146122824 learned_addr learned my addr 172.21.15.100:0/3146122824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.762+0000 7fd6effff700 1 -- 172.21.15.100:0/3146122824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f019e190 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.762+0000 7fd6effff700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.762+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e4003aa0 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.762+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e401b8f0 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.762+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f019e420 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.763+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e4023890 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.763+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f01a1030 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.763+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd6e40193d0 con 0x7fd6f010a3b0 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.763+0000 7fd6ed7fa700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 0x7fd6d803bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:46.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.763+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd6e4054580 con 0x7fd6f010a3b0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.764+0000 7fd6ef7fe700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 0x7fd6d803bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.764+0000 7fd6ef7fe700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 0x7fd6d803bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006fd0 tx=0x7fd6e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.764+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f0064d30 con 0x7fd6f010a3b0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.769+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6e401f030 con 0x7fd6f010a3b0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.992+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd6f01a1200 con 0x7fd6f010a3b0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.996+0000 7fd6ed7fa700 1 -- 172.21.15.100:0/3146122824 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd6e4021560 con 0x7fd6f010a3b0 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 msgr2=0x7fd6d803bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 0x7fd6d803bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006fd0 tx=0x7fd6e0006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 msgr2=0x7fd6f019dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4011aa0 comp rx=0 tx=0).stop 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 shutdown_connections 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fd6d8039650 0x7fd6d803bb60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 --2- 172.21.15.100:0/3146122824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6f010a3b0 0x7fd6f019dc50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:46.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 >> 172.21.15.100:0/3146122824 conn(0x7fd6f0103e10 msgr2=0x7fd6f01046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:46.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 shutdown_connections 2024-04-30T23:03:46.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:45.998+0000 7fd6f6337700 1 -- 172.21.15.100:0/3146122824 wait complete. 2024-04-30T23:03:46.898 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling the dashboard module... 2024-04-30T23:03:47.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:46 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3146122824' entity='client.admin' 2024-04-30T23:03:48.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-mon[29745]: from='mgr.14120 172.21.15.100:0/1580315381' entity='mgr.x' 2024-04-30T23:03:48.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2136320553' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-30T23:03:48.928 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: ignoring --setuser ceph since I am not root 2024-04-30T23:03:48.928 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: ignoring --setgroup ceph since I am not root 2024-04-30T23:03:48.928 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:48.806+0000 7f3d04adb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T23:03:49.211 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:48.995+0000 7f3d04adb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:49.211 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:49.099+0000 7f3d04adb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T23:03:49.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.521+0000 7f7289615700 1 Processor -- start 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.521+0000 7f7289615700 1 -- start start 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.521+0000 7f7289615700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.521+0000 7f7289615700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7284108540 con 0x7f7284107b60 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7282ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7282ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57706/0 (socket says 172.21.15.100:57706) 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7282ffd700 1 -- 172.21.15.100:0/2398398622 learned_addr learned my addr 172.21.15.100:0/2398398622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7282ffd700 1 -- 172.21.15.100:0/2398398622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728410ab60 con 0x7f7284107b60 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7282ffd700 1 --2- 172.21.15.100:0/2398398622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72780098a0 tx=0x7f7278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8046dfe559113651 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7281ffb700 1 -- 172.21.15.100:0/2398398622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278004160 con 0x7f7284107b60 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7281ffb700 1 -- 172.21.15.100:0/2398398622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7278004300 con 0x7f7284107b60 2024-04-30T23:03:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.522+0000 7f7281ffb700 1 -- 172.21.15.100:0/2398398622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278011a20 con 0x7f7284107b60 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 -- 172.21.15.100:0/2398398622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 msgr2=0x7f7284107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 --2- 172.21.15.100:0/2398398622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72780098a0 tx=0x7f7278009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 -- 172.21.15.100:0/2398398622 shutdown_connections 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 --2- 172.21.15.100:0/2398398622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f7284107f70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 -- 172.21.15.100:0/2398398622 >> 172.21.15.100:0/2398398622 conn(0x7f7284103570 msgr2=0x7f72841059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 -- 172.21.15.100:0/2398398622 shutdown_connections 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.523+0000 7f7289615700 1 -- 172.21.15.100:0/2398398622 wait complete. 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.524+0000 7f7289615700 1 Processor -- start 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.524+0000 7f7289615700 1 -- start start 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.524+0000 7f7289615700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7289615700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f728410dd90 con 0x7f7284107b60 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7282ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7282ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57708/0 (socket says 172.21.15.100:57708) 2024-04-30T23:03:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7282ffd700 1 -- 172.21.15.100:0/2136320553 learned_addr learned my addr 172.21.15.100:0/2136320553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7282ffd700 1 -- 172.21.15.100:0/2136320553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728419e380 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7282ffd700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7278011a20 tx=0x7f7278011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278003af0 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f727801b8f0 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278023890 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.525+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728419e610 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.526+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72841a1220 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.526+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f727802c3f0 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.526+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7284064d30 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.527+0000 7f726bfff700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 0x7f726c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.527+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f727804ee00 con 0x7f7284107b60 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.527+0000 7f72827fc700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 0x7f726c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:49.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.527+0000 7f72827fc700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 0x7f726c03bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.532+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f727801f030 con 0x7f7284107b60 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:47.802+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f728410df10 con 0x7f7284107b60 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.598+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f72780202b0 con 0x7f7284107b60 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.600+0000 7f726bfff700 1 -- 172.21.15.100:0/2136320553 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f727804d8b0 con 0x7f7284107b60 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 msgr2=0x7f726c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 0x7f726c03bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 msgr2=0x7f728419de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7278011a20 tx=0x7f7278011b00 comp rx=0 tx=0).stop 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 shutdown_connections 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f726c0395b0 0x7f726c03bac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 --2- 172.21.15.100:0/2136320553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7284107b60 0x7f728419de40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 >> 172.21.15.100:0/2136320553 conn(0x7f7284103570 msgr2=0x7f7284103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 shutdown_connections 2024-04-30T23:03:49.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:48.601+0000 7f7289615700 1 -- 172.21.15.100:0/2136320553 wait complete. 2024-04-30T23:03:49.508 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:49.422+0000 7f3d04adb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T23:03:49.508 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:49.511+0000 7f3d04adb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T23:03:49.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2136320553' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-30T23:03:49.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:49 smithi100 ceph-mon[29745]: mgrmap e9: x(active, since 20s) 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.655+0000 7f5086bb5700 1 Processor -- start 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.655+0000 7f5086bb5700 1 -- start start 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.655+0000 7f5086bb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.655+0000 7f5086bb5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f508010a2a0 con 0x7f50801098a0 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f5084951700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:50.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f5084951700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57734/0 (socket says 172.21.15.100:57734) 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f5084951700 1 -- 172.21.15.100:0/3207685195 learned_addr learned my addr 172.21.15.100:0/3207685195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f5084951700 1 -- 172.21.15.100:0/3207685195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508010aa70 con 0x7f50801098a0 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f5084951700 1 --2- 172.21.15.100:0/3207685195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50740098a0 tx=0x7f5074009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cf4c434bf40611 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f507f7fe700 1 -- 172.21.15.100:0/3207685195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5074004160 con 0x7f50801098a0 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f507f7fe700 1 -- 172.21.15.100:0/3207685195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5074004300 con 0x7f50801098a0 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.656+0000 7f507f7fe700 1 -- 172.21.15.100:0/3207685195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5074011a20 con 0x7f50801098a0 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 -- 172.21.15.100:0/3207685195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 msgr2=0x7f5080109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 --2- 172.21.15.100:0/3207685195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50740098a0 tx=0x7f5074009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 -- 172.21.15.100:0/3207685195 shutdown_connections 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 --2- 172.21.15.100:0/3207685195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f5080109cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 -- 172.21.15.100:0/3207685195 >> 172.21.15.100:0/3207685195 conn(0x7f5080104f60 msgr2=0x7f50801073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 -- 172.21.15.100:0/3207685195 shutdown_connections 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.657+0000 7f5086bb5700 1 -- 172.21.15.100:0/3207685195 wait complete. 2024-04-30T23:03:50.519 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5086bb5700 1 Processor -- start 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5086bb5700 1 -- start start 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5086bb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5086bb5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f508010de20 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5084951700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5084951700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57744/0 (socket says 172.21.15.100:57744) 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5084951700 1 -- 172.21.15.100:0/4201668678 learned_addr learned my addr 172.21.15.100:0/4201668678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.658+0000 7f5084951700 1 -- 172.21.15.100:0/4201668678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508019e280 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f5084951700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5074009130 tx=0x7f5074011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5074003aa0 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508019e510 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f507401a8e0 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50740248f0 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.659+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50801a1110 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f5074022020 con 0x7f50801098a0 2024-04-30T23:03:50.520 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f507dffb700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 0x7f507003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f507404e900 con 0x7f50801098a0 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f507ffff700 1 -- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 msgr2=0x7f507003bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f507ffff700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 0x7f507003bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.660+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5080064d30 con 0x7f50801098a0 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.670+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f50740172b0 con 0x7f50801098a0 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.861+0000 7f507ffff700 1 -- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 msgr2=0x7f507003bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.861+0000 7f507ffff700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 0x7f507003bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.965+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f50801a12e0 con 0x7f50801098a0 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.965+0000 7f507dffb700 1 -- 172.21.15.100:0/4201668678 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f507400b7e0 con 0x7f50801098a0 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.967+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 msgr2=0x7f507003bb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.967+0000 7f5086bb5700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 0x7f507003bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 msgr2=0x7f508019dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5074009130 tx=0x7f5074011aa0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.521 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 shutdown_connections 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7f5070039600 0x7f507003bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 --2- 172.21.15.100:0/4201668678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50801098a0 0x7f508019dd40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 >> 172.21.15.100:0/4201668678 conn(0x7f5080104f60 msgr2=0x7f5080106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 shutdown_connections 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:49.968+0000 7f5086bb5700 1 -- 172.21.15.100:0/4201668678 wait complete. 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-04-30T23:03:50.522 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 9... 2024-04-30T23:03:50.899 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4201668678' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-30T23:03:50.900 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:50.722+0000 7f3d04adb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T23:03:51.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:50.902+0000 7f3d04adb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:51.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:51.075+0000 7f3d04adb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T23:03:51.655 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:51.365+0000 7f3d04adb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T23:03:51.655 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:51.458+0000 7f3d04adb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T23:03:51.655 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:51.658+0000 7f3d04adb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T23:03:52.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:51.852+0000 7f3d04adb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:03:52.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:52.443+0000 7f3d04adb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T23:03:53.158 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:52.863+0000 7f3d04adb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T23:03:53.159 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:52.960+0000 7f3d04adb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T23:03:53.159 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:53.162+0000 7f3d04adb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T23:03:53.950 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:53.677+0000 7f3d04adb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T23:03:53.951 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:53.770+0000 7f3d04adb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T23:03:54.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:54.012+0000 7f3d04adb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T23:03:54.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:54.144+0000 7f3d04adb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T23:03:54.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:54.240+0000 7f3d04adb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T23:03:54.568 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:54.355+0000 7f3d04adb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T23:03:55.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:54.651+0000 7f3d04adb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T23:03:55.332 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:55.256+0000 7f3d04adb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T23:03:55.588 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:03:55.486+0000 7f3d04adb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: Active manager daemon x restarted 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: Activating manager daemon x 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: osdmap e3: 0 total, 0 up, 0 in 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: mgrmap e10: x(active, starting, since 0.00415237s) 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: Manager daemon x is now available 2024-04-30T23:03:55.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-30T23:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-30T23:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:56 smithi100 ceph-mon[29745]: mgrmap e11: x(active, since 1.00856s) 2024-04-30T23:03:57.328 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-04-30T23:03:57.328 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-30T23:03:57.328 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-30T23:03:57.328 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-04-30T23:03:57.328 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.944+0000 7fae2dd4d700 1 Processor -- start 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.944+0000 7fae2dd4d700 1 -- start start 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.944+0000 7fae2dd4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.944+0000 7fae2dd4d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae28108570 con 0x7fae28107b90 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57750/0 (socket says 172.21.15.100:57750) 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae277fe700 1 -- 172.21.15.100:0/3472603178 learned_addr learned my addr 172.21.15.100:0/3472603178 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae277fe700 1 -- 172.21.15.100:0/3472603178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2810ab90 con 0x7fae28107b90 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae277fe700 1 --2- 172.21.15.100:0/3472603178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098a0 tx=0x7fae1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c522de9fd43970 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae267fc700 1 -- 172.21.15.100:0/3472603178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c004160 con 0x7fae28107b90 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae267fc700 1 -- 172.21.15.100:0/3472603178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c004300 con 0x7fae28107b90 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.945+0000 7fae267fc700 1 -- 172.21.15.100:0/3472603178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c011a20 con 0x7fae28107b90 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 -- 172.21.15.100:0/3472603178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 msgr2=0x7fae28107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 --2- 172.21.15.100:0/3472603178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0098a0 tx=0x7fae1c009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.329 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 -- 172.21.15.100:0/3472603178 shutdown_connections 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 --2- 172.21.15.100:0/3472603178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae28107fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 -- 172.21.15.100:0/3472603178 >> 172.21.15.100:0/3472603178 conn(0x7fae281035c0 msgr2=0x7fae28105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 -- 172.21.15.100:0/3472603178 shutdown_connections 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.946+0000 7fae2dd4d700 1 -- 172.21.15.100:0/3472603178 wait complete. 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.947+0000 7fae2dd4d700 1 Processor -- start 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.947+0000 7fae2dd4d700 1 -- start start 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae2dd4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae2dd4d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae2810ddc0 con 0x7fae28107b90 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57758/0 (socket says 172.21.15.100:57758) 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae277fe700 1 -- 172.21.15.100:0/2460511673 learned_addr learned my addr 172.21.15.100:0/2460511673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae277fe700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2810a850 con 0x7fae28107b90 2024-04-30T23:03:57.330 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae277fe700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae1c011a20 tx=0x7fae1c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c003af0 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae2dd4d700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae28108aa0 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c01b8f0 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.948+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c023890 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.949+0000 7fae2dd4d700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae28108f80 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.949+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fae1c02c3f0 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.950+0000 7fae24ff9700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.950+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fae08000d10 con 0x7fae100395b0 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.950+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fae1c04f2c0 con 0x7fae28107b90 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.950+0000 7fae26ffd700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:50.950+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:51.151+0000 7fae26ffd700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:57.331 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:51.151+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:51.552+0000 7fae26ffd700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:51.552+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:52.353+0000 7fae26ffd700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:52.353+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:53.954+0000 7fae26ffd700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/642565197 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:53.954+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:55.490+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7fae1c019750 con 0x7fae28107b90 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:55.490+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 msgr2=0x7fae1003bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:55.490+0000 7fae24ff9700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.492+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7fae1c018350 con 0x7fae28107b90 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.493+0000 7fae24ff9700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 0x7fae1003eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.493+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fae1c004300 con 0x7fae1c04ee50 2024-04-30T23:03:57.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.494+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 0x7fae1003eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.495+0000 7fae26ffd700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 0x7fae1003eea0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fae18003a10 tx=0x7fae180092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.495+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fae1c004300 con 0x7fae1c04ee50 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.504+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fae08002810 con 0x7fae1c04ee50 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.504+0000 7fae24ff9700 1 -- 172.21.15.100:0/2460511673 <== mgr.14152 v2:172.21.15.100:6800/3346272580 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fae08002810 con 0x7fae1c04ee50 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 msgr2=0x7fae1003eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 0x7fae1003eea0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fae18003a10 tx=0x7fae180092b0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 msgr2=0x7fae2810a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae1c011a20 tx=0x7fae1c011b00 comp rx=0 tx=0).stop 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 shutdown_connections 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fae1c04ee50 0x7fae1003eea0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae28107b90 0x7fae2810a310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 --2- 172.21.15.100:0/2460511673 >> [v2:172.21.15.100:6800/642565197,v1:172.21.15.100:6801/642565197] conn(0x7fae100395b0 0x7fae1003bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:57.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 >> 172.21.15.100:0/2460511673 conn(0x7fae281035c0 msgr2=0x7fae28103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:57.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 shutdown_connections 2024-04-30T23:03:57.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:56.505+0000 7fae0e7fc700 1 -- 172.21.15.100:0/2460511673 wait complete. 2024-04-30T23:03:57.334 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 9 is available 2024-04-30T23:03:57.334 INFO:teuthology.orchestra.run.smithi100.stdout:Generating a dashboard self-signed certificate... 2024-04-30T23:03:57.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:57 smithi100 ceph-mon[29745]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-30T23:03:57.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:57 smithi100 ceph-mon[29745]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-30T23:03:57.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.765+0000 7f18cfb6d700 1 Processor -- start 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.765+0000 7f18cfb6d700 1 -- start start 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.765+0000 7f18cfb6d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.765+0000 7f18cfb6d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18c807d5f0 con 0x7f18c8108200 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cd909700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cd909700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45802/0 (socket says 172.21.15.100:45802) 2024-04-30T23:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cd909700 1 -- 172.21.15.100:0/104299974 learned_addr learned my addr 172.21.15.100:0/104299974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cd909700 1 -- 172.21.15.100:0/104299974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c8108b50 con 0x7f18c8108200 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cd909700 1 --2- 172.21.15.100:0/104299974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18c40098a0 tx=0x7f18c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd3ea00c6039a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cc907700 1 -- 172.21.15.100:0/104299974 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c4004160 con 0x7f18c8108200 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cc907700 1 -- 172.21.15.100:0/104299974 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18c4004300 con 0x7f18c8108200 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.766+0000 7f18cc907700 1 -- 172.21.15.100:0/104299974 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c4011a20 con 0x7f18c8108200 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 -- 172.21.15.100:0/104299974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 msgr2=0x7f18c8108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/104299974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18c40098a0 tx=0x7f18c4009bb0 comp rx=0 tx=0).stop 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 -- 172.21.15.100:0/104299974 shutdown_connections 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/104299974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c8108610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 -- 172.21.15.100:0/104299974 >> 172.21.15.100:0/104299974 conn(0x7f18c8103e30 msgr2=0x7f18c81062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 -- 172.21.15.100:0/104299974 shutdown_connections 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.767+0000 7f18cfb6d700 1 -- 172.21.15.100:0/104299974 wait complete. 2024-04-30T23:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.768+0000 7f18cfb6d700 1 Processor -- start 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.768+0000 7f18cfb6d700 1 -- start start 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.768+0000 7f18cfb6d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.768+0000 7f18cfb6d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8109c10 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cd909700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cd909700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45806/0 (socket says 172.21.15.100:45806) 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cd909700 1 -- 172.21.15.100:0/1184121968 learned_addr learned my addr 172.21.15.100:0/1184121968 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cd909700 1 -- 172.21.15.100:0/1184121968 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81a03e0 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cd909700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000c00 tx=0x7f18c4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c4003aa0 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c81a0670 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18c401b8f0 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.769+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81a3280 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.770+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c4023890 con 0x7f18c8108200 2024-04-30T23:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.770+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c8064d30 con 0x7f18c8108200 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.770+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f18c402c3f0 con 0x7f18c8108200 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.771+0000 7f18beffd700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 0x7f18b403b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.771+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f18c404de30 con 0x7f18c8108200 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.771+0000 7f18cd108700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 0x7f18b403b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.771+0000 7f18cd108700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 0x7f18b403b9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006fd0 tx=0x7f18b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.776+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18c401f030 con 0x7f18c8108200 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:57.981+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f18c8063b10 con 0x7f18b40394e0 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.051+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f18c400bcd0 con 0x7f18c8108200 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.058+0000 7f18beffd700 1 -- 172.21.15.100:0/1184121968 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f18c8063b10 con 0x7f18b40394e0 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 msgr2=0x7f18b403b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 0x7f18b403b9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006fd0 tx=0x7f18b8006e40 comp rx=0 tx=0).stop 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 msgr2=0x7f18c819fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000c00 tx=0x7f18c4011aa0 comp rx=0 tx=0).stop 2024-04-30T23:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 shutdown_connections 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18b40394e0 0x7f18b403b9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 --2- 172.21.15.100:0/1184121968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c8108200 0x7f18c819fea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 >> 172.21.15.100:0/1184121968 conn(0x7f18c8103e30 msgr2=0x7f18c8193e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 shutdown_connections 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:58.060+0000 7f18cfb6d700 1 -- 172.21.15.100:0/1184121968 wait complete. 2024-04-30T23:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial admin user... 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:57] ENGINE Bus STARTING 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:57] ENGINE Serving on https://172.21.15.100:7150 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:57] ENGINE Serving on http://172.21.15.100:8765 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: [30/Apr/2024:23:03:57] ENGINE Bus STARTED 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: mgrmap e12: x(active, since 2s) 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:03:58.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:03:58.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:03:59.673 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:03:59 smithi100 ceph-mon[29745]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:00.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:00 smithi100 ceph-mon[29745]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:00.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:00.948 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$j7FWMDSu807F3lAoDCURJeSCHN1zEyZ4NTt1yaTuCs9vOq1FVdqiS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714518239, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-30T23:04:00.948 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.120+0000 7f86e359c700 1 Processor -- start 2024-04-30T23:04:00.948 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e359c700 1 -- start start 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e359c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e359c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc10a2c0 con 0x7f86dc1098c0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e1338700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e1338700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45822/0 (socket says 172.21.15.100:45822) 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e1338700 1 -- 172.21.15.100:0/453063548 learned_addr learned my addr 172.21.15.100:0/453063548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e1338700 1 -- 172.21.15.100:0/453063548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc10aa90 con 0x7f86dc1098c0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86e1338700 1 --2- 172.21.15.100:0/453063548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0098a0 tx=0x7f86cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ed877d2500d572 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.121+0000 7f86d3fff700 1 -- 172.21.15.100:0/453063548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc004160 con 0x7f86dc1098c0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86d3fff700 1 -- 172.21.15.100:0/453063548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86cc004300 con 0x7f86dc1098c0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86d3fff700 1 -- 172.21.15.100:0/453063548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc011a20 con 0x7f86dc1098c0 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 -- 172.21.15.100:0/453063548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 msgr2=0x7f86dc109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:00.949 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 --2- 172.21.15.100:0/453063548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0098a0 tx=0x7f86cc009bb0 comp rx=0 tx=0).stop 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 -- 172.21.15.100:0/453063548 shutdown_connections 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 --2- 172.21.15.100:0/453063548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc109cd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 -- 172.21.15.100:0/453063548 >> 172.21.15.100:0/453063548 conn(0x7f86dc104f80 msgr2=0x7f86dc1073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 -- 172.21.15.100:0/453063548 shutdown_connections 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.122+0000 7f86e359c700 1 -- 172.21.15.100:0/453063548 wait complete. 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e359c700 1 Processor -- start 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e359c700 1 -- start start 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e359c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e359c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc10de40 con 0x7f86dc1098c0 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e1338700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e1338700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45836/0 (socket says 172.21.15.100:45836) 2024-04-30T23:04:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.123+0000 7f86e1338700 1 -- 172.21.15.100:0/3723938959 learned_addr learned my addr 172.21.15.100:0/3723938959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86e1338700 1 -- 172.21.15.100:0/3723938959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc19e1e0 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86e1338700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86cc003e70 tx=0x7f86cc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc003af0 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86cc01a8e0 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86cc024870 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc19e470 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.124+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc1a1080 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.125+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f86cc022020 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.125+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc064d30 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.125+0000 7f86d27fc700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 0x7f86c803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.125+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f86cc04dab0 con 0x7f86dc1098c0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.125+0000 7f86e0b37700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 0x7f86c803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.126+0000 7f86e0b37700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 0x7f86c803bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006fd0 tx=0x7f86d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.131+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f86cc01ad90 con 0x7f86dc1098c0 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.362+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f86dc1a1310 con 0x7f86c8039610 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.587+0000 7f86d27fc700 1 -- 172.21.15.100:0/3723938959 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f86dc1a1310 con 0x7f86c8039610 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 msgr2=0x7f86c803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 0x7f86c803bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006fd0 tx=0x7f86d8006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 msgr2=0x7f86dc19dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86cc003e70 tx=0x7f86cc011aa0 comp rx=0 tx=0).stop 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 shutdown_connections 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86c8039610 0x7f86c803bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 --2- 172.21.15.100:0/3723938959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86dc1098c0 0x7f86dc19dca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 >> 172.21.15.100:0/3723938959 conn(0x7f86dc104f80 msgr2=0x7f86dc1067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 shutdown_connections 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:03:59.589+0000 7f86e359c700 1 -- 172.21.15.100:0/3723938959 wait complete. 2024-04-30T23:04:00.952 INFO:teuthology.orchestra.run.smithi100.stdout:Fetching dashboard port number... 2024-04-30T23:04:01.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:01 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3846825094' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-30T23:04:02.111 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 8443 2024-04-30T23:04:02.111 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.323+0000 7f6f96a29700 1 Processor -- start 2024-04-30T23:04:02.111 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.323+0000 7f6f96a29700 1 -- start start 2024-04-30T23:04:02.111 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f96a29700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:02.111 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f96a29700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9007cd80 con 0x7f6f9010a3b0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45844/0 (socket says 172.21.15.100:45844) 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8ffff700 1 -- 172.21.15.100:0/2020571157 learned_addr learned my addr 172.21.15.100:0/2020571157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8ffff700 1 -- 172.21.15.100:0/2020571157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9010cd10 con 0x7f6f9010a3b0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8ffff700 1 --2- 172.21.15.100:0/2020571157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f800098a0 tx=0x7f6f80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47670a3bde06b789 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8effd700 1 -- 172.21.15.100:0/2020571157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80004160 con 0x7f6f9010a3b0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8effd700 1 -- 172.21.15.100:0/2020571157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f80004300 con 0x7f6f9010a3b0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.324+0000 7f6f8effd700 1 -- 172.21.15.100:0/2020571157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80011a20 con 0x7f6f9010a3b0 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 -- 172.21.15.100:0/2020571157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 msgr2=0x7f6f9010c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 --2- 172.21.15.100:0/2020571157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f800098a0 tx=0x7f6f80009bb0 comp rx=0 tx=0).stop 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 -- 172.21.15.100:0/2020571157 shutdown_connections 2024-04-30T23:04:02.112 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 --2- 172.21.15.100:0/2020571157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9010c7d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 -- 172.21.15.100:0/2020571157 >> 172.21.15.100:0/2020571157 conn(0x7f6f90103e10 msgr2=0x7f6f90106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 -- 172.21.15.100:0/2020571157 shutdown_connections 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.325+0000 7f6f96a29700 1 -- 172.21.15.100:0/2020571157 wait complete. 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f96a29700 1 Processor -- start 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f96a29700 1 -- start start 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f96a29700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f96a29700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9010dcb0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45846/0 (socket says 172.21.15.100:45846) 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.326+0000 7f6f8ffff700 1 -- 172.21.15.100:0/3846825094 learned_addr learned my addr 172.21.15.100:0/3846825094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f8ffff700 1 -- 172.21.15.100:0/3846825094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9019e190 con 0x7f6f9010a3b0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f8ffff700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f800119f0 tx=0x7f6f80011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f800039e0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f8001b8f0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9019e420 con 0x7f6f9010a3b0 2024-04-30T23:04:02.113 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f800237a0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.327+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f901a1030 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.328+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f6f8002c3f0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.328+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f90064d30 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.328+0000 7f6f8d7fa700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 0x7f6f7c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.328+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6f8004e000 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.328+0000 7f6f8f7fe700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 0x7f6f7c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.329+0000 7f6f8f7fe700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 0x7f6f7c03bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f78006fd0 tx=0x7f6f78006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.333+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6f8001f030 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.533+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f6f901a1320 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.533+0000 7f6f8d7fa700 1 -- 172.21.15.100:0/3846825094 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f6f800202b0 con 0x7f6f9010a3b0 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 msgr2=0x7f6f7c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 0x7f6f7c03bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f78006fd0 tx=0x7f6f78006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 msgr2=0x7f6f9019dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f800119f0 tx=0x7f6f80011ad0 comp rx=0 tx=0).stop 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 shutdown_connections 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6f7c0395b0 0x7f6f7c03bac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 --2- 172.21.15.100:0/3846825094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f9010a3b0 0x7f6f9019dc50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 >> 172.21.15.100:0/3846825094 conn(0x7f6f90103e10 msgr2=0x7f6f901046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 shutdown_connections 2024-04-30T23:04:02.115 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:01.535+0000 7f6f96a29700 1 -- 172.21.15.100:0/3846825094 wait complete. 2024-04-30T23:04:02.117 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-30T23:04:02.117 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-04-30T23:04:02.124 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-30T23:04:02.124 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-04-30T23:04:02.124 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-04-30T23:04:02.124 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-30T23:04:02.125 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph Dashboard is now available at: 2024-04-30T23:04:02.125 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout: URL: https://smithi100.front.sepia.ceph.com:8443/ 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout: User: admin 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout: Password: tulo2adml9 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout:Saving cluster configuration to /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config directory 2024-04-30T23:04:02.126 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling autotune for osd_memory_target 2024-04-30T23:04:02.757 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:02 smithi100 ceph-mon[29745]: mgrmap e13: x(active, since 6s) 2024-04-30T23:04:03.350 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.555+0000 7fbee3c3d700 1 Processor -- start 2024-04-30T23:04:03.350 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee3c3d700 1 -- start start 2024-04-30T23:04:03.350 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee3c3d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:03.350 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee3c3d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc07d630 con 0x7fbedc10a3d0 2024-04-30T23:04:03.350 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee19d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee19d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45856/0 (socket says 172.21.15.100:45856) 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee19d9700 1 -- 172.21.15.100:0/317653828 learned_addr learned my addr 172.21.15.100:0/317653828 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee19d9700 1 -- 172.21.15.100:0/317653828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc10cd30 con 0x7fbedc10a3d0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.556+0000 7fbee19d9700 1 --2- 172.21.15.100:0/317653828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0098a0 tx=0x7fbecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd6a39409d29c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee09d7700 1 -- 172.21.15.100:0/317653828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc004160 con 0x7fbedc10a3d0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee09d7700 1 -- 172.21.15.100:0/317653828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbecc004300 con 0x7fbedc10a3d0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee09d7700 1 -- 172.21.15.100:0/317653828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc011a20 con 0x7fbedc10a3d0 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee3c3d700 1 -- 172.21.15.100:0/317653828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 msgr2=0x7fbedc10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/317653828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0098a0 tx=0x7fbecc009bb0 comp rx=0 tx=0).stop 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee3c3d700 1 -- 172.21.15.100:0/317653828 shutdown_connections 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/317653828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc10c7f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.557+0000 7fbee3c3d700 1 -- 172.21.15.100:0/317653828 >> 172.21.15.100:0/317653828 conn(0x7fbedc103e30 msgr2=0x7fbedc1062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 -- 172.21.15.100:0/317653828 shutdown_connections 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 -- 172.21.15.100:0/317653828 wait complete. 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 Processor -- start 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 -- start start 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.558+0000 7fbee3c3d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc10dcd0 con 0x7fbedc10a3d0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee19d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee19d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45866/0 (socket says 172.21.15.100:45866) 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee19d9700 1 -- 172.21.15.100:0/2784900495 learned_addr learned my addr 172.21.15.100:0/2784900495 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee19d9700 1 -- 172.21.15.100:0/2784900495 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc19e190 con 0x7fbedc10a3d0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee19d9700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0119f0 tx=0x7fbecc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc0039e0 con 0x7fbedc10a3d0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbecc01b8f0 con 0x7fbedc10a3d0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc19e420 con 0x7fbedc10a3d0 2024-04-30T23:04:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc0237a0 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.559+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1a1030 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.560+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fbecc023aa0 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.560+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc064d30 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.560+0000 7fbed2ffd700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 0x7fbec803bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.560+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbecc04e180 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.560+0000 7fbee11d8700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 0x7fbec803bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.561+0000 7fbee11d8700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 0x7fbec803bb60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbed8006fd0 tx=0x7fbed8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.566+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbecc01f030 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.762+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fbedc1a1200 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.762+0000 7fbed2ffd700 1 -- 172.21.15.100:0/2784900495 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fbecc018c10 con 0x7fbedc10a3d0 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 msgr2=0x7fbec803bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 0x7fbec803bb60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbed8006fd0 tx=0x7fbed8006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:03.353 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 msgr2=0x7fbedc19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0119f0 tx=0x7fbecc011ad0 comp rx=0 tx=0).stop 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 shutdown_connections 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbec8039650 0x7fbec803bb60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 --2- 172.21.15.100:0/2784900495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbedc10a3d0 0x7fbedc19dc50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 >> 172.21.15.100:0/2784900495 conn(0x7fbedc103e30 msgr2=0x7fbedc104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 shutdown_connections 2024-04-30T23:04:03.354 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:02.765+0000 7fbee3c3d700 1 -- 172.21.15.100:0/2784900495 wait complete. 2024-04-30T23:04:04.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.834+0000 7f4109327700 1 Processor -- start 2024-04-30T23:04:04.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.834+0000 7f4109327700 1 -- start start 2024-04-30T23:04:04.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4109327700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:04.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4109327700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f410410a2c0 con 0x7f41041098c0 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4102ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4102ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34402/0 (socket says 172.21.15.100:34402) 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4102ffd700 1 -- 172.21.15.100:0/2691787750 learned_addr learned my addr 172.21.15.100:0/2691787750 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4102ffd700 1 -- 172.21.15.100:0/2691787750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410410aa90 con 0x7f41041098c0 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4102ffd700 1 --2- 172.21.15.100:0/2691787750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009e80 tx=0x7f40f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f3f5e43959bd38 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:04.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4101ffb700 1 -- 172.21.15.100:0/2691787750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x7f41041098c0 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4101ffb700 1 -- 172.21.15.100:0/2691787750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f400b8c0 con 0x7f41041098c0 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.835+0000 7f4101ffb700 1 -- 172.21.15.100:0/2691787750 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4004490 con 0x7f41041098c0 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 -- 172.21.15.100:0/2691787750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 msgr2=0x7f4104109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 --2- 172.21.15.100:0/2691787750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009e80 tx=0x7f40f400b330 comp rx=0 tx=0).stop 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 -- 172.21.15.100:0/2691787750 shutdown_connections 2024-04-30T23:04:04.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 --2- 172.21.15.100:0/2691787750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f4104109cd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 -- 172.21.15.100:0/2691787750 >> 172.21.15.100:0/2691787750 conn(0x7f4104104f80 msgr2=0x7f41041073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 -- 172.21.15.100:0/2691787750 shutdown_connections 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.836+0000 7f4109327700 1 -- 172.21.15.100:0/2691787750 wait complete. 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4109327700 1 Processor -- start 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4109327700 1 -- start start 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4109327700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4109327700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f410410de40 con 0x7f41041098c0 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4102ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4102ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34410/0 (socket says 172.21.15.100:34410) 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.837+0000 7f4102ffd700 1 -- 172.21.15.100:0/1161614809 learned_addr learned my addr 172.21.15.100:0/1161614809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f4102ffd700 1 -- 172.21.15.100:0/1161614809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410419e260 con 0x7f41041098c0 2024-04-30T23:04:04.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f4102ffd700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fd0 tx=0x7f40f400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4020020 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f4003b50 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410419e4f0 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4017040 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.838+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a10f0 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.839+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f40f4023020 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.839+0000 7f40fbfff700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 0x7f40f003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.839+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f40f400f050 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.839+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4104064d30 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.839+0000 7f41027fc700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 0x7f40f003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.840+0000 7f41027fc700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 0x7f40f003bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40ec006fd0 tx=0x7f40ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:03.845+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f40f402a020 con 0x7f41041098c0 2024-04-30T23:04:04.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.153+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f41041a12c0 con 0x7f41041098c0 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.155+0000 7f40fbfff700 1 -- 172.21.15.100:0/1161614809 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f40f4011390 con 0x7f41041098c0 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 msgr2=0x7f40f003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 0x7f40f003bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40ec006fd0 tx=0x7f40ec006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 msgr2=0x7f410419dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fd0 tx=0x7f40f400bd30 comp rx=0 tx=0).stop 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 shutdown_connections 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40f0039600 0x7f40f003bb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 --2- 172.21.15.100:0/1161614809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41041098c0 0x7f410419dd20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 >> 172.21.15.100:0/1161614809 conn(0x7f4104104f80 msgr2=0x7f4104106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 shutdown_connections 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-04-30T23:04:04.158+0000 7f4109327700 1 -- 172.21.15.100:0/1161614809 wait complete. 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.725 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout:Or, if you are only running a single cluster on this host: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: ceph telemetry on 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout:For more information see: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:04.726 INFO:teuthology.orchestra.run.smithi100.stdout:Bootstrap complete. 2024-04-30T23:04:04.752 INFO:tasks.cephadm:Fetching config... 2024-04-30T23:04:04.753 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:04.753 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-30T23:04:04.769 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-30T23:04:04.769 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:04.769 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-30T23:04:04.824 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-30T23:04:04.825 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:04.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-30T23:04:04.888 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-30T23:04:04.888 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:04.889 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-30T23:04:04.943 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-30T23:04:04.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-30T23:04:05.015 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:05.025 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-30T23:04:05.065 INFO:teuthology.orchestra.run.smithi104.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:05.077 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-30T23:04:05.117 INFO:teuthology.orchestra.run.smithi183.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4o4pxIzfx1VmCKeM8mjTrn1p8N5zJ3pvLqs4sW6B58KIhQZLic1wm86BsKIJwiRnuCW/0wzweD5n8TMg2Of/FZZInaoDUQC8iGc8Di2rA02yWSb6cSySmzNJslDIyfRP4o5AL1jPyJTy5o9CYCRhMiKdzKBOsJY8IrsnRh2mabxL1aggIYImaeNoMCi48bN3TyILw+IOpLKy7nKzkBod3odbWSfyNmtqoVQN0Z96Bx1jbBYF2waUqJNNkgEdgYN8pIxdhviMFvf/3ESrG4ZTbYj3BQPvD4mh3ImXHZZAZKJIeqZJQFkKWyfP2lh6dKxaylLDdk/E2q2SG63aiqJZ3WjTwNv0ywyK8hHwSnPXe4/jL9nppgAfkVsqjxFwMYvWyJMupaRe4eqtNCuXm4IHL98roHprenvMwVqoP2XBXNoIHOJSD1oPiJPq9MBixfmG/aV35V0+ubH+FlTwhR2WrLHM024ez68SirJO7dS5nF6jSHVOQBHUH5ZptfVMt9Ic= ceph-a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:05.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-30T23:04:05.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:05 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1161614809' entity='client.admin' 2024-04-30T23:04:05.368 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:07.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 -- 172.21.15.100:0/3698695449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 msgr2=0x7fc204102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/3698695449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc204102e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009910 tx=0x7fc1f4009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 -- 172.21.15.100:0/3698695449 shutdown_connections 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/3698695449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc204102e10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 -- 172.21.15.100:0/3698695449 >> 172.21.15.100:0/3698695449 conn(0x7fc2040fe020 msgr2=0x7fc2041004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 -- 172.21.15.100:0/3698695449 shutdown_connections 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.650+0000 7fc20a8cc700 1 -- 172.21.15.100:0/3698695449 wait complete. 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc20a8cc700 1 Processor -- start 2024-04-30T23:04:07.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc20a8cc700 1 -- start start 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc20a8cc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc20a8cc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2041089c0 con 0x7fc204102a00 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc203fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc203fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34430/0 (socket says 172.21.15.100:34430) 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.651+0000 7fc203fff700 1 -- 172.21.15.100:0/4100225223 learned_addr learned my addr 172.21.15.100:0/4100225223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc203fff700 1 -- 172.21.15.100:0/4100225223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20419bdf0 con 0x7fc204102a00 2024-04-30T23:04:07.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc203fff700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40057d0 tx=0x7fc1f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1f4027070 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f400be10 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1f4022dd0 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20419c080 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.652+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20419ec90 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.653+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc204109140 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.653+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fc1f402a070 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.653+0000 7fc2017fa700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 0x7fc1ec03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.653+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc1f401e030 con 0x7fc204102a00 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.653+0000 7fc2037fe700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 0x7fc1ec03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:07.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.654+0000 7fc2037fe700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 0x7fc1ec03bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8006fd0 tx=0x7fc1f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.658+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc1f4013070 con 0x7fc204102a00 2024-04-30T23:04:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.857+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fc20402e690 con 0x7fc204102a00 2024-04-30T23:04:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.859+0000 7fc2017fa700 1 -- 172.21.15.100:0/4100225223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fc1f40292c0 con 0x7fc204102a00 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 msgr2=0x7fc1ec03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 0x7fc1ec03bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8006fd0 tx=0x7fc1f8006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 msgr2=0x7fc20419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40057d0 tx=0x7fc1f4005800 comp rx=0 tx=0).stop 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 shutdown_connections 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1ec039600 0x7fc1ec03bb10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 --2- 172.21.15.100:0/4100225223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102a00 0x7fc20419b8b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 >> 172.21.15.100:0/4100225223 conn(0x7fc2040fe020 msgr2=0x7fc204192470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 shutdown_connections 2024-04-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:07.862+0000 7fc20a8cc700 1 -- 172.21.15.100:0/4100225223 wait complete. 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:08.440 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-30T23:04:08.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-30T23:04:08.674 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:09.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:08 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4100225223' entity='client.admin' 2024-04-30T23:04:09.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:09.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:10.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.065+0000 7fa6db4b6700 1 -- 172.21.15.100:0/3502036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 msgr2=0x7fa6d4102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.065+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/3502036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4102df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009910 tx=0x7fa6d0009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.065+0000 7fa6db4b6700 1 -- 172.21.15.100:0/3502036872 shutdown_connections 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.065+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/3502036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4102df0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.065+0000 7fa6db4b6700 1 -- 172.21.15.100:0/3502036872 >> 172.21.15.100:0/3502036872 conn(0x7fa6d40fe040 msgr2=0x7fa6d41004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 -- 172.21.15.100:0/3502036872 shutdown_connections 2024-04-30T23:04:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 -- 172.21.15.100:0/3502036872 wait complete. 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 Processor -- start 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 -- start start 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.066+0000 7fa6db4b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d41089a0 con 0x7fa6d41029e0 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6d9252700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6d9252700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34444/0 (socket says 172.21.15.100:34444) 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6d9252700 1 -- 172.21.15.100:0/4116213301 learned_addr learned my addr 172.21.15.100:0/4116213301 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6d9252700 1 -- 172.21.15.100:0/4116213301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d4199bc0 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6d9252700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00057d0 tx=0x7fa6d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0027070 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d000be10 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d4199e50 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0022dd0 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.067+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d419ca60 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.068+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fa6d002a070 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.068+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d4109120 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.068+0000 7fa6ca7fc700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 0x7fa6c003bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.068+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa6d001e030 con 0x7fa6d41029e0 2024-04-30T23:04:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.068+0000 7fa6d8a51700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 0x7fa6c003bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:10.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.069+0000 7fa6d8a51700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 0x7fa6c003bb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4006fd0 tx=0x7fa6c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:10.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.073+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa6d0013070 con 0x7fa6d41029e0 2024-04-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.276+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa6d402e660 con 0x7fa6c0039650 2024-04-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.280+0000 7fa6ca7fc700 1 -- 172.21.15.100:0/4116213301 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6d402e660 con 0x7fa6c0039650 2024-04-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.282+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 msgr2=0x7fa6c003bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.282+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 0x7fa6c003bb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4006fd0 tx=0x7fa6c4006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.282+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 msgr2=0x7fa6d4199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.282+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00057d0 tx=0x7fa6d0005800 comp rx=0 tx=0).stop 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 shutdown_connections 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6c0039650 0x7fa6c003bb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 --2- 172.21.15.100:0/4116213301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d41029e0 0x7fa6d4199680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 >> 172.21.15.100:0/4116213301 conn(0x7fa6d40fe040 msgr2=0x7fa6d406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 shutdown_connections 2024-04-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:10.283+0000 7fa6db4b6700 1 -- 172.21.15.100:0/4116213301 wait complete. 2024-04-30T23:04:10.971 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi104 2024-04-30T23:04:10.971 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:04:10.971 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/etc/ceph/ceph.conf 2024-04-30T23:04:10.990 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:04:10.990 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:11.047 INFO:tasks.cephadm:Adding host smithi104 to orchestrator... 2024-04-30T23:04:11.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch host add smithi104 2024-04-30T23:04:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: Updating smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:11.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:12.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:12 smithi100 ceph-mon[29745]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:12.566 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:12 smithi100 ceph-mon[29745]: Updating smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 -- 172.21.15.100:0/2436653504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 msgr2=0x7f8224108d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 --2- 172.21.15.100:0/2436653504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224108d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8214009910 tx=0x7f8214009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 -- 172.21.15.100:0/2436653504 shutdown_connections 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 --2- 172.21.15.100:0/2436653504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224108d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 -- 172.21.15.100:0/2436653504 >> 172.21.15.100:0/2436653504 conn(0x7f82240fe470 msgr2=0x7f82241008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 -- 172.21.15.100:0/2436653504 shutdown_connections 2024-04-30T23:04:12.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.777+0000 7f822a380700 1 -- 172.21.15.100:0/2436653504 wait complete. 2024-04-30T23:04:12.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.778+0000 7f822a380700 1 Processor -- start 2024-04-30T23:04:12.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.778+0000 7f822a380700 1 -- start start 2024-04-30T23:04:12.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f822a380700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:12.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f822a380700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f822410ced0 con 0x7f8224108980 2024-04-30T23:04:12.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f8223fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:12.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f8223fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34454/0 (socket says 172.21.15.100:34454) 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f8223fff700 1 -- 172.21.15.100:0/980038614 learned_addr learned my addr 172.21.15.100:0/980038614 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f8223fff700 1 -- 172.21.15.100:0/980038614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8224198c70 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f8223fff700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82140056d0 tx=0x7f82140057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8214027070 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821400be10 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8224198f60 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8214022d20 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.779+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822419cf60 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.780+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8224104090 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.780+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f821402a070 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.781+0000 7f82217fa700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 0x7f820c03bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.781+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f821401e030 con 0x7f8224108980 2024-04-30T23:04:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.781+0000 7f82237fe700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 0x7f820c03bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:12.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.781+0000 7f82237fe700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 0x7f820c03bbc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8218006fd0 tx=0x7f8218006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.786+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8214013070 con 0x7f8224108980 2024-04-30T23:04:12.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:12.988+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi104", "target": ["mon-mgr", ""]}) -- 0x7f8224199a90 con 0x7f820c0396b0 2024-04-30T23:04:14.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:13 smithi100 ceph-mon[29745]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi104", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:14.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:13 smithi100 ceph-mon[29745]: Deploying cephadm binary to smithi104 2024-04-30T23:04:16.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:16 smithi100 ceph-mon[29745]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:17.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.096+0000 7f82217fa700 1 -- 172.21.15.100:0/980038614 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8224199a90 con 0x7f820c0396b0 2024-04-30T23:04:17.092 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi104' with addr '172.21.15.104' 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 msgr2=0x7f820c03bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 0x7f820c03bbc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8218006fd0 tx=0x7f8218006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 msgr2=0x7f8224198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82140056d0 tx=0x7f82140057b0 comp rx=0 tx=0).stop 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 shutdown_connections 2024-04-30T23:04:17.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f820c0396b0 0x7f820c03bbc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 --2- 172.21.15.100:0/980038614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8224108980 0x7f8224198730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 >> 172.21.15.100:0/980038614 conn(0x7f82240fe470 msgr2=0x7f82240ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 shutdown_connections 2024-04-30T23:04:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:17.098+0000 7f822a380700 1 -- 172.21.15.100:0/980038614 wait complete. 2024-04-30T23:04:17.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-30T23:04:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:18.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:18 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:18.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:18 smithi100 ceph-mon[29745]: Added host smithi104 2024-04-30T23:04:18.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:18 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:18.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:18 smithi100 ceph-mon[29745]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:18.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:18 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:19.188 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 -- 172.21.15.100:0/2066064271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 msgr2=0x7f81a8104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/2066064271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a8104280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8198009910 tx=0x7f8198009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 -- 172.21.15.100:0/2066064271 shutdown_connections 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/2066064271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a8104280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 -- 172.21.15.100:0/2066064271 >> 172.21.15.100:0/2066064271 conn(0x7f81a80ff5d0 msgr2=0x7f81a8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 -- 172.21.15.100:0/2066064271 shutdown_connections 2024-04-30T23:04:19.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 -- 172.21.15.100:0/2066064271 wait complete. 2024-04-30T23:04:19.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.432+0000 7f81ae5c1700 1 Processor -- start 2024-04-30T23:04:19.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81ae5c1700 1 -- start start 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81ae5c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81ae5c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f81a810e170 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81a7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81a7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50198/0 (socket says 172.21.15.100:50198) 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81a7fff700 1 -- 172.21.15.100:0/1927979635 learned_addr learned my addr 172.21.15.100:0/1927979635 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81a7fff700 1 -- 172.21.15.100:0/1927979635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a8077820 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.433+0000 7f81a7fff700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8198006010 tx=0x7f8198005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8198026070 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819800bc00 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a8075f10 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8198003910 con 0x7f81a8103e70 2024-04-30T23:04:19.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a8076310 con 0x7f81a8103e70 2024-04-30T23:04:19.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.434+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f8198029070 con 0x7f81a8103e70 2024-04-30T23:04:19.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.435+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a81051d0 con 0x7f81a8103e70 2024-04-30T23:04:19.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.435+0000 7f81a57fa700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 0x7f819003bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:19.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.435+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f819801e070 con 0x7f81a8103e70 2024-04-30T23:04:19.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.435+0000 7f81a77fe700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 0x7f819003bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:19.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.435+0000 7f81a77fe700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 0x7f819003bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f819c006fd0 tx=0x7f819c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:19.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.440+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8198013070 con 0x7f81a8103e70 2024-04-30T23:04:19.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.647+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81a8076f00 con 0x7f8190039650 2024-04-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.648+0000 7f81a57fa700 1 -- 172.21.15.100:0/1927979635 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f81a8076f00 con 0x7f8190039650 2024-04-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.104", "hostname": "smithi104", "labels": [], "status": ""}] 2024-04-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 msgr2=0x7f819003bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 0x7f819003bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f819c006fd0 tx=0x7f819c006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 msgr2=0x7f81a80759d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8198006010 tx=0x7f8198005780 comp rx=0 tx=0).stop 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 shutdown_connections 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8190039650 0x7f819003bb60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 --2- 172.21.15.100:0/1927979635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a8103e70 0x7f81a80759d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 >> 172.21.15.100:0/1927979635 conn(0x7f81a80ff5d0 msgr2=0x7f81a8106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.650+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 shutdown_connections 2024-04-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:19.651+0000 7f81ae5c1700 1 -- 172.21.15.100:0/1927979635 wait complete. 2024-04-30T23:04:20.263 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi183 2024-04-30T23:04:20.263 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:04:20.263 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.conf 2024-04-30T23:04:20.282 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:04:20.282 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:20.339 INFO:tasks.cephadm:Adding host smithi183 to orchestrator... 2024-04-30T23:04:20.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch host add smithi183 2024-04-30T23:04:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:21.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:20 smithi100 ceph-mon[29745]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:21.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:20 smithi100 ceph-mon[29745]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:21.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:22.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 -- 172.21.15.100:0/3020619358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 msgr2=0x7fda68108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:22.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 --2- 172.21.15.100:0/3020619358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda68108ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009910 tx=0x7fda5c009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:22.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 -- 172.21.15.100:0/3020619358 shutdown_connections 2024-04-30T23:04:22.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 --2- 172.21.15.100:0/3020619358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda68108ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:22.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 -- 172.21.15.100:0/3020619358 >> 172.21.15.100:0/3020619358 conn(0x7fda68077c60 msgr2=0x7fda680780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:22.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 -- 172.21.15.100:0/3020619358 shutdown_connections 2024-04-30T23:04:22.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.096+0000 7fda6ed98700 1 -- 172.21.15.100:0/3020619358 wait complete. 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6ed98700 1 Processor -- start 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6ed98700 1 -- start start 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6ed98700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6ed98700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810e150 con 0x7fda68108ab0 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6cb34700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6cb34700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50214/0 (socket says 172.21.15.100:50214) 2024-04-30T23:04:22.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.097+0000 7fda6cb34700 1 -- 172.21.15.100:0/1924284051 learned_addr learned my addr 172.21.15.100:0/1924284051 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda6cb34700 1 -- 172.21.15.100:0/1924284051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6819fad0 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda6cb34700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0056d0 tx=0x7fda5c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5c027070 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda5c00be10 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6819fd60 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5c022d20 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.098+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda68199720 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.099+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda681052d0 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.099+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fda5c02a070 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.099+0000 7fda65ffb700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 0x7fda5803bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.099+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda5c01e030 con 0x7fda68108ab0 2024-04-30T23:04:22.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.099+0000 7fda67fff700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 0x7fda5803bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:22.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.100+0000 7fda67fff700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 0x7fda5803bbc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda54006fd0 tx=0x7fda54006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:22.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.105+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fda5c013070 con 0x7fda68108ab0 2024-04-30T23:04:22.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:22.304+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}) -- 0x7fda68064d90 con 0x7fda580396b0 2024-04-30T23:04:23.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:22 smithi100 ceph-mon[29745]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:24.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:24.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:24.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:25.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:25.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: Deploying cephadm binary to smithi183 2024-04-30T23:04:25.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:25.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:25.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:25.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:24 smithi100 ceph-mon[29745]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:26.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.546+0000 7fda65ffb700 1 -- 172.21.15.100:0/1924284051 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fda68064d90 con 0x7fda580396b0 2024-04-30T23:04:26.543 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi183' with addr '172.21.15.183' 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.548+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 msgr2=0x7fda5803bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.548+0000 7fda6ed98700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 0x7fda5803bbc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda54006fd0 tx=0x7fda54006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.548+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 msgr2=0x7fda6819f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.548+0000 7fda6ed98700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0056d0 tx=0x7fda5c0057b0 comp rx=0 tx=0).stop 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 shutdown_connections 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda580396b0 0x7fda5803bbc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 --2- 172.21.15.100:0/1924284051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda68108ab0 0x7fda6819f590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 >> 172.21.15.100:0/1924284051 conn(0x7fda68077c60 msgr2=0x7fda681056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 shutdown_connections 2024-04-30T23:04:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:26.549+0000 7fda6ed98700 1 -- 172.21.15.100:0/1924284051 wait complete. 2024-04-30T23:04:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:26.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:26.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:26.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:27.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-30T23:04:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:27.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:27 smithi100 ceph-mon[29745]: Added host smithi183 2024-04-30T23:04:27.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:27 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:27.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:27 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:28.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:28 smithi100 ceph-mon[29745]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/595305448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 msgr2=0x7f1c08105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/595305448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c08105030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009910 tx=0x7f1bfc009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/595305448 shutdown_connections 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/595305448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c08105030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/595305448 >> 172.21.15.100:0/595305448 conn(0x7f1c080fe470 msgr2=0x7f1c081008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/595305448 shutdown_connections 2024-04-30T23:04:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/595305448 wait complete. 2024-04-30T23:04:28.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 Processor -- start 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.983+0000 7f1c0ecdc700 1 -- start start 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ecdc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ecdc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0810e010 con 0x7f1c08104c20 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ca78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ca78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57348/0 (socket says 172.21.15.100:57348) 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ca78700 1 -- 172.21.15.100:0/2710176106 learned_addr learned my addr 172.21.15.100:0/2710176106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ca78700 1 -- 172.21.15.100:0/2710176106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c081a1c40 con 0x7f1c08104c20 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ca78700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0092e0 tx=0x7f1bfc005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc026070 con 0x7f1c08104c20 2024-04-30T23:04:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c081a1ed0 con 0x7f1c08104c20 2024-04-30T23:04:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bfc00b750 con 0x7f1c08104c20 2024-04-30T23:04:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.984+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0038a0 con 0x7f1c08104c20 2024-04-30T23:04:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.985+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0819b920 con 0x7f1c08104c20 2024-04-30T23:04:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.985+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f1bfc029070 con 0x7f1c08104c20 2024-04-30T23:04:28.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.986+0000 7f1c05ffb700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 0x7f1bf803bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:28.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.986+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1bfc01e070 con 0x7f1c08104c20 2024-04-30T23:04:28.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.986+0000 7f1c07fff700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 0x7f1bf803bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:28.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.986+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0806c020 con 0x7f1c08104c20 2024-04-30T23:04:28.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.986+0000 7f1c07fff700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 0x7f1bf803bb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:28.991+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1bfc030020 con 0x7f1c08104c20 2024-04-30T23:04:29.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.204+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c0819ce50 con 0x7f1bf8039650 2024-04-30T23:04:29.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.205+0000 7f1c05ffb700 1 -- 172.21.15.100:0/2710176106 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f1c0819ce50 con 0x7f1bf8039650 2024-04-30T23:04:29.202 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:04:29.202 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.104", "hostname": "smithi104", "labels": [], "status": ""}, {"addr": "172.21.15.183", "hostname": "smithi183", "labels": [], "status": ""}] 2024-04-30T23:04:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 msgr2=0x7f1bf803bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 0x7f1bf803bb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 msgr2=0x7f1c081a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0092e0 tx=0x7f1bfc005780 comp rx=0 tx=0).stop 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 shutdown_connections 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1bf8039650 0x7f1bf803bb60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 --2- 172.21.15.100:0/2710176106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c08104c20 0x7f1c081a1700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 >> 172.21.15.100:0/2710176106 conn(0x7f1c080fe470 msgr2=0x7f1c08109d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 shutdown_connections 2024-04-30T23:04:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:29.207+0000 7f1c0ecdc700 1 -- 172.21.15.100:0/2710176106 wait complete. 2024-04-30T23:04:29.889 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-30T23:04:29.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-30T23:04:30.123 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:30.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:30.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:30 smithi100 ceph-mon[29745]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:30.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:30 smithi100 ceph-mon[29745]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.702+0000 7f060e588700 1 -- 172.21.15.100:0/4238088317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 msgr2=0x7f0608109eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 --2- 172.21.15.100:0/4238088317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f0608109eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009910 tx=0x7f05f8009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 -- 172.21.15.100:0/4238088317 shutdown_connections 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 --2- 172.21.15.100:0/4238088317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f0608109eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 -- 172.21.15.100:0/4238088317 >> 172.21.15.100:0/4238088317 conn(0x7f06080ff5b0 msgr2=0x7f0608101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 -- 172.21.15.100:0/4238088317 shutdown_connections 2024-04-30T23:04:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 -- 172.21.15.100:0/4238088317 wait complete. 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.703+0000 7f060e588700 1 Processor -- start 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f060e588700 1 -- start start 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f060e588700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f060e588700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f060810dff0 con 0x7f0608109aa0 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f0607fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:31.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f0607fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57372/0 (socket says 172.21.15.100:57372) 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f0607fff700 1 -- 172.21.15.100:0/1983654884 learned_addr learned my addr 172.21.15.100:0/1983654884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.704+0000 7f0607fff700 1 -- 172.21.15.100:0/1983654884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060819fa70 con 0x7f0608109aa0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f0607fff700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f80056d0 tx=0x7f05f80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f8027070 con 0x7f0608109aa0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f800be10 con 0x7f0608109aa0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060819fd60 con 0x7f0608109aa0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f8022d20 con 0x7f0608109aa0 2024-04-30T23:04:31.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.705+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0608199890 con 0x7f0608109aa0 2024-04-30T23:04:31.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f05f802a070 con 0x7f0608109aa0 2024-04-30T23:04:31.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f06057fa700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 0x7f05f003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:31.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f05f801e030 con 0x7f0608109aa0 2024-04-30T23:04:31.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f06077fe700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 0x7f05f003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:31.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06081051b0 con 0x7f0608109aa0 2024-04-30T23:04:31.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.706+0000 7f06077fe700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 0x7f05f003bbc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006fd0 tx=0x7f05fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.711+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f05f8013070 con 0x7f0608109aa0 2024-04-30T23:04:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:31.917+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f060819fff0 con 0x7f0608109aa0 2024-04-30T23:04:32.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.550+0000 7f06057fa700 1 -- 172.21.15.100:0/1983654884 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f05f8034020 con 0x7f0608109aa0 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 msgr2=0x7f05f003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 0x7f05f003bbc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006fd0 tx=0x7f05fc006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 msgr2=0x7f060819f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f80056d0 tx=0x7f05f80057b0 comp rx=0 tx=0).stop 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 shutdown_connections 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f05f00396b0 0x7f05f003bbc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 --2- 172.21.15.100:0/1983654884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0608109aa0 0x7f060819f530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 >> 172.21.15.100:0/1983654884 conn(0x7f06080ff5b0 msgr2=0x7f0608100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.552+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 shutdown_connections 2024-04-30T23:04:32.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:32.553+0000 7f060e588700 1 -- 172.21.15.100:0/1983654884 wait complete. 2024-04-30T23:04:32.551 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-04-30T23:04:32.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:32.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:32.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:33.217 INFO:tasks.cephadm:Adding mon.a on smithi100 2024-04-30T23:04:33.217 INFO:tasks.cephadm:Adding mon.b on smithi104 2024-04-30T23:04:33.217 INFO:tasks.cephadm:Adding mon.c on smithi183 2024-04-30T23:04:33.218 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c' 2024-04-30T23:04:33.442 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:33.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:34.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 -- 172.21.15.183:0/1123086907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 msgr2=0x7f2a3c108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:34.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 --2- 172.21.15.183:0/1123086907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c108da0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 -- 172.21.15.183:0/1123086907 shutdown_connections 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 --2- 172.21.15.183:0/1123086907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c108da0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 -- 172.21.15.183:0/1123086907 >> 172.21.15.183:0/1123086907 conn(0x7f2a3c0784c0 msgr2=0x7f2a3c078900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 -- 172.21.15.183:0/1123086907 shutdown_connections 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 -- 172.21.15.183:0/1123086907 wait complete. 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.777+0000 7f2a41469700 1 Processor -- start 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a41469700 1 -- start start 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a41469700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a41469700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c10bdd0 con 0x7f2a3c108990 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a3affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a3affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.183:58656/0 (socket says 172.21.15.183:58656) 2024-04-30T23:04:34.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.778+0000 7f2a3affd700 1 -- 172.21.15.183:0/845870467 learned_addr learned my addr 172.21.15.183:0/845870467 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:04:34.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a3affd700 1 -- 172.21.15.183:0/845870467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c197bd0 con 0x7f2a3c108990 2024-04-30T23:04:34.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a3affd700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0056d0 tx=0x7f2a2c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:34.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c027070 con 0x7f2a3c108990 2024-04-30T23:04:34.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a2c00be10 con 0x7f2a3c108990 2024-04-30T23:04:34.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c197ec0 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c022d20 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.779+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c19be70 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.780+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f2a2c02a070 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.780+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c1040a0 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.780+0000 7f2a38ff9700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 0x7f2a2803de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.780+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2a2c01e030 con 0x7f2a3c108990 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.780+0000 7f2a327fc700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 0x7f2a2803de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:34.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.781+0000 7f2a327fc700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 0x7f2a2803de00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a24006fd0 tx=0x7f2a24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:34.783 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.786+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2a2c013070 con 0x7f2a3c108990 2024-04-30T23:04:34.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:34 smithi100 ceph-mon[29745]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:34 smithi100 ceph-mon[29745]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:34.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:34.993+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}) -- 0x7f2a3c1989a0 con 0x7f2a2803b8f0 2024-04-30T23:04:34.998 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.001+0000 7f2a38ff9700 1 -- 172.21.15.183:0/845870467 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2a3c1989a0 con 0x7f2a2803b8f0 2024-04-30T23:04:34.998 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mon update... 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 msgr2=0x7f2a2803de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 0x7f2a2803de00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a24006fd0 tx=0x7f2a24006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 msgr2=0x7f2a3c197690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0056d0 tx=0x7f2a2c0057b0 comp rx=0 tx=0).stop 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 shutdown_connections 2024-04-30T23:04:35.000 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2a2803b8f0 0x7f2a2803de00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:35.001 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 --2- 172.21.15.183:0/845870467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a3c108990 0x7f2a3c197690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:35.001 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 >> 172.21.15.183:0/845870467 conn(0x7f2a3c0784c0 msgr2=0x7f2a3c101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:35.001 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 shutdown_connections 2024-04-30T23:04:35.001 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:35.003+0000 7f2a41469700 1 -- 172.21.15.183:0/845870467 wait complete. 2024-04-30T23:04:35.582 DEBUG:teuthology.orchestra.run.smithi104:mon.b> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.b.service 2024-04-30T23:04:35.584 DEBUG:teuthology.orchestra.run.smithi183:mon.c> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.c.service 2024-04-30T23:04:35.586 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-30T23:04:35.586 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-30T23:04:36.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c;count:3 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: Deploying daemon mon.c on smithi183 2024-04-30T23:04:36.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:36 smithi100 ceph-mon[29745]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:37.610 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:04:38.720 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:38 smithi183 systemd[1]: Starting Ceph mon.c for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:04:38.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:38 smithi100 ceph-mon[29745]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.229+0000 7f52200fc700 1 -- 172.21.15.183:0/2214916791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 msgr2=0x7f5218075e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.229+0000 7f52200fc700 1 --2- 172.21.15.183:0/2214916791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f5218075e80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5214009910 tx=0x7f5214009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.229+0000 7f52200fc700 1 -- 172.21.15.183:0/2214916791 shutdown_connections 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.229+0000 7f52200fc700 1 --2- 172.21.15.183:0/2214916791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f5218075e80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.229+0000 7f52200fc700 1 -- 172.21.15.183:0/2214916791 >> 172.21.15.183:0/2214916791 conn(0x7f52180ff6b0 msgr2=0x7f5218101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.230+0000 7f52200fc700 1 -- 172.21.15.183:0/2214916791 shutdown_connections 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.230+0000 7f52200fc700 1 -- 172.21.15.183:0/2214916791 wait complete. 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.230+0000 7f52200fc700 1 Processor -- start 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.230+0000 7f52200fc700 1 -- start start 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f52200fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f52200fc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5218114740 con 0x7f5218075a70 2024-04-30T23:04:39.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f521de98700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f521de98700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.183:52688/0 (socket says 172.21.15.183:52688) 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f521de98700 1 -- 172.21.15.183:0/353613774 learned_addr learned my addr 172.21.15.183:0/353613774 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f521de98700 1 -- 172.21.15.183:0/353613774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52181a0520 con 0x7f5218075a70 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f521de98700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52140056d0 tx=0x7f52140057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5214026070 con 0x7f5218075a70 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214004370 con 0x7f5218075a70 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.231+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52181a07b0 con 0x7f5218075a70 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.232+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52140039b0 con 0x7f5218075a70 2024-04-30T23:04:39.229 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.232+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181a0c10 con 0x7f5218075a70 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.232+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f5214029070 con 0x7f5218075a70 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.233+0000 7f520effd700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 0x7f520403bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.233+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f521401e070 con 0x7f5218075a70 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.233+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52180771b0 con 0x7f5218075a70 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.233+0000 7f521d697700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 0x7f520403bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:39.230 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.233+0000 7f521d697700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 0x7f520403bb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5208006fd0 tx=0x7f5208006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:39.235 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.239+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5214030080 con 0x7f5218075a70 2024-04-30T23:04:39.536 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.540+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f52181a1340 con 0x7f5218075a70 2024-04-30T23:04:39.538 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.542+0000 7f520effd700 1 -- 172.21.15.183:0/353613774 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f5214013070 con 0x7f5218075a70 2024-04-30T23:04:39.539 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:04:39.539 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":1,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","modified":"2024-04-30T23:02:58.443888Z","created":"2024-04-30T23:02:58.443888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 msgr2=0x7f520403bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 0x7f520403bb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5208006fd0 tx=0x7f5208006e40 comp rx=0 tx=0).stop 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 msgr2=0x7f521819ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52140056d0 tx=0x7f52140057b0 comp rx=0 tx=0).stop 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 shutdown_connections 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5204039650 0x7f520403bb60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:39.541 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 --2- 172.21.15.183:0/353613774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5218075a70 0x7f521819ffe0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:39.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 >> 172.21.15.183:0/353613774 conn(0x7f52180ff6b0 msgr2=0x7f52181020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:39.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 shutdown_connections 2024-04-30T23:04:39.542 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:39.545+0000 7f52200fc700 1 -- 172.21.15.183:0/353613774 wait complete. 2024-04-30T23:04:39.542 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 1 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 podman[33527]: 2024-04-30 23:04:39.288716037 +0000 UTC m=+0.019904654 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 podman[33527]: 2024-04-30 23:04:39.411988403 +0000 UTC m=+0.143177000 container create 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 podman[33527]: 2024-04-30 23:04:39.581063965 +0000 UTC m=+0.312252560 container init 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5) 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 podman[33527]: 2024-04-30 23:04:39.584801405 +0000 UTC m=+0.315990009 container start 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: set uid:gid to 167:167 (ceph:ceph) 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev), process ceph-mon, pid 2 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pidfile_write: ignore empty --pid-file 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: load: jerasure load: lrc 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: RocksDB version: 7.9.2 2024-04-30T23:04:39.643 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Git sha 0 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Compile date 2024-04-29 07:05:04 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: DB SUMMARY 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: DB Session ID: GWJ0SJQTP05QK0P47P29 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: CURRENT file: CURRENT 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: IDENTITY file: IDENTITY 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.error_if_exists: 0 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.create_if_missing: 0 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.paranoid_checks: 1 2024-04-30T23:04:39.644 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.env: 0x55ef0ddb6500 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.fs: PosixFileSystem 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.info_log: 0x55ef0f483fe0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_file_opening_threads: 16 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.statistics: (nil) 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.use_fsync: 0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_log_file_size: 0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.keep_log_file_num: 1000 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.recycle_log_file_num: 0 2024-04-30T23:04:39.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_fallocate: 1 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_mmap_reads: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_mmap_writes: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.use_direct_reads: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.create_missing_column_families: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.db_log_dir: 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.wal_dir: 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-30T23:04:39.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.advise_random_on_open: 1 2024-04-30T23:04:39.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.db_write_buffer_size: 0 2024-04-30T23:04:39.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.write_buffer_manager: 0x55ef0f4548c0 2024-04-30T23:04:39.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-30T23:04:39.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-30T23:04:39.647 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-30T23:04:39.648 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.rate_limiter: (nil) 2024-04-30T23:04:39.648 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-30T23:04:39.648 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.wal_recovery_mode: 2 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enable_thread_tracking: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enable_pipelined_write: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.unordered_write: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.row_cache: None 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.wal_filter: None 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_ingest_behind: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.two_write_queues: 0 2024-04-30T23:04:39.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.manual_wal_flush: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.wal_compression: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.atomic_flush: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.log_readahead_size: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.best_efforts_recovery: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.allow_data_in_errors: 0 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.db_host_id: __hostname__ 2024-04-30T23:04:39.650 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_background_jobs: 2 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_background_compactions: -1 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_subcompactions: 1 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_total_wal_size: 0 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_open_files: -1 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bytes_per_sync: 0 2024-04-30T23:04:39.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_readahead_size: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_background_flushes: -1 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Compression algorithms supported: 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kZSTD supported: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kXpressCompression supported: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kLZ4HCCompression supported: 1 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kZlibCompression supported: 1 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kSnappyCompression supported: 1 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kLZ4Compression supported: 1 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: kBZip2Compression supported: 0 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-30T23:04:39.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.merge_operator: 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_filter: None 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_filter_factory: None 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.sst_partitioner_factory: None 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ef0f58a1c0) 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout: cache_index_and_filter_blocks: 1 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-30T23:04:39.653 INFO:journalctl@ceph.mon.c.smithi183.stdout: pin_top_level_index_and_filter: 1 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_type: 0 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: data_block_index_type: 0 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_shortening: 1 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: checksum: 4 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: no_block_cache: 0 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache: 0x55ef0f4871f0 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_name: BinnedLRUCache 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_options: 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: capacity : 536870912 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: num_shard_bits : 4 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: strict_capacity_limit : 0 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: high_pri_pool_ratio: 0.000 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_cache_compressed: (nil) 2024-04-30T23:04:39.654 INFO:journalctl@ceph.mon.c.smithi183.stdout: persistent_cache: (nil) 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_size: 4096 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_size_deviation: 10 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_restart_interval: 16 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: index_block_restart_interval: 1 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: metadata_block_size: 4096 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: partition_filters: 0 2024-04-30T23:04:39.655 INFO:journalctl@ceph.mon.c.smithi183.stdout: use_delta_encoding: 1 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: filter_policy: bloomfilter 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: whole_key_filtering: 1 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: verify_compression: 0 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: read_amp_bytes_per_bit: 0 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: format_version: 5 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: enable_index_compression: 1 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: block_align: 0 2024-04-30T23:04:39.656 INFO:journalctl@ceph.mon.c.smithi183.stdout: max_auto_readahead_size: 262144 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout: prepopulate_block_cache: 0 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout: initial_auto_readahead_size: 8192 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout: num_file_reads_for_auto_readahead: 2 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.write_buffer_size: 33554432 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_write_buffer_number: 2 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression: NoCompression 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression: Disabled 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.prefix_extractor: nullptr 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.num_levels: 7 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-30T23:04:39.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.level: 32767 2024-04-30T23:04:39.658 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.strategy: 0 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.enabled: false 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.target_file_size_base: 67108864 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-30T23:04:39.659 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.arena_block_size: 1048576 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-30T23:04:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.disable_auto_compactions: 0 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.inplace_update_support: 0 2024-04-30T23:04:39.661 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.bloom_locality: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.max_successive_merges: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.paranoid_file_checks: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.force_consistency_checks: 1 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.report_bg_io_stats: 0 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.ttl: 2592000 2024-04-30T23:04:39.662 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enable_blob_files: false 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.min_blob_size: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_file_size: 268435456 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.blob_file_starting_level: 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-30T23:04:39.663 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d4d040a9-7501-4167-b73d-173a6da1aea3 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518279625827, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518279626381, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714518279, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d4d040a9-7501-4167-b73d-173a6da1aea3", "db_session_id": "GWJ0SJQTP05QK0P47P29", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518279626483, "job": 1, "event": "recovery_finished"} 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ef0f46bc00 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: DB pointer 0x55ef1425e000 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** DB Stats ** 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:04:39.664 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** Compaction Stats [default] ** 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.665 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** Compaction Stats [default] ** 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Cumulative compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:04:39.666 INFO:journalctl@ceph.mon.c.smithi183.stdout: Interval compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: Block cache BinnedLRUCache@0x55ef0f4871f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: using public_addr v2:172.21.15.183:0/0 -> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: starting mon.c rank -1 at public addrs [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] at bind addrs [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(???) e0 preinit fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).mds e1 new map 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: e1 2024-04-30T23:04:39.667 INFO:journalctl@ceph.mon.c.smithi183.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: legacy client fscid: -1 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout: No filesystems configured 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:39.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Deploying cephadm binary to smithi183 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:39.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Added host smithi183 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.671 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:39.672 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c;count:3 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: Deploying daemon mon.c on smithi183 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/353613774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:39.673 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 ceph-mon[33560]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-30T23:04:39.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:39 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/353613774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:39.937 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 bash[33527]: 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 2024-04-30T23:04:39.937 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:39 smithi183 systemd[1]: Started Ceph mon.c for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:04:41.224 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-30T23:04:41.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-30T23:04:41.470 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:04:45.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: mon.a calling monitor election 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: mon.c calling monitor election 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: monmap epoch 2 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: last_changed 2024-04-30T23:04:39.652456+0000 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: min_mon_release 19 (squid) 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: election_strategy: 1 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: fsmap 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: mgrmap e13: x(active, since 49s) 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:04:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: mon.a calling monitor election 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: mon.c calling monitor election 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: monmap epoch 2 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: last_changed 2024-04-30T23:04:39.652456+0000 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: min_mon_release 19 (squid) 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: election_strategy: 1 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: fsmap 2024-04-30T23:04:45.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: mgrmap e13: x(active, since 49s) 2024-04-30T23:04:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:04:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 -- 172.21.15.183:0/1937029518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13900035c0 msgr2=0x7f1390005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 --2- 172.21.15.183:0/1937029518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13900035c0 0x7f1390005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13a4102980 tx=0x7f13a000feb0 comp rx=0 tx=0).stop 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 -- 172.21.15.183:0/1937029518 shutdown_connections 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 --2- 172.21.15.183:0/1937029518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13900035c0 0x7f1390005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 -- 172.21.15.183:0/1937029518 >> 172.21.15.183:0/1937029518 conn(0x7f13a40796f0 msgr2=0x7f13a4079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 -- 172.21.15.183:0/1937029518 shutdown_connections 2024-04-30T23:04:45.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.778+0000 7f13aba3d700 1 -- 172.21.15.183:0/1937029518 wait complete. 2024-04-30T23:04:45.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.779+0000 7f13aba3d700 1 Processor -- start 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.779+0000 7f13aba3d700 1 -- start start 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13aba3d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13aba3d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 0x7f13a4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13aba3d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13a406c2d0 con 0x7f13a419fb40 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13aba3d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13a406c150 con 0x7f13900035c0 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:60744/0 (socket says 172.21.15.183:60744) 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 -- 172.21.15.183:0/2360464965 learned_addr learned my addr 172.21.15.183:0/2360464965 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 -- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 msgr2=0x7f13a419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 -- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 msgr2=0x7f13a419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a8fd8700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 0x7f13a4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:45.777 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a97d9700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:04:45.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a8fd8700 1 -- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 msgr2=0x7f13a419f600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:04:45.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a8fd8700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:45.778 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.780+0000 7f13a8fd8700 1 -- 172.21.15.183:0/2360464965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a41a00e0 con 0x7f13a419fb40 2024-04-30T23:04:45.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f13a8fd8700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 0x7f13a4199790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f139400b4d0 tx=0x7f139400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:45.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1394011630 con 0x7f13a419fb40 2024-04-30T23:04:45.779 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1394011c80 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a4199d90 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1394010da0 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.781+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a419a320 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.782+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f1394018020 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.782+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a419a630 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.782+0000 7f139a7fc700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 0x7f138803b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.782+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f139404c270 con 0x7f13a419fb40 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.783+0000 7f13a97d9700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 0x7f138803b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:45.780 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.783+0000 7f13a97d9700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 0x7f138803b950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f13a000fa60 tx=0x7f13a000f4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:45.784 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:45.788+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f139401f020 con 0x7f13a419fb40 2024-04-30T23:04:46.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:46.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:46.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:45 smithi183 ceph-mon[33560]: Deploying daemon mon.b on smithi104 2024-04-30T23:04:46.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:45 smithi183 ceph-mon[33560]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:46.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:46.064 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.068+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f13a4064d60 con 0x7f13a419fb40 2024-04-30T23:04:46.065 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.069+0000 7f139a7fc700 1 -- 172.21.15.183:0/2360464965 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f13a4064d60 con 0x7f13a419fb40 2024-04-30T23:04:46.065 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:04:46.065 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":2,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","modified":"2024-04-30T23:04:39.652456Z","created":"2024-04-30T23:02:58.443888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 msgr2=0x7f138803b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 0x7f138803b950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f13a000fa60 tx=0x7f13a000f4a0 comp rx=0 tx=0).stop 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 msgr2=0x7f13a4199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 0x7f13a4199790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f139400b4d0 tx=0x7f139400b890 comp rx=0 tx=0).stop 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 shutdown_connections 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1388039440 0x7f138803b950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13900035c0 0x7f13a419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 --2- 172.21.15.183:0/2360464965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13a419fb40 0x7f13a4199790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 >> 172.21.15.183:0/2360464965 conn(0x7f13a40796f0 msgr2=0x7f13a4106c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:46.068 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 shutdown_connections 2024-04-30T23:04:46.069 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:46.071+0000 7f13aba3d700 1 -- 172.21.15.183:0/2360464965 wait complete. 2024-04-30T23:04:46.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:46.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:46.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:45 smithi100 ceph-mon[29745]: Deploying daemon mon.b on smithi104 2024-04-30T23:04:46.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:45 smithi100 ceph-mon[29745]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:46.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:46.069 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 2 2024-04-30T23:04:47.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:46 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/2360464965' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:47.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:46 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/2360464965' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:47.652 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-30T23:04:47.652 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-30T23:04:47.897 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:04:48.019 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:47 smithi183 ceph-mon[33560]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:47 smithi100 ceph-mon[29745]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.466 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 podman[32968]: 2024-04-30 23:04:48.435682047 +0000 UTC m=+0.347080727 container start 52f900d59fc6d0d94bc8e34b5b79da346afe6088ab881be43c4d6d16f24c358e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:04:48.466 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: set uid:gid to 167:167 (ceph:ceph) 2024-04-30T23:04:48.466 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev), process ceph-mon, pid 2 2024-04-30T23:04:48.466 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pidfile_write: ignore empty --pid-file 2024-04-30T23:04:48.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: load: jerasure load: lrc 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: RocksDB version: 7.9.2 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Git sha 0 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Compile date 2024-04-29 07:05:04 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: DB SUMMARY 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: DB Session ID: KM4DR3CYYV6JJLQ307W8 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: CURRENT file: CURRENT 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: IDENTITY file: IDENTITY 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.error_if_exists: 0 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.create_if_missing: 0 2024-04-30T23:04:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.paranoid_checks: 1 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.env: 0x56295f89f500 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.fs: PosixFileSystem 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.info_log: 0x562960c91fe0 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_file_opening_threads: 16 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.statistics: (nil) 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.use_fsync: 0 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_log_file_size: 0 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-30T23:04:48.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.keep_log_file_num: 1000 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.recycle_log_file_num: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_fallocate: 1 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_mmap_reads: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_mmap_writes: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.use_direct_reads: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.create_missing_column_families: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.db_log_dir: 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.wal_dir: 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-30T23:04:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.advise_random_on_open: 1 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.db_write_buffer_size: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.write_buffer_manager: 0x562960c628c0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.rate_limiter: (nil) 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.wal_recovery_mode: 2 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enable_thread_tracking: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enable_pipelined_write: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.unordered_write: 0 2024-04-30T23:04:48.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.row_cache: None 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.wal_filter: None 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_ingest_behind: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.two_write_queues: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.manual_wal_flush: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.wal_compression: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.atomic_flush: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-30T23:04:48.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.log_readahead_size: 0 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.best_efforts_recovery: 0 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.allow_data_in_errors: 0 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.db_host_id: __hostname__ 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_background_jobs: 2 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_background_compactions: -1 2024-04-30T23:04:48.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_subcompactions: 1 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_total_wal_size: 0 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_open_files: -1 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bytes_per_sync: 0 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-30T23:04:48.800 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_readahead_size: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_background_flushes: -1 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Compression algorithms supported: 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kZSTD supported: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kXpressCompression supported: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kLZ4HCCompression supported: 1 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kZlibCompression supported: 1 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kSnappyCompression supported: 1 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kLZ4Compression supported: 1 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: kBZip2Compression supported: 0 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-30T23:04:48.801 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.merge_operator: 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_filter: None 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_filter_factory: None 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.sst_partitioner_factory: None 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562960d981c0) 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout: cache_index_and_filter_blocks: 1 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout: pin_top_level_index_and_filter: 1 2024-04-30T23:04:48.802 INFO:journalctl@ceph.mon.b.smithi104.stdout: index_type: 0 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: data_block_index_type: 0 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: index_shortening: 1 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: checksum: 4 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: no_block_cache: 0 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_cache: 0x562960c951f0 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_cache_name: BinnedLRUCache 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_cache_options: 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: capacity : 536870912 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: num_shard_bits : 4 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: strict_capacity_limit : 0 2024-04-30T23:04:48.803 INFO:journalctl@ceph.mon.b.smithi104.stdout: high_pri_pool_ratio: 0.000 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_cache_compressed: (nil) 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: persistent_cache: (nil) 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_size: 4096 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_size_deviation: 10 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_restart_interval: 16 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: index_block_restart_interval: 1 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: metadata_block_size: 4096 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: partition_filters: 0 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: use_delta_encoding: 1 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: filter_policy: bloomfilter 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: whole_key_filtering: 1 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: verify_compression: 0 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: read_amp_bytes_per_bit: 0 2024-04-30T23:04:48.804 INFO:journalctl@ceph.mon.b.smithi104.stdout: format_version: 5 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: enable_index_compression: 1 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: block_align: 0 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: max_auto_readahead_size: 262144 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: prepopulate_block_cache: 0 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: initial_auto_readahead_size: 8192 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout: num_file_reads_for_auto_readahead: 2 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.write_buffer_size: 33554432 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_write_buffer_number: 2 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression: NoCompression 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression: Disabled 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.prefix_extractor: nullptr 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.num_levels: 7 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-30T23:04:48.805 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.level: 32767 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.strategy: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-30T23:04:48.806 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.enabled: false 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.target_file_size_base: 67108864 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-30T23:04:48.807 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.arena_block_size: 1048576 2024-04-30T23:04:48.808 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.disable_auto_compactions: 0 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.inplace_update_support: 0 2024-04-30T23:04:48.809 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.bloom_locality: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.max_successive_merges: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.paranoid_file_checks: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.force_consistency_checks: 1 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.report_bg_io_stats: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.ttl: 2592000 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-30T23:04:48.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enable_blob_files: false 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.min_blob_size: 0 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_file_size: 268435456 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.blob_file_starting_level: 0 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8a14c072-4405-46a9-aa44-88f3e8cb2555 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518288476482, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-30T23:04:48.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518288476891, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714518288, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8a14c072-4405-46a9-aa44-88f3e8cb2555", "db_session_id": "KM4DR3CYYV6JJLQ307W8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714518288476970, "job": 1, "event": "recovery_finished"} 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562960c79c00 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: DB pointer 0x562965a6c000 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: ** DB Stats ** 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-30T23:04:48.812 INFO:journalctl@ceph.mon.b.smithi104.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: ** Compaction Stats [default] ** 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: ** Compaction Stats [default] ** 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-30T23:04:48.813 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Cumulative compaction: 0.00 GB write, 0.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Interval compaction: 0.00 GB write, 0.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Block cache BinnedLRUCache@0x562960c951f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-30T23:04:48.814 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: using public_addr v2:172.21.15.104:0/0 -> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: starting mon.b rank -1 at public addrs [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] at bind addrs [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(???) e0 preinit fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).mds e1 new map 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: e1 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: legacy client fscid: -1 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout: No filesystems configured 2024-04-30T23:04:48.815 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.816 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Deploying cephadm binary to smithi183 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:48.817 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Added host smithi183 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.818 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1983654884' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c;count:3 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Deploying daemon mon.c on smithi183 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.820 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/353613774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.a calling monitor election 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.c calling monitor election 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:48.821 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: monmap epoch 2 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: last_changed 2024-04-30T23:04:39.652456+0000 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: min_mon_release 19 (squid) 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: election_strategy: 1 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: fsmap 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mgrmap e13: x(active, since 49s) 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:48.822 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: Deploying daemon mon.b on smithi104 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/2360464965' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 ceph-mon[32987]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 bash[32968]: 52f900d59fc6d0d94bc8e34b5b79da346afe6088ab881be43c4d6d16f24c358e 2024-04-30T23:04:48.823 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:48 smithi104 systemd[1]: Started Ceph mon.b for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/2821872532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 msgr2=0x7f3d60005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/2821872532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d60005610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c005fa0 tx=0x7f3d6c00ff70 comp rx=0 tx=0).stop 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/2821872532 shutdown_connections 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/2821872532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d60005610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/2821872532 >> 172.21.15.183:0/2821872532 conn(0x7f3d780ff6a0 msgr2=0x7f3d78101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:53.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/2821872532 shutdown_connections 2024-04-30T23:04:53.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.658+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/2821872532 wait complete. 2024-04-30T23:04:53.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.659+0000 7f3d7dcc1700 1 Processor -- start 2024-04-30T23:04:53.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 -- start start 2024-04-30T23:04:53.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:53.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:53.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810bac0 con 0x7f3d78103dd0 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810b940 con 0x7f3d78199e40 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d7dcc1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810bc40 con 0x7f3d7819fc20 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d76ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.183:44442/0 (socket says 172.21.15.183:44442) 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d777fe700 1 -- 172.21.15.183:0/957642333 learned_addr learned my addr 172.21.15.183:0/957642333 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d77fff700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d76ffd700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 msgr2=0x7f3d78199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d76ffd700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 msgr2=0x7f3d78199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d76ffd700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-30T23:04:53.659 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d76ffd700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d77fff700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 msgr2=0x7f3d7819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d77fff700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 msgr2=0x7f3d7819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d77fff700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.660+0000 7f3d77fff700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 msgr2=0x7f3d78199900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 msgr2=0x7f3d7819a250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 -- 172.21.15.183:0/957642333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a6570 con 0x7f3d78103dd0 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d777fe700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c022040 con 0x7f3d78103dd0 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d6c0042f0 con 0x7f3d78103dd0 2024-04-30T23:04:53.660 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a67a0 con 0x7f3d78103dd0 2024-04-30T23:04:53.661 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0048f0 con 0x7f3d78103dd0 2024-04-30T23:04:53.661 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.661+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a6d00 con 0x7f3d78103dd0 2024-04-30T23:04:53.661 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.662+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f3d6c004a90 con 0x7f3d78103dd0 2024-04-30T23:04:53.661 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.662+0000 7f3d74ff9700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 0x7f3d6403bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:53.662 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.662+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3d6c050590 con 0x7f3d78103dd0 2024-04-30T23:04:53.662 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.662+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78064d30 con 0x7f3d78103dd0 2024-04-30T23:04:53.662 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.663+0000 7f3d76ffd700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 0x7f3d6403bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:53.662 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.663+0000 7f3d76ffd700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 0x7f3d6403bff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d78107390 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:53.665 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.669+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d6c0103d0 con 0x7f3d78103dd0 2024-04-30T23:04:53.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:53.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: mon.a calling monitor election 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: mon.c calling monitor election 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: monmap epoch 3 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: min_mon_release 19 (squid) 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: election_strategy: 1 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: fsmap 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: mgrmap e13: x(active, since 58s) 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:53.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:53.965 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.968+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3d7802e710 con 0x7f3d78103dd0 2024-04-30T23:04:53.965 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.969+0000 7f3d74ff9700 1 -- 172.21.15.183:0/957642333 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f3d6c00d340 con 0x7f3d78103dd0 2024-04-30T23:04:53.966 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-30T23:04:53.966 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":3,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","modified":"2024-04-30T23:04:48.502827Z","created":"2024-04-30T23:02:58.443888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:3300","nonce":0},{"type":"v1","addr":"172.21.15.104:6789","nonce":0}]},"addr":"172.21.15.104:6789/0","public_addr":"172.21.15.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: mon.a calling monitor election 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: mon.c calling monitor election 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:53.966 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: monmap epoch 3 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: min_mon_release 19 (squid) 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: election_strategy: 1 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:53.967 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: fsmap 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: mgrmap e13: x(active, since 58s) 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:53.968 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 msgr2=0x7f3d6403bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 0x7f3d6403bff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d78107390 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 msgr2=0x7f3d7819f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c003b60 comp rx=0 tx=0).stop 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 shutdown_connections 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d64039ae0 0x7f3d6403bff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d78199e40 0x7f3d7819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.969 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78103dd0 0x7f3d7819f6e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.970 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 --2- 172.21.15.183:0/957642333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7819fc20 0x7f3d78199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:53.970 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 >> 172.21.15.183:0/957642333 conn(0x7f3d780ff6a0 msgr2=0x7f3d78107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:53.970 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 shutdown_connections 2024-04-30T23:04:53.970 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:04:53.972+0000 7f3d7dcc1700 1 -- 172.21.15.183:0/957642333 wait complete. 2024-04-30T23:04:53.970 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 3 2024-04-30T23:04:54.588 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-30T23:04:54.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/957642333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:54.831 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/957642333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:54.989 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:04:55.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: mon.a calling monitor election 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: mon.c calling monitor election 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: monmap epoch 3 2024-04-30T23:04:55.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: min_mon_release 19 (squid) 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: election_strategy: 1 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: fsmap 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: mgrmap e13: x(active, since 58s) 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:55.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:55.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:55.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:04:55.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/957642333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-30T23:04:55.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 -- 172.21.15.100:0/2569895963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 msgr2=0x7f0d94105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 --2- 172.21.15.100:0/2569895963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d94105e90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009910 tx=0x7f0d84009c20 comp rx=0 tx=0).stop 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 -- 172.21.15.100:0/2569895963 shutdown_connections 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 --2- 172.21.15.100:0/2569895963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d94105e90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 -- 172.21.15.100:0/2569895963 >> 172.21.15.100:0/2569895963 conn(0x7f0d94078c70 msgr2=0x7f0d940790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 -- 172.21.15.100:0/2569895963 shutdown_connections 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.486+0000 7f0d990e4700 1 -- 172.21.15.100:0/2569895963 wait complete. 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.487+0000 7f0d990e4700 1 Processor -- start 2024-04-30T23:04:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.487+0000 7f0d990e4700 1 -- start start 2024-04-30T23:04:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.487+0000 7f0d990e4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.487+0000 7f0d990e4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d941035e0 0x7f0d941039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.487+0000 7f0d990e4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d941a5ef0 0x7f0d941a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d990e4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9410e1e0 con 0x7f0d94105a80 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d990e4700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9410e060 con 0x7f0d941a5ef0 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d990e4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9410e360 con 0x7f0d941035e0 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54062/0 (socket says 172.21.15.100:54062) 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 -- 172.21.15.100:0/2234768196 learned_addr learned my addr 172.21.15.100:0/2234768196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d9259c700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d941035e0 0x7f0d941039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d9359e700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d941a5ef0 0x7f0d941a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 -- 172.21.15.100:0/2234768196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d941035e0 msgr2=0x7f0d941039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d941035e0 0x7f0d941039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 -- 172.21.15.100:0/2234768196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d941a5ef0 msgr2=0x7f0d941a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d941a5ef0 0x7f0d941a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 -- 172.21.15.100:0/2234768196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d941a8990 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d92d9d700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d84004f80 tx=0x7f0d84004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84026070 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d8400b750 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d990e4700 1 -- 172.21.15.100:0/2234768196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d941a8c20 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84009e60 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.488+0000 7f0d990e4700 1 -- 172.21.15.100:0/2234768196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941a9150 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.489+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f0d84029070 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.490+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d74005330 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.490+0000 7f0d7bfff700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 0x7f0d7c03bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.490+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0d84004460 con 0x7f0d94105a80 2024-04-30T23:04:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.490+0000 7f0d9259c700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 0x7f0d7c03bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:04:56.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.490+0000 7f0d9259c700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 0x7f0d7c03bff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d941012e0 tx=0x7f0d88009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:04:56.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.495+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0d84013070 con 0x7f0d94105a80 2024-04-30T23:04:56.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mon.b calling monitor election 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mon.b calling monitor election 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mon.c calling monitor election 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mon.a calling monitor election 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: monmap epoch 3 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:56.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: min_mon_release 19 (squid) 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: election_strategy: 1 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: fsmap 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: mgrmap e13: x(active, since 60s) 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:56.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.728+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0d74005620 con 0x7f0d94105a80 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.729+0000 7f0d7bfff700 1 -- 172.21.15.100:0/2234768196 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f0d84030090 con 0x7f0d94105a80 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:56.725 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] 2024-04-30T23:04:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 msgr2=0x7f0d7c03bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 0x7f0d7c03bff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d941012e0 tx=0x7f0d88009210 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 msgr2=0x7f0d941030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d84004f80 tx=0x7f0d84004fb0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 shutdown_connections 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0d7c039ae0 0x7f0d7c03bff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d941a5ef0 0x7f0d941a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d94105a80 0x7f0d941030a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 --2- 172.21.15.100:0/2234768196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d941035e0 0x7f0d941039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 >> 172.21.15.100:0/2234768196 conn(0x7f0d94078c70 msgr2=0x7f0d940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 shutdown_connections 2024-04-30T23:04:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:04:56.731+0000 7f0d79ffb700 1 -- 172.21.15.100:0/2234768196 wait complete. 2024-04-30T23:04:56.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mon.b calling monitor election 2024-04-30T23:04:56.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mon.b calling monitor election 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mon.c calling monitor election 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mon.a calling monitor election 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: monmap epoch 3 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: min_mon_release 19 (squid) 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: election_strategy: 1 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:56.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: fsmap 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: mgrmap e13: x(active, since 60s) 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:56.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:56.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mon.b calling monitor election 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: Updating smithi104:/etc/ceph/ceph.conf 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: Updating smithi183:/etc/ceph/ceph.conf 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mon.b calling monitor election 2024-04-30T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mon.c calling monitor election 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mon.a calling monitor election 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: monmap epoch 3 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: last_changed 2024-04-30T23:04:48.502827+0000 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: created 2024-04-30T23:02:58.443888+0000 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: min_mon_release 19 (squid) 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: election_strategy: 1 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-04-30T23:04:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: 2: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: fsmap 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: osdmap e4: 0 total, 0 up, 0 in 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: mgrmap e13: x(active, since 60s) 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.802 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:56.802 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:56.802 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:56.802 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:57.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: Updating smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: Reconfiguring mon.a (unknown last config time)... 2024-04-30T23:04:57.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: Reconfiguring daemon mon.a on smithi100 2024-04-30T23:04:57.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:57.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2234768196' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: Updating smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: Reconfiguring mon.a (unknown last config time)... 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: Reconfiguring daemon mon.a on smithi100 2024-04-30T23:04:57.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:57.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2234768196' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:57.819 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:04:57.502+0000 7f3cca54f700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: Updating smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: Updating smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: Updating smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: Reconfiguring mon.a (unknown last config time)... 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: Reconfiguring daemon mon.a on smithi100 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:04:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2234768196' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:58.255 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-30T23:04:58.255 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:58.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-04-30T23:04:58.281 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:04:58.281 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:58.344 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:04:58.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.conf 2024-04-30T23:04:58.371 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:04:58.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:58.435 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:04:58.435 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.conf 2024-04-30T23:04:58.467 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:04:58.468 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-30T23:04:58.535 INFO:tasks.cephadm:Adding mgr.x on smithi100 2024-04-30T23:04:58.535 INFO:tasks.cephadm:Adding mgr.y on smithi104 2024-04-30T23:04:58.535 INFO:tasks.cephadm:Adding mgr.z on smithi183 2024-04-30T23:04:58.536 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi100=x;smithi104=y;smithi183=z' 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:58.626 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:58.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:04:58.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:04:58.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:04:58.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:04:58.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:04:58.806 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:04:59.779 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:59 smithi183 ceph-mon[33560]: Reconfiguring mon.b (monmap changed)... 2024-04-30T23:04:59.779 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:04:59 smithi183 ceph-mon[33560]: Reconfiguring daemon mon.b on smithi104 2024-04-30T23:04:59.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:59 smithi104 ceph-mon[32987]: Reconfiguring mon.b (monmap changed)... 2024-04-30T23:04:59.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:04:59 smithi104 ceph-mon[32987]: Reconfiguring daemon mon.b on smithi104 2024-04-30T23:04:59.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:59 smithi100 ceph-mon[29745]: Reconfiguring mon.b (monmap changed)... 2024-04-30T23:04:59.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:04:59 smithi100 ceph-mon[29745]: Reconfiguring daemon mon.b on smithi104 2024-04-30T23:05:00.246 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 -- 172.21.15.183:0/2595946290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 msgr2=0x7f48381022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:00.246 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 --2- 172.21.15.183:0/2595946290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f48381022a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f482c009910 tx=0x7f482c009c20 comp rx=0 tx=0).stop 2024-04-30T23:05:00.246 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 -- 172.21.15.183:0/2595946290 shutdown_connections 2024-04-30T23:05:00.247 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 --2- 172.21.15.183:0/2595946290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f48381022a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.247 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 -- 172.21.15.183:0/2595946290 >> 172.21.15.183:0/2595946290 conn(0x7f48380fd870 msgr2=0x7f48380ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:00.247 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.249+0000 7f483ec75700 1 -- 172.21.15.183:0/2595946290 shutdown_connections 2024-04-30T23:05:00.247 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.250+0000 7f483ec75700 1 -- 172.21.15.183:0/2595946290 wait complete. 2024-04-30T23:05:00.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.250+0000 7f483ec75700 1 Processor -- start 2024-04-30T23:05:00.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.250+0000 7f483ec75700 1 -- start start 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4838199dd0 0x7f483819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f483819f2a0 0x7f48381a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4838109b90 con 0x7f4838101e90 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4838109a10 con 0x7f483819f2a0 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ec75700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4838109d10 con 0x7f4838199dd0 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.183:53046/0 (socket says 172.21.15.183:53046) 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 -- 172.21.15.183:0/423197023 learned_addr learned my addr 172.21.15.183:0/423197023 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f4837fff700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4838199dd0 0x7f483819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483d212700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f483819f2a0 0x7f48381a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:00.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 -- 172.21.15.183:0/423197023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4838199dd0 msgr2=0x7f483819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4838199dd0 0x7f483819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 -- 172.21.15.183:0/423197023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f483819f2a0 msgr2=0x7f48381a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f483819f2a0 0x7f48381a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.251+0000 7f483ca11700 1 -- 172.21.15.183:0/423197023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48381a1c30 con 0x7f4838101e90 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f483ca11700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f482c005850 tx=0x7f482c004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c026070 con 0x7f4838101e90 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48381a1ec0 con 0x7f4838101e90 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f482c00b750 con 0x7f4838101e90 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c0038e0 con 0x7f4838101e90 2024-04-30T23:05:00.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.252+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48381a2390 con 0x7f4838101e90 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.253+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4838064d30 con 0x7f4838101e90 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.253+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f482c029070 con 0x7f4838101e90 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.253+0000 7f4835ffb700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 0x7f482803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.254+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f482c04d400 con 0x7f4838101e90 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.254+0000 7f4837fff700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 0x7f482803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:00.251 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.254+0000 7f4837fff700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 0x7f482803bff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f483819a940 tx=0x7f4824009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:00.256 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.259+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f482c013070 con 0x7f4838101e90 2024-04-30T23:05:00.477 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.480+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi104=y;smithi183=z", "target": ["mon-mgr", ""]}) -- 0x7f48380ff720 con 0x7f4828039ae0 2024-04-30T23:05:00.483 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.486+0000 7f4835ffb700 1 -- 172.21.15.183:0/423197023 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f48380ff720 con 0x7f4828039ae0 2024-04-30T23:05:00.483 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mgr update... 2024-04-30T23:05:00.485 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 msgr2=0x7f482803bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:00.485 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 0x7f482803bff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f483819a940 tx=0x7f4824009210 comp rx=0 tx=0).stop 2024-04-30T23:05:00.485 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 msgr2=0x7f4838199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:00.485 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f482c005850 tx=0x7f482c004ed0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 shutdown_connections 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4828039ae0 0x7f482803bff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f483819f2a0 0x7f48381a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4838101e90 0x7f4838199890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 --2- 172.21.15.183:0/423197023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4838199dd0 0x7f483819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 >> 172.21.15.183:0/423197023 conn(0x7f48380fd870 msgr2=0x7f48380ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 shutdown_connections 2024-04-30T23:05:00.486 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:00.489+0000 7f483ec75700 1 -- 172.21.15.183:0/423197023 wait complete. 2024-04-30T23:05:00.676 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: Reconfiguring mon.c (monmap changed)... 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: Reconfiguring daemon mon.c on smithi183 2024-04-30T23:05:00.677 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:00.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: Reconfiguring mon.c (monmap changed)... 2024-04-30T23:05:00.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:05:00.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:05:00.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:00.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: Reconfiguring daemon mon.c on smithi183 2024-04-30T23:05:00.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: Reconfiguring mon.c (monmap changed)... 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: Reconfiguring daemon mon.c on smithi183 2024-04-30T23:05:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:01.437 DEBUG:teuthology.orchestra.run.smithi104:mgr.y> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.y.service 2024-04-30T23:05:01.440 DEBUG:teuthology.orchestra.run.smithi183:mgr.z> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.z.service 2024-04-30T23:05:01.443 INFO:tasks.cephadm:Deploying OSDs... 2024-04-30T23:05:01.443 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:05:01.443 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-04-30T23:05:01.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-30T23:05:01.462 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-30 23:04:05.779512371 +0000 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-30 22:59:04.189843305 +0000 2024-04-30T23:05:01.519 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-30 22:59:04.189843305 +0000 2024-04-30T23:05:01.520 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-30 22:59:04.189843305 +0000 2024-04-30T23:05:01.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-30T23:05:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-30T23:05:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-30T23:05:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000243853 s, 2.1 MB/s 2024-04-30T23:05:01.588 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-30T23:05:01.646 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-04-30T23:05:01.702 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-30T23:05:01.702 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-30 23:04:05.811511560 +0000 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-30 22:59:04.550833860 +0000 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-30 22:59:04.550833860 +0000 2024-04-30T23:05:01.703 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-30 22:59:04.550833860 +0000 2024-04-30T23:05:01.703 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-30T23:05:01.767 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-30T23:05:01.768 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-30T23:05:01.768 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000203652 s, 2.5 MB/s 2024-04-30T23:05:01.769 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-30T23:05:01.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:01 smithi104 ceph-mon[32987]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi104=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:01.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:01 smithi104 ceph-mon[32987]: Saving service mgr spec with placement smithi100=x;smithi104=y;smithi183=z;count:3 2024-04-30T23:05:01.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:01 smithi183 ceph-mon[33560]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi104=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:01.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:01 smithi183 ceph-mon[33560]: Saving service mgr spec with placement smithi100=x;smithi104=y;smithi183=z;count:3 2024-04-30T23:05:01.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:01 smithi100 ceph-mon[29745]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi104=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:01.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:01 smithi100 ceph-mon[29745]: Saving service mgr spec with placement smithi100=x;smithi104=y;smithi183=z;count:3 2024-04-30T23:05:01.826 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-04-30T23:05:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-30 23:04:05.837510902 +0000 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-30 22:59:04.892824912 +0000 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-30 22:59:04.892824912 +0000 2024-04-30T23:05:01.883 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-30 22:59:04.892824912 +0000 2024-04-30T23:05:01.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-30T23:05:01.946 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-30T23:05:01.946 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-30T23:05:01.947 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000235391 s, 2.2 MB/s 2024-04-30T23:05:01.948 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-30T23:05:02.003 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-04-30T23:05:02.059 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-30T23:05:02.059 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.059 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-30 23:04:05.868510117 +0000 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-30 22:59:05.232816017 +0000 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-30 22:59:05.232816017 +0000 2024-04-30T23:05:02.060 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-30 22:59:05.232816017 +0000 2024-04-30T23:05:02.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-30T23:05:02.121 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-30T23:05:02.121 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-30T23:05:02.121 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000204097 s, 2.5 MB/s 2024-04-30T23:05:02.122 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-30T23:05:02.179 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-30T23:05:02.179 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-04-30T23:05:02.198 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-30T23:05:02.198 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-30 23:04:47.900541118 +0000 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-30 22:59:16.187995036 +0000 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-30 22:59:16.187995036 +0000 2024-04-30T23:05:02.257 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-30 22:59:16.187995036 +0000 2024-04-30T23:05:02.257 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-30T23:05:02.324 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-30T23:05:02.324 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-30T23:05:02.324 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000268105 s, 1.9 MB/s 2024-04-30T23:05:02.325 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-30T23:05:02.384 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-30 23:04:47.900541118 +0000 2024-04-30T23:05:02.440 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-30 22:59:16.521990819 +0000 2024-04-30T23:05:02.441 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-30 22:59:16.521990819 +0000 2024-04-30T23:05:02.441 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-30 22:59:16.521990819 +0000 2024-04-30T23:05:02.441 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-30T23:05:02.505 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-30T23:05:02.505 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-30T23:05:02.505 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000202656 s, 2.5 MB/s 2024-04-30T23:05:02.506 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-30T23:05:02.563 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-04-30T23:05:02.620 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-30T23:05:02.620 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.620 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-30T23:05:02.620 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.620 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.621 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-30 23:04:47.901541106 +0000 2024-04-30T23:05:02.621 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-30 22:59:16.864986488 +0000 2024-04-30T23:05:02.621 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-30 22:59:16.864986488 +0000 2024-04-30T23:05:02.621 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-30 22:59:16.864986488 +0000 2024-04-30T23:05:02.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-30T23:05:02.681 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:02.681 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:02.682 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.683 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-30T23:05:02.683 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-30T23:05:02.683 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000190841 s, 2.7 MB/s 2024-04-30T23:05:02.685 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-30T23:05:02.741 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-30 23:04:47.901541106 +0000 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-30 22:59:17.201982232 +0000 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-30 22:59:17.201982232 +0000 2024-04-30T23:05:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-30 22:59:17.201982232 +0000 2024-04-30T23:05:02.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-30T23:05:02.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:02.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:02.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-30T23:05:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-30T23:05:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000251421 s, 2.0 MB/s 2024-04-30T23:05:02.860 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-30T23:05:02.916 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-04-30T23:05:02.916 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-04-30T23:05:02.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-30T23:05:02.932 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-04-30 23:04:38.483775377 +0000 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-04-30 22:59:38.043060477 +0000 2024-04-30T23:05:02.987 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-04-30 22:59:38.043060477 +0000 2024-04-30T23:05:02.988 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-04-30 22:59:38.043060477 +0000 2024-04-30T23:05:02.988 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-30T23:05:03.050 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-04-30T23:05:03.051 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-04-30T23:05:03.051 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000189082 s, 2.7 MB/s 2024-04-30T23:05:03.052 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-30T23:05:03.107 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-04-30 23:04:38.483775377 +0000 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-04-30 22:59:38.382050863 +0000 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-04-30 22:59:38.382050863 +0000 2024-04-30T23:05:03.162 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-04-30 22:59:38.382050863 +0000 2024-04-30T23:05:03.163 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-30T23:05:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-04-30T23:05:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-04-30T23:05:03.225 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000216774 s, 2.4 MB/s 2024-04-30T23:05:03.226 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-30T23:05:03.281 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-04-30T23:05:03.336 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-30T23:05:03.336 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:03.336 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-30T23:05:03.336 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:03.337 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:03.337 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-04-30 23:04:38.483775377 +0000 2024-04-30T23:05:03.337 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-04-30 22:59:38.722041220 +0000 2024-04-30T23:05:03.337 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-04-30 22:59:38.722041220 +0000 2024-04-30T23:05:03.337 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-04-30 22:59:38.722041220 +0000 2024-04-30T23:05:03.337 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-30T23:05:03.399 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-04-30T23:05:03.399 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-04-30T23:05:03.399 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000189586 s, 2.7 MB/s 2024-04-30T23:05:03.400 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-30T23:05:03.455 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-04-30T23:05:03.509 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-04-30 23:04:38.484775350 +0000 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-04-30 22:59:39.046032031 +0000 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-04-30 22:59:39.046032031 +0000 2024-04-30T23:05:03.510 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-04-30 22:59:39.046032031 +0000 2024-04-30T23:05:03.510 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-30T23:05:03.573 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-04-30T23:05:03.573 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-04-30T23:05:03.573 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000194234 s, 2.6 MB/s 2024-04-30T23:05:03.574 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-30T23:05:03.629 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2024-04-30T23:05:03.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-30T23:05:03.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:03 smithi104 ceph-mon[32987]: Deploying daemon mgr.z on smithi183 2024-04-30T23:05:03.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:03 smithi183 ceph-mon[33560]: Deploying daemon mgr.z on smithi183 2024-04-30T23:05:03.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:03 smithi100 ceph-mon[29745]: Deploying daemon mgr.z on smithi183 2024-04-30T23:05:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:05:04.539 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 systemd[1]: Starting Ceph mgr.z for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:05:04.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:04 smithi104 ceph-mon[32987]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:04.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:04 smithi183 ceph-mon[33560]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:04.797 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 podman[35404]: 2024-04-30 23:05:04.637475499 +0000 UTC m=+0.114125036 container create 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:05:04.797 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 podman[35404]: 2024-04-30 23:05:04.540712766 +0000 UTC m=+0.017362261 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:05:04.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:04 smithi100 ceph-mon[29745]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:05.195 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 podman[35404]: 2024-04-30 23:05:04.848159542 +0000 UTC m=+0.324809037 container init 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 podman[35404]: 2024-04-30 23:05:04.852057855 +0000 UTC m=+0.328707354 container start 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 ceph-mgr[35423]: -- 172.21.15.183:0/523640296 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bcdd6e5a0 con 0x563bd2af4000 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 bash[35404]: 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:04 smithi183 systemd[1]: Started Ceph mgr.z for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:05.014+0000 7feb593c2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T23:05:05.196 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:05.198+0000 7feb593c2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:05:05.547 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:05.302+0000 7feb593c2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T23:05:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-30T23:05:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-30T23:05:05.698 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-30T23:05:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-30T23:05:05.699 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113764 s, 922 MB/s 2024-04-30T23:05:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-30T23:05:05.998 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:05.610+0000 7feb593c2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T23:05:05.998 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:05.693+0000 7feb593c2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T23:05:06.292 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.292 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.292 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: Deploying daemon mgr.y on smithi104 2024-04-30T23:05:06.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:06 smithi104 ceph-mon[32987]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:06.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:06.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:06.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:06.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:06.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: Deploying daemon mgr.y on smithi104 2024-04-30T23:05:06.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-mon[33560]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:06.308 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.308 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:06.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: Deploying daemon mgr.y on smithi104 2024-04-30T23:05:06.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:06 smithi100 ceph-mon[29745]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:06.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-04-30T23:05:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:05:07.234 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:06.889+0000 7feb593c2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T23:05:07.235 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:07.060+0000 7feb593c2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T23:05:07.235 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:07.237+0000 7feb593c2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T23:05:07.504 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:07.474+0000 7f38f645a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T23:05:07.778 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:07.668+0000 7f38f645a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:05:07.779 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:07.781+0000 7f38f645a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T23:05:07.797 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:07.540+0000 7feb593c2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T23:05:07.797 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:07.638+0000 7feb593c2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T23:05:08.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 -- 172.21.15.100:0/1708070418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200103160 msgr2=0x7fe200103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:08.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 --2- 172.21.15.100:0/1708070418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200103160 0x7fe200103570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009990 tx=0x7fe1f0009ca0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 -- 172.21.15.100:0/1708070418 shutdown_connections 2024-04-30T23:05:08.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 --2- 172.21.15.100:0/1708070418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104c30 0x7fe20010b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 --2- 172.21.15.100:0/1708070418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200103160 0x7fe200103570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 --2- 172.21.15.100:0/1708070418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200104290 0x7fe2001046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 -- 172.21.15.100:0/1708070418 >> 172.21.15.100:0/1708070418 conn(0x7fe2000fe7a0 msgr2=0x7fe200100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 -- 172.21.15.100:0/1708070418 shutdown_connections 2024-04-30T23:05:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.150+0000 7fe207e15700 1 -- 172.21.15.100:0/1708070418 wait complete. 2024-04-30T23:05:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 Processor -- start 2024-04-30T23:05:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 -- start start 2024-04-30T23:05:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200103160 0x7fe200199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104290 0x7fe200199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe20010ec00 con 0x7fe200104c30 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe20010ea80 con 0x7fe200103160 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe207e15700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe20010ed80 con 0x7fe200104290 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe2063b2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe205bb1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200103160 0x7fe200199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe2063b2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53030/0 (socket says 172.21.15.100:53030) 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe2063b2700 1 -- 172.21.15.100:0/1236170502 learned_addr learned my addr 172.21.15.100:0/1236170502 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.151+0000 7fe2053b0700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104290 0x7fe200199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 -- 172.21.15.100:0/1236170502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104290 msgr2=0x7fe200199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104290 0x7fe200199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 -- 172.21.15.100:0/1236170502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200103160 msgr2=0x7fe200199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200103160 0x7fe200199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 -- 172.21.15.100:0/1236170502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2001a1250 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe2063b2700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8007ee0 tx=0x7fe1f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8004bb0 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1f8004d50 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2001a1540 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005920 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.152+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe200075900 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.153+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fe1f801a020 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.153+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2000511d0 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.153+0000 7fe1f6ffd700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 0x7fe1ec03dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.153+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe1f804c050 con 0x7fe200104c30 2024-04-30T23:05:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.153+0000 7fe205bb1700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 0x7fe1ec03dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.154+0000 7fe205bb1700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 0x7fe1ec03dfb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00038a0 tx=0x7fe1f001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.158+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe1f8010070 con 0x7fe200104c30 2024-04-30T23:05:08.248 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:07.854+0000 7feb593c2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T23:05:08.248 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:08.066+0000 7feb593c2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:05:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:08.389+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe200075b60 con 0x7fe1ec03baa0 2024-04-30T23:05:08.466 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:08.107+0000 7f38f645a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T23:05:08.466 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:08.214+0000 7f38f645a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T23:05:08.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:08.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:08.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:08.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:08.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:08.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:08.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:08.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.047 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:08.714+0000 7feb593c2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T23:05:09.449 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:09.153+0000 7feb593c2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T23:05:09.449 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:09.250+0000 7feb593c2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T23:05:09.449 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:09.451+0000 7feb593c2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.792 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:09.462+0000 7f38f645a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T23:05:09.792 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:09.630+0000 7f38f645a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T23:05:09.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:09.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:09.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:09.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:09.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-30T23:05:09.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-30T23:05:09.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:10.080 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:09 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:09.798+0000 7f38f645a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T23:05:10.080 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:10.082+0000 7f38f645a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T23:05:10.297 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:09.977+0000 7feb593c2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T23:05:10.297 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.069+0000 7feb593c2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T23:05:10.372 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:10.173+0000 7f38f645a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T23:05:10.372 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:10.375+0000 7f38f645a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T23:05:10.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-mon[33560]: Reconfiguring mgr.x (unknown last config time)... 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-mon[33560]: Reconfiguring daemon mgr.x on smithi100 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-mon[33560]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.309+0000 7feb593c2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.440+0000 7feb593c2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.537+0000 7feb593c2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T23:05:10.652 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.654+0000 7feb593c2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T23:05:10.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-mon[32987]: Reconfiguring mgr.x (unknown last config time)... 2024-04-30T23:05:10.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-mon[32987]: Reconfiguring daemon mgr.x on smithi100 2024-04-30T23:05:10.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-mon[32987]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:10.793 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:10 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:10.563+0000 7f38f645a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T23:05:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:10 smithi100 ceph-mon[29745]: Reconfiguring mgr.x (unknown last config time)... 2024-04-30T23:05:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:10 smithi100 ceph-mon[29745]: Reconfiguring daemon mgr.x on smithi100 2024-04-30T23:05:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:10 smithi100 ceph-mon[29745]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:11.297 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:10.964+0000 7feb593c2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T23:05:11.542 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:11.158+0000 7f38f645a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T23:05:11.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:11.797 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]: dispatch 2024-04-30T23:05:11.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]': finished 2024-04-30T23:05:11.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-mon[33560]: osdmap e5: 1 total, 0 up, 1 in 2024-04-30T23:05:11.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:11.798 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:11.564+0000 7feb593c2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T23:05:11.798 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:05:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z[35418]: 2024-04-30T23:05:11.777+0000 7feb593c2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T23:05:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:11 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]: dispatch 2024-04-30T23:05:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:11 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]': finished 2024-04-30T23:05:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:11 smithi100 ceph-mon[29745]: osdmap e5: 1 total, 0 up, 1 in 2024-04-30T23:05:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:11.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:11.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]: dispatch 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1608344774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef7c5b0b-6410-4a8c-bfea-6469f5de392e"}]': finished 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-mon[32987]: osdmap e5: 1 total, 0 up, 1 in 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:11.575+0000 7f38f645a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:11.670+0000 7f38f645a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T23:05:11.864 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:11 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:11.866+0000 7f38f645a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T23:05:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:12.555+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) ==== 92603+0+0 (secure 0 0 0) 0x7fe1f80133f0 con 0x7fe200104c30 2024-04-30T23:05:12.722 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:12.398+0000 7f38f645a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:12.488+0000 7f38f645a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1269290874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: Standby manager daemon z started 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-30T23:05:12.723 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1269290874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: Standby manager daemon z started 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-30T23:05:12.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:12 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1269290874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: Standby manager daemon z started 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-30T23:05:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:12 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.183:0/513898722' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:13.042 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:12.726+0000 7f38f645a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T23:05:13.042 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:12.858+0000 7f38f645a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T23:05:13.042 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:12.952+0000 7f38f645a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T23:05:13.373 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:13 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:13.067+0000 7f38f645a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T23:05:13.373 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:13 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:13.377+0000 7f38f645a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T23:05:13.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:13 smithi104 ceph-mon[32987]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-30T23:05:13.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:13 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-30T23:05:13.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:13 smithi100 ceph-mon[29745]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-30T23:05:13.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:13 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-30T23:05:14.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:13 smithi183 ceph-mon[33560]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-30T23:05:14.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:13 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-30T23:05:14.292 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:13 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:13.970+0000 7f38f645a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T23:05:14.292 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y[34371]: 2024-04-30T23:05:14.181+0000 7f38f645a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T23:05:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:14.566+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7fe1f801a310 con 0x7fe200104c30 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: Standby manager daemon y started 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-30T23:05:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:14 smithi100 ceph-mon[29745]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:15.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:15.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: Standby manager daemon y started 2024-04-30T23:05:15.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-30T23:05:15.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:15.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-30T23:05:15.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:14 smithi104 ceph-mon[32987]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: Standby manager daemon y started 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-30T23:05:15.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:14 smithi183 ceph-mon[33560]: from='mgr.? 172.21.15.104:0/2754710946' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-30T23:05:15.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:15 smithi100 ceph-mon[29745]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-30T23:05:15.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:15 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-30T23:05:16.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:15 smithi104 ceph-mon[32987]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-30T23:05:16.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:15 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-30T23:05:16.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:15 smithi183 ceph-mon[33560]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-30T23:05:16.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:15 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-30T23:05:16.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:16 smithi100 ceph-mon[29745]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:17.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:16 smithi104 ceph-mon[32987]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:17.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:16 smithi183 ceph-mon[33560]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:17.928 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:17.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:17.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:17.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:17.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:17.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:17.948 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:17.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:17.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:17.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:17.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:17.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:18.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:18.961 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:18 smithi100 ceph-mon[29745]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:19.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:18 smithi104 ceph-mon[32987]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:19.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:18 smithi183 ceph-mon[33560]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:19.923 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-30T23:05:19.923 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:20.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-30T23:05:20.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:20.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-30T23:05:20.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:20.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:20 smithi100 ceph-mon[29745]: Deploying daemon osd.0 on smithi100 2024-04-30T23:05:20.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:20 smithi100 ceph-mon[29745]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:21.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:20 smithi104 ceph-mon[32987]: Deploying daemon osd.0 on smithi100 2024-04-30T23:05:21.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:20 smithi104 ceph-mon[32987]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:21.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:20 smithi183 ceph-mon[33560]: Deploying daemon osd.0 on smithi100 2024-04-30T23:05:21.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:20 smithi183 ceph-mon[33560]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:23.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:22 smithi104 ceph-mon[32987]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:23.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:22 smithi183 ceph-mon[33560]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:23.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:22 smithi100 ceph-mon[29745]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:24.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:24 smithi100 ceph-mon[29745]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:24.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:24.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:24.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:25.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:24 smithi104 ceph-mon[32987]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:25.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:25.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:25.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:25.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:24 smithi183 ceph-mon[33560]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:25.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:25.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:25.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:26.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:26 smithi100 ceph-mon[29745]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:27.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:26 smithi104 ceph-mon[32987]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:27.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:26 smithi183 ceph-mon[33560]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:28.095 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2024-04-30T23:05:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.097+0000 7fe1f6ffd700 1 -- 172.21.15.100:0/1236170502 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe200075b60 con 0x7fe1ec03baa0 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 msgr2=0x7fe1ec03dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 0x7fe1ec03dfb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00038a0 tx=0x7fe1f001a040 comp rx=0 tx=0).stop 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 msgr2=0x7fe2001a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8007ee0 tx=0x7fe1f800d3b0 comp rx=0 tx=0).stop 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 shutdown_connections 2024-04-30T23:05:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe1ec03baa0 0x7fe1ec03dfb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe200104c30 0x7fe2001a0c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe200103160 0x7fe200199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 --2- 172.21.15.100:0/1236170502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe200104290 0x7fe200199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 >> 172.21.15.100:0/1236170502 conn(0x7fe2000fe7a0 msgr2=0x7fe2001074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 shutdown_connections 2024-04-30T23:05:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:05:28.100+0000 7fe207e15700 1 -- 172.21.15.100:0/1236170502 wait complete. 2024-04-30T23:05:28.695 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.0.service 2024-04-30T23:05:28.697 INFO:tasks.cephadm:Deploying osd.1 on smithi104 with /dev/vg_nvme/lv_4... 2024-04-30T23:05:28.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:28.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:28 smithi100 ceph-mon[29745]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-30T23:05:29.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:28 smithi104 ceph-mon[32987]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:28 smithi183 ceph-mon[33560]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-30T23:05:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:05:30.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-mon[29745]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-30T23:05:30.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-mon[29745]: osdmap e6: 1 total, 0 up, 1 in 2024-04-30T23:05:30.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-mon[29745]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:05:30.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:30.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-mon[29745]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:30.329 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:30 smithi104 ceph-mon[32987]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-30T23:05:30.329 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:30 smithi104 ceph-mon[32987]: osdmap e6: 1 total, 0 up, 1 in 2024-04-30T23:05:30.330 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:30 smithi104 ceph-mon[32987]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:05:30.330 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:30.330 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:30 smithi104 ceph-mon[32987]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:30.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:30 smithi183 ceph-mon[33560]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-30T23:05:30.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:30 smithi183 ceph-mon[33560]: osdmap e6: 1 total, 0 up, 1 in 2024-04-30T23:05:30.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:30 smithi183 ceph-mon[33560]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:05:30.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:30.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:30 smithi183 ceph-mon[33560]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:30.886 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-30T23:05:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-30T23:05:30.887 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-04-30T23:05:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-04-30T23:05:30.887 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011379 s, 922 MB/s 2024-04-30T23:05:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-04-30T23:05:31.070 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0[42010]: 2024-04-30T23:05:30.797+0000 7f1fb4041700 -1 osd.0 0 waiting for initial osdmap 2024-04-30T23:05:31.070 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:05:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0[42010]: 2024-04-30T23:05:30.801+0000 7f1fabdee700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:05:31.456 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:05:31.457 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: osdmap e7: 1 total, 0 up, 1 in 2024-04-30T23:05:31.457 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.457 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.457 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' 2024-04-30T23:05:31.457 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi104:vg_nvme/lv_4 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: osdmap e7: 1 total, 0 up, 1 in 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' 2024-04-30T23:05:31.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: osdmap e7: 1 total, 0 up, 1 in 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: from='osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249]' entity='osd.0' 2024-04-30T23:05:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:31.766 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:05:32.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:05:32.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:05:32.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:32.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] boot 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: osdmap e8: 1 total, 1 up, 1 in 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:32.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:32.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] boot 2024-04-30T23:05:32.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: osdmap e8: 1 total, 1 up, 1 in 2024-04-30T23:05:32.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:32.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:32.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:05:32.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:05:32.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-30T23:05:32.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: osd.0 [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] boot 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: osdmap e8: 1 total, 1 up, 1 in 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-30T23:05:32.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:33.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- 172.21.15.104:0/1240248728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8104290 msgr2=0x7ff3a81046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 --2- 172.21.15.104:0/1240248728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8104290 0x7ff3a81046a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff394009990 tx=0x7ff394009ca0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- 172.21.15.104:0/1240248728 shutdown_connections 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 --2- 172.21.15.104:0/1240248728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104c30 0x7ff3a810b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 --2- 172.21.15.104:0/1240248728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8103160 0x7ff3a8103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 --2- 172.21.15.104:0/1240248728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8104290 0x7ff3a81046a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- 172.21.15.104:0/1240248728 >> 172.21.15.104:0/1240248728 conn(0x7ff3a80fe7a0 msgr2=0x7ff3a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- 172.21.15.104:0/1240248728 shutdown_connections 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- 172.21.15.104:0/1240248728 wait complete. 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 Processor -- start 2024-04-30T23:05:33.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.322+0000 7ff3aee43700 1 -- start start 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104290 0x7ff3a819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 0x7ff3a81a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a80767a0 con 0x7ff3a8104c30 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8076620 con 0x7ff3a8103160 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3aee43700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a810ff50 con 0x7ff3a8104290 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38234/0 (socket says 172.21.15.104:38234) 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 -- 172.21.15.104:0/2504753864 learned_addr learned my addr 172.21.15.104:0/2504753864 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3a7fff700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104290 0x7ff3a819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3ad3e0700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 0x7ff3a81a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 -- 172.21.15.104:0/2504753864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104290 msgr2=0x7ff3a819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104290 0x7ff3a819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 -- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 msgr2=0x7ff3a81a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 0x7ff3a81a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 -- 172.21.15.104:0/2504753864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a81a2380 con 0x7ff3a8103160 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3ad3e0700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 0x7ff3a81a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3acbdf700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00d950 tx=0x7ff39c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.323+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c016070 con 0x7ff3a8103160 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.324+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff39c00be00 con 0x7ff3a8103160 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.324+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c00f3c0 con 0x7ff3a8103160 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.324+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a81a2670 con 0x7ff3a8103160 2024-04-30T23:05:33.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.324+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a81a2c00 con 0x7ff3a8103160 2024-04-30T23:05:33.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.325+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a80511d0 con 0x7ff3a8103160 2024-04-30T23:05:33.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.326+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7ff39c019070 con 0x7ff3a8103160 2024-04-30T23:05:33.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.327+0000 7ff3a5ffb700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 0x7ff3980a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:33.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.327+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7ff39c0cece0 con 0x7ff3a8103160 2024-04-30T23:05:33.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.327+0000 7ff3a7fff700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 0x7ff3980a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:33.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.327+0000 7ff3a7fff700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 0x7ff3980a6140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff39400b5c0 tx=0x7ff39401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:33.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.331+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff39c020020 con 0x7ff3a8103160 2024-04-30T23:05:33.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:33.536+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff3a8063b10 con 0x7ff3980a3c30 2024-04-30T23:05:33.534 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:33 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi100 2024-04-30T23:05:33.534 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:33 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 17088M 2024-04-30T23:05:33.534 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:33.534 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:33.534 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:33.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:33 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi100 2024-04-30T23:05:33.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:33 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 17088M 2024-04-30T23:05:33.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:33.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:33.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:33.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:33 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi100 2024-04-30T23:05:33.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:33 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 17088M 2024-04-30T23:05:33.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:33.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:33.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:34.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: osdmap e9: 1 total, 1 up, 1 in 2024-04-30T23:05:34.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:34.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:34.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:34.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:34.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: osdmap e9: 1 total, 1 up, 1 in 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:34.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: osdmap e9: 1 total, 1 up, 1 in 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:34.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/658494187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]': finished 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: osdmap e10: 2 total, 1 up, 2 in 2024-04-30T23:05:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:36 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/658494187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]': finished 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: osdmap e10: 2 total, 1 up, 2 in 2024-04-30T23:05:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:36 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:36.876 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:36.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/658494187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]: dispatch 2024-04-30T23:05:36.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37aaab18-a336-45c6-a43f-26d4dd5183b6"}]': finished 2024-04-30T23:05:36.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: osdmap e10: 2 total, 1 up, 2 in 2024-04-30T23:05:36.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:36 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:37.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:37 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/3330351205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:38.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:37 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/3330351205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:38.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:37 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/3330351205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:05:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:38 smithi100 ceph-mon[29745]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:39.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:38 smithi104 ceph-mon[32987]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:39.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:38 smithi183 ceph-mon[33560]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:41.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:40 smithi104 ceph-mon[32987]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:41.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:40 smithi183 ceph-mon[33560]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:41.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:40 smithi100 ceph-mon[29745]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:42.839 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:42 smithi104 ceph-mon[32987]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:43.047 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:42 smithi183 ceph-mon[33560]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:43.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:42 smithi100 ceph-mon[29745]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:43.836 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-30T23:05:43.836 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:44.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-30T23:05:44.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:44.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-30T23:05:44.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:44.886 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:44 smithi104 ceph-mon[32987]: Deploying daemon osd.1 on smithi104 2024-04-30T23:05:44.886 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:44 smithi104 ceph-mon[32987]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:44 smithi183 ceph-mon[33560]: Deploying daemon osd.1 on smithi104 2024-04-30T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:44 smithi183 ceph-mon[33560]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:44 smithi100 ceph-mon[29745]: Deploying daemon osd.1 on smithi104 2024-04-30T23:05:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:44 smithi100 ceph-mon[29745]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:46.777 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:46 smithi104 ceph-mon[32987]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:47.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:46 smithi183 ceph-mon[33560]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:46 smithi100 ceph-mon[29745]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:48 smithi104 ceph-mon[32987]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:48.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:48 smithi183 ceph-mon[33560]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:49.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:48 smithi100 ceph-mon[29745]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:49.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:49.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:49.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:50.693 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:50 smithi104 ceph-mon[32987]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:51.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:50 smithi183 ceph-mon[33560]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:51.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:50 smithi100 ceph-mon[29745]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:51.696 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 1 on host 'smithi104' 2024-04-30T23:05:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.698+0000 7ff3a5ffb700 1 -- 172.21.15.104:0/2504753864 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff3a8063b10 con 0x7ff3980a3c30 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 msgr2=0x7ff3980a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 0x7ff3980a6140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff39400b5c0 tx=0x7ff39401a040 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 msgr2=0x7ff3a819a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00d950 tx=0x7ff39c00dc60 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 shutdown_connections 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3980a3c30 0x7ff3980a6140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8104c30 0x7ff3a81a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3a8103160 0x7ff3a819a820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 --2- 172.21.15.104:0/2504753864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3a8104290 0x7ff3a819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 >> 172.21.15.104:0/2504753864 conn(0x7ff3a80fe7a0 msgr2=0x7ff3a81074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 shutdown_connections 2024-04-30T23:05:51.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:05:51.701+0000 7ff3aee43700 1 -- 172.21.15.104:0/2504753864 wait complete. 2024-04-30T23:05:52.304 DEBUG:teuthology.orchestra.run.smithi104:osd.1> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.1.service 2024-04-30T23:05:52.306 INFO:tasks.cephadm:Deploying osd.2 on smithi183 with /dev/vg_nvme/lv_4... 2024-04-30T23:05:52.306 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-30T23:05:52.543 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:05:52.369+0000 7f8f593d67c0 -1 osd.1 0 log_to_monitors true 2024-04-30T23:05:52.549 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:05:52.979 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:52.979 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:52.979 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:52.980 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:52.980 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:52.980 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:52.980 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:52 smithi183 ceph-mon[33560]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:53.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:52 smithi104 ceph-mon[32987]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:53.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:53.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:52 smithi100 ceph-mon[29745]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-30T23:05:53.792 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-mon[32987]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-30T23:05:53.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-mon[32987]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:53.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-mon[32987]: osdmap e11: 2 total, 1 up, 2 in 2024-04-30T23:05:53.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:53.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-mon[32987]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:53.793 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:05:53.705+0000 7f8f4ea3b700 -1 osd.1 0 waiting for initial osdmap 2024-04-30T23:05:53.793 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:05:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:05:53.709+0000 7f8f4a7f0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:05:53.906 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:53 smithi183 ceph-mon[33560]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-30T23:05:53.906 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:53 smithi183 ceph-mon[33560]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:53.907 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:53 smithi183 ceph-mon[33560]: osdmap e11: 2 total, 1 up, 2 in 2024-04-30T23:05:53.907 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:53.907 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:53 smithi183 ceph-mon[33560]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:54.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:53 smithi100 ceph-mon[29745]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-30T23:05:54.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:53 smithi100 ceph-mon[29745]: from='osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:54.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:53 smithi100 ceph-mon[29745]: osdmap e11: 2 total, 1 up, 2 in 2024-04-30T23:05:54.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:54.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:53 smithi100 ceph-mon[29745]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:05:54.465 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-30T23:05:54.465 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-30T23:05:54.465 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-04-30T23:05:54.466 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-04-30T23:05:54.466 INFO:teuthology.orchestra.run.smithi183.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113583 s, 923 MB/s 2024-04-30T23:05:54.466 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-04-30T23:05:54.907 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:54 smithi104 ceph-mon[32987]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:54.907 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:54 smithi104 ceph-mon[32987]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:05:54.907 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:54 smithi104 ceph-mon[32987]: osdmap e12: 2 total, 1 up, 2 in 2024-04-30T23:05:54.907 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:54.907 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:55.039 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:54 smithi183 ceph-mon[33560]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:55.039 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:54 smithi183 ceph-mon[33560]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:05:55.039 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:54 smithi183 ceph-mon[33560]: osdmap e12: 2 total, 1 up, 2 in 2024-04-30T23:05:55.040 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:55.040 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:55.066 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_4 2024-04-30T23:05:55.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:54 smithi100 ceph-mon[29745]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:55.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:54 smithi100 ceph-mon[29745]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:05:55.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:54 smithi100 ceph-mon[29745]: osdmap e12: 2 total, 1 up, 2 in 2024-04-30T23:05:55.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:55.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:55.299 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] boot 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: osdmap e13: 2 total, 2 up, 2 in 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:56.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi104 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 17088M 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:55 smithi104 ceph-mon[32987]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:56.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:05:56.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:05:56.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] boot 2024-04-30T23:05:56.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: osdmap e13: 2 total, 2 up, 2 in 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi104 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 17088M 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:55 smithi183 ceph-mon[33560]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:56.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: osd.1 [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] boot 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: osdmap e13: 2 total, 2 up, 2 in 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi104 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 17088M 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:05:56.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:55 smithi100 ceph-mon[29745]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-30T23:05:56.889 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 -- 172.21.15.183:0/2350083390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 msgr2=0x7f666c103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 --2- 172.21.15.183:0/2350083390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c103af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6660009990 tx=0x7f6660009ca0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 -- 172.21.15.183:0/2350083390 shutdown_connections 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 --2- 172.21.15.183:0/2350083390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 0x7f666c10b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 --2- 172.21.15.183:0/2350083390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c103af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 --2- 172.21.15.183:0/2350083390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c104590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 -- 172.21.15.183:0/2350083390 >> 172.21.15.183:0/2350083390 conn(0x7f666c0fdf30 msgr2=0x7f666c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 -- 172.21.15.183:0/2350083390 shutdown_connections 2024-04-30T23:05:56.890 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.892+0000 7f6672db2700 1 -- 172.21.15.183:0/2350083390 wait complete. 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 Processor -- start 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 -- start start 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 0x7f666c1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:56.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10ec20 con 0x7f666c1040c0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10eaa0 con 0x7f666c104c20 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6672db2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10eda0 con 0x7f666c1036e0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6670b4e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6670b4e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:42994/0 (socket says 172.21.15.183:42994) 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f6670b4e700 1 -- 172.21.15.183:0/3810682642 learned_addr learned my addr 172.21.15.183:0/3810682642 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f666bfff700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.893+0000 7f667134f700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 0x7f666c1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 -- 172.21.15.183:0/3810682642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 msgr2=0x7f666c1a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 0x7f666c1a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 -- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 msgr2=0x7f666c19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 -- 172.21.15.183:0/3810682642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c1a2370 con 0x7f666c1036e0 2024-04-30T23:05:56.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f666bfff700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6670b4e700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6660003800 tx=0x7f6660005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660027070 con 0x7f666c1036e0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c1a2600 con 0x7f666c1036e0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6660022470 con 0x7f666c1036e0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666000f6c0 con 0x7f666c1036e0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.894+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1a2a50 con 0x7f666c1036e0 2024-04-30T23:05:56.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.895+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c0511d0 con 0x7f666c1036e0 2024-04-30T23:05:56.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.897+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f666002a070 con 0x7f666c1036e0 2024-04-30T23:05:56.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.897+0000 7f6669ffb700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 0x7f665c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:05:56.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.897+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f66600d0000 con 0x7f666c1036e0 2024-04-30T23:05:56.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.897+0000 7f666bfff700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 0x7f665c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:05:56.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.898+0000 7f666bfff700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 0x7f665c0a60c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6658005950 tx=0x7f6658005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:05:56.898 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:56.901+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f666005eff0 con 0x7f666c1036e0 2024-04-30T23:05:57.100 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:05:57.103+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f666c0fffb0 con 0x7f665c0a3bb0 2024-04-30T23:05:57.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:57 smithi104 ceph-mon[32987]: osdmap e14: 2 total, 2 up, 2 in 2024-04-30T23:05:57.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:57.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:57.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:57.547 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:57 smithi183 ceph-mon[33560]: osdmap e14: 2 total, 2 up, 2 in 2024-04-30T23:05:57.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:57.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:57.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:57 smithi100 ceph-mon[29745]: osdmap e14: 2 total, 2 up, 2 in 2024-04-30T23:05:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:05:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:05:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:05:58.530 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:58 smithi183 ceph-mon[33560]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:58.530 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:05:58 smithi183 ceph-mon[33560]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:05:58.542 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:58 smithi104 ceph-mon[32987]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:58.542 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:05:58 smithi104 ceph-mon[32987]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:05:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:58 smithi100 ceph-mon[29745]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:05:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:05:58 smithi100 ceph-mon[29745]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/1293794336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]': finished 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: osdmap e15: 3 total, 2 up, 3 in 2024-04-30T23:06:00.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:00.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:00 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/190827483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:01.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:01.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/1293794336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:01.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:01.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]': finished 2024-04-30T23:06:01.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: osdmap e15: 3 total, 2 up, 3 in 2024-04-30T23:06:01.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:01.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:00 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/190827483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/1293794336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]: dispatch 2024-04-30T23:06:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe687b16-00c0-432c-9361-0371a0152831"}]': finished 2024-04-30T23:06:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: osdmap e15: 3 total, 2 up, 3 in 2024-04-30T23:06:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:00 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/190827483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:02.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:02 smithi100 ceph-mon[29745]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:03.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:02 smithi104 ceph-mon[32987]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:03.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:02 smithi183 ceph-mon[33560]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:04.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:04 smithi100 ceph-mon[29745]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:04 smithi183 ceph-mon[33560]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:05.042 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:04 smithi104 ceph-mon[32987]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:06.845 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:06 smithi104 ceph-mon[32987]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:06 smithi183 ceph-mon[33560]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:06 smithi100 ceph-mon[29745]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:07.865 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-30T23:06:07.865 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:07.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-30T23:06:07.897 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:08.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-30T23:06:08.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:08.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:08 smithi183 ceph-mon[33560]: Deploying daemon osd.2 on smithi183 2024-04-30T23:06:08.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:08 smithi183 ceph-mon[33560]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:09.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:08 smithi104 ceph-mon[32987]: Deploying daemon osd.2 on smithi183 2024-04-30T23:06:09.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:08 smithi104 ceph-mon[32987]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:09.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:08 smithi100 ceph-mon[29745]: Deploying daemon osd.2 on smithi183 2024-04-30T23:06:09.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:08 smithi100 ceph-mon[29745]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:10.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:10 smithi183 ceph-mon[33560]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:11.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:10 smithi104 ceph-mon[32987]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:10 smithi100 ceph-mon[29745]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:13.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:12 smithi183 ceph-mon[33560]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:13.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:13.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:13.034 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:13.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:12 smithi104 ceph-mon[32987]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:13.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:13.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:13.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:12 smithi100 ceph-mon[29745]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:14.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:14 smithi183 ceph-mon[33560]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:15.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:14 smithi104 ceph-mon[32987]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:14 smithi100 ceph-mon[29745]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:15.513 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.515+0000 7f6669ffb700 1 -- 172.21.15.183:0/3810682642 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f666c0fffb0 con 0x7f665c0a3bb0 2024-04-30T23:06:15.513 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 2 on host 'smithi183' 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 msgr2=0x7f665c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 0x7f665c0a60c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6658005950 tx=0x7f6658005f50 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 msgr2=0x7f666c19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6660003800 tx=0x7f6660005ad0 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 shutdown_connections 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f665c0a3bb0 0x7f665c0a60c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f666c104c20 0x7f666c1a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f666c1036e0 0x7f666c19a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 --2- 172.21.15.183:0/3810682642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f666c1040c0 0x7f666c19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 >> 172.21.15.183:0/3810682642 conn(0x7f666c0fdf30 msgr2=0x7f666c0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 shutdown_connections 2024-04-30T23:06:15.517 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:06:15.519+0000 7f6672db2700 1 -- 172.21.15.183:0/3810682642 wait complete. 2024-04-30T23:06:16.192 DEBUG:teuthology.orchestra.run.smithi183:osd.2> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.2.service 2024-04-30T23:06:16.194 INFO:tasks.cephadm:Deploying osd.3 on smithi100 with /dev/vg_nvme/lv_3... 2024-04-30T23:06:16.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-30T23:06:16.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.297 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:16.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:16.437 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:16.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:16.548 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:06:16.299+0000 7fa7598197c0 -1 osd.2 0 log_to_monitors true 2024-04-30T23:06:16.558 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.558 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.558 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:16.558 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:16.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:16.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:16.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:17.448 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:17 smithi183 ceph-mon[33560]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:17.448 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:17 smithi183 ceph-mon[33560]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:17.504 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:17 smithi100 ceph-mon[29745]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:17.505 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:17 smithi100 ceph-mon[29745]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:17.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:17 smithi104 ceph-mon[32987]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:17.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:17 smithi104 ceph-mon[32987]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: osdmap e16: 3 total, 2 up, 3 in 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.347 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:18 smithi100 ceph-mon[29745]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:18.400 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-30T23:06:18.400 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-30T23:06:18.401 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-30T23:06:18.401 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-30T23:06:18.401 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129866 s, 807 MB/s 2024-04-30T23:06:18.401 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-30T23:06:18.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-30T23:06:18.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: osdmap e16: 3 total, 2 up, 3 in 2024-04-30T23:06:18.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:18.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:18 smithi104 ceph-mon[32987]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:18.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-30T23:06:18.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: from='osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: osdmap e16: 3 total, 2 up, 3 in 2024-04-30T23:06:18.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:18.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:06:18.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-mon[33560]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:19.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-04-30T23:06:19.183 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:06:18.900+0000 7fa74f67f700 -1 osd.2 0 waiting for initial osdmap 2024-04-30T23:06:19.183 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:18 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:06:18.907+0000 7fa746c2b700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:06:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:06:19.462 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:06:19.463 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: osdmap e17: 3 total, 2 up, 3 in 2024-04-30T23:06:19.463 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.463 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.463 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: from='osd.2 ' entity='osd.2' 2024-04-30T23:06:19.463 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.538 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:06:19.538 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: osdmap e17: 3 total, 2 up, 3 in 2024-04-30T23:06:19.539 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.539 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.539 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: from='osd.2 ' entity='osd.2' 2024-04-30T23:06:19.539 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: osdmap e17: 3 total, 2 up, 3 in 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: from='osd.2 ' entity='osd.2' 2024-04-30T23:06:19.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi183 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 17088M 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:20.496 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:20.497 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.497 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] boot 2024-04-30T23:06:20.497 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: osdmap e18: 3 total, 3 up, 3 in 2024-04-30T23:06:20.497 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:20.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:06:20.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:06:20.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:20.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi183 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 17088M 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] boot 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: osdmap e18: 3 total, 3 up, 3 in 2024-04-30T23:06:20.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:20.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:06:20.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:06:20.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi183 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 17088M 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: osd.2 [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] boot 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: osdmap e18: 3 total, 3 up, 3 in 2024-04-30T23:06:20.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 -- 172.21.15.100:0/3252717702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1570104d50 msgr2=0x7f1570107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 --2- 172.21.15.100:0/3252717702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1570104d50 0x7f1570107170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f156000b0a0 tx=0x7f156000b3b0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 -- 172.21.15.100:0/3252717702 shutdown_connections 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 --2- 172.21.15.100:0/3252717702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 0x7f157010c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 --2- 172.21.15.100:0/3252717702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1570104d50 0x7f1570107170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 --2- 172.21.15.100:0/3252717702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15701076b0 0x7f1570109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 -- 172.21.15.100:0/3252717702 >> 172.21.15.100:0/3252717702 conn(0x7f15700fe790 msgr2=0x7f1570100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 -- 172.21.15.100:0/3252717702 shutdown_connections 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.040+0000 7f1575357700 1 -- 172.21.15.100:0/3252717702 wait complete. 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 Processor -- start 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 -- start start 2024-04-30T23:06:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1570104d50 0x7f157019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 0x7f15701a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f157010fcd0 con 0x7f15701076b0 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f157010fb50 con 0x7f1570104d50 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f1575357700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f157010fe50 con 0x7f157010a010 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f156e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f156e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43028/0 (socket says 172.21.15.100:43028) 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f156e7fc700 1 -- 172.21.15.100:0/2066699853 learned_addr learned my addr 172.21.15.100:0/2066699853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.041+0000 7f156effd700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1570104d50 0x7f157019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156f7fe700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 0x7f15701a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 -- 172.21.15.100:0/2066699853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 msgr2=0x7f15701a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 0x7f15701a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 -- 172.21.15.100:0/2066699853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1570104d50 msgr2=0x7f157019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1570104d50 0x7f157019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:21.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 -- 172.21.15.100:0/2066699853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15701a23e0 con 0x7f15701076b0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f156e7fc700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f155800d950 tx=0x7f155800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1558016070 con 0x7f15701076b0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15701a26d0 con 0x7f15701076b0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1558009df0 con 0x7f15701076b0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155800f3c0 con 0x7f15701076b0 2024-04-30T23:06:21.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.042+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701a2c60 con 0x7f15701076b0 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.043+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15700511d0 con 0x7f15701076b0 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.044+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f1558019070 con 0x7f15701076b0 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.045+0000 7f1567fff700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 0x7f155c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.045+0000 7f156effd700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 0x7f155c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.045+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f15580ce980 con 0x7f15701076b0 2024-04-30T23:06:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.045+0000 7f156effd700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 0x7f155c0a60c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f156000b830 tx=0x7f1560006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:06:21.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.049+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f155809c990 con 0x7f15701076b0 2024-04-30T23:06:21.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:21.259+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1570063b10 con 0x7f155c0a3bb0 2024-04-30T23:06:22.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: osdmap e19: 3 total, 3 up, 3 in 2024-04-30T23:06:22.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:22.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:22.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:22.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:22.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:22.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: osdmap e19: 3 total, 3 up, 3 in 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:22.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:22.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: osdmap e19: 3 total, 3 up, 3 in 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:23.464 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:23.464 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 ceph-mon[33560]: osdmap e20: 3 total, 3 up, 3 in 2024-04-30T23:06:23.464 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:23.465 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42799]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:23.465 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42799]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.465 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42799]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.465 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42799]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.500 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:23.500 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 ceph-mon[29745]: osdmap e20: 3 total, 3 up, 3 in 2024-04-30T23:06:23.500 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:23.500 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46448]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:23.500 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46448]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46448]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46451]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46451]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46451]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.501 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46451]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:23.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 ceph-mon[32987]: osdmap e20: 3 total, 3 up, 3 in 2024-04-30T23:06:23.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:06:23.543 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41723]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:23.543 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41723]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.543 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41723]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.543 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41723]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.544 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:23.544 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.544 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41726]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.544 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41726]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.798 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42802]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:23.798 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42802]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.798 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42802]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.798 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42802]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42805]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42805]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42805]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42805]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42808]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42808]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:23 smithi183 sudo[42808]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46457]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46457]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46461]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:23 smithi100 sudo[46461]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41729]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41729]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41732]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41732]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41732]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-30T23:06:24.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:23 smithi104 sudo[41732]: pam_unix(sudo:session): session closed for user root 2024-04-30T23:06:24.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:24.503+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1558098900 con 0x7f15701076b0 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: osdmap e21: 3 total, 3 up, 3 in 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.501 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.502 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]: dispatch 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]': finished 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: osdmap e22: 4 total, 3 up, 4 in 2024-04-30T23:06:24.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:24.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:24.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: osdmap e21: 3 total, 3 up, 3 in 2024-04-30T23:06:24.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]: dispatch 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]': finished 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: osdmap e22: 4 total, 3 up, 4 in 2024-04-30T23:06:24.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:24.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:06:24.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: osdmap e21: 3 total, 3 up, 3 in 2024-04-30T23:06:24.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.548 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-30T23:06:24.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]: dispatch 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2749711043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d12a3f3-d9a4-43a4-879a-4aa2964857ae"}]': finished 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: osdmap e22: 4 total, 3 up, 4 in 2024-04-30T23:06:24.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:25.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:25 smithi104 ceph-mon[32987]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-30T23:06:25.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1453860685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:25.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:25 smithi183 ceph-mon[33560]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-30T23:06:25.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1453860685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:25.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:25 smithi100 ceph-mon[29745]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-30T23:06:25.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1453860685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:26.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:26 smithi104 ceph-mon[32987]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:26.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:26 smithi183 ceph-mon[33560]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:26.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:26 smithi100 ceph-mon[29745]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:28.782 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:28 smithi100 ceph-mon[29745]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:29.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:28 smithi104 ceph-mon[32987]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:29.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:28 smithi183 ceph-mon[33560]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:30.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:30 smithi100 ceph-mon[29745]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:31.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:30 smithi104 ceph-mon[32987]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:31.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:30 smithi183 ceph-mon[33560]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:32.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-30T23:06:32.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:32.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-30T23:06:32.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:32.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-30T23:06:32.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:32.756 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:32 smithi100 ceph-mon[29745]: Deploying daemon osd.3 on smithi100 2024-04-30T23:06:32.756 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:32 smithi100 ceph-mon[29745]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:33.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:32 smithi104 ceph-mon[32987]: Deploying daemon osd.3 on smithi100 2024-04-30T23:06:33.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:32 smithi104 ceph-mon[32987]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:33.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:32 smithi183 ceph-mon[33560]: Deploying daemon osd.3 on smithi100 2024-04-30T23:06:33.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:32 smithi183 ceph-mon[33560]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:35.021 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:34 smithi100 ceph-mon[29745]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:35.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:34 smithi104 ceph-mon[32987]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:35.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:34 smithi183 ceph-mon[33560]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:36.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:36 smithi100 ceph-mon[29745]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:36.845 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:36 smithi104 ceph-mon[32987]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:36.850 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:36 smithi183 ceph-mon[33560]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:38.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:38.293 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:38 smithi104 ceph-mon[32987]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:38.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:38.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:38 smithi183 ceph-mon[33560]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:38.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:38.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:38.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:38 smithi100 ceph-mon[29745]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:40.561 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 3 on host 'smithi100' 2024-04-30T23:06:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.563+0000 7f1567fff700 1 -- 172.21.15.100:0/2066699853 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1570063b10 con 0x7f155c0a3bb0 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 msgr2=0x7f155c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 0x7f155c0a60c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f156000b830 tx=0x7f1560006210 comp rx=0 tx=0).stop 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 msgr2=0x7f157019adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f155800d950 tx=0x7f155800dc60 comp rx=0 tx=0).stop 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 shutdown_connections 2024-04-30T23:06:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f155c0a3bb0 0x7f155c0a60c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157010a010 0x7f15701a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1570104d50 0x7f157019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 --2- 172.21.15.100:0/2066699853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15701076b0 0x7f157019adc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 >> 172.21.15.100:0/2066699853 conn(0x7f15700fe790 msgr2=0x7f1570106d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 shutdown_connections 2024-04-30T23:06:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:06:40.565+0000 7f1575357700 1 -- 172.21.15.100:0/2066699853 wait complete. 2024-04-30T23:06:40.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:40 smithi100 ceph-mon[29745]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:40.882 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:40.882 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:40 smithi104 ceph-mon[32987]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:41.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:40 smithi183 ceph-mon[33560]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:41.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.246 DEBUG:teuthology.orchestra.run.smithi100:osd.3> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.3.service 2024-04-30T23:06:41.248 INFO:tasks.cephadm:Deploying osd.4 on smithi104 with /dev/vg_nvme/lv_3... 2024-04-30T23:06:41.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-30T23:06:41.492 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:06:41.828 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:41 smithi104 ceph-mon[32987]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-30T23:06:41.828 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.828 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.921 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:41 smithi100 ceph-mon[29745]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-30T23:06:41.921 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:41.922 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:42.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:41 smithi183 ceph-mon[33560]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-30T23:06:42.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:42.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:42.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:42 smithi104 ceph-mon[32987]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:42.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:42 smithi104 ceph-mon[32987]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-30T23:06:42.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:42 smithi104 ceph-mon[32987]: osdmap e23: 4 total, 3 up, 4 in 2024-04-30T23:06:42.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:42 smithi104 ceph-mon[32987]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:06:42.819 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:42.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-mon[29745]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:42.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-mon[29745]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-30T23:06:42.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-mon[29745]: osdmap e23: 4 total, 3 up, 4 in 2024-04-30T23:06:42.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-mon[29745]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:06:42.927 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:42.927 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:06:42.594+0000 7ff88adbb700 -1 osd.3 0 waiting for initial osdmap 2024-04-30T23:06:42.927 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:06:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:06:42.600+0000 7ff886b70700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:06:43.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:42 smithi183 ceph-mon[33560]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:43.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:42 smithi183 ceph-mon[33560]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-30T23:06:43.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:42 smithi183 ceph-mon[33560]: osdmap e23: 4 total, 3 up, 4 in 2024-04-30T23:06:43.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:42 smithi183 ceph-mon[33560]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:06:43.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:43.334 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-30T23:06:43.335 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-30T23:06:43.335 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-04-30T23:06:43.335 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-04-30T23:06:43.335 INFO:teuthology.orchestra.run.smithi104.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133604 s, 785 MB/s 2024-04-30T23:06:43.335 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-04-30T23:06:43.923 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:43 smithi104 ceph-mon[32987]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:06:43.923 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:43 smithi104 ceph-mon[32987]: osdmap e24: 4 total, 3 up, 4 in 2024-04-30T23:06:43.923 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:43.923 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:43.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi104:vg_nvme/lv_3 2024-04-30T23:06:44.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:43 smithi183 ceph-mon[33560]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:06:44.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:43 smithi183 ceph-mon[33560]: osdmap e24: 4 total, 3 up, 4 in 2024-04-30T23:06:44.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:44.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:44.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:43 smithi100 ceph-mon[29745]: from='osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:06:44.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:43 smithi100 ceph-mon[29745]: osdmap e24: 4 total, 3 up, 4 in 2024-04-30T23:06:44.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:44.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] boot 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: osdmap e25: 4 total, 4 up, 4 in 2024-04-30T23:06:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] boot 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: osdmap e25: 4 total, 4 up, 4 in 2024-04-30T23:06:45.029 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: osd.3 [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] boot 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: osdmap e25: 4 total, 4 up, 4 in 2024-04-30T23:06:45.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-30T23:06:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 -- 172.21.15.104:0/2488925619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540104260 msgr2=0x7f6540104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 --2- 172.21.15.104:0/2488925619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540104260 0x7f6540104670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6530009990 tx=0x7f6530009ca0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 -- 172.21.15.104:0/2488925619 shutdown_connections 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 --2- 172.21.15.104:0/2488925619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 0x7f654010c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 --2- 172.21.15.104:0/2488925619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540104260 0x7f6540104670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 --2- 172.21.15.104:0/2488925619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540105390 0x7f65401057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 -- 172.21.15.104:0/2488925619 >> 172.21.15.104:0/2488925619 conn(0x7f65400ff8a0 msgr2=0x7f6540101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 -- 172.21.15.104:0/2488925619 shutdown_connections 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.823+0000 7f65475de700 1 -- 172.21.15.104:0/2488925619 wait complete. 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 Processor -- start 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 -- start start 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540104260 0x7f654019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 0x7f65401a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f654010fca0 con 0x7f6540104260 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f654010fb20 con 0x7f6540105390 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f65475de700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f654010fe20 con 0x7f6540105d30 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f6544b79700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f6544b79700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47506/0 (socket says 172.21.15.104:47506) 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f6544b79700 1 -- 172.21.15.104:0/374268525 learned_addr learned my addr 172.21.15.104:0/374268525 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.824+0000 7f654537a700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540104260 0x7f654019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6545b7b700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 0x7f65401a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 -- 172.21.15.104:0/374268525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 msgr2=0x7f65401a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 0x7f65401a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 -- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540104260 msgr2=0x7f654019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540104260 0x7f654019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:06:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 -- 172.21.15.104:0/374268525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65401a23a0 con 0x7f6540105390 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f6544b79700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f653c00d980 tx=0x7f653c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c016070 con 0x7f6540105390 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f653c004830 con 0x7f6540105390 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65401a2690 con 0x7f6540105390 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c005540 con 0x7f6540105390 2024-04-30T23:06:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.825+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65401a2c20 con 0x7f6540105390 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.826+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65400511d0 con 0x7f6540105390 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.827+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f653c004220 con 0x7f6540105390 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.828+0000 7f65367fc700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 0x7f652c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.828+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f653c0cf4c0 con 0x7f6540105390 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.828+0000 7f654537a700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 0x7f652c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:06:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.828+0000 7f654537a700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 0x7f652c0a61d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65300038a0 tx=0x7f653001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:06:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:45.832+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f653c01f020 con 0x7f6540105390 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: osdmap e26: 4 total, 4 up, 4 in 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:45.829 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:45.830 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:06:46.042+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6540063b10 con 0x7f652c0a3cc0 2024-04-30T23:06:46.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: osdmap e26: 4 total, 4 up, 4 in 2024-04-30T23:06:46.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:46.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: osdmap e26: 4 total, 4 up, 4 in 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:46.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:06:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:06:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi100 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 8544M 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: osdmap e27: 4 total, 4 up, 4 in 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:46.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:47.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi100 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 8544M 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: osdmap e27: 4 total, 4 up, 4 in 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:47.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi100 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 8544M 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: osdmap e27: 4 total, 4 up, 4 in 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:06:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:47.886 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:47 smithi104 ceph-mon[32987]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:47.886 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:47 smithi104 ceph-mon[32987]: osdmap e28: 4 total, 4 up, 4 in 2024-04-30T23:06:48.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:47 smithi183 ceph-mon[33560]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:48.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:47 smithi183 ceph-mon[33560]: osdmap e28: 4 total, 4 up, 4 in 2024-04-30T23:06:48.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:47 smithi100 ceph-mon[29745]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:06:48.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:47 smithi100 ceph-mon[29745]: osdmap e28: 4 total, 4 up, 4 in 2024-04-30T23:06:49.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:48 smithi104 ceph-mon[32987]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:49.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:48 smithi104 ceph-mon[32987]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-30T23:06:49.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:48 smithi104 ceph-mon[32987]: osdmap e29: 4 total, 4 up, 4 in 2024-04-30T23:06:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:48 smithi183 ceph-mon[33560]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:48 smithi183 ceph-mon[33560]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-30T23:06:49.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:48 smithi183 ceph-mon[33560]: osdmap e29: 4 total, 4 up, 4 in 2024-04-30T23:06:49.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:48 smithi100 ceph-mon[29745]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:49.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:48 smithi100 ceph-mon[29745]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-30T23:06:49.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:48 smithi100 ceph-mon[29745]: osdmap e29: 4 total, 4 up, 4 in 2024-04-30T23:06:50.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/1597729256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]': finished 2024-04-30T23:06:50.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: osdmap e30: 5 total, 4 up, 5 in 2024-04-30T23:06:50.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:06:50.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/847032489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/1597729256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]': finished 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: osdmap e30: 5 total, 4 up, 5 in 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:06:50.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/847032489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/1597729256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]: dispatch 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aed289f-1846-4fd1-8f0c-b1f293bd50e1"}]': finished 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: osdmap e30: 5 total, 4 up, 5 in 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:06:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/847032489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:06:51.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:50 smithi104 ceph-mon[32987]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:51.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:50 smithi183 ceph-mon[33560]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:51.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:50 smithi100 ceph-mon[29745]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-04-30T23:06:52.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:51 smithi104 ceph-mon[32987]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-30T23:06:52.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:51 smithi104 ceph-mon[32987]: Cluster is now healthy 2024-04-30T23:06:52.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:51 smithi183 ceph-mon[33560]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-30T23:06:52.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:51 smithi183 ceph-mon[33560]: Cluster is now healthy 2024-04-30T23:06:52.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:51 smithi100 ceph-mon[29745]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-30T23:06:52.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:51 smithi100 ceph-mon[29745]: Cluster is now healthy 2024-04-30T23:06:52.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:52 smithi104 ceph-mon[32987]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-30T23:06:53.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:52 smithi183 ceph-mon[33560]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-30T23:06:53.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:52 smithi100 ceph-mon[29745]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-30T23:06:54.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:54 smithi104 ceph-mon[32987]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-30T23:06:55.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:54 smithi183 ceph-mon[33560]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-30T23:06:55.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:54 smithi100 ceph-mon[29745]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-30T23:06:57.017 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:56 smithi104 ceph-mon[32987]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:06:57.017 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-30T23:06:57.017 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:57.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:56 smithi183 ceph-mon[33560]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:06:57.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-30T23:06:57.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:57.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:56 smithi100 ceph-mon[29745]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:06:57.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-30T23:06:57.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:06:58.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:57 smithi104 ceph-mon[32987]: Deploying daemon osd.4 on smithi104 2024-04-30T23:06:58.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:57 smithi183 ceph-mon[33560]: Deploying daemon osd.4 on smithi104 2024-04-30T23:06:58.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:57 smithi100 ceph-mon[29745]: Deploying daemon osd.4 on smithi104 2024-04-30T23:06:58.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:06:58 smithi104 ceph-mon[32987]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:06:58.971 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:06:58 smithi100 ceph-mon[29745]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:06:59.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:06:58 smithi183 ceph-mon[33560]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:07:00.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:00 smithi104 ceph-mon[32987]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-30T23:07:01.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:00 smithi183 ceph-mon[33560]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-30T23:07:01.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:00 smithi100 ceph-mon[29745]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-30T23:07:02.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:02.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:02 smithi104 ceph-mon[32987]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-30T23:07:02.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:02.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:02 smithi183 ceph-mon[33560]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-30T23:07:02.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:02.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:02.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:02 smithi100 ceph-mon[29745]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:04.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:05.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:05.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:05.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:05.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.153+0000 7f65367fc700 1 -- 172.21.15.104:0/374268525 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6540063b10 con 0x7f652c0a3cc0 2024-04-30T23:07:05.152 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 4 on host 'smithi104' 2024-04-30T23:07:05.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 msgr2=0x7f652c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:05.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 0x7f652c0a61d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65300038a0 tx=0x7f653001a040 comp rx=0 tx=0).stop 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 msgr2=0x7f654019ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f653c00d980 tx=0x7f653c00dc90 comp rx=0 tx=0).stop 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 shutdown_connections 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f652c0a3cc0 0x7f652c0a61d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6540105d30 0x7f65401a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:05.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6540104260 0x7f654019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:05.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 --2- 172.21.15.104:0/374268525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6540105390 0x7f654019ad80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:05.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 >> 172.21.15.104:0/374268525 conn(0x7f65400ff8a0 msgr2=0x7f65401085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:07:05.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 shutdown_connections 2024-04-30T23:07:05.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:07:05.156+0000 7f65475de700 1 -- 172.21.15.104:0/374268525 wait complete. 2024-04-30T23:07:05.806 DEBUG:teuthology.orchestra.run.smithi104:osd.4> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.4.service 2024-04-30T23:07:05.808 INFO:tasks.cephadm:Deploying osd.5 on smithi183 with /dev/vg_nvme/lv_3... 2024-04-30T23:07:05.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-30T23:07:06.059 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:07:06.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:06.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:06 smithi104 ceph-mon[32987]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:06.428 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.429 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.429 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:06.429 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.429 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.429 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:06 smithi183 ceph-mon[33560]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:06.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:06.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:06.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-30T23:07:06.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:06 smithi100 ceph-mon[29745]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:07.229 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-mon[32987]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-30T23:07:07.230 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-mon[32987]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:07.230 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-mon[32987]: osdmap e31: 5 total, 4 up, 5 in 2024-04-30T23:07:07.230 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:07.230 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-mon[32987]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:07.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:07 smithi183 ceph-mon[33560]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-30T23:07:07.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:07 smithi183 ceph-mon[33560]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:07.400 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:07 smithi183 ceph-mon[33560]: osdmap e31: 5 total, 4 up, 5 in 2024-04-30T23:07:07.400 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:07.400 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:07 smithi183 ceph-mon[33560]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:07.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:07 smithi100 ceph-mon[29745]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-30T23:07:07.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:07 smithi100 ceph-mon[29745]: from='osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:07.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:07 smithi100 ceph-mon[29745]: osdmap e31: 5 total, 4 up, 5 in 2024-04-30T23:07:07.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:07.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:07 smithi100 ceph-mon[29745]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132941 s, 789 MB/s 2024-04-30T23:07:08.037 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-04-30T23:07:08.145 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:07:08.145 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: osdmap e32: 5 total, 4 up, 5 in 2024-04-30T23:07:08.146 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.146 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.146 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:08.146 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:08 smithi104 ceph-mon[32987]: from='osd.4 ' entity='osd.4' 2024-04-30T23:07:08.146 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:07:07.886+0000 7fe95b03c700 -1 osd.4 0 waiting for initial osdmap 2024-04-30T23:07:08.146 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:07:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:07:07.896+0000 7fe952de9700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:07:08.298 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:07:08.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: osdmap e32: 5 total, 4 up, 5 in 2024-04-30T23:07:08.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:08.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:08 smithi183 ceph-mon[33560]: from='osd.4 ' entity='osd.4' 2024-04-30T23:07:08.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:07:08.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: osdmap e32: 5 total, 4 up, 5 in 2024-04-30T23:07:08.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:08.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-04-30T23:07:08.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:08 smithi100 ceph-mon[29745]: from='osd.4 ' entity='osd.4' 2024-04-30T23:07:08.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_3 2024-04-30T23:07:08.914 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] boot 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: osdmap e33: 5 total, 5 up, 5 in 2024-04-30T23:07:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:09.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:09.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] boot 2024-04-30T23:07:09.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: osdmap e33: 5 total, 5 up, 5 in 2024-04-30T23:07:09.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:07:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:07:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:09.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: osd.4 [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] boot 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: osdmap e33: 5 total, 5 up, 5 in 2024-04-30T23:07:09.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-30T23:07:10.230 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:10 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi104 2024-04-30T23:07:10.230 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:10 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 8544M 2024-04-30T23:07:10.230 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:10 smithi183 ceph-mon[33560]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 -- 172.21.15.183:0/3510489675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa81074c0 msgr2=0x7f7fa81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 --2- 172.21.15.183:0/3510489675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa81074c0 0x7f7fa81098e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009990 tx=0x7f7f90009ca0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 -- 172.21.15.183:0/3510489675 shutdown_connections 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 --2- 172.21.15.183:0/3510489675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 --2- 172.21.15.183:0/3510489675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa8104b60 0x7f7fa8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.453 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 --2- 172.21.15.183:0/3510489675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa81074c0 0x7f7fa81098e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.454 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 -- 172.21.15.183:0/3510489675 >> 172.21.15.183:0/3510489675 conn(0x7f7fa80fe5a0 msgr2=0x7f7fa8100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:07:10.454 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 -- 172.21.15.183:0/3510489675 shutdown_connections 2024-04-30T23:07:10.454 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.454+0000 7f7faca02700 1 -- 172.21.15.183:0/3510489675 wait complete. 2024-04-30T23:07:10.454 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.455+0000 7f7faca02700 1 Processor -- start 2024-04-30T23:07:10.454 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.455+0000 7f7faca02700 1 -- start start 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa81074c0 0x7f7fa819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa81a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810fab0 con 0x7f7fa8109e20 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810f930 con 0x7f7fa81074c0 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7faca02700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810fc30 con 0x7f7fa8104b60 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:47420/0 (socket says 172.21.15.183:47420) 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 -- 172.21.15.183:0/2925383778 learned_addr learned my addr 172.21.15.183:0/2925383778 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:07:10.456 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa759e700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa81a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7f9e59c700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa81074c0 0x7f7fa819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 -- 172.21.15.183:0/2925383778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa81074c0 msgr2=0x7f7fa819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa81074c0 0x7f7fa819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 -- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 msgr2=0x7f7fa81a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa81a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 -- 172.21.15.183:0/2925383778 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa81a2180 con 0x7f7fa8104b60 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa759e700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa81a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa6d9d700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800d980 tx=0x7f7f9800dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.456+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98017070 con 0x7f7fa8104b60 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.457+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f98010460 con 0x7f7fa8104b60 2024-04-30T23:07:10.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.457+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa81a2470 con 0x7f7fa8104b60 2024-04-30T23:07:10.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.457+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800de60 con 0x7f7fa8104b60 2024-04-30T23:07:10.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.457+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81a2a00 con 0x7f7fa8104b60 2024-04-30T23:07:10.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.458+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa80511d0 con 0x7f7fa8104b60 2024-04-30T23:07:10.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.460+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f7f98010610 con 0x7f7fa8104b60 2024-04-30T23:07:10.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.460+0000 7f7fa4d99700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 0x7f7f940a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:10.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.460+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f7f980ceea0 con 0x7f7fa8104b60 2024-04-30T23:07:10.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.461+0000 7f7f9e59c700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 0x7f7f940a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:10.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.461+0000 7f7f9e59c700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 0x7f7f940a61d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f90006010 tx=0x7f7f9000b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:07:10.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.464+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f9809c970 con 0x7f7fa8104b60 2024-04-30T23:07:10.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:10 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi104 2024-04-30T23:07:10.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:10 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 8544M 2024-04-30T23:07:10.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:10 smithi104 ceph-mon[32987]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:10.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:10 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi104 2024-04-30T23:07:10.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:10 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 8544M 2024-04-30T23:07:10.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:10 smithi100 ceph-mon[29745]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:10.671 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:10.674+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7fa8063b10 con 0x7f7f940a3cc0 2024-04-30T23:07:11.414 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:11 smithi183 ceph-mon[33560]: osdmap e34: 5 total, 5 up, 5 in 2024-04-30T23:07:11.414 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:11 smithi183 ceph-mon[33560]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:11.414 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:11.414 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:11.414 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:11.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:11 smithi104 ceph-mon[32987]: osdmap e34: 5 total, 5 up, 5 in 2024-04-30T23:07:11.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:11 smithi104 ceph-mon[32987]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:11.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:11.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:11.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:11.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:11 smithi100 ceph-mon[29745]: osdmap e34: 5 total, 5 up, 5 in 2024-04-30T23:07:11.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:11 smithi100 ceph-mon[29745]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:11.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:11.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:11.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:12.270 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:12 smithi183 ceph-mon[33560]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:12.543 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:12 smithi104 ceph-mon[32987]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:12.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:12 smithi100 ceph-mon[29745]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:13.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/4156057202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:13 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:13 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]': finished 2024-04-30T23:07:13.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:13 smithi104 ceph-mon[32987]: osdmap e35: 6 total, 5 up, 6 in 2024-04-30T23:07:13.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:13 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:13.794 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/4156057202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.795 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:13 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.795 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:13 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]': finished 2024-04-30T23:07:13.795 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:13 smithi183 ceph-mon[33560]: osdmap e35: 6 total, 5 up, 6 in 2024-04-30T23:07:13.795 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:13 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:13.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/4156057202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:13 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]: dispatch 2024-04-30T23:07:13.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:13 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff24999e-56a0-4b18-92e5-f7165c4f5752"}]': finished 2024-04-30T23:07:13.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:13 smithi100 ceph-mon[29745]: osdmap e35: 6 total, 5 up, 6 in 2024-04-30T23:07:13.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:13 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:14.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:14 smithi104 ceph-mon[32987]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:14.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/2691465617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:14.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:14 smithi183 ceph-mon[33560]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:14.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/2691465617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:14 smithi100 ceph-mon[29745]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/2691465617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:17.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:16 smithi104 ceph-mon[32987]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:17.048 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:16 smithi183 ceph-mon[33560]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:17.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:16 smithi100 ceph-mon[29745]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:18.690 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:18 smithi183 ceph-mon[33560]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:19.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:18 smithi104 ceph-mon[32987]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:19.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:18 smithi100 ceph-mon[29745]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:20.908 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:20 smithi183 ceph-mon[33560]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:21.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:20 smithi104 ceph-mon[32987]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:21.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:20 smithi100 ceph-mon[29745]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:21.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:21 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-30T23:07:21.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:21 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:22.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:21 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-30T23:07:22.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:21 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:22.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:21 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-30T23:07:22.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:21 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:22.773 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:22 smithi183 ceph-mon[33560]: Deploying daemon osd.5 on smithi183 2024-04-30T23:07:22.773 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:22 smithi183 ceph-mon[33560]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:23.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:22 smithi104 ceph-mon[32987]: Deploying daemon osd.5 on smithi183 2024-04-30T23:07:23.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:22 smithi104 ceph-mon[32987]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:23.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:22 smithi100 ceph-mon[29745]: Deploying daemon osd.5 on smithi183 2024-04-30T23:07:23.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:22 smithi100 ceph-mon[29745]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:24.883 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:24 smithi183 ceph-mon[33560]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:25.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:24 smithi104 ceph-mon[32987]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:25.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:24 smithi100 ceph-mon[29745]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:26 smithi183 ceph-mon[33560]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:27.043 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:26 smithi104 ceph-mon[32987]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:27.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:26 smithi100 ceph-mon[29745]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:27.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:27 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:27.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:27 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:27.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:27 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:27.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:27 smithi183 ceph-mon[33560]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:27 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:27 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:27 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:27 smithi104 ceph-mon[32987]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:28.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:27 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:28.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:27 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:28.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:27 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:28.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:27 smithi100 ceph-mon[29745]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.651 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:30 smithi183 ceph-mon[33560]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:30.738 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.740+0000 7f7fa4d99700 1 -- 172.21.15.183:0/2925383778 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7fa8063b10 con 0x7f7f940a3cc0 2024-04-30T23:07:30.739 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 5 on host 'smithi183' 2024-04-30T23:07:30.740 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.742+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 msgr2=0x7f7f940a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.742+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 0x7f7f940a61d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f90006010 tx=0x7f7f9000b580 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.742+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 msgr2=0x7f7fa819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.742+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800d980 tx=0x7f7f9800dd40 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.742+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 shutdown_connections 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7f940a3cc0 0x7f7f940a61d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa8109e20 0x7f7fa81a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fa8104b60 0x7f7fa819a620 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 --2- 172.21.15.183:0/2925383778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7fa81074c0 0x7f7fa819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 >> 172.21.15.183:0/2925383778 conn(0x7f7fa80fe5a0 msgr2=0x7f7fa8105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 shutdown_connections 2024-04-30T23:07:30.741 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:07:30.743+0000 7f7faca02700 1 -- 172.21.15.183:0/2925383778 wait complete. 2024-04-30T23:07:30.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:30.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:30.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:30 smithi100 ceph-mon[29745]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:30.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:30.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:30.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:30.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:30 smithi104 ceph-mon[32987]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:31.371 DEBUG:teuthology.orchestra.run.smithi183:osd.5> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.5.service 2024-04-30T23:07:31.373 INFO:tasks.cephadm:Deploying osd.6 on smithi100 with /dev/vg_nvme/lv_2... 2024-04-30T23:07:31.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-30T23:07:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:07:31.656 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:31 smithi183 ceph-mon[33560]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.656 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:31 smithi183 ceph-mon[33560]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.656 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:31.656 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:31.656 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:31.745 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:31 smithi100 ceph-mon[29745]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.745 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:31 smithi100 ceph-mon[29745]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.746 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:31.746 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:31.746 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:31.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:31 smithi104 ceph-mon[32987]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:31 smithi104 ceph-mon[32987]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-30T23:07:31.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:31.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:31.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:32.767 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-30T23:07:32.767 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: osdmap e36: 6 total, 5 up, 6 in 2024-04-30T23:07:32.768 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:32.768 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.768 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.768 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:32 smithi183 ceph-mon[33560]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:32.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-30T23:07:32.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: osdmap e36: 6 total, 5 up, 6 in 2024-04-30T23:07:32.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:32.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:32 smithi104 ceph-mon[32987]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:32.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-30T23:07:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: osdmap e36: 6 total, 5 up, 6 in 2024-04-30T23:07:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: from='osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:07:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:32 smithi100 ceph-mon[29745]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-30T23:07:33.299 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:07:33.257+0000 7fdd112ba700 -1 osd.5 0 waiting for initial osdmap 2024-04-30T23:07:33.299 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:07:33.266+0000 7fdd09067700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: osdmap e37: 6 total, 5 up, 6 in 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: from='osd.5 ' entity='osd.5' 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] boot 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: osdmap e38: 6 total, 6 up, 6 in 2024-04-30T23:07:33.562 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.775 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: osdmap e37: 6 total, 5 up, 6 in 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: from='osd.5 ' entity='osd.5' 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] boot 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: osdmap e38: 6 total, 6 up, 6 in 2024-04-30T23:07:33.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: osdmap e37: 6 total, 5 up, 6 in 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: from='osd.5 ' entity='osd.5' 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: osd.5 [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] boot 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: osdmap e38: 6 total, 6 up, 6 in 2024-04-30T23:07:33.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140625 s, 746 MB/s 2024-04-30T23:07:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-30T23:07:34.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:34.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:34.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:34 smithi104 ceph-mon[32987]: osdmap e39: 6 total, 6 up, 6 in 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:34.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:34 smithi183 ceph-mon[33560]: osdmap e39: 6 total, 6 up, 6 in 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:07:34.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:34.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:34.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:34.801 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:34 smithi100 ceph-mon[29745]: osdmap e39: 6 total, 6 up, 6 in 2024-04-30T23:07:34.814 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:07:35.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:35 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi183 2024-04-30T23:07:35.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:35 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 8544M 2024-04-30T23:07:35.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:35 smithi104 ceph-mon[32987]: osdmap e40: 6 total, 6 up, 6 in 2024-04-30T23:07:35.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:35 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi183 2024-04-30T23:07:35.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:35 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 8544M 2024-04-30T23:07:35.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:35 smithi183 ceph-mon[33560]: osdmap e40: 6 total, 6 up, 6 in 2024-04-30T23:07:35.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:35 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi183 2024-04-30T23:07:35.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:35 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 8544M 2024-04-30T23:07:35.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:35 smithi100 ceph-mon[29745]: osdmap e40: 6 total, 6 up, 6 in 2024-04-30T23:07:36.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 -- 172.21.15.100:0/596380140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678103150 msgr2=0x7f8678103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 --2- 172.21.15.100:0/596380140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678103150 0x7f8678103560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f866c009990 tx=0x7f866c009ca0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 -- 172.21.15.100:0/596380140 shutdown_connections 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 --2- 172.21.15.100:0/596380140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8678104c20 0x7f867810b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 --2- 172.21.15.100:0/596380140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678103150 0x7f8678103560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 --2- 172.21.15.100:0/596380140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678104280 0x7f8678104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 -- 172.21.15.100:0/596380140 >> 172.21.15.100:0/596380140 conn(0x7f86780fe790 msgr2=0x7f8678100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 -- 172.21.15.100:0/596380140 shutdown_connections 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.502+0000 7f867f0fc700 1 -- 172.21.15.100:0/596380140 wait complete. 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 Processor -- start 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 -- start start 2024-04-30T23:07:36.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678103150 0x7f867806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8678104c20 0x7f86781a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f867810eba0 con 0x7f8678104280 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f867810ea20 con 0x7f8678103150 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.503+0000 7f867f0fc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f867810ed20 con 0x7f8678104c20 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60322/0 (socket says 172.21.15.100:60322) 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 -- 172.21.15.100:0/2270732925 learned_addr learned my addr 172.21.15.100:0/2270732925 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f867ce98700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678103150 0x7f867806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 -- 172.21.15.100:0/2270732925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8678104c20 msgr2=0x7f86781a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8678104c20 0x7f86781a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 -- 172.21.15.100:0/2270732925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678103150 msgr2=0x7f867806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678103150 0x7f867806bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 -- 172.21.15.100:0/2270732925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86781a23b0 con 0x7f8678104280 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8677fff700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f866400d950 tx=0x7f866400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664016070 con 0x7f8678104280 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8664010460 con 0x7f8678104280 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86781a26a0 con 0x7f8678104280 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866400f620 con 0x7f8678104280 2024-04-30T23:07:36.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.504+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86781a2be0 con 0x7f8678104280 2024-04-30T23:07:36.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.505+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86780511d0 con 0x7f8678104280 2024-04-30T23:07:36.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.507+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8664019070 con 0x7f8678104280 2024-04-30T23:07:36.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.507+0000 7f8675ffb700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 0x7f86680a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:07:36.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.507+0000 7f867ce98700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 0x7f86680a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:07:36.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.507+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7f86640cf140 con 0x7f8678104280 2024-04-30T23:07:36.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.508+0000 7f867ce98700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 0x7f86680a6150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b760 tx=0x7f866c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:07:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.511+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f866409c9c0 con 0x7f8678104280 2024-04-30T23:07:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:36.722+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8678063b10 con 0x7f86680a3c40 2024-04-30T23:07:36.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:36 smithi104 ceph-mon[32987]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:36.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:36 smithi183 ceph-mon[33560]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:36.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:36 smithi100 ceph-mon[29745]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:37 smithi100 ceph-mon[29745]: osdmap e41: 6 total, 6 up, 6 in 2024-04-30T23:07:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:37.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:37 smithi104 ceph-mon[32987]: osdmap e41: 6 total, 6 up, 6 in 2024-04-30T23:07:37.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:37.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:37.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:37.798 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:37 smithi183 ceph-mon[33560]: osdmap e41: 6 total, 6 up, 6 in 2024-04-30T23:07:37.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:07:37.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:07:37.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:38.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:38 smithi100 ceph-mon[29745]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:38.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:38 smithi100 ceph-mon[29745]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-30T23:07:38.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:38 smithi100 ceph-mon[29745]: osdmap e42: 6 total, 6 up, 6 in 2024-04-30T23:07:38.793 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:38 smithi104 ceph-mon[32987]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:38.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:38 smithi104 ceph-mon[32987]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-30T23:07:38.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:38 smithi104 ceph-mon[32987]: osdmap e42: 6 total, 6 up, 6 in 2024-04-30T23:07:38.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:38 smithi183 ceph-mon[33560]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:07:38.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:38 smithi183 ceph-mon[33560]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 386 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-30T23:07:38.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:38 smithi183 ceph-mon[33560]: osdmap e42: 6 total, 6 up, 6 in 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]: dispatch 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]': finished 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: osdmap e43: 7 total, 6 up, 7 in 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:40.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:40 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3525473738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]: dispatch 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]': finished 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: osdmap e43: 7 total, 6 up, 7 in 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:40.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:40 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3525473738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:40.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-30T23:07:40.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]: dispatch 2024-04-30T23:07:40.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3820701100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc4bc468-d384-49f6-a3c3-85963a7d828d"}]': finished 2024-04-30T23:07:40.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: osdmap e43: 7 total, 6 up, 7 in 2024-04-30T23:07:40.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:40.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:40 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3525473738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:07:42.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:42 smithi104 ceph-mon[32987]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:07:42.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:42 smithi183 ceph-mon[33560]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:07:42.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:42 smithi100 ceph-mon[29745]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:07:44.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:44 smithi183 ceph-mon[33560]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:44.805 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:44 smithi100 ceph-mon[29745]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:45.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:44 smithi104 ceph-mon[32987]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:46.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:46 smithi100 ceph-mon[29745]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:46.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:46 smithi183 ceph-mon[33560]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:47.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:46 smithi104 ceph-mon[32987]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:47.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-30T23:07:47.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:47.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-30T23:07:47.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:47.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-30T23:07:47.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:48.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:48 smithi100 ceph-mon[29745]: Deploying daemon osd.6 on smithi100 2024-04-30T23:07:48.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:48 smithi100 ceph-mon[29745]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:49.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:48 smithi104 ceph-mon[32987]: Deploying daemon osd.6 on smithi100 2024-04-30T23:07:49.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:48 smithi104 ceph-mon[32987]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:49.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:48 smithi183 ceph-mon[33560]: Deploying daemon osd.6 on smithi100 2024-04-30T23:07:49.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:48 smithi183 ceph-mon[33560]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:50.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:50 smithi100 ceph-mon[29745]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:51.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:50 smithi104 ceph-mon[32987]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:51.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:50 smithi183 ceph-mon[33560]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:52.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:52 smithi100 ceph-mon[29745]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:53.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:52 smithi104 ceph-mon[32987]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:53.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:52 smithi183 ceph-mon[33560]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:54.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:54.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:54 smithi104 ceph-mon[32987]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:54.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:54.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:54 smithi183 ceph-mon[33560]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:54.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:54.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:54.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:54 smithi100 ceph-mon[29745]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:57.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:57.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:07:57.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.535 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 6 on host 'smithi100' 2024-04-30T23:07:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.537+0000 7f8675ffb700 1 -- 172.21.15.100:0/2270732925 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8678063b10 con 0x7f86680a3c40 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 msgr2=0x7f86680a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 0x7f86680a6150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b760 tx=0x7f866c005fb0 comp rx=0 tx=0).stop 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 msgr2=0x7f867819f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f866400d950 tx=0x7f866400dd10 comp rx=0 tx=0).stop 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 shutdown_connections 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86680a3c40 0x7f86680a6150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8678104c20 0x7f86781a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8678103150 0x7f867806bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:57.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 --2- 172.21.15.100:0/2270732925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678104280 0x7f867819f610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:07:57.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 >> 172.21.15.100:0/2270732925 conn(0x7f86780fe790 msgr2=0x7f86781074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:07:57.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 shutdown_connections 2024-04-30T23:07:57.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:07:57.539+0000 7f867f0fc700 1 -- 172.21.15.100:0/2270732925 wait complete. 2024-04-30T23:07:57.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:57 smithi100 ceph-mon[29745]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-30T23:07:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:58.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:57 smithi104 ceph-mon[32987]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-30T23:07:58.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:58.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:58.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:58.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:57 smithi183 ceph-mon[33560]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-30T23:07:58.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:07:58.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:58.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:07:58.364 DEBUG:teuthology.orchestra.run.smithi100:osd.6> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.6.service 2024-04-30T23:07:58.366 INFO:tasks.cephadm:Deploying osd.7 on smithi104 with /dev/vg_nvme/lv_2... 2024-04-30T23:07:58.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-30T23:07:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:07:58.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:58 smithi104 ceph-mon[32987]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:58.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:58 smithi104 ceph-mon[32987]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-30T23:07:58.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:58 smithi104 ceph-mon[32987]: osdmap e44: 7 total, 6 up, 7 in 2024-04-30T23:07:58.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:58 smithi104 ceph-mon[32987]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:07:58.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:58.876 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:58 smithi100 ceph-mon[29745]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:58.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:58 smithi100 ceph-mon[29745]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-30T23:07:58.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:58 smithi100 ceph-mon[29745]: osdmap e44: 7 total, 6 up, 7 in 2024-04-30T23:07:58.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:58 smithi100 ceph-mon[29745]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:07:58.877 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:59.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:58 smithi183 ceph-mon[33560]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:07:59.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:58 smithi183 ceph-mon[33560]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-30T23:07:59.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:58 smithi183 ceph-mon[33560]: osdmap e44: 7 total, 6 up, 7 in 2024-04-30T23:07:59.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:58 smithi183 ceph-mon[33560]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:07:59.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:59.571 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:07:59.306+0000 7fabca9b3700 -1 osd.6 0 waiting for initial osdmap 2024-04-30T23:07:59.571 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:07:59.316+0000 7fabc1f5f700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:07:59.941 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:07:59.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: osdmap e45: 7 total, 6 up, 7 in 2024-04-30T23:07:59.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:59.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:07:59.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' 2024-04-30T23:07:59.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:07:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: osdmap e45: 7 total, 6 up, 7 in 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' 2024-04-30T23:08:00.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:07:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:08:00.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: osdmap e45: 7 total, 6 up, 7 in 2024-04-30T23:08:00.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: from='osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635]' entity='osd.6' 2024-04-30T23:08:00.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:07:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-30T23:08:00.617 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-30T23:08:00.617 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-04-30T23:08:00.617 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-04-30T23:08:00.617 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115527 s, 908 MB/s 2024-04-30T23:08:00.617 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] boot 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: osdmap e46: 7 total, 7 up, 7 in 2024-04-30T23:08:00.916 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] boot 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: osdmap e46: 7 total, 7 up, 7 in 2024-04-30T23:08:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: osd.6 [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] boot 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: osdmap e46: 7 total, 7 up, 7 in 2024-04-30T23:08:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-30T23:08:01.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi104:vg_nvme/lv_2 2024-04-30T23:08:01.545 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: osdmap e47: 7 total, 7 up, 7 in 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:02.863 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:02.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:02.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:02.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:02 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: osdmap e47: 7 total, 7 up, 7 in 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:02 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: osdmap e47: 7 total, 7 up, 7 in 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:02 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 -- 172.21.15.104:0/788024624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 msgr2=0x7fc17c10c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 --2- 172.21.15.104:0/788024624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c10c7d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc17400b0a0 tx=0x7fc17400b3b0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 -- 172.21.15.104:0/788024624 shutdown_connections 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 --2- 172.21.15.104:0/788024624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c10c7d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 --2- 172.21.15.104:0/788024624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 0x7fc17c105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 --2- 172.21.15.104:0/788024624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 0x7fc17c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 -- 172.21.15.104:0/788024624 >> 172.21.15.104:0/788024624 conn(0x7fc17c0fdf30 msgr2=0x7fc17c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 -- 172.21.15.104:0/788024624 shutdown_connections 2024-04-30T23:08:03.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.116+0000 7fc180ee3700 1 -- 172.21.15.104:0/788024624 wait complete. 2024-04-30T23:08:03.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 Processor -- start 2024-04-30T23:08:03.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 -- start start 2024-04-30T23:08:03.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 0x7fc17c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:03.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 0x7fc17c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c10fd50 con 0x7fc17c102260 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c10fbd0 con 0x7fc17c102bb0 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc180ee3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c10fed0 con 0x7fc17c105810 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.117+0000 7fc171d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46902/0 (socket says 172.21.15.104:46902) 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 -- 172.21.15.104:0/2461742644 learned_addr learned my addr 172.21.15.104:0/2461742644 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc17a59c700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 0x7fc17c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc17ad9d700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 0x7fc17c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 -- 172.21.15.104:0/2461742644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 msgr2=0x7fc17c1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 0x7fc17c1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 -- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 msgr2=0x7fc17c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 0x7fc17c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 -- 172.21.15.104:0/2461742644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c1a2330 con 0x7fc17c102bb0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc171d9b700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c920 tx=0x7fc16400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164004a30 con 0x7fc17c102bb0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c1a2620 con 0x7fc17c102bb0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1640054d0 con 0x7fc17c102bb0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164007bd0 con 0x7fc17c102bb0 2024-04-30T23:08:03.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.118+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a2c30 con 0x7fc17c102bb0 2024-04-30T23:08:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.120+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c0511d0 con 0x7fc17c102bb0 2024-04-30T23:08:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.121+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fc164005020 con 0x7fc17c102bb0 2024-04-30T23:08:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.121+0000 7fc173fff700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 0x7fc1680a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.121+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7fc1640cf250 con 0x7fc17c102bb0 2024-04-30T23:08:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.121+0000 7fc17a59c700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 0x7fc1680a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:03.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.122+0000 7fc17a59c700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 0x7fc1680a6150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06bf90 tx=0x7fc16c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:03.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.126+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc164014030 con 0x7fc17c102bb0 2024-04-30T23:08:03.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:03.331+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc17c063b10 con 0x7fc1680a3c40 2024-04-30T23:08:03.930 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:03 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi100 2024-04-30T23:08:03.931 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:03 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 5696M 2024-04-30T23:08:03.931 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:03 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:03.931 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:03 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:03.931 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:03 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:04.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:03 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi100 2024-04-30T23:08:04.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:03 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 5696M 2024-04-30T23:08:04.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:03 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:04.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:03 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:04.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:03 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:04.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:03 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi100 2024-04-30T23:08:04.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:03 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 5696M 2024-04-30T23:08:04.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:03 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:04.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:03 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:04.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:03 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:04.911 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:04 smithi104 ceph-mon[32987]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:04.911 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:04 smithi104 ceph-mon[32987]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:04 smithi183 ceph-mon[33560]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:04 smithi183 ceph-mon[33560]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:05.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:04 smithi100 ceph-mon[29745]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:05.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:04 smithi100 ceph-mon[29745]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:06.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:06.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/519750760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:06.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:06.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]': finished 2024-04-30T23:08:06.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: osdmap e48: 8 total, 7 up, 8 in 2024-04-30T23:08:06.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:07.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:07.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/519750760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:07.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:07.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]': finished 2024-04-30T23:08:07.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: osdmap e48: 8 total, 7 up, 8 in 2024-04-30T23:08:07.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:07.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:07.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/519750760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:07.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]: dispatch 2024-04-30T23:08:07.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21ba1dd0-804d-435d-b437-8d0975de2d30"}]': finished 2024-04-30T23:08:07.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: osdmap e48: 8 total, 7 up, 8 in 2024-04-30T23:08:07.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:08.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:07 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/1245248820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:08.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:07 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/1245248820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:08.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:07 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/1245248820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:09.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:08 smithi104 ceph-mon[32987]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:09.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:08 smithi183 ceph-mon[33560]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:09.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:08 smithi100 ceph-mon[29745]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:10.945 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:10 smithi104 ceph-mon[32987]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:11.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:10 smithi183 ceph-mon[33560]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:11.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:10 smithi100 ceph-mon[29745]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:12.948 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:12 smithi104 ceph-mon[32987]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:13.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:12 smithi183 ceph-mon[33560]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:12 smithi100 ceph-mon[29745]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:13.919 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:13 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-30T23:08:13.919 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:13 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:14.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:13 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-30T23:08:14.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:13 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:14.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:13 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-30T23:08:14.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:13 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:14.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:14 smithi104 ceph-mon[32987]: Deploying daemon osd.7 on smithi104 2024-04-30T23:08:14.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:14 smithi104 ceph-mon[32987]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:15.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:14 smithi183 ceph-mon[33560]: Deploying daemon osd.7 on smithi104 2024-04-30T23:08:15.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:14 smithi183 ceph-mon[33560]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:14 smithi100 ceph-mon[29745]: Deploying daemon osd.7 on smithi104 2024-04-30T23:08:15.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:14 smithi100 ceph-mon[29745]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:16.930 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:16 smithi104 ceph-mon[32987]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:17.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:16 smithi183 ceph-mon[33560]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:16 smithi100 ceph-mon[29745]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:18.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:18 smithi104 ceph-mon[32987]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:19.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:18 smithi183 ceph-mon[33560]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:18 smithi100 ceph-mon[29745]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:20.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:19 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:20.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:19 smithi104 ceph-mon[32987]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:20.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:19 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:20.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:19 smithi100 ceph-mon[29745]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:20.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:19 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:19 smithi183 ceph-mon[33560]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:22.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:22 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:22.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.695+0000 7fc173fff700 1 -- 172.21.15.104:0/2461742644 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc17c063b10 con 0x7fc1680a3c40 2024-04-30T23:08:22.694 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 7 on host 'smithi104' 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.697+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 msgr2=0x7fc1680a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.697+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 0x7fc1680a6150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06bf90 tx=0x7fc16c009190 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.697+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 msgr2=0x7fc17c19ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.697+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c920 tx=0x7fc16400cc30 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 shutdown_connections 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1680a3c40 0x7fc1680a6150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17c105810 0x7fc17c1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c102260 0x7fc17c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 --2- 172.21.15.104:0/2461742644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc17c102bb0 0x7fc17c19ad10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 >> 172.21.15.104:0/2461742644 conn(0x7fc17c0fdf30 msgr2=0x7fc17c1087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 shutdown_connections 2024-04-30T23:08:22.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:08:22.698+0000 7fc180ee3700 1 -- 172.21.15.104:0/2461742644 wait complete. 2024-04-30T23:08:23.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:23.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:23.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:23.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:22 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:23.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:22 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.379 DEBUG:teuthology.orchestra.run.smithi104:osd.7> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.7.service 2024-04-30T23:08:23.381 INFO:tasks.cephadm:Deploying osd.8 on smithi183 with /dev/vg_nvme/lv_2... 2024-04-30T23:08:23.382 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-30T23:08:23.626 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:08:23.980 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.981 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:23.981 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:23.981 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:23 smithi183 ceph-mon[33560]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:23.981 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:23 smithi183 ceph-mon[33560]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:24.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:24.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:24.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:24.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:23 smithi104 ceph-mon[32987]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:24.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:23 smithi104 ceph-mon[32987]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:24.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:24.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:24.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:24.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:23 smithi100 ceph-mon[29745]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:24.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:23 smithi100 ceph-mon[29745]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-30T23:08:24.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:24.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-30T23:08:24.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:24.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: osdmap e49: 8 total, 7 up, 8 in 2024-04-30T23:08:24.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:24.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:24 smithi104 ceph-mon[32987]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:25.002 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:25.002 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-30T23:08:25.002 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:25.002 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: osdmap e49: 8 total, 7 up, 8 in 2024-04-30T23:08:25.002 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:25.003 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:24 smithi183 ceph-mon[33560]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: from='osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: osdmap e49: 8 total, 7 up, 8 in 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:24 smithi100 ceph-mon[29745]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:08:25.642 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-30T23:08:25.642 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-30T23:08:25.642 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-04-30T23:08:25.642 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-04-30T23:08:25.642 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0143185 s, 732 MB/s 2024-04-30T23:08:25.643 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-04-30T23:08:25.705 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:08:25.439+0000 7fdd47ccf700 -1 osd.7 0 waiting for initial osdmap 2024-04-30T23:08:25.705 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:08:25.450+0000 7fdd3fa7c700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:08:25.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-mon[32987]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:08:25.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-mon[32987]: osdmap e50: 8 total, 7 up, 8 in 2024-04-30T23:08:25.986 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:25.986 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:25.986 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:25 smithi104 ceph-mon[32987]: from='osd.7 ' entity='osd.7' 2024-04-30T23:08:26.000 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:25 smithi183 ceph-mon[33560]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:08:26.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:25 smithi183 ceph-mon[33560]: osdmap e50: 8 total, 7 up, 8 in 2024-04-30T23:08:26.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:25 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:26.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:25 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:26.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:25 smithi183 ceph-mon[33560]: from='osd.7 ' entity='osd.7' 2024-04-30T23:08:26.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:25 smithi100 ceph-mon[29745]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:08:26.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:25 smithi100 ceph-mon[29745]: osdmap e50: 8 total, 7 up, 8 in 2024-04-30T23:08:26.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:25 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:26.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:25 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:26.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:25 smithi100 ceph-mon[29745]: from='osd.7 ' entity='osd.7' 2024-04-30T23:08:26.320 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_2 2024-04-30T23:08:26.562 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:08:26.970 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] boot 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: osdmap e51: 8 total, 8 up, 8 in 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:26.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:26.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:26 smithi183 ceph-mon[33560]: osdmap e52: 8 total, 8 up, 8 in 2024-04-30T23:08:27.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:08:27.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:08:27.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] boot 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: osdmap e51: 8 total, 8 up, 8 in 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:26 smithi104 ceph-mon[32987]: osdmap e52: 8 total, 8 up, 8 in 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: osd.7 [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] boot 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: osdmap e51: 8 total, 8 up, 8 in 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:27.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:26 smithi100 ceph-mon[29745]: osdmap e52: 8 total, 8 up, 8 in 2024-04-30T23:08:27.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:27 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi104 2024-04-30T23:08:27.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:27 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 5696M 2024-04-30T23:08:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:27 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi104 2024-04-30T23:08:28.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:27 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 5696M 2024-04-30T23:08:28.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:27 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi104 2024-04-30T23:08:28.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:27 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 5696M 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 -- 172.21.15.183:0/1187228466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc0103e70 msgr2=0x7facc0104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 --2- 172.21.15.183:0/1187228466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc0103e70 0x7facc0104280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7facb4009990 tx=0x7facb4009ca0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 -- 172.21.15.183:0/1187228466 shutdown_connections 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 --2- 172.21.15.183:0/1187228466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 0x7facc010c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 --2- 172.21.15.183:0/1187228466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc01058c0 0x7facc0105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 --2- 172.21.15.183:0/1187228466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc0103e70 0x7facc0104280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 -- 172.21.15.183:0/1187228466 >> 172.21.15.183:0/1187228466 conn(0x7facc00ff8e0 msgr2=0x7facc0101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 -- 172.21.15.183:0/1187228466 shutdown_connections 2024-04-30T23:08:28.149 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.150+0000 7facc4e67700 1 -- 172.21.15.183:0/1187228466 wait complete. 2024-04-30T23:08:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 Processor -- start 2024-04-30T23:08:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 -- start start 2024-04-30T23:08:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc0103e70 0x7facc0078480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 0x7facc0076b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7facc010fe50 con 0x7facc01048f0 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7facc010fcd0 con 0x7facc0103e70 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facc4e67700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facc010ffd0 con 0x7facc01058c0 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facbed9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facbed9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38012/0 (socket says 172.21.15.183:38012) 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facbed9d700 1 -- 172.21.15.183:0/2752661288 learned_addr learned my addr 172.21.15.183:0/2752661288 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facbe59c700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc0103e70 0x7facc0078480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.151+0000 7facbdd9b700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 0x7facc0076b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 -- 172.21.15.183:0/2752661288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc0103e70 msgr2=0x7facc0078480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc0103e70 0x7facc0078480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 -- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 msgr2=0x7facc0076b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 0x7facc0076b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 -- 172.21.15.183:0/2752661288 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00777d0 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facbed9d700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facb8007ee0 tx=0x7facb800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb800dbd0 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb800dd70 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8005990 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc01a4a00 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.152+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01a4e90 con 0x7facc01058c0 2024-04-30T23:08:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.153+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc00511d0 con 0x7facc01058c0 2024-04-30T23:08:28.154 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.154+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7facb801a020 con 0x7facc01058c0 2024-04-30T23:08:28.154 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.155+0000 7facaf7fe700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 0x7faca80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:28.154 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.155+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7facb80cf710 con 0x7facc01058c0 2024-04-30T23:08:28.154 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.155+0000 7facbe59c700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 0x7faca80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:28.154 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.156+0000 7facbe59c700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 0x7faca80a6150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facc01052b0 tx=0x7facb000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:28.157 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.159+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7facb8010070 con 0x7facc01058c0 2024-04-30T23:08:28.364 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:28.365+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7facc002e940 con 0x7faca80a3c40 2024-04-30T23:08:28.974 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:28 smithi183 ceph-mon[33560]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:28.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:28 smithi183 ceph-mon[33560]: osdmap e53: 8 total, 8 up, 8 in 2024-04-30T23:08:28.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:28.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:28.975 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:29.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:28 smithi104 ceph-mon[32987]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:29.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:28 smithi104 ceph-mon[32987]: osdmap e53: 8 total, 8 up, 8 in 2024-04-30T23:08:29.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:29.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:29.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:28 smithi100 ceph-mon[29745]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:28 smithi100 ceph-mon[29745]: osdmap e53: 8 total, 8 up, 8 in 2024-04-30T23:08:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:30.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:29 smithi104 ceph-mon[32987]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:30.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:29 smithi104 ceph-mon[32987]: osdmap e54: 8 total, 8 up, 8 in 2024-04-30T23:08:30.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:29 smithi183 ceph-mon[33560]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:30.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:29 smithi183 ceph-mon[33560]: osdmap e54: 8 total, 8 up, 8 in 2024-04-30T23:08:30.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:29 smithi100 ceph-mon[29745]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:30.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:29 smithi100 ceph-mon[29745]: osdmap e54: 8 total, 8 up, 8 in 2024-04-30T23:08:31.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:30 smithi104 ceph-mon[32987]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:31.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:30 smithi104 ceph-mon[32987]: osdmap e55: 8 total, 8 up, 8 in 2024-04-30T23:08:31.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:30 smithi183 ceph-mon[33560]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:31.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:30 smithi183 ceph-mon[33560]: osdmap e55: 8 total, 8 up, 8 in 2024-04-30T23:08:31.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:30 smithi100 ceph-mon[29745]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:31.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:30 smithi100 ceph-mon[29745]: osdmap e55: 8 total, 8 up, 8 in 2024-04-30T23:08:31.991 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/2121351271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]': finished 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: osdmap e56: 9 total, 8 up, 9 in 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:31.992 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/2328225523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/2121351271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]': finished 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: osdmap e56: 9 total, 8 up, 9 in 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:32.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/2328225523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/2121351271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]: dispatch 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3275bb80-7285-4045-909d-0dc4220da519"}]': finished 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: osdmap e56: 9 total, 8 up, 9 in 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:32.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/2328225523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:35.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:34 smithi104 ceph-mon[32987]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:35.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:34 smithi183 ceph-mon[33560]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:35.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:34 smithi100 ceph-mon[29745]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:37.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:36 smithi104 ceph-mon[32987]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:37.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:36 smithi183 ceph-mon[33560]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:37.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:36 smithi100 ceph-mon[29745]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:38.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:38 smithi183 ceph-mon[33560]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:38.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-30T23:08:38.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:39.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:38 smithi104 ceph-mon[32987]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:39.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-30T23:08:39.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:39.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:38 smithi100 ceph-mon[29745]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:39.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-30T23:08:39.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:39.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:39 smithi183 ceph-mon[33560]: Deploying daemon osd.8 on smithi183 2024-04-30T23:08:40.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:39 smithi104 ceph-mon[32987]: Deploying daemon osd.8 on smithi183 2024-04-30T23:08:40.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:39 smithi100 ceph-mon[29745]: Deploying daemon osd.8 on smithi183 2024-04-30T23:08:40.935 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:40 smithi183 ceph-mon[33560]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:41.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:40 smithi104 ceph-mon[32987]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:41.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:40 smithi100 ceph-mon[29745]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:42.726 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:42 smithi183 ceph-mon[33560]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:43.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:42 smithi104 ceph-mon[32987]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:43.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:42 smithi100 ceph-mon[29745]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:45.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:44 smithi104 ceph-mon[32987]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:45.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:44 smithi183 ceph-mon[33560]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:44 smithi100 ceph-mon[29745]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:45.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:46.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:46 smithi183 ceph-mon[33560]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:47.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:46 smithi104 ceph-mon[32987]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:47.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:46 smithi100 ceph-mon[29745]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:48.129 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 8 on host 'smithi183' 2024-04-30T23:08:48.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.129+0000 7facaf7fe700 1 -- 172.21.15.183:0/2752661288 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7facc002e940 con 0x7faca80a3c40 2024-04-30T23:08:48.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 msgr2=0x7faca80a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:48.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 0x7faca80a6150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facc01052b0 tx=0x7facb000b410 comp rx=0 tx=0).stop 2024-04-30T23:08:48.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 msgr2=0x7facc0077070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:48.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facb8007ee0 tx=0x7facb800d3b0 comp rx=0 tx=0).stop 2024-04-30T23:08:48.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 shutdown_connections 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faca80a3c40 0x7faca80a6150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facc01058c0 0x7facc0077070 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facc0103e70 0x7facc0078480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 --2- 172.21.15.183:0/2752661288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc01048f0 0x7facc0076b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 >> 172.21.15.183:0/2752661288 conn(0x7facc00ff8e0 msgr2=0x7facc01085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 shutdown_connections 2024-04-30T23:08:48.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:08:48.132+0000 7facc4e67700 1 -- 172.21.15.183:0/2752661288 wait complete. 2024-04-30T23:08:48.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:48 smithi183 ceph-mon[33560]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:48.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:48.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:48.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:48 smithi183 ceph-mon[33560]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:48.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:48 smithi183 ceph-mon[33560]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:48.794 DEBUG:teuthology.orchestra.run.smithi183:osd.8> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.8.service 2024-04-30T23:08:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:48 smithi104 ceph-mon[32987]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:48 smithi104 ceph-mon[32987]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:48.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:48 smithi104 ceph-mon[32987]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:48.797 INFO:tasks.cephadm:Deploying osd.9 on smithi100 with /dev/vg_nvme/lv_1... 2024-04-30T23:08:48.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-30T23:08:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:08:49.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:48 smithi100 ceph-mon[29745]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:49.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:49.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:49.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:48 smithi100 ceph-mon[29745]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:49.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:48 smithi100 ceph-mon[29745]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-30T23:08:50.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: osdmap e57: 9 total, 8 up, 9 in 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:49 smithi183 ceph-mon[33560]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:50.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-30T23:08:50.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: osdmap e57: 9 total, 8 up, 9 in 2024-04-30T23:08:50.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:50.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:49 smithi100 ceph-mon[29745]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:50.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:50.294 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-30T23:08:50.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: osdmap e57: 9 total, 8 up, 9 in 2024-04-30T23:08:50.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:50.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:08:50.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:49 smithi104 ceph-mon[32987]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:51.049 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:08:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:08:50.794+0000 7f52812e9700 -1 osd.8 0 waiting for initial osdmap 2024-04-30T23:08:51.050 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:08:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:08:50.806+0000 7f5279096700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:08:51.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:51 smithi100 ceph-mon[29745]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:08:51.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:51 smithi100 ceph-mon[29745]: osdmap e58: 9 total, 8 up, 9 in 2024-04-30T23:08:51.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:51 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:51 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:51 smithi100 ceph-mon[29745]: from='osd.8 ' entity='osd.8' 2024-04-30T23:08:51.302 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-30T23:08:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-30T23:08:51.303 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-30T23:08:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-30T23:08:51.303 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128535 s, 816 MB/s 2024-04-30T23:08:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-30T23:08:51.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:51 smithi104 ceph-mon[32987]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:08:51.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:51 smithi104 ceph-mon[32987]: osdmap e58: 9 total, 8 up, 9 in 2024-04-30T23:08:51.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:51 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:51 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:51 smithi104 ceph-mon[32987]: from='osd.8 ' entity='osd.8' 2024-04-30T23:08:51.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:51 smithi183 ceph-mon[33560]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:08:51.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:51 smithi183 ceph-mon[33560]: osdmap e58: 9 total, 8 up, 9 in 2024-04-30T23:08:51.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:51 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:51 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:51.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:51 smithi183 ceph-mon[33560]: from='osd.8 ' entity='osd.8' 2024-04-30T23:08:52.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-04-30T23:08:52.279 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] boot 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: osdmap e59: 9 total, 9 up, 9 in 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:52.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:52 smithi100 ceph-mon[29745]: osdmap e60: 9 total, 9 up, 9 in 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] boot 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: osdmap e59: 9 total, 9 up, 9 in 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:52.399 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:52 smithi183 ceph-mon[33560]: osdmap e60: 9 total, 9 up, 9 in 2024-04-30T23:08:52.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:08:52.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:08:52.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: osd.8 [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] boot 2024-04-30T23:08:52.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: osdmap e59: 9 total, 9 up, 9 in 2024-04-30T23:08:52.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-30T23:08:52.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-30T23:08:52.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:52 smithi104 ceph-mon[32987]: osdmap e60: 9 total, 9 up, 9 in 2024-04-30T23:08:53.766 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi183 2024-04-30T23:08:53.766 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.766 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.766 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 5696M 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:53 smithi100 ceph-mon[29745]: osdmap e61: 9 total, 9 up, 9 in 2024-04-30T23:08:53.797 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi183 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 5696M 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:53 smithi104 ceph-mon[32987]: osdmap e61: 9 total, 9 up, 9 in 2024-04-30T23:08:53.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi183 2024-04-30T23:08:53.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 5696M 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:08:53.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:53.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:08:53.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:08:53.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:53 smithi183 ceph-mon[33560]: osdmap e61: 9 total, 9 up, 9 in 2024-04-30T23:08:54.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 -- 172.21.15.100:0/3677542919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0102bb0 msgr2=0x7fe6e010c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 --2- 172.21.15.100:0/3677542919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0102bb0 0x7fe6e010c7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800b0a0 tx=0x7fe6d800b3b0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 -- 172.21.15.100:0/3677542919 shutdown_connections 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 --2- 172.21.15.100:0/3677542919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0102bb0 0x7fe6e010c7d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 --2- 172.21.15.100:0/3677542919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0105810 0x7fe6e0105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 --2- 172.21.15.100:0/3677542919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 0x7fe6e0102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 -- 172.21.15.100:0/3677542919 >> 172.21.15.100:0/3677542919 conn(0x7fe6e00fdf30 msgr2=0x7fe6e01003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 -- 172.21.15.100:0/3677542919 shutdown_connections 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.015+0000 7fe6e637b700 1 -- 172.21.15.100:0/3677542919 wait complete. 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 Processor -- start 2024-04-30T23:08:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 -- start start 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 0x7fe6e019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0102bb0 0x7fe6e019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010fcd0 con 0x7fe6e0105810 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010fb50 con 0x7fe6e0102260 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.016+0000 7fe6e637b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010fe50 con 0x7fe6e0102bb0 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43954/0 (socket says 172.21.15.100:43954) 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 -- 172.21.15.100:0/1924229109 learned_addr learned my addr 172.21.15.100:0/1924229109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6df7fe700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0102bb0 0x7fe6e019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6dffff700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 0x7fe6e019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 -- 172.21.15.100:0/1924229109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0102bb0 msgr2=0x7fe6e019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0102bb0 0x7fe6e019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 -- 172.21.15.100:0/1924229109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 msgr2=0x7fe6e019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 0x7fe6e019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 -- 172.21.15.100:0/1924229109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e01a22e0 con 0x7fe6e0105810 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e4918700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80062a0 tx=0x7fe6d8004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8021070 con 0x7fe6e0105810 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e01a2570 con 0x7fe6e0105810 2024-04-30T23:08:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6d8007b80 con 0x7fe6e0105810 2024-04-30T23:08:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8004670 con 0x7fe6e0105810 2024-04-30T23:08:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.017+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e01a2b00 con 0x7fe6e0105810 2024-04-30T23:08:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.019+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e00511d0 con 0x7fe6e0105810 2024-04-30T23:08:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.020+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe6d8003a00 con 0x7fe6e0105810 2024-04-30T23:08:54.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.020+0000 7fe6dd7fa700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 0x7fe6c80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:08:54.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.020+0000 7fe6dffff700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 0x7fe6c80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:08:54.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.020+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5829+0+0 (secure 0 0 0) 0x7fe6d800f020 con 0x7fe6e0105810 2024-04-30T23:08:54.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.021+0000 7fe6dffff700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 0x7fe6c80a61d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6e006bf90 tx=0x7fe6d000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:08:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.025+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe6d802a020 con 0x7fe6e0105810 2024-04-30T23:08:54.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:08:54.230+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe6e0063b10 con 0x7fe6c80a3cc0 2024-04-30T23:08:54.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:54 smithi104 ceph-mon[32987]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:54.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:54 smithi104 ceph-mon[32987]: osdmap e62: 9 total, 9 up, 9 in 2024-04-30T23:08:54.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:54.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:54.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:54.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:54 smithi183 ceph-mon[33560]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:54.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:54 smithi183 ceph-mon[33560]: osdmap e62: 9 total, 9 up, 9 in 2024-04-30T23:08:54.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:54.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:54.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:54.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:54 smithi100 ceph-mon[29745]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:54.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:54 smithi100 ceph-mon[29745]: osdmap e62: 9 total, 9 up, 9 in 2024-04-30T23:08:54.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:08:54.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:08:54.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:08:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:55 smithi104 ceph-mon[32987]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:55.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:55 smithi104 ceph-mon[32987]: osdmap e63: 9 total, 9 up, 9 in 2024-04-30T23:08:55.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:55 smithi183 ceph-mon[33560]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:55.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:55 smithi183 ceph-mon[33560]: osdmap e63: 9 total, 9 up, 9 in 2024-04-30T23:08:55.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:55 smithi100 ceph-mon[29745]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:08:55.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:55 smithi100 ceph-mon[29745]: osdmap e63: 9 total, 9 up, 9 in 2024-04-30T23:08:56.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:56 smithi104 ceph-mon[32987]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:56.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:56 smithi183 ceph-mon[33560]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:56.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:56 smithi100 ceph-mon[29745]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:08:57.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]: dispatch 2024-04-30T23:08:57.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]': finished 2024-04-30T23:08:57.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:57 smithi104 ceph-mon[32987]: osdmap e64: 10 total, 9 up, 10 in 2024-04-30T23:08:57.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:08:57.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]: dispatch 2024-04-30T23:08:57.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]': finished 2024-04-30T23:08:57.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:57 smithi183 ceph-mon[33560]: osdmap e64: 10 total, 9 up, 10 in 2024-04-30T23:08:57.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:08:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]: dispatch 2024-04-30T23:08:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2919699127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f73884-91f7-49e8-8a4d-bf23f66567a2"}]': finished 2024-04-30T23:08:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:57 smithi100 ceph-mon[29745]: osdmap e64: 10 total, 9 up, 10 in 2024-04-30T23:08:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:08:58.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:58 smithi104 ceph-mon[32987]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-30T23:08:58.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:08:58 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2318441494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:58.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:58 smithi183 ceph-mon[33560]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-30T23:08:58.799 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:08:58 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2318441494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:08:58.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:58 smithi100 ceph-mon[29745]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-30T23:08:58.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:08:58 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2318441494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:01.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:00 smithi104 ceph-mon[32987]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:09:01.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:00 smithi183 ceph-mon[33560]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:09:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:00 smithi100 ceph-mon[29745]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-30T23:09:02.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:02 smithi100 ceph-mon[29745]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-30T23:09:03.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:02 smithi104 ceph-mon[32987]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-30T23:09:03.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:02 smithi183 ceph-mon[33560]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-30T23:09:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:04 smithi100 ceph-mon[29745]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-30T23:09:05.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:04 smithi104 ceph-mon[32987]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-30T23:09:05.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:04 smithi183 ceph-mon[33560]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-30T23:09:05.761 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:05 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-30T23:09:05.762 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:05 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:06.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:05 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-30T23:09:06.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:05 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:06.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:05 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-30T23:09:06.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:05 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:06.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:06 smithi100 ceph-mon[29745]: Deploying daemon osd.9 on smithi100 2024-04-30T23:09:06.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:06 smithi100 ceph-mon[29745]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:09:06.946 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:06 smithi104 ceph-mon[32987]: Deploying daemon osd.9 on smithi100 2024-04-30T23:09:06.946 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:06 smithi104 ceph-mon[32987]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:09:06.951 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:06 smithi183 ceph-mon[33560]: Deploying daemon osd.9 on smithi100 2024-04-30T23:09:06.951 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:06 smithi183 ceph-mon[33560]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:09:08.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:08 smithi100 ceph-mon[29745]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:09.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:08 smithi104 ceph-mon[32987]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:09.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:08 smithi183 ceph-mon[33560]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:10.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:10 smithi100 ceph-mon[29745]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:11.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:10 smithi104 ceph-mon[32987]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:11.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:10 smithi183 ceph-mon[33560]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:12.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:12 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:12.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:12 smithi100 ceph-mon[29745]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:12.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:12 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:12.544 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:12 smithi104 ceph-mon[32987]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:12.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:12.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:12 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:12.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:12 smithi183 ceph-mon[33560]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:14.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:14.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:14.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:14.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:14.760 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:14.761 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:14 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:15.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:14 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:15.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:14 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.137 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 9 on host 'smithi100' 2024-04-30T23:09:15.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.137+0000 7fe6dd7fa700 1 -- 172.21.15.100:0/1924229109 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6e0063b10 con 0x7fe6c80a3cc0 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 msgr2=0x7fe6c80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 0x7fe6c80a61d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6e006bf90 tx=0x7fe6d000a380 comp rx=0 tx=0).stop 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 msgr2=0x7fe6e01a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80062a0 tx=0x7fe6d8004e40 comp rx=0 tx=0).stop 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 shutdown_connections 2024-04-30T23:09:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe6c80a3cc0 0x7fe6c80a61d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e0105810 0x7fe6e01a1c60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e0102260 0x7fe6e019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 --2- 172.21.15.100:0/1924229109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e0102bb0 0x7fe6e019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.139+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 >> 172.21.15.100:0/1924229109 conn(0x7fe6e00fdf30 msgr2=0x7fe6e01087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:09:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.140+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 shutdown_connections 2024-04-30T23:09:15.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:09:15.140+0000 7fe6e637b700 1 -- 172.21.15.100:0/1924229109 wait complete. 2024-04-30T23:09:15.808 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:15 smithi100 ceph-mon[29745]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-30T23:09:15.809 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:15 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.809 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:15 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.809 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:15 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:15.835 DEBUG:teuthology.orchestra.run.smithi100:osd.9> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.9.service 2024-04-30T23:09:15.837 INFO:tasks.cephadm:Deploying osd.10 on smithi104 with /dev/vg_nvme/lv_1... 2024-04-30T23:09:15.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-30T23:09:15.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:15 smithi104 ceph-mon[32987]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-30T23:09:15.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:15 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:15 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:15.864 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:15 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:15 smithi183 ceph-mon[33560]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-30T23:09:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:15 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:15 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:15 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:16.083 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:09:16.794 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:16 smithi104 ceph-mon[32987]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:16.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:16 smithi104 ceph-mon[32987]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-30T23:09:16.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:16 smithi104 ceph-mon[32987]: osdmap e65: 10 total, 9 up, 10 in 2024-04-30T23:09:16.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:16 smithi104 ceph-mon[32987]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:09:16.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:16 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:16 smithi183 ceph-mon[33560]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:17.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:16 smithi183 ceph-mon[33560]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-30T23:09:17.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:16 smithi183 ceph-mon[33560]: osdmap e65: 10 total, 9 up, 10 in 2024-04-30T23:09:17.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:16 smithi183 ceph-mon[33560]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:09:17.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:16 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:16 smithi100 ceph-mon[29745]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:16 smithi100 ceph-mon[29745]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-30T23:09:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:16 smithi100 ceph-mon[29745]: osdmap e65: 10 total, 9 up, 10 in 2024-04-30T23:09:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:16 smithi100 ceph-mon[29745]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-30T23:09:17.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:16 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.455 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:09:17.340+0000 7fa7d6b79700 -1 osd.9 0 waiting for initial osdmap 2024-04-30T23:09:17.455 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:09:17.353+0000 7fa7ce926700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: osdmap e66: 10 total, 9 up, 10 in 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' 2024-04-30T23:09:17.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:17 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:09:17.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: osdmap e66: 10 total, 9 up, 10 in 2024-04-30T23:09:17.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:17.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' 2024-04-30T23:09:17.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:17 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:18.002 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-30T23:09:18.003 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-30T23:09:18.003 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-04-30T23:09:18.003 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-04-30T23:09:18.003 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113904 s, 921 MB/s 2024-04-30T23:09:18.003 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: osdmap e66: 10 total, 9 up, 10 in 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: from='osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884]' entity='osd.9' 2024-04-30T23:09:18.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:17 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:18.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi104:vg_nvme/lv_1 2024-04-30T23:09:18.987 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:09:19.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:09:19.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:09:19.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] boot 2024-04-30T23:09:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: osdmap e67: 10 total, 10 up, 10 in 2024-04-30T23:09:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:18 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:19.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:09:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:09:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] boot 2024-04-30T23:09:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: osdmap e67: 10 total, 10 up, 10 in 2024-04-30T23:09:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:18 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:09:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:09:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-04-30T23:09:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: osd.9 [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] boot 2024-04-30T23:09:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: osdmap e67: 10 total, 10 up, 10 in 2024-04-30T23:09:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:18 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-30T23:09:20.423 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi100 2024-04-30T23:09:20.423 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.423 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 4272M 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:20.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:20.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:20.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:20 smithi104 ceph-mon[32987]: osdmap e68: 10 total, 10 up, 10 in 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi100 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 4272M 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:20.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:20 smithi183 ceph-mon[33560]: osdmap e68: 10 total, 10 up, 10 in 2024-04-30T23:09:20.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi100 2024-04-30T23:09:20.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 4272M 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:20.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:20 smithi100 ceph-mon[29745]: osdmap e68: 10 total, 10 up, 10 in 2024-04-30T23:09:20.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 -- 172.21.15.104:0/1149696664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88103160 msgr2=0x7fef88103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 --2- 172.21.15.104:0/1149696664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88103160 0x7fef88103570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fef78009990 tx=0x7fef78009ca0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 -- 172.21.15.104:0/1149696664 shutdown_connections 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 --2- 172.21.15.104:0/1149696664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104c30 0x7fef8810b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 --2- 172.21.15.104:0/1149696664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88103160 0x7fef88103570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 --2- 172.21.15.104:0/1149696664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88104290 0x7fef881046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 -- 172.21.15.104:0/1149696664 >> 172.21.15.104:0/1149696664 conn(0x7fef880fe7a0 msgr2=0x7fef88100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 -- 172.21.15.104:0/1149696664 shutdown_connections 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.656+0000 7fef8cca8700 1 -- 172.21.15.104:0/1149696664 wait complete. 2024-04-30T23:09:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 Processor -- start 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 -- start start 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88103160 0x7fef88199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104290 0x7fef88199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810ebb0 con 0x7fef88104290 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810ea30 con 0x7fef88104c30 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8cca8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810ed30 con 0x7fef88103160 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:20.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57190/0 (socket says 172.21.15.104:57190) 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 -- 172.21.15.104:0/3639217986 learned_addr learned my addr 172.21.15.104:0/3639217986 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef8659c700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88103160 0x7fef88199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef85d9b700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104290 0x7fef88199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 -- 172.21.15.104:0/3639217986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88103160 msgr2=0x7fef88199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88103160 0x7fef88199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 -- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104290 msgr2=0x7fef88199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104290 0x7fef88199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.657+0000 7fef86d9d700 1 -- 172.21.15.104:0/3639217986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef881a1280 con 0x7fef88104c30 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef86d9d700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef80007ee0 tx=0x7fef8000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:09:20.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80004bb0 con 0x7fef88104c30 2024-04-30T23:09:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef80004d50 con 0x7fef88104c30 2024-04-30T23:09:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef881a1570 con 0x7fef88104c30 2024-04-30T23:09:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80005920 con 0x7fef88104c30 2024-04-30T23:09:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.658+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef881a1a60 con 0x7fef88104c30 2024-04-30T23:09:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.659+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef880511d0 con 0x7fef88104c30 2024-04-30T23:09:20.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.661+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fef8001a020 con 0x7fef88104c30 2024-04-30T23:09:20.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.662+0000 7fef777fe700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 0x7fef700a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:20.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.662+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7fef800cf920 con 0x7fef88104c30 2024-04-30T23:09:20.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.662+0000 7fef8659c700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 0x7fef700a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:20.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.662+0000 7fef8659c700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 0x7fef700a6150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef780038a0 tx=0x7fef7801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:09:20.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.666+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef80010070 con 0x7fef88104c30 2024-04-30T23:09:20.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:20.872+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fef88063b10 con 0x7fef700a3c40 2024-04-30T23:09:21.475 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:21 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:21.475 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:21 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:21.475 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:21 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:21.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:21 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:21.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:21 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:21.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:21 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:21.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:21 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:21.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:21 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:21.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:21 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:22.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:22 smithi104 ceph-mon[32987]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:22.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:22 smithi104 ceph-mon[32987]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:22.549 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:22 smithi183 ceph-mon[33560]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:22.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:22 smithi183 ceph-mon[33560]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:22.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:22 smithi100 ceph-mon[29745]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:22.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:22 smithi100 ceph-mon[29745]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/2383906405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]': finished 2024-04-30T23:09:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: osdmap e69: 11 total, 10 up, 11 in 2024-04-30T23:09:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.104:0/886366892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:25.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/2383906405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]': finished 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: osdmap e69: 11 total, 10 up, 11 in 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.104:0/886366892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/2383906405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]: dispatch 2024-04-30T23:09:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9e09c9-e0f3-4359-ba40-3fce08a144d0"}]': finished 2024-04-30T23:09:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: osdmap e69: 11 total, 10 up, 11 in 2024-04-30T23:09:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.104:0/886366892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:27.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:26 smithi104 ceph-mon[32987]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:27.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:26 smithi183 ceph-mon[33560]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:27.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:26 smithi100 ceph-mon[29745]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:28.876 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:28 smithi104 ceph-mon[32987]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:28 smithi183 ceph-mon[33560]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:29.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:28 smithi100 ceph-mon[29745]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:30.771 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:30 smithi104 ceph-mon[32987]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:30.874 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:30 smithi100 ceph-mon[29745]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:31.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:30 smithi183 ceph-mon[33560]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:31.879 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-30T23:09:31.879 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:31 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:32.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-30T23:09:32.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:31 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:32.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-30T23:09:32.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:31 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:32.928 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:32 smithi104 ceph-mon[32987]: Deploying daemon osd.10 on smithi104 2024-04-30T23:09:32.928 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:32 smithi104 ceph-mon[32987]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:33.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:32 smithi183 ceph-mon[33560]: Deploying daemon osd.10 on smithi104 2024-04-30T23:09:33.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:32 smithi183 ceph-mon[33560]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:33.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:32 smithi100 ceph-mon[29745]: Deploying daemon osd.10 on smithi104 2024-04-30T23:09:33.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:32 smithi100 ceph-mon[29745]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:34 smithi104 ceph-mon[32987]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:35.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:34 smithi183 ceph-mon[33560]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:35.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:34 smithi100 ceph-mon[29745]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:36.865 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:36 smithi104 ceph-mon[32987]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:37.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:36 smithi183 ceph-mon[33560]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:37.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:36 smithi100 ceph-mon[29745]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:38.123 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.123 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.123 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:37 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:38.123 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:37 smithi183 ceph-mon[33560]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:38.268 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.269 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.269 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:37 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:38.269 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:37 smithi104 ceph-mon[32987]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:38.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:37 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:37 smithi100 ceph-mon[29745]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:40.884 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:40.884 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:40.884 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:40.884 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:40.885 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:40.885 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:40.941 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 10 on host 'smithi104' 2024-04-30T23:09:40.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.941+0000 7fef777fe700 1 -- 172.21.15.104:0/3639217986 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fef88063b10 con 0x7fef700a3c40 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 msgr2=0x7fef700a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 0x7fef700a6150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef780038a0 tx=0x7fef7801a040 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 msgr2=0x7fef881a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef80007ee0 tx=0x7fef8000d3b0 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 shutdown_connections 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef700a3c40 0x7fef700a6150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef88104c30 0x7fef881a0c00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef88103160 0x7fef88199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 --2- 172.21.15.104:0/3639217986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef88104290 0x7fef88199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 >> 172.21.15.104:0/3639217986 conn(0x7fef880fe7a0 msgr2=0x7fef881074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 shutdown_connections 2024-04-30T23:09:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-30T23:09:40.944+0000 7fef8cca8700 1 -- 172.21.15.104:0/3639217986 wait complete. 2024-04-30T23:09:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:41.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:41.591 DEBUG:teuthology.orchestra.run.smithi104:osd.10> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.10.service 2024-04-30T23:09:41.593 INFO:tasks.cephadm:Deploying osd.11 on smithi183 with /dev/vg_nvme/lv_1... 2024-04-30T23:09:41.593 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-30T23:09:41.839 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:09:42.150 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.151 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.151 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.151 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.151 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:42.151 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:41 smithi104 ceph-mon[32987]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:42.217 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.217 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.217 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.217 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.218 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:42.218 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:41 smithi183 ceph-mon[33560]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:09:42.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:41 smithi100 ceph-mon[29745]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:42 smithi183 ceph-mon[33560]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-30T23:09:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:42 smithi183 ceph-mon[33560]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:42 smithi183 ceph-mon[33560]: osdmap e70: 11 total, 10 up, 11 in 2024-04-30T23:09:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:42 smithi183 ceph-mon[33560]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:43.126 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:09:42.948+0000 7fcd3a0a2700 -1 osd.10 0 waiting for initial osdmap 2024-04-30T23:09:43.126 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:09:42.961+0000 7fcd35e57700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:09:43.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-mon[32987]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-30T23:09:43.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-mon[32987]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:43.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-mon[32987]: osdmap e70: 11 total, 10 up, 11 in 2024-04-30T23:09:43.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:43.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:42 smithi104 ceph-mon[32987]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:43.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:42 smithi100 ceph-mon[29745]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-30T23:09:43.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:42 smithi100 ceph-mon[29745]: from='osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:43.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:42 smithi100 ceph-mon[29745]: osdmap e70: 11 total, 10 up, 11 in 2024-04-30T23:09:43.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:43.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:42 smithi100 ceph-mon[29745]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-04-30T23:09:44.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:09:44.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:09:44.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:09:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: osdmap e71: 11 total, 10 up, 11 in 2024-04-30T23:09:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:43 smithi183 ceph-mon[33560]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112833 s, 929 MB/s 2024-04-30T23:09:44.058 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: osdmap e71: 11 total, 10 up, 11 in 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.254 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:43 smithi104 ceph-mon[32987]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:44.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:09:44.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:09:44.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-04-30T23:09:44.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: osdmap e71: 11 total, 10 up, 11 in 2024-04-30T23:09:44.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:44.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:43 smithi100 ceph-mon[29745]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-04-30T23:09:44.761 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_1 2024-04-30T23:09:44.998 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] boot 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: osdmap e72: 11 total, 11 up, 11 in 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi104 2024-04-30T23:09:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 4272M 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] boot 2024-04-30T23:09:45.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: osdmap e72: 11 total, 11 up, 11 in 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi104 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 4272M 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:45.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: osd.10 [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] boot 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: osdmap e72: 11 total, 11 up, 11 in 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi104 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:09:45.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 4272M 2024-04-30T23:09:45.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:45.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:45.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:09:45.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:09:46.125 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:45 smithi183 ceph-mon[33560]: osdmap e73: 11 total, 11 up, 11 in 2024-04-30T23:09:46.125 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:45 smithi183 ceph-mon[33560]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:46.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:45 smithi104 ceph-mon[32987]: osdmap e73: 11 total, 11 up, 11 in 2024-04-30T23:09:46.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:45 smithi104 ceph-mon[32987]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:46.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:45 smithi100 ceph-mon[29745]: osdmap e73: 11 total, 11 up, 11 in 2024-04-30T23:09:46.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:45 smithi100 ceph-mon[29745]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:46.704 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 -- 172.21.15.183:0/1595290707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd681053b0 msgr2=0x7fbd681057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:46.704 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/1595290707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd681053b0 0x7fbd681057c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009990 tx=0x7fbd58009ca0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.704 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 -- 172.21.15.183:0/1595290707 shutdown_connections 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/1595290707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 0x7fbd6810c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/1595290707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd68104280 0x7fbd68104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/1595290707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd681053b0 0x7fbd681057c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 -- 172.21.15.183:0/1595290707 >> 172.21.15.183:0/1595290707 conn(0x7fbd680ff8e0 msgr2=0x7fbd68101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 -- 172.21.15.183:0/1595290707 shutdown_connections 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.703+0000 7fbd6fa76700 1 -- 172.21.15.183:0/1595290707 wait complete. 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 Processor -- start 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 -- start start 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd681053b0 0x7fbd6819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 0x7fbd681a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810fce0 con 0x7fbd681053b0 2024-04-30T23:09:46.705 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810fb60 con 0x7fbd68105d50 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6fa76700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810fe60 con 0x7fbd68104280 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6d812700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6d812700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:49740/0 (socket says 172.21.15.183:49740) 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6d812700 1 -- 172.21.15.183:0/169657312 learned_addr learned my addr 172.21.15.183:0/169657312 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.704+0000 7fbd6e013700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 0x7fbd681a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d011700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd681053b0 0x7fbd6819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 -- 172.21.15.183:0/169657312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 msgr2=0x7fbd681a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 0x7fbd681a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 -- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd681053b0 msgr2=0x7fbd6819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd681053b0 0x7fbd6819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 -- 172.21.15.183:0/169657312 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd681a2360 con 0x7fbd68104280 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6d812700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d950 tx=0x7fbd6400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:09:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64017070 con 0x7fbd68104280 2024-04-30T23:09:46.707 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd64009730 con 0x7fbd68104280 2024-04-30T23:09:46.707 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681a2650 con 0x7fbd68104280 2024-04-30T23:09:46.707 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64003a50 con 0x7fbd68104280 2024-04-30T23:09:46.707 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.705+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a2b90 con 0x7fbd68104280 2024-04-30T23:09:46.707 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.706+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd680511d0 con 0x7fbd68104280 2024-04-30T23:09:46.708 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.708+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fbd64003bf0 con 0x7fbd68104280 2024-04-30T23:09:46.708 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.708+0000 7fbd5effd700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 0x7fbd540a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:09:46.708 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.709+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7fbd640d0070 con 0x7fbd68104280 2024-04-30T23:09:46.708 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.709+0000 7fbd6d011700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 0x7fbd540a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:09:46.708 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.709+0000 7fbd6d011700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 0x7fbd540a6150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd580038a0 tx=0x7fbd5801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:09:46.711 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.713+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd64020030 con 0x7fbd68104280 2024-04-30T23:09:46.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:09:46.923+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbd68063b10 con 0x7fbd540a3c40 2024-04-30T23:09:47.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:46 smithi104 ceph-mon[32987]: osdmap e74: 11 total, 11 up, 11 in 2024-04-30T23:09:47.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:46 smithi104 ceph-mon[32987]: osdmap e75: 11 total, 11 up, 11 in 2024-04-30T23:09:47.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:47.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:47.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:47.299 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:46 smithi183 ceph-mon[33560]: osdmap e74: 11 total, 11 up, 11 in 2024-04-30T23:09:47.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:46 smithi183 ceph-mon[33560]: osdmap e75: 11 total, 11 up, 11 in 2024-04-30T23:09:47.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:47.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:47.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:47.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:46 smithi100 ceph-mon[29745]: osdmap e74: 11 total, 11 up, 11 in 2024-04-30T23:09:47.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:46 smithi100 ceph-mon[29745]: osdmap e75: 11 total, 11 up, 11 in 2024-04-30T23:09:47.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-30T23:09:47.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-30T23:09:47.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:48.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:47 smithi104 ceph-mon[32987]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:48.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:47 smithi104 ceph-mon[32987]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:48.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:47 smithi104 ceph-mon[32987]: osdmap e76: 11 total, 11 up, 11 in 2024-04-30T23:09:48.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:47 smithi183 ceph-mon[33560]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:48.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:47 smithi183 ceph-mon[33560]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:48.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:47 smithi183 ceph-mon[33560]: osdmap e76: 11 total, 11 up, 11 in 2024-04-30T23:09:48.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:47 smithi100 ceph-mon[29745]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:09:48.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:47 smithi100 ceph-mon[29745]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:48.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:47 smithi100 ceph-mon[29745]: osdmap e76: 11 total, 11 up, 11 in 2024-04-30T23:09:51.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/2754085180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]': finished 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: osdmap e77: 12 total, 11 up, 12 in 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:09:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:50 smithi104 ceph-mon[32987]: from='client.? 172.21.15.183:0/3451209513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/2754085180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]': finished 2024-04-30T23:09:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: osdmap e77: 12 total, 11 up, 12 in 2024-04-30T23:09:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:09:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:50 smithi183 ceph-mon[33560]: from='client.? 172.21.15.183:0/3451209513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/2754085180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]: dispatch 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c5e3fbe-3128-4f57-93fe-c9fb639c9407"}]': finished 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: osdmap e77: 12 total, 11 up, 12 in 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:09:51.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.183:0/3451209513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-30T23:09:53.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:52 smithi104 ceph-mon[32987]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-30T23:09:53.049 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:52 smithi183 ceph-mon[33560]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-30T23:09:53.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:52 smithi100 ceph-mon[29745]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-30T23:09:54.892 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:54 smithi183 ceph-mon[33560]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-30T23:09:55.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:54 smithi104 ceph-mon[32987]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-30T23:09:55.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:54 smithi100 ceph-mon[29745]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-30T23:09:56.932 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:56 smithi183 ceph-mon[33560]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:09:57.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:56 smithi104 ceph-mon[32987]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:09:57.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:56 smithi100 ceph-mon[29745]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-30T23:09:57.892 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-30T23:09:57.892 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:58.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-30T23:09:58.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:58.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-30T23:09:58.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:09:58.891 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:58 smithi183 ceph-mon[33560]: Deploying daemon osd.11 on smithi183 2024-04-30T23:09:58.893 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:09:58 smithi183 ceph-mon[33560]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-30T23:09:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:58 smithi104 ceph-mon[32987]: Deploying daemon osd.11 on smithi183 2024-04-30T23:09:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:09:58 smithi104 ceph-mon[32987]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-30T23:09:59.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:58 smithi100 ceph-mon[29745]: Deploying daemon osd.11 on smithi183 2024-04-30T23:09:59.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:09:58 smithi100 ceph-mon[29745]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-30T23:10:00.767 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:00 smithi183 ceph-mon[33560]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:10:00.767 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:00 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:10:01.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:00 smithi104 ceph-mon[32987]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:10:01.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:00 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:10:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:00 smithi100 ceph-mon[29745]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-30T23:10:01.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:00 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:10:02.963 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:02 smithi183 ceph-mon[33560]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-04-30T23:10:03.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:02 smithi104 ceph-mon[32987]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-04-30T23:10:03.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:02 smithi100 ceph-mon[29745]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-04-30T23:10:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:04 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:04 smithi183 ceph-mon[33560]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:04.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:04 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:04.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:04 smithi104 ceph-mon[32987]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:04.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:04.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:04 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:04.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:04 smithi100 ceph-mon[29745]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:06.902 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:06 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:07.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:06 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:07.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:06 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.244 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.244+0000 7fbd5effd700 1 -- 172.21.15.183:0/169657312 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbd68063b10 con 0x7fbd540a3c40 2024-04-30T23:10:07.244 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 11 on host 'smithi183' 2024-04-30T23:10:07.247 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 msgr2=0x7fbd540a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:07.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 0x7fbd540a6150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd580038a0 tx=0x7fbd5801a040 comp rx=0 tx=0).stop 2024-04-30T23:10:07.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 msgr2=0x7fbd6819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:07.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d950 tx=0x7fbd6400dc60 comp rx=0 tx=0).stop 2024-04-30T23:10:07.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 shutdown_connections 2024-04-30T23:10:07.248 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd540a3c40 0x7fbd540a6150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:07.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd68105d50 0x7fbd681a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:07.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd68104280 0x7fbd6819a800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:07.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 --2- 172.21.15.183:0/169657312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd681053b0 0x7fbd6819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:07.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.247+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 >> 172.21.15.183:0/169657312 conn(0x7fbd680ff8e0 msgr2=0x7fbd681085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:07.249 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.248+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 shutdown_connections 2024-04-30T23:10:07.250 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:07.248+0000 7fbd6fa76700 1 -- 172.21.15.183:0/169657312 wait complete. 2024-04-30T23:10:07.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:07 smithi183 ceph-mon[33560]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:07.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:07 smithi183 ceph-mon[33560]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:07.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:07.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:07 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.953 DEBUG:teuthology.orchestra.run.smithi183:osd.11> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.11.service 2024-04-30T23:10:07.955 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-30T23:10:07.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-30T23:10:07.982 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:07 smithi100 ceph-mon[29745]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:07.982 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:07 smithi100 ceph-mon[29745]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:07.983 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:07.983 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:07.983 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:07 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:08.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:07 smithi104 ceph-mon[32987]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:08.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:07 smithi104 ceph-mon[32987]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-30T23:10:08.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:08.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:08.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:07 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:08.207 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: osdmap e78: 12 total, 11 up, 12 in 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:08.971 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-mon[33560]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:08.972 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:10:08.639+0000 7fc5a7a59700 -1 osd.11 0 waiting for initial osdmap 2024-04-30T23:10:08.972 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:10:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:10:08.652+0000 7fc5a380e700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: osdmap e78: 12 total, 11 up, 12 in 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:08 smithi104 ceph-mon[32987]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: osdmap e78: 12 total, 11 up, 12 in 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: from='osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:08 smithi100 ceph-mon[29745]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-04-30T23:10:09.981 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:09 smithi100 ceph-mon[29745]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:10:09.981 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:09 smithi100 ceph-mon[29745]: osdmap e79: 12 total, 11 up, 12 in 2024-04-30T23:10:09.981 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:09.981 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:09.982 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:09 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:09 smithi104 ceph-mon[32987]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:10:10.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:09 smithi104 ceph-mon[32987]: osdmap e79: 12 total, 11 up, 12 in 2024-04-30T23:10:10.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:09 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:09 smithi183 ceph-mon[33560]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-04-30T23:10:10.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:09 smithi183 ceph-mon[33560]: osdmap e79: 12 total, 11 up, 12 in 2024-04-30T23:10:10.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:09 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 -- 172.21.15.100:0/2569508112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 msgr2=0x7f3cf410b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2569508112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf410b4c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00b0a0 tx=0x7f3cec00b3b0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 -- 172.21.15.100:0/2569508112 shutdown_connections 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2569508112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf410b4c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2569508112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf4103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2569508112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 -- 172.21.15.100:0/2569508112 >> 172.21.15.100:0/2569508112 conn(0x7f3cf40fe780 msgr2=0x7f3cf4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 -- 172.21.15.100:0/2569508112 shutdown_connections 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.093+0000 7f3cf9565700 1 -- 172.21.15.100:0/2569508112 wait complete. 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 Processor -- start 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 -- start start 2024-04-30T23:10:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410ebb0 con 0x7f3cf4104c10 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410ea30 con 0x7f3cf4104270 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf9565700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410ed30 con 0x7f3cf4103140 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf2ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49356/0 (socket says 172.21.15.100:49356) 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf2ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf41996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:40850/0 (socket says 172.21.15.100:40850) 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf37fe700 1 -- 172.21.15.100:0/2876126752 learned_addr learned my addr 172.21.15.100:0/2876126752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.094+0000 7f3cf27fc700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 -- 172.21.15.100:0/2876126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 msgr2=0x7f3cf41996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf41996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 -- 172.21.15.100:0/2876126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 msgr2=0x7f3cf4199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 -- 172.21.15.100:0/2876126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf41a1220 con 0x7f3cf4104c10 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf27fc700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf37fe700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00b070 tx=0x7f3cec004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec021070 con 0x7f3cf4104c10 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf41a14b0 con 0x7f3cf4104c10 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cec007b80 con 0x7f3cf4104c10 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0052a0 con 0x7f3cf4104c10 2024-04-30T23:10:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.095+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf41a19f0 con 0x7f3cf4104c10 2024-04-30T23:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.096+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf40511d0 con 0x7f3cf4104c10 2024-04-30T23:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.097+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3cec024070 con 0x7f3cf4104c10 2024-04-30T23:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.098+0000 7f3cdbfff700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 0x7f3cdc0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.098+0000 7f3cf2ffd700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 0x7f3cdc0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.098+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f3cec00f020 con 0x7f3cf4104c10 2024-04-30T23:10:10.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.098+0000 7f3cf2ffd700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 0x7f3cdc0a6150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4104170 tx=0x7f3ce4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:10.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.103+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3cec02b020 con 0x7f3cf4104c10 2024-04-30T23:10:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.304+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3cf402e550 con 0x7f3cf4104c10 2024-04-30T23:10:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.304+0000 7f3cdbfff700 1 -- 172.21.15.100:0/2876126752 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7f3cec09e4c0 con 0x7f3cf4104c10 2024-04-30T23:10:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 msgr2=0x7f3cdc0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 0x7f3cdc0a6150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4104170 tx=0x7f3ce4009260 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 msgr2=0x7f3cf41a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00b070 tx=0x7f3cec004ce0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 shutdown_connections 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3cdc0a3c40 0x7f3cdc0a6150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cf4104c10 0x7f3cf41a0ba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4103140 0x7f3cf41996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 --2- 172.21.15.100:0/2876126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4104270 0x7f3cf4199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.306+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 >> 172.21.15.100:0/2876126752 conn(0x7f3cf40fe780 msgr2=0x7f3cf41074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.307+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 shutdown_connections 2024-04-30T23:10:10.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:10.307+0000 7f3cf9565700 1 -- 172.21.15.100:0/2876126752 wait complete. 2024-04-30T23:10:10.765 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: purged_snaps scrub starts 2024-04-30T23:10:10.765 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: purged_snaps scrub ok 2024-04-30T23:10:10.765 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:10.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] boot 2024-04-30T23:10:10.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: osdmap e80: 12 total, 12 up, 12 in 2024-04-30T23:10:10.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.766 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:10 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2876126752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-30T23:10:10.994 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: purged_snaps scrub starts 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: purged_snaps scrub ok 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] boot 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: osdmap e80: 12 total, 12 up, 12 in 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:10.995 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:10 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2876126752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-30T23:10:11.022 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1714518609,"num_in_osds":12,"osd_in_since":1714518589,"num_remapped_pgs":0} 2024-04-30T23:10:11.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: purged_snaps scrub starts 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: purged_snaps scrub ok 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: osd.11 [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] boot 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: osdmap e80: 12 total, 12 up, 12 in 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-30T23:10:11.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:10 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2876126752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-30T23:10:11.306 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:10:11.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: osdmap e81: 12 total, 12 up, 12 in 2024-04-30T23:10:11.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:11.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:11.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:11.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:11 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: osdmap e81: 12 total, 12 up, 12 in 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:12.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:12.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:11 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: osdmap e81: 12 total, 12 up, 12 in 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:10:12.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:11 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:12.756 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:12 smithi100 ceph-mon[29745]: Detected new or changed devices on smithi183 2024-04-30T23:10:12.756 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:12 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 4272M 2024-04-30T23:10:12.757 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:12 smithi100 ceph-mon[29745]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.976+0000 7f70d634b700 1 -- 172.21.15.100:0/3179193099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0108650 msgr2=0x7f70d010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.976+0000 7f70d634b700 1 --2- 172.21.15.100:0/3179193099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0108650 0x7f70d010ffb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70c800b0d0 tx=0x7f70c800b3e0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 -- 172.21.15.100:0/3179193099 shutdown_connections 2024-04-30T23:10:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 --2- 172.21.15.100:0/3179193099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0108650 0x7f70d010ffb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 --2- 172.21.15.100:0/3179193099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70d01033d0 0x7f70d01037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 --2- 172.21.15.100:0/3179193099 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0107d00 0x7f70d0108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 -- 172.21.15.100:0/3179193099 >> 172.21.15.100:0/3179193099 conn(0x7f70d00fecd0 msgr2=0x7f70d01010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 -- 172.21.15.100:0/3179193099 shutdown_connections 2024-04-30T23:10:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 -- 172.21.15.100:0/3179193099 wait complete. 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.977+0000 7f70d634b700 1 Processor -- start 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 -- start start 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70d0107d00 0x7f70d019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0108650 0x7f70d01999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0113280 con 0x7f70d01033d0 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0113100 con 0x7f70d0108650 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d634b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0113400 con 0x7f70d0107d00 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49370/0 (socket says 172.21.15.100:49370) 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 -- 172.21.15.100:0/1194089676 learned_addr learned my addr 172.21.15.100:0/1194089676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70d48e8700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0108650 0x7f70d01999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 -- 172.21.15.100:0/1194089676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70d0107d00 msgr2=0x7f70d019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70d0107d00 0x7f70d019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 -- 172.21.15.100:0/1194089676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0108650 msgr2=0x7f70d01999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0108650 0x7f70d01999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.978+0000 7f70cffff700 1 -- 172.21.15.100:0/1194089676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d019a090 con 0x7f70d01033d0 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70cffff700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c920 tx=0x7f70c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0007b00 con 0x7f70d01033d0 2024-04-30T23:10:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70c0004ce0 con 0x7f70d01033d0 2024-04-30T23:10:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d019a380 con 0x7f70d01033d0 2024-04-30T23:10:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0005650 con 0x7f70d01033d0 2024-04-30T23:10:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.979+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d01a6650 con 0x7f70d01033d0 2024-04-30T23:10:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.980+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d00511d0 con 0x7f70d01033d0 2024-04-30T23:10:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.981+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f70c0004750 con 0x7f70d01033d0 2024-04-30T23:10:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.982+0000 7f70cd7fa700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 0x7f70b80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.982+0000 7f70cf7fe700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 0x7f70b80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.982+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f70c00cff10 con 0x7f70d01033d0 2024-04-30T23:10:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.982+0000 7f70cf7fe700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 0x7f70b80a6150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70d0106a80 tx=0x7f70c4005bf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:12.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:12.986+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70c0014030 con 0x7f70d01033d0 2024-04-30T23:10:13.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:12 smithi104 ceph-mon[32987]: Detected new or changed devices on smithi183 2024-04-30T23:10:13.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:12 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 4272M 2024-04-30T23:10:13.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:12 smithi104 ceph-mon[32987]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:13.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:12 smithi183 ceph-mon[33560]: Detected new or changed devices on smithi183 2024-04-30T23:10:13.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:12 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 4272M 2024-04-30T23:10:13.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:12 smithi183 ceph-mon[33560]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.184+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70d002e550 con 0x7f70d01033d0 2024-04-30T23:10:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.185+0000 7f70cd7fa700 1 -- 172.21.15.100:0/1194089676 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18475 (secure 0 0 0) 0x7f70c009cd90 con 0x7f70d01033d0 2024-04-30T23:10:13.185 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:13.185 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:10:10.651018+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 msgr2=0x7f70b80a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 0x7f70b80a6150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70d0106a80 tx=0x7f70c4005bf0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 msgr2=0x7f70d019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c920 tx=0x7f70c000cce0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 shutdown_connections 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70b80a3c40 0x7f70b80a6150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70d0108650 0x7f70d01999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d01033d0 0x7f70d019f7c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.187+0000 7f70d634b700 1 --2- 172.21.15.100:0/1194089676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70d0107d00 0x7f70d019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.188+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 >> 172.21.15.100:0/1194089676 conn(0x7f70d00fecd0 msgr2=0x7f70d0107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:13.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.188+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 shutdown_connections 2024-04-30T23:10:13.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:13.188+0000 7f70d634b700 1 -- 172.21.15.100:0/1194089676 wait complete. 2024-04-30T23:10:13.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1194089676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:13.866 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T23:10:13.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-30T23:10:14.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1194089676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:14.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1194089676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:10:14.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:14 smithi100 ceph-mon[29745]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:14 smithi104 ceph-mon[32987]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:14 smithi183 ceph-mon[33560]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.906+0000 7fe564c10700 1 -- 172.21.15.100:0/2367383509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560108690 msgr2=0x7fe56010fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.906+0000 7fe564c10700 1 --2- 172.21.15.100:0/2367383509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560108690 0x7fe56010fff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe55800b0d0 tx=0x7fe55800b3e0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 -- 172.21.15.100:0/2367383509 shutdown_connections 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 --2- 172.21.15.100:0/2367383509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560108690 0x7fe56010fff0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 --2- 172.21.15.100:0/2367383509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560103460 0x7fe560103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 --2- 172.21.15.100:0/2367383509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560107d40 0x7fe560108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 -- 172.21.15.100:0/2367383509 >> 172.21.15.100:0/2367383509 conn(0x7fe560078d10 msgr2=0x7fe560079150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 -- 172.21.15.100:0/2367383509 shutdown_connections 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 -- 172.21.15.100:0/2367383509 wait complete. 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.907+0000 7fe564c10700 1 Processor -- start 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 -- start start 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560103460 0x7fe56019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560108690 0x7fe56019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe560113330 con 0x7fe560107d40 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601131b0 con 0x7fe560108690 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe564c10700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601134b0 con 0x7fe560103460 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57410/0 (socket says 172.21.15.100:57410) 2024-04-30T23:10:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 -- 172.21.15.100:0/1595738218 learned_addr learned my addr 172.21.15.100:0/1595738218 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55e59c700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560103460 0x7fe56019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55ed9d700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560108690 0x7fe56019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 -- 172.21.15.100:0/1595738218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560103460 msgr2=0x7fe56019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560103460 0x7fe56019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 -- 172.21.15.100:0/1595738218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560108690 msgr2=0x7fe56019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560108690 0x7fe56019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 -- 172.21.15.100:0/1595738218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5601a6e90 con 0x7fe560107d40 2024-04-30T23:10:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.908+0000 7fe55dd9b700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b500 tx=0x7fe55400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.909+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554015020 con 0x7fe560107d40 2024-04-30T23:10:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.909+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe554011ce0 con 0x7fe560107d40 2024-04-30T23:10:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.909+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5601a7180 con 0x7fe560107d40 2024-04-30T23:10:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.909+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554010cb0 con 0x7fe560107d40 2024-04-30T23:10:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.909+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5601a76c0 con 0x7fe560107d40 2024-04-30T23:10:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.910+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5600511d0 con 0x7fe560107d40 2024-04-30T23:10:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.911+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe554018020 con 0x7fe560107d40 2024-04-30T23:10:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.912+0000 7fe54f7fe700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 0x7fe5480a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.912+0000 7fe55e59c700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 0x7fe5480a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.912+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe5540cfb60 con 0x7fe560107d40 2024-04-30T23:10:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.912+0000 7fe55e59c700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 0x7fe5480a6150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe55000ac50 tx=0x7fe55000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:15.916+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe55401f020 con 0x7fe560107d40 2024-04-30T23:10:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.115+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5601a79e0 con 0x7fe560107d40 2024-04-30T23:10:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.116+0000 7fe54f7fe700 1 -- 172.21.15.100:0/1595738218 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fe55409c9c0 con 0x7fe560107d40 2024-04-30T23:10:16.115 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:10:16.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 msgr2=0x7fe5480a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:16.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 0x7fe5480a6150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe55000ac50 tx=0x7fe55000a380 comp rx=0 tx=0).stop 2024-04-30T23:10:16.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 msgr2=0x7fe56019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:16.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b500 tx=0x7fe55400b810 comp rx=0 tx=0).stop 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 shutdown_connections 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5480a3c40 0x7fe5480a6150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe560108690 0x7fe56019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe560103460 0x7fe56019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 --2- 172.21.15.100:0/1595738218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560107d40 0x7fe56019c110 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 >> 172.21.15.100:0/1595738218 conn(0x7fe560078d10 msgr2=0x7fe560100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 shutdown_connections 2024-04-30T23:10:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:16.118+0000 7fe564c10700 1 -- 172.21.15.100:0/1595738218 wait complete. 2024-04-30T23:10:16.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:16 smithi100 ceph-mon[29745]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:16.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1595738218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:16.962 INFO:tasks.cephadm:Adding mds.a on smithi100 2024-04-30T23:10:16.962 INFO:tasks.cephadm:Adding mds.d on smithi100 2024-04-30T23:10:16.962 INFO:tasks.cephadm:Adding mds.g on smithi100 2024-04-30T23:10:16.962 INFO:tasks.cephadm:Adding mds.j on smithi100 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.b on smithi104 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.e on smithi104 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.h on smithi104 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.k on smithi104 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.c on smithi183 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.f on smithi183 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.i on smithi183 2024-04-30T23:10:16.963 INFO:tasks.cephadm:Adding mds.l on smithi183 2024-04-30T23:10:16.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l' 2024-04-30T23:10:16.990 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:16 smithi183 ceph-mon[33560]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:16.991 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1595738218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:17.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:16 smithi104 ceph-mon[32987]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:17.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1595738218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:17.217 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:10:18.860 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 -- 172.21.15.183:0/157721438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc103150 msgr2=0x7ff6fc103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:18.860 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 --2- 172.21.15.183:0/157721438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc103150 0x7ff6fc103560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009990 tx=0x7ff6ec009ca0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.860 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 -- 172.21.15.183:0/157721438 shutdown_connections 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 --2- 172.21.15.183:0/157721438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104c20 0x7ff6fc10b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 --2- 172.21.15.183:0/157721438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc103150 0x7ff6fc103560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 --2- 172.21.15.183:0/157721438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc104280 0x7ff6fc104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 -- 172.21.15.183:0/157721438 >> 172.21.15.183:0/157721438 conn(0x7ff6fc0fe790 msgr2=0x7ff6fc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 -- 172.21.15.183:0/157721438 shutdown_connections 2024-04-30T23:10:18.861 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.861+0000 7ff7018b6700 1 -- 172.21.15.183:0/157721438 wait complete. 2024-04-30T23:10:18.863 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 Processor -- start 2024-04-30T23:10:18.863 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 -- start start 2024-04-30T23:10:18.863 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc103150 0x7ff6fc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:18.863 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104280 0x7ff6fc19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc10eba0 con 0x7ff6fc104280 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc10ea20 con 0x7ff6fc103150 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff7018b6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc10ed20 con 0x7ff6fc104c20 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:40404/0 (socket says 172.21.15.183:40404) 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff6fb7fe700 1 -- 172.21.15.183:0/2478592927 learned_addr learned my addr 172.21.15.183:0/2478592927 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff6faffd700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc103150 0x7ff6fc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.862+0000 7ff6fa7fc700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104280 0x7ff6fc19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 -- 172.21.15.183:0/2478592927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc103150 msgr2=0x7ff6fc06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:18.864 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc103150 0x7ff6fc06bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 -- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104280 msgr2=0x7ff6fc19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104280 0x7ff6fc19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 -- 172.21.15.183:0/2478592927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc1a23e0 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff6fb7fe700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007ee0 tx=0x7ff6f400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400ddd0 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc1a26d0 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6f4004020 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc1a2c10 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.863+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4015660 con 0x7ff6fc104c20 2024-04-30T23:10:18.865 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.864+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8005330 con 0x7ff6fc104c20 2024-04-30T23:10:18.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.865+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff6f4003a00 con 0x7ff6fc104c20 2024-04-30T23:10:18.866 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:18 smithi183 ceph-mon[33560]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:18.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.866+0000 7ff7008b4700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 0x7ff6e40a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:18.867 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.866+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff6f40d0130 con 0x7ff6fc104c20 2024-04-30T23:10:18.867 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.866+0000 7ff6faffd700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 0x7ff6e40a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:18.867 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.867+0000 7ff6faffd700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 0x7ff6e40a6150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0098e0 tx=0x7ff6ec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:18.870 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:18.870+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff6f4010070 con 0x7ff6fc104c20 2024-04-30T23:10:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:18 smithi104 ceph-mon[32987]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:18 smithi100 ceph-mon[29745]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:19.079 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.080+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}) -- 0x7ff6e8000cc0 con 0x7ff6e40a3c40 2024-04-30T23:10:19.088 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.089+0000 7ff7008b4700 1 -- 172.21.15.183:0/2478592927 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7ff6e8000cc0 con 0x7ff6e40a3c40 2024-04-30T23:10:19.088 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mds.all update... 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 msgr2=0x7ff6e40a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 0x7ff6e40a6150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0098e0 tx=0x7ff6ec01a040 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 msgr2=0x7ff6fc1a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007ee0 tx=0x7ff6f400d3b0 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 shutdown_connections 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6e40a3c40 0x7ff6e40a6150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6fc104c20 0x7ff6fc1a1bb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6fc103150 0x7ff6fc06bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 --2- 172.21.15.183:0/2478592927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6fc104280 0x7ff6fc19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:19.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.091+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 >> 172.21.15.183:0/2478592927 conn(0x7ff6fc0fe790 msgr2=0x7ff6fc1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:19.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.092+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 shutdown_connections 2024-04-30T23:10:19.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-04-30T23:10:19.092+0000 7ff7018b6700 1 -- 172.21.15.183:0/2478592927 wait complete. 2024-04-30T23:10:19.703 DEBUG:teuthology.orchestra.run.smithi100:mds.a> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.a.service 2024-04-30T23:10:19.706 DEBUG:teuthology.orchestra.run.smithi100:mds.d> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.d.service 2024-04-30T23:10:19.749 DEBUG:teuthology.orchestra.run.smithi100:mds.g> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.g.service 2024-04-30T23:10:19.792 DEBUG:teuthology.orchestra.run.smithi100:mds.j> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.j.service 2024-04-30T23:10:19.835 DEBUG:teuthology.orchestra.run.smithi104:mds.b> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.b.service 2024-04-30T23:10:19.837 DEBUG:teuthology.orchestra.run.smithi104:mds.e> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.e.service 2024-04-30T23:10:19.881 DEBUG:teuthology.orchestra.run.smithi104:mds.h> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.h.service 2024-04-30T23:10:19.923 DEBUG:teuthology.orchestra.run.smithi104:mds.k> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.k.service 2024-04-30T23:10:19.967 DEBUG:teuthology.orchestra.run.smithi183:mds.c> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.c.service 2024-04-30T23:10:19.969 DEBUG:teuthology.orchestra.run.smithi183:mds.f> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.f.service 2024-04-30T23:10:20.012 DEBUG:teuthology.orchestra.run.smithi183:mds.i> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.i.service 2024-04-30T23:10:20.055 DEBUG:teuthology.orchestra.run.smithi183:mds.l> sudo journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.l.service 2024-04-30T23:10:20.098 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-30T23:10:20.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- 172.21.15.100:0/64932698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 msgr2=0x7f961010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 --2- 172.21.15.100:0/64932698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f961010ad60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9608009ca0 tx=0x7f960802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- 172.21.15.100:0/64932698 shutdown_connections 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 --2- 172.21.15.100:0/64932698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f961010ad60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 --2- 172.21.15.100:0/64932698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610103c40 0x7f9610104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 --2- 172.21.15.100:0/64932698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610102a00 0x7f9610103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- 172.21.15.100:0/64932698 >> 172.21.15.100:0/64932698 conn(0x7f96100fdc10 msgr2=0x7f96101000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- 172.21.15.100:0/64932698 shutdown_connections 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- 172.21.15.100:0/64932698 wait complete. 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 Processor -- start 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.223+0000 7f961549d640 1 -- start start 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610102a00 0x7f9610199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 0x7f9610199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f961010e530 con 0x7f9610108940 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f961010e3b0 con 0x7f9610102a00 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f961010e6b0 con 0x7f9610103c40 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57416/0 (socket says 172.21.15.100:57416) 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 -- 172.21.15.100:0/3564073085 learned_addr learned my addr 172.21.15.100:0/3564073085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f9607fff640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 0x7f9610199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960effd640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610102a00 0x7f9610199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 -- 172.21.15.100:0/3564073085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 msgr2=0x7f9610199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 0x7f9610199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 -- 172.21.15.100:0/3564073085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610102a00 msgr2=0x7f9610199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610102a00 0x7f9610199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 -- 172.21.15.100:0/3564073085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96101a0c40 con 0x7f9610108940 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f9607fff640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 0x7f9610199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960f7fe640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9608004af0 tx=0x7f9608031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608003b70 con 0x7f9610108940 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9608003d10 con 0x7f9610108940 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96101a0ed0 con 0x7f9610108940 2024-04-30T23:10:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960802fb20 con 0x7f9610108940 2024-04-30T23:10:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.224+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96101a1330 con 0x7f9610108940 2024-04-30T23:10:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.225+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961006afe0 con 0x7f9610108940 2024-04-30T23:10:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.227+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f9608004580 con 0x7f9610108940 2024-04-30T23:10:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.227+0000 7f960cff9640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 0x7f95fc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.227+0000 7f960effd640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 0x7f95fc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.227+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f96080f1680 con 0x7f9610108940 2024-04-30T23:10:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.228+0000 7f960effd640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 0x7f95fc0a60c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9610103600 tx=0x7f9600005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.231+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96080be500 con 0x7f9610108940 2024-04-30T23:10:20.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:10:20.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-04-30T23:10:20.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:20.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:20 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:20.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:20.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:20.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:20 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.408+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f961002dc50 con 0x7f9610108940 2024-04-30T23:10:20.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.409+0000 7f960cff9640 1 -- 172.21.15.100:0/3564073085 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18475 (secure 0 0 0) 0x7f96080bde00 con 0x7f9610108940 2024-04-30T23:10:20.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:20.408 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:10:10.651018+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 msgr2=0x7f95fc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 0x7f95fc0a60c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9610103600 tx=0x7f9600005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 msgr2=0x7f96101a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9608004af0 tx=0x7f9608031700 comp rx=0 tx=0).stop 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 shutdown_connections 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f95fc0a3bb0 0x7f95fc0a60c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9610108940 0x7f96101a05d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9610103c40 0x7f9610199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 --2- 172.21.15.100:0/3564073085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9610102a00 0x7f9610199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 >> 172.21.15.100:0/3564073085 conn(0x7f96100fdc10 msgr2=0x7f9610104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:20.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 shutdown_connections 2024-04-30T23:10:20.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.411+0000 7f961549d640 1 -- 172.21.15.100:0/3564073085 wait complete. 2024-04-30T23:10:20.420 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:10:20.420 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-04-30T23:10:20.420 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.420 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:20.420 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:20.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:20 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:20.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T23:10:20.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 -- 172.21.15.100:0/4033202648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 msgr2=0x7f679c10bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 --2- 172.21.15.100:0/4033202648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c10bd00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6794009ca0 tx=0x7f679402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 -- 172.21.15.100:0/4033202648 shutdown_connections 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 --2- 172.21.15.100:0/4033202648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c10bd00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 --2- 172.21.15.100:0/4033202648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 0x7f679c1093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 --2- 172.21.15.100:0/4033202648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 0x7f679c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 -- 172.21.15.100:0/4033202648 >> 172.21.15.100:0/4033202648 conn(0x7f679c0fdc00 msgr2=0x7f679c1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 -- 172.21.15.100:0/4033202648 shutdown_connections 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 -- 172.21.15.100:0/4033202648 wait complete. 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.536+0000 7f67a2277640 1 Processor -- start 2024-04-30T23:10:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 -- start start 2024-04-30T23:10:20.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 0x7f679c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 0x7f679c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f679c10f660 con 0x7f679c1098e0 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f679c10f4e0 con 0x7f679c104620 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a2277640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f679c10f7e0 con 0x7f679c106f80 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57444/0 (socket says 172.21.15.100:57444) 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 -- 172.21.15.100:0/2802892915 learned_addr learned my addr 172.21.15.100:0/2802892915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f679bfff640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 0x7f679c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f679b7fe640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 0x7f679c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 -- 172.21.15.100:0/2802892915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 msgr2=0x7f679c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 0x7f679c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 -- 172.21.15.100:0/2802892915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 msgr2=0x7f679c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 0x7f679c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 -- 172.21.15.100:0/2802892915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c1a1d40 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.537+0000 7f67a0814640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67940317c0 tx=0x7f67940317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.538+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794003b70 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.538+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6794003d10 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.538+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1a1fd0 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.538+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679402fbd0 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.538+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1a2430 con 0x7f679c1098e0 2024-04-30T23:10:20.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.539+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c06a1a0 con 0x7f679c1098e0 2024-04-30T23:10:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.540+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f679402fd70 con 0x7f679c1098e0 2024-04-30T23:10:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.540+0000 7f67997fa640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 0x7f67840a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.541+0000 7f679bfff640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 0x7f67840a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.541+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f67940f1780 con 0x7f679c1098e0 2024-04-30T23:10:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.541+0000 7f679bfff640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 0x7f67840a60c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f678c005d00 tx=0x7f678c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.544+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67940be600 con 0x7f679c1098e0 2024-04-30T23:10:20.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.721+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f679c02dc10 con 0x7f679c1098e0 2024-04-30T23:10:20.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.722+0000 7f67997fa640 1 -- 172.21.15.100:0/2802892915 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f67940bdf00 con 0x7f679c1098e0 2024-04-30T23:10:20.721 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:10:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 msgr2=0x7f67840a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 0x7f67840a60c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f678c005d00 tx=0x7f678c005c50 comp rx=0 tx=0).stop 2024-04-30T23:10:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 msgr2=0x7f679c1a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67940317c0 tx=0x7f67940317f0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 shutdown_connections 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67840a3bb0 0x7f67840a60c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f679c1098e0 0x7f679c1a16d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f679c106f80 0x7f679c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 --2- 172.21.15.100:0/2802892915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f679c104620 0x7f679c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 >> 172.21.15.100:0/2802892915 conn(0x7f679c0fdc00 msgr2=0x7f679c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 shutdown_connections 2024-04-30T23:10:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.724+0000 7f67a2277640 1 -- 172.21.15.100:0/2802892915 wait complete. 2024-04-30T23:10:20.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:20.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.841+0000 7f2ae5296640 1 -- 172.21.15.100:0/2108995540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0102290 msgr2=0x7f2ae010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.841+0000 7f2ae5296640 1 --2- 172.21.15.100:0/2108995540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0102290 0x7f2ae010bcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009900 tx=0x7f2ad802a410 comp rx=0 tx=0).stop 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 -- 172.21.15.100:0/2108995540 shutdown_connections 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 --2- 172.21.15.100:0/2108995540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0102290 0x7f2ae010bcf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 --2- 172.21.15.100:0/2108995540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae0101790 0x7f2ae0101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 --2- 172.21.15.100:0/2108995540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae01050e0 0x7f2ae01054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 -- 172.21.15.100:0/2108995540 >> 172.21.15.100:0/2108995540 conn(0x7f2ae00fd3b0 msgr2=0x7f2ae00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 -- 172.21.15.100:0/2108995540 shutdown_connections 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 -- 172.21.15.100:0/2108995540 wait complete. 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 Processor -- start 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.842+0000 7f2ae5296640 1 -- start start 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae0102290 0x7f2ae019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae01050e0 0x7f2ae01a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae010f670 con 0x7f2ae0101790 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae010f4f0 con 0x7f2ae01050e0 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae010f7f0 con 0x7f2ae0102290 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57458/0 (socket says 172.21.15.100:57458) 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 -- 172.21.15.100:0/4243333541 learned_addr learned my addr 172.21.15.100:0/4243333541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:20.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ade7fc640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae0102290 0x7f2ae019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adf7fe640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae01050e0 0x7f2ae01a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 -- 172.21.15.100:0/4243333541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae0102290 msgr2=0x7f2ae019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae0102290 0x7f2ae019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 -- 172.21.15.100:0/4243333541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae01050e0 msgr2=0x7f2ae01a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae01050e0 0x7f2ae01a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:20.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 -- 172.21.15.100:0/4243333541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae01a1d00 con 0x7f2ae0101790 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2adeffd640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ead0 tx=0x7f2ad000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000cde0 con 0x7f2ae0101790 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad0003e20 con 0x7f2ae0101790 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae01a1ff0 con 0x7f2ae0101790 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00116d0 con 0x7f2ae0101790 2024-04-30T23:10:20.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.843+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae01a2450 con 0x7f2ae0101790 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.844+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae010aa80 con 0x7f2ae0101790 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.846+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f2ad0004270 con 0x7f2ae0101790 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.846+0000 7f2ac7fff640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 0x7f2ac80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.846+0000 7f2ade7fc640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 0x7f2ac80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.846+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2ad00d0500 con 0x7f2ae0101790 2024-04-30T23:10:20.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.847+0000 7f2ade7fc640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 0x7f2ac80a60c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ae019b260 tx=0x7f2ad4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:20.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:20.850+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2ad0015030 con 0x7f2ae0101790 2024-04-30T23:10:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.066+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ae002db90 con 0x7f2ae0101790 2024-04-30T23:10:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.066+0000 7f2ac7fff640 1 -- 172.21.15.100:0/4243333541 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f2ad009d410 con 0x7f2ae0101790 2024-04-30T23:10:21.065 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:21.066 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-30T23:10:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 1 2024-04-30T23:10:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 msgr2=0x7f2ac80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 0x7f2ac80a60c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ae019b260 tx=0x7f2ad4005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 msgr2=0x7f2ae019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ead0 tx=0x7f2ad000ef90 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 shutdown_connections 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ac80a3bb0 0x7f2ac80a60c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae01050e0 0x7f2ae01a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae0102290 0x7f2ae019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 --2- 172.21.15.100:0/4243333541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae0101790 0x7f2ae019a1c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 >> 172.21.15.100:0/4243333541 conn(0x7f2ae00fd3b0 msgr2=0x7f2ae0107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 shutdown_connections 2024-04-30T23:10:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:21.068+0000 7f2ae5296640 1 -- 172.21.15.100:0/4243333541 wait complete. 2024-04-30T23:10:21.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:21 smithi183 ceph-mon[33560]: Deploying daemon mds.l on smithi183 2024-04-30T23:10:21.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:21 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3564073085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:21.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:21 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2802892915' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:21.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:21 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4243333541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:21.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:21 smithi100 ceph-mon[29745]: Deploying daemon mds.l on smithi183 2024-04-30T23:10:21.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:21 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3564073085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:21.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:21 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2802892915' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:21.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:21 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4243333541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:21.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:21 smithi104 ceph-mon[32987]: Deploying daemon mds.l on smithi183 2024-04-30T23:10:21.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:21 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3564073085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:21.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:21 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2802892915' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:21.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:21 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4243333541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:22.293 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:22 smithi183 ceph-mon[33560]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:22.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:22 smithi104 ceph-mon[32987]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:22.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:22 smithi100 ceph-mon[29745]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:23.050 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:10:22 smithi183 systemd[1]: Started Ceph mds.l for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:23.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 -- 172.21.15.100:0/1591103825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 msgr2=0x7f13fc103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1591103825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc103720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009ca0 tx=0x7f13f402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 -- 172.21.15.100:0/1591103825 shutdown_connections 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1591103825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 0x7f13fc10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1591103825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 0x7f13fc104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1591103825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc103720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 -- 172.21.15.100:0/1591103825 >> 172.21.15.100:0/1591103825 conn(0x7f13fc0fdc10 msgr2=0x7f13fc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 -- 172.21.15.100:0/1591103825 shutdown_connections 2024-04-30T23:10:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.200+0000 7f1400f0d640 1 -- 172.21.15.100:0/1591103825 wait complete. 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 Processor -- start 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 -- start start 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 0x7f13fc19f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 0x7f13fc1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc10e520 con 0x7f13fc102a20 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc10e3a0 con 0x7f13fc103c60 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f1400f0d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc10e6a0 con 0x7f13fc108960 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f13fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f13fa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57480/0 (socket says 172.21.15.100:57480) 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.201+0000 7f13fa59c640 1 -- 172.21.15.100:0/1672506531 learned_addr learned my addr 172.21.15.100:0/1672506531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13f9d9b640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 0x7f13fc19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fad9d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 0x7f13fc1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 -- 172.21.15.100:0/1672506531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 msgr2=0x7f13fc1a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 0x7f13fc1a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 -- 172.21.15.100:0/1672506531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 msgr2=0x7f13fc19f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 0x7f13fc19f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 -- 172.21.15.100:0/1672506531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc1a1de0 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13fa59c640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13f4004af0 tx=0x7f13f40316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4003b70 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc1a2070 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f4003d10 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f402fa60 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.202+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1a2610 con 0x7f13fc102a20 2024-04-30T23:10:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.203+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc107770 con 0x7f13fc102a20 2024-04-30T23:10:23.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.204+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f13f4004580 con 0x7f13fc102a20 2024-04-30T23:10:23.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.205+0000 7f13f37fe640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 0x7f13e80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:23.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.205+0000 7f13f9d9b640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 0x7f13e80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:23.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.205+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f13f40f13c0 con 0x7f13fc102a20 2024-04-30T23:10:23.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.206+0000 7f13f9d9b640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 0x7f13e80a60c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13fc075240 tx=0x7f13e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.209+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f13f40be240 con 0x7f13fc102a20 2024-04-30T23:10:23.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.424+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13fc02db90 con 0x7f13fc102a20 2024-04-30T23:10:23.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.425+0000 7f13f37fe640 1 -- 172.21.15.100:0/1672506531 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f13f40bdb40 con 0x7f13fc102a20 2024-04-30T23:10:23.425 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-30T23:10:23.426 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 msgr2=0x7f13e80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 0x7f13e80a60c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13fc075240 tx=0x7f13e4005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 msgr2=0x7f13fc0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13f4004af0 tx=0x7f13f40316e0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 shutdown_connections 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f13e80a3bb0 0x7f13e80a60c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13fc108960 0x7f13fc1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13fc103c60 0x7f13fc19f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 --2- 172.21.15.100:0/1672506531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13fc102a20 0x7f13fc0758a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 >> 172.21.15.100:0/1672506531 conn(0x7f13fc0fdc10 msgr2=0x7f13fc104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 shutdown_connections 2024-04-30T23:10:23.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:23.427+0000 7f1400f0d640 1 -- 172.21.15.100:0/1672506531 wait complete. 2024-04-30T23:10:23.687 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6832/2331654352,v1:172.21.15.183:6833/2331654352] up:boot 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: fsmap 1 up:standby 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:23.688 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:23 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1672506531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:23.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6832/2331654352,v1:172.21.15.183:6833/2331654352] up:boot 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: fsmap 1 up:standby 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:23.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1672506531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6832/2331654352,v1:172.21.15.183:6833/2331654352] up:boot 2024-04-30T23:10:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: fsmap 1 up:standby 2024-04-30T23:10:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:10:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:23 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1672506531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:24.716 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:24 smithi104 ceph-mon[32987]: Deploying daemon mds.k on smithi104 2024-04-30T23:10:24.717 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:24 smithi104 ceph-mon[32987]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:25.045 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:24 smithi104 systemd[1]: Starting Ceph mds.k for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:24 smithi183 ceph-mon[33560]: Deploying daemon mds.k on smithi104 2024-04-30T23:10:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:24 smithi183 ceph-mon[33560]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:25.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:24 smithi100 ceph-mon[29745]: Deploying daemon mds.k on smithi104 2024-04-30T23:10:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:24 smithi100 ceph-mon[29745]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:25.380 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 podman[62291]: 2024-04-30 23:10:25.024360543 +0000 UTC m=+0.018217753 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:25.380 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 podman[62291]: 2024-04-30 23:10:25.145903624 +0000 UTC m=+0.139760859 container create 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-30T23:10:25.381 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 podman[62291]: 2024-04-30 23:10:25.381823772 +0000 UTC m=+0.375680965 container init 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-30T23:10:25.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:25.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 -- 172.21.15.100:0/1718748751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 msgr2=0x7f9f74106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:25.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 --2- 172.21.15.100:0/1718748751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f74106a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009900 tx=0x7f9f7002a410 comp rx=0 tx=0).stop 2024-04-30T23:10:25.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 -- 172.21.15.100:0/1718748751 shutdown_connections 2024-04-30T23:10:25.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 --2- 172.21.15.100:0/1718748751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f7410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 --2- 172.21.15.100:0/1718748751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 0x7f9f74109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.567+0000 7f9f7b096640 1 --2- 172.21.15.100:0/1718748751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f74106a10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.568+0000 7f9f7b096640 1 -- 172.21.15.100:0/1718748751 >> 172.21.15.100:0/1718748751 conn(0x7f9f740fdc10 msgr2=0x7f9f741000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.568+0000 7f9f7b096640 1 -- 172.21.15.100:0/1718748751 shutdown_connections 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.568+0000 7f9f7b096640 1 -- 172.21.15.100:0/1718748751 wait complete. 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.568+0000 7f9f7b096640 1 Processor -- start 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.568+0000 7f9f7b096640 1 -- start start 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 0x7f9f7419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f741a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7410f5e0 con 0x7f9f741045f0 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7410f460 con 0x7f9f74106f50 2024-04-30T23:10:25.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f7b096640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7410f760 con 0x7f9f741098b0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38104/0 (socket says 172.21.15.100:38104) 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 -- 172.21.15.100:0/3043295719 learned_addr learned my addr 172.21.15.100:0/3043295719 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f79633640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f741a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f6bfff640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 0x7f9f7419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 -- 172.21.15.100:0/3043295719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 msgr2=0x7f9f741a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f741a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 -- 172.21.15.100:0/3043295719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 msgr2=0x7f9f7419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 0x7f9f7419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 -- 172.21.15.100:0/3043295719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f741a1d80 con 0x7f9f741045f0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f79633640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f741a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f78e32640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f70006010 tx=0x7f9f70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.569+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7003f030 con 0x7f9f741045f0 2024-04-30T23:10:25.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.570+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f741a2010 con 0x7f9f741045f0 2024-04-30T23:10:25.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.570+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f70003aa0 con 0x7f9f741045f0 2024-04-30T23:10:25.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.570+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70035070 con 0x7f9f741045f0 2024-04-30T23:10:25.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.570+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741a2550 con 0x7f9f741045f0 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.571+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f740ff730 con 0x7f9f741045f0 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.572+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f9f70042030 con 0x7f9f741045f0 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.573+0000 7f9f69ffb640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 0x7f9f5c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.573+0000 7f9f6bfff640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 0x7f9f5c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.573+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9f700f0a70 con 0x7f9f741045f0 2024-04-30T23:10:25.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.573+0000 7f9f6bfff640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 0x7f9f5c0a60c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f7419b2e0 tx=0x7f9f64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:25.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.577+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9f700bd8f0 con 0x7f9f741045f0 2024-04-30T23:10:25.795 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 podman[62291]: 2024-04-30 23:10:25.384707496 +0000 UTC m=+0.378564695 container start 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424) 2024-04-30T23:10:25.795 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 ceph-mds[62310]: -- 172.21.15.104:0/3817353598 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb49d67a40 con 0x55bb49dafa80 2024-04-30T23:10:25.795 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: starting mds.k at 2024-04-30T23:10:25.795 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 bash[62291]: 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b 2024-04-30T23:10:25.795 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:10:25 smithi104 systemd[1]: Started Ceph mds.k for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:25.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.802+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7402db90 con 0x7f9f741045f0 2024-04-30T23:10:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.802+0000 7f9f69ffb640 1 -- 172.21.15.100:0/3043295719 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f9f700bd1f0 con 0x7f9f741045f0 2024-04-30T23:10:25.803 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:25.803 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-30T23:10:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 msgr2=0x7f9f5c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 0x7f9f5c0a60c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f7419b2e0 tx=0x7f9f64005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 msgr2=0x7f9f7419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f70006010 tx=0x7f9f70004270 comp rx=0 tx=0).stop 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 shutdown_connections 2024-04-30T23:10:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f5c0a3bb0 0x7f9f5c0a60c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f741098b0 0x7f9f741a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f74106f50 0x7f9f7419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 --2- 172.21.15.100:0/3043295719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f741045f0 0x7f9f7419a240 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 >> 172.21.15.100:0/3043295719 conn(0x7f9f740fdc10 msgr2=0x7f9f74105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 shutdown_connections 2024-04-30T23:10:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:25.805+0000 7f9f7b096640 1 -- 172.21.15.100:0/3043295719 wait complete. 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:26.785 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: Deploying daemon mds.j on smithi100 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6832/176831078,v1:172.21.15.104:6833/176831078] up:boot 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: fsmap 2 up:standby 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:10:26.786 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3043295719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:26.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: Deploying daemon mds.j on smithi100 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6832/176831078,v1:172.21.15.104:6833/176831078] up:boot 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: fsmap 2 up:standby 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:10:26.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3043295719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:26.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: Deploying daemon mds.j on smithi100 2024-04-30T23:10:26.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:26.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6832/176831078,v1:172.21.15.104:6833/176831078] up:boot 2024-04-30T23:10:26.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: fsmap 2 up:standby 2024-04-30T23:10:26.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:10:26.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3043295719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:27.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 -- 172.21.15.100:0/1132512669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 msgr2=0x7f3960106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 --2- 172.21.15.100:0/1132512669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f3960106a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3950009900 tx=0x7f395002a410 comp rx=0 tx=0).stop 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 -- 172.21.15.100:0/1132512669 shutdown_connections 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 --2- 172.21.15.100:0/1132512669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 0x7f396010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 --2- 172.21.15.100:0/1132512669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 0x7f3960109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 --2- 172.21.15.100:0/1132512669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f3960106a10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 -- 172.21.15.100:0/1132512669 >> 172.21.15.100:0/1132512669 conn(0x7f39600fdc10 msgr2=0x7f39601000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 -- 172.21.15.100:0/1132512669 shutdown_connections 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 -- 172.21.15.100:0/1132512669 wait complete. 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.938+0000 7f3965b82640 1 Processor -- start 2024-04-30T23:10:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 -- start start 2024-04-30T23:10:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 0x7f396019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 0x7f39601a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f396010f600 con 0x7f39601045f0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f396010f480 con 0x7f3960106f50 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f3965b82640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f396010f780 con 0x7f39601098b0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38130/0 (socket says 172.21.15.100:38130) 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 -- 172.21.15.100:0/857083718 learned_addr learned my addr 172.21.15.100:0/857083718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395effd640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 0x7f396019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395ffff640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 0x7f39601a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 -- 172.21.15.100:0/857083718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 msgr2=0x7f39601a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 0x7f39601a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 -- 172.21.15.100:0/857083718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 msgr2=0x7f396019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 0x7f396019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 -- 172.21.15.100:0/857083718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39601a1d80 con 0x7f39601045f0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395f7fe640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3950006010 tx=0x7f3950031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.939+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395003f030 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.940+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39601a2010 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.940+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3950003aa0 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.940+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950035070 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.940+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39601a2500 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.941+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396006afe0 con 0x7f39601045f0 2024-04-30T23:10:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.942+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3950042030 con 0x7f39601045f0 2024-04-30T23:10:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.942+0000 7f395cff9640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 0x7f39480a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.942+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f39500f04a0 con 0x7f39601045f0 2024-04-30T23:10:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.942+0000 7f395effd640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 0x7f39480a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.943+0000 7f395effd640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 0x7f39480a60c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f396019b2e0 tx=0x7f395400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:27.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:27.947+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f39500bccd0 con 0x7f39601045f0 2024-04-30T23:10:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.169+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f396002db90 con 0x7f39601045f0 2024-04-30T23:10:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.170+0000 7f395cff9640 1 -- 172.21.15.100:0/857083718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f39500c0fd0 con 0x7f39601045f0 2024-04-30T23:10:28.171 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:28.171 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-30T23:10:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-04-30T23:10:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 msgr2=0x7f39480a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 0x7f39480a60c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f396019b2e0 tx=0x7f395400b390 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 msgr2=0x7f396019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3950006010 tx=0x7f3950031a50 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 shutdown_connections 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39480a3bb0 0x7f39480a60c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39601098b0 0x7f39601a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3960106f50 0x7f396019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 --2- 172.21.15.100:0/857083718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39601045f0 0x7f396019a240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 >> 172.21.15.100:0/857083718 conn(0x7f39600fdc10 msgr2=0x7f3960105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 shutdown_connections 2024-04-30T23:10:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:28.172+0000 7f3965b82640 1 -- 172.21.15.100:0/857083718 wait complete. 2024-04-30T23:10:28.571 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:10:28 smithi100 systemd[1]: Started Ceph mds.j for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/857083718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:28 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/857083718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:29.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:28 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/857083718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:29.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:28 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:30.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:29 smithi104 ceph-mon[32987]: Deploying daemon mds.d on smithi100 2024-04-30T23:10:30.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:29 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6834/2182837858,v1:172.21.15.100:6835/2182837858] up:boot 2024-04-30T23:10:30.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:29 smithi104 ceph-mon[32987]: fsmap 3 up:standby 2024-04-30T23:10:30.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:29 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-30T23:10:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:29 smithi183 ceph-mon[33560]: Deploying daemon mds.d on smithi100 2024-04-30T23:10:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:29 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6834/2182837858,v1:172.21.15.100:6835/2182837858] up:boot 2024-04-30T23:10:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:29 smithi183 ceph-mon[33560]: fsmap 3 up:standby 2024-04-30T23:10:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:29 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-30T23:10:30.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:29 smithi100 ceph-mon[29745]: Deploying daemon mds.d on smithi100 2024-04-30T23:10:30.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:29 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6834/2182837858,v1:172.21.15.100:6835/2182837858] up:boot 2024-04-30T23:10:30.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:29 smithi100 ceph-mon[29745]: fsmap 3 up:standby 2024-04-30T23:10:30.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:29 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-30T23:10:30.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 -- 172.21.15.100:0/2142968384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 msgr2=0x7f68cc1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/2142968384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1038d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009cd0 tx=0x7f68c402a8e0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 -- 172.21.15.100:0/2142968384 shutdown_connections 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/2142968384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1038d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/2142968384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102b70 0x7f68cc102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/2142968384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102220 0x7f68cc102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 -- 172.21.15.100:0/2142968384 >> 172.21.15.100:0/2142968384 conn(0x7f68cc0fda30 msgr2=0x7f68cc0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 -- 172.21.15.100:0/2142968384 shutdown_connections 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.301+0000 7f68d0d9f640 1 -- 172.21.15.100:0/2142968384 wait complete. 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 Processor -- start 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 -- start start 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102220 0x7f68cc19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 0x7f68cc19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc111660 con 0x7f68cc1034c0 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc1114e0 con 0x7f68cc102b70 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.302+0000 7f68d0d9f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc1117e0 con 0x7f68cc102220 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38156/0 (socket says 172.21.15.100:38156) 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 -- 172.21.15.100:0/1958526251 learned_addr learned my addr 172.21.15.100:0/1958526251 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:30.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68caffd640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 0x7f68cc19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cb7fe640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102220 0x7f68cc19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 -- 172.21.15.100:0/1958526251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102220 msgr2=0x7f68cc19c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102220 0x7f68cc19c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 -- 172.21.15.100:0/1958526251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 msgr2=0x7f68cc19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 0x7f68cc19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 -- 172.21.15.100:0/1958526251 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc1a3cf0 con 0x7f68cc1034c0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68caffd640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 0x7f68cc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68cbfff640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005e30 tx=0x7f68c4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4004240 con 0x7f68cc1034c0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68cc1a3f80 con 0x7f68cc1034c0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c40305a0 con 0x7f68cc1034c0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c40466c0 con 0x7f68cc1034c0 2024-04-30T23:10:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.303+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68cc1a43e0 con 0x7f68cc1034c0 2024-04-30T23:10:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.305+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68cc069c20 con 0x7f68cc1034c0 2024-04-30T23:10:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.305+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f68c40043e0 con 0x7f68cc1034c0 2024-04-30T23:10:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.306+0000 7f68c8ff9640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 0x7f68b40a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.306+0000 7f68cb7fe640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 0x7f68b40a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.306+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f68c402e030 con 0x7f68cc1034c0 2024-04-30T23:10:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.306+0000 7f68cb7fe640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 0x7f68b40a60b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005d00 tx=0x7f68bc005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.311+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f68c404b060 con 0x7f68cc1034c0 2024-04-30T23:10:30.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.541+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68cc02db90 con 0x7f68cc1034c0 2024-04-30T23:10:30.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.542+0000 7f68c8ff9640 1 -- 172.21.15.100:0/1958526251 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7f68c40be2f0 con 0x7f68cc1034c0 2024-04-30T23:10:30.543 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:30.543 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-30T23:10:30.543 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 4 2024-04-30T23:10:30.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 msgr2=0x7f68b40a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:30.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 0x7f68b40a60b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005d00 tx=0x7f68bc005c50 comp rx=0 tx=0).stop 2024-04-30T23:10:30.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 msgr2=0x7f68cc1a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005e30 tx=0x7f68c4003ba0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 shutdown_connections 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68b40a3ba0 0x7f68b40a60b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68cc1034c0 0x7f68cc1a3730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc102b70 0x7f68cc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 --2- 172.21.15.100:0/1958526251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68cc102220 0x7f68cc19c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 >> 172.21.15.100:0/1958526251 conn(0x7f68cc0fda30 msgr2=0x7f68cc10a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 shutdown_connections 2024-04-30T23:10:30.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:30.545+0000 7f68d0d9f640 1 -- 172.21.15.100:0/1958526251 wait complete. 2024-04-30T23:10:30.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:30 smithi183 ceph-mon[33560]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:30.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1958526251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:30.914 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:30 smithi100 ceph-mon[29745]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:30.914 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1958526251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:30.914 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:30 smithi100 systemd[1]: Starting Ceph mds.d for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:31.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:30 smithi104 ceph-mon[32987]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:31.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1958526251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:31.174 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:30 smithi100 podman[68256]: 2024-04-30 23:10:30.817565236 +0000 UTC m=+0.017701661 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:31.175 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:30 smithi100 podman[68256]: 2024-04-30 23:10:30.928836026 +0000 UTC m=+0.128972471 container create b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-30T23:10:31.175 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 podman[68256]: 2024-04-30 23:10:31.175536533 +0000 UTC m=+0.375672927 container init b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, ceph=True) 2024-04-30T23:10:31.483 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 podman[68256]: 2024-04-30 23:10:31.178891365 +0000 UTC m=+0.379027761 container start b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:10:31.483 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 ceph-mds[68277]: -- 172.21.15.100:0/3467826637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c2b61fa40 con 0x558c2b667180 2024-04-30T23:10:31.483 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d[68272]: starting mds.d at 2024-04-30T23:10:31.484 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 bash[68256]: b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e 2024-04-30T23:10:31.484 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:10:31 smithi100 systemd[1]: Started Ceph mds.d for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:32.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:32.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: Deploying daemon mds.e on smithi104 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6836/1947176646,v1:172.21.15.100:6837/1947176646] up:boot 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: fsmap 4 up:standby 2024-04-30T23:10:32.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:32 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-30T23:10:32.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- 172.21.15.100:0/442817256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50103c60 msgr2=0x7f8e50104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 --2- 172.21.15.100:0/442817256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50103c60 0x7f8e50104070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009860 tx=0x7f8e4002a340 comp rx=0 tx=0).stop 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- 172.21.15.100:0/442817256 shutdown_connections 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 --2- 172.21.15.100:0/442817256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50108960 0x7f8e5010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 --2- 172.21.15.100:0/442817256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50103c60 0x7f8e50104070 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 --2- 172.21.15.100:0/442817256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50102a20 0x7f8e50103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- 172.21.15.100:0/442817256 >> 172.21.15.100:0/442817256 conn(0x7f8e500fdc10 msgr2=0x7f8e501000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- 172.21.15.100:0/442817256 shutdown_connections 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- 172.21.15.100:0/442817256 wait complete. 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 Processor -- start 2024-04-30T23:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 -- start start 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.674+0000 7f8e56bad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50102a20 0x7f8e500758e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 0x7f8e5019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5010e550 con 0x7f8e50108960 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5010e3d0 con 0x7f8e50103c60 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5010e6d0 con 0x7f8e50102a20 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38194/0 (socket says 172.21.15.100:38194) 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 -- 172.21.15.100:0/3372690343 learned_addr learned my addr 172.21.15.100:0/3372690343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e47fff640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 0x7f8e5019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e54949640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50102a20 0x7f8e500758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 -- 172.21.15.100:0/3372690343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50102a20 msgr2=0x7f8e500758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:32.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50102a20 0x7f8e500758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 -- 172.21.15.100:0/3372690343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 msgr2=0x7f8e5019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 0x7f8e5019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 -- 172.21.15.100:0/3372690343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e501a1d50 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e47fff640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 0x7f8e5019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e5514a640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800eb10 tx=0x7f8e4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48004b20 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e48004cc0 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e501a1fe0 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.675+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48010670 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.676+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e501a24a0 con 0x7f8e50108960 2024-04-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.677+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50107770 con 0x7f8e50108960 2024-04-30T23:10:32.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.677+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8e48005020 con 0x7f8e50108960 2024-04-30T23:10:32.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.678+0000 7f8e45ffb640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 0x7f8e380a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:32.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.678+0000 7f8e54949640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 0x7f8e380a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:32.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.678+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8e480d0530 con 0x7f8e50108960 2024-04-30T23:10:32.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.679+0000 7f8e54949640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 0x7f8e380a60c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0096c0 tx=0x7f8e4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:32.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.683+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8e4809d3b0 con 0x7f8e50108960 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: Deploying daemon mds.e on smithi104 2024-04-30T23:10:32.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:32.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6836/1947176646,v1:172.21.15.100:6837/1947176646] up:boot 2024-04-30T23:10:32.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: fsmap 4 up:standby 2024-04-30T23:10:32.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:32 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: Deploying daemon mds.e on smithi104 2024-04-30T23:10:32.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:32.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6836/1947176646,v1:172.21.15.100:6837/1947176646] up:boot 2024-04-30T23:10:32.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: fsmap 4 up:standby 2024-04-30T23:10:32.801 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:32 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-30T23:10:32.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.895+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e500637e0 con 0x7f8e50108960 2024-04-30T23:10:32.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.896+0000 7f8e45ffb640 1 -- 172.21.15.100:0/3372690343 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3877 (secure 0 0 0) 0x7f8e4809ccb0 con 0x7f8e50108960 2024-04-30T23:10:32.897 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:32.897 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-30T23:10:32.897 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 5 2024-04-30T23:10:32.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 msgr2=0x7f8e380a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 0x7f8e380a60c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0096c0 tx=0x7f8e4c009260 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 msgr2=0x7f8e501a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800eb10 tx=0x7f8e4800c2d0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 shutdown_connections 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8e380a3bb0 0x7f8e380a60c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e50108960 0x7f8e501a1530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8e50103c60 0x7f8e5019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 --2- 172.21.15.100:0/3372690343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e50102a20 0x7f8e500758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 >> 172.21.15.100:0/3372690343 conn(0x7f8e500fdc10 msgr2=0x7f8e50104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 shutdown_connections 2024-04-30T23:10:32.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:32.898+0000 7f8e56bad640 1 -- 172.21.15.100:0/3372690343 wait complete. 2024-04-30T23:10:33.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:33 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3372690343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:33.796 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:33 smithi104 systemd[1]: Starting Ceph mds.e for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:33.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:33 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3372690343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:33.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:33 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3372690343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:34.234 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:33 smithi104 podman[62618]: 2024-04-30 23:10:33.843376719 +0000 UTC m=+0.018024658 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:33 smithi104 podman[62618]: 2024-04-30 23:10:33.949593845 +0000 UTC m=+0.124241782 container create b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 podman[62618]: 2024-04-30 23:10:34.135411935 +0000 UTC m=+0.310059873 container init b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 podman[62618]: 2024-04-30 23:10:34.138497174 +0000 UTC m=+0.313145112 container start b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mds[62637]: -- 172.21.15.104:0/3200169107 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55729ae83a40 con 0x55729aecb180 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: starting mds.e at 2024-04-30T23:10:34.235 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 bash[62618]: b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f 2024-04-30T23:10:34.513 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:10:34 smithi104 systemd[1]: Started Ceph mds.e for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:34.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:34.796 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:34 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:34.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:34 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:34 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:34.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:35.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- 172.21.15.100:0/4136051359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00102a10 msgr2=0x7fbe00103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 --2- 172.21.15.100:0/4136051359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00102a10 0x7fbe00103710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009900 tx=0x7fbdf002a410 comp rx=0 tx=0).stop 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- 172.21.15.100:0/4136051359 shutdown_connections 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 --2- 172.21.15.100:0/4136051359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00108950 0x7fbe0010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 --2- 172.21.15.100:0/4136051359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00103c50 0x7fbe00104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 --2- 172.21.15.100:0/4136051359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00102a10 0x7fbe00103710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- 172.21.15.100:0/4136051359 >> 172.21.15.100:0/4136051359 conn(0x7fbe000fdbe0 msgr2=0x7fbe001000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- 172.21.15.100:0/4136051359 shutdown_connections 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- 172.21.15.100:0/4136051359 wait complete. 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 Processor -- start 2024-04-30T23:10:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.032+0000 7fbe0658d640 1 -- start start 2024-04-30T23:10:35.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00102a10 0x7fbe0006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 0x7fbe0019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010e510 con 0x7fbe00108950 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010e390 con 0x7fbe00103c50 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe0658d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010e690 con 0x7fbe00102a10 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38340/0 (socket says 172.21.15.100:38340) 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 -- 172.21.15.100:0/1428369075 learned_addr learned my addr 172.21.15.100:0/1428369075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbdfffff640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00102a10 0x7fbe0006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbdff7fe640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 0x7fbe0019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 -- 172.21.15.100:0/1428369075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00102a10 msgr2=0x7fbe0006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00102a10 0x7fbe0006bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 -- 172.21.15.100:0/1428369075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 msgr2=0x7fbe0019f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 0x7fbe0019f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 -- 172.21.15.100:0/1428369075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe001a1da0 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbdff7fe640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 0x7fbe0019f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.033+0000 7fbe04b2a640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009fd0 tx=0x7fbdf800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.034+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017070 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.034+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf8003e20 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.034+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001a2090 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.034+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe001a2590 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.034+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8020060 con 0x7fbe00108950 2024-04-30T23:10:35.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.035+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00107760 con 0x7fbe00108950 2024-04-30T23:10:35.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.036+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fbdf8003970 con 0x7fbe00108950 2024-04-30T23:10:35.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.036+0000 7fbdfd7fa640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 0x7fbde80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:35.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.037+0000 7fbdfffff640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 0x7fbde80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:35.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.037+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbdf80d01c0 con 0x7fbe00108950 2024-04-30T23:10:35.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.037+0000 7fbdfffff640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 0x7fbde80a60c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0005ab0 tx=0x7fbdf0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.040+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbdf809d040 con 0x7fbe00108950 2024-04-30T23:10:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.255+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe0002db90 con 0x7fbe00108950 2024-04-30T23:10:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.256+0000 7fbdfd7fa640 1 -- 172.21.15.100:0/1428369075 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4705 (secure 0 0 0) 0x7fbdf809c940 con 0x7fbe00108950 2024-04-30T23:10:35.255 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:35.255 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-30T23:10:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 6 2024-04-30T23:10:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 msgr2=0x7fbde80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 0x7fbde80a60c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0005ab0 tx=0x7fbdf0031400 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 msgr2=0x7fbe001a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009fd0 tx=0x7fbdf800b260 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 shutdown_connections 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbde80a3bb0 0x7fbde80a60c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe00108950 0x7fbe001a1580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe00103c50 0x7fbe0019f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 --2- 172.21.15.100:0/1428369075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe00102a10 0x7fbe0006bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 >> 172.21.15.100:0/1428369075 conn(0x7fbe000fdbe0 msgr2=0x7fbe00104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 shutdown_connections 2024-04-30T23:10:35.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:35.258+0000 7fbe0658d640 1 -- 172.21.15.100:0/1428369075 wait complete. 2024-04-30T23:10:35.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:35 smithi100 ceph-mon[29745]: Deploying daemon mds.f on smithi183 2024-04-30T23:10:35.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:35 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6834/4094200769,v1:172.21.15.104:6835/4094200769] up:boot 2024-04-30T23:10:35.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:35 smithi100 ceph-mon[29745]: fsmap 5 up:standby 2024-04-30T23:10:35.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:35 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:10:35.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:35 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1428369075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:35.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:35 smithi104 ceph-mon[32987]: Deploying daemon mds.f on smithi183 2024-04-30T23:10:35.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:35 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6834/4094200769,v1:172.21.15.104:6835/4094200769] up:boot 2024-04-30T23:10:35.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:35 smithi104 ceph-mon[32987]: fsmap 5 up:standby 2024-04-30T23:10:35.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:35 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:10:35.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:35 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1428369075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:35.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:35 smithi183 ceph-mon[33560]: Deploying daemon mds.f on smithi183 2024-04-30T23:10:35.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:35 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6834/4094200769,v1:172.21.15.104:6835/4094200769] up:boot 2024-04-30T23:10:35.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:35 smithi183 ceph-mon[33560]: fsmap 5 up:standby 2024-04-30T23:10:35.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:35 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:10:35.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:35 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1428369075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:36.522 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 systemd[1]: Starting Ceph mds.f for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:36.795 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:36 smithi104 ceph-mon[32987]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:36.800 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:36 smithi183 ceph-mon[33560]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:36.800 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 podman[63927]: 2024-04-30 23:10:36.562419638 +0000 UTC m=+0.017977419 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:36.800 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 podman[63927]: 2024-04-30 23:10:36.688089763 +0000 UTC m=+0.143647545 container create 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-04-30T23:10:36.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:36 smithi100 ceph-mon[29745]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:37.269 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:37.300 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 podman[63927]: 2024-04-30 23:10:36.882331315 +0000 UTC m=+0.337889100 container init 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:10:37.300 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 podman[63927]: 2024-04-30 23:10:36.885365107 +0000 UTC m=+0.340922891 container start 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-30T23:10:37.300 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 ceph-mds[63947]: -- 172.21.15.183:0/3060366278 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dbbf26fa40 con 0x55dbbf2b7600 2024-04-30T23:10:37.300 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: starting mds.f at 2024-04-30T23:10:37.301 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 bash[63927]: 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 2024-04-30T23:10:37.301 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:10:36 smithi183 systemd[1]: Started Ceph mds.f for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 -- 172.21.15.100:0/405277102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8104600 msgr2=0x7f97d8106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 --2- 172.21.15.100:0/405277102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8104600 0x7f97d8106a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009900 tx=0x7f97c802a410 comp rx=0 tx=0).stop 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 -- 172.21.15.100:0/405277102 shutdown_connections 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 --2- 172.21.15.100:0/405277102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d81098c0 0x7f97d810bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 --2- 172.21.15.100:0/405277102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d8106f60 0x7f97d8109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 --2- 172.21.15.100:0/405277102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8104600 0x7f97d8106a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 -- 172.21.15.100:0/405277102 >> 172.21.15.100:0/405277102 conn(0x7f97d80fdbe0 msgr2=0x7f97d81000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 -- 172.21.15.100:0/405277102 shutdown_connections 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.391+0000 7f97dee43640 1 -- 172.21.15.100:0/405277102 wait complete. 2024-04-30T23:10:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 Processor -- start 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 -- start start 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 0x7f97d819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d81098c0 0x7f97d81a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97d810f610 con 0x7f97d8106f60 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97d810f490 con 0x7f97d8104600 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dee43640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f97d810f790 con 0x7f97d81098c0 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38366/0 (socket says 172.21.15.100:38366) 2024-04-30T23:10:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 -- 172.21.15.100:0/3701765112 learned_addr learned my addr 172.21.15.100:0/3701765112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dd3e0640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d81098c0 0x7f97d81a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dcbdf640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 0x7f97d819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 -- 172.21.15.100:0/3701765112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d81098c0 msgr2=0x7f97d81a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d81098c0 0x7f97d81a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 -- 172.21.15.100:0/3701765112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 msgr2=0x7f97d819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 0x7f97d819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97d7fff640 1 -- 172.21.15.100:0/3701765112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d81a1d80 con 0x7f97d8106f60 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.392+0000 7f97dcbdf640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 0x7f97d819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97d7fff640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00e9f0 tx=0x7f97cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00cd80 con 0x7f97d8106f60 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d81a2070 con 0x7f97d8106f60 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97cc0054d0 con 0x7f97d8106f60 2024-04-30T23:10:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc010690 con 0x7f97d8106f60 2024-04-30T23:10:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.393+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d81a2570 con 0x7f97d8106f60 2024-04-30T23:10:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.394+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d80ff700 con 0x7f97d8106f60 2024-04-30T23:10:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.395+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f97cc004e90 con 0x7f97d8106f60 2024-04-30T23:10:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.396+0000 7f97d5ffb640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 0x7f97c00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.396+0000 7f97dcbdf640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 0x7f97c00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.396+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f97cc0d0400 con 0x7f97d8106f60 2024-04-30T23:10:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.396+0000 7f97dcbdf640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 0x7f97c00a60c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97c8000c00 tx=0x7f97c80314c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.401+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f97cc09d280 con 0x7f97d8106f60 2024-04-30T23:10:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.623+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97d802db90 con 0x7f97d8106f60 2024-04-30T23:10:37.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.623+0000 7f97d5ffb640 1 -- 172.21.15.100:0/3701765112 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5533 (secure 0 0 0) 0x7f97cc09cb80 con 0x7f97d8106f60 2024-04-30T23:10:37.623 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:37.623 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-30T23:10:37.623 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 msgr2=0x7f97c00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 0x7f97c00a60c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97c8000c00 tx=0x7f97c80314c0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 msgr2=0x7f97d819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00e9f0 tx=0x7f97cc00edf0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 shutdown_connections 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f97c00a3bb0 0x7f97c00a60c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97d81098c0 0x7f97d81a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97d8106f60 0x7f97d819a780 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 --2- 172.21.15.100:0/3701765112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97d8104600 0x7f97d819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:37.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 >> 172.21.15.100:0/3701765112 conn(0x7f97d80fdbe0 msgr2=0x7f97d8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:37.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 shutdown_connections 2024-04-30T23:10:37.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:37.625+0000 7f97dee43640 1 -- 172.21.15.100:0/3701765112 wait complete. 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:38.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: Deploying daemon mds.c on smithi183 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6834/2697644609,v1:172.21.15.183:6835/2697644609] up:boot 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: fsmap 6 up:standby 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:38.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:38 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3701765112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:38.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: Deploying daemon mds.c on smithi183 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6834/2697644609,v1:172.21.15.183:6835/2697644609] up:boot 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: fsmap 6 up:standby 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:38.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:38 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3701765112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:38.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: Deploying daemon mds.c on smithi183 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6834/2697644609,v1:172.21.15.183:6835/2697644609] up:boot 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: fsmap 6 up:standby 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:38.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:38 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3701765112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:39.283 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 systemd[1]: Starting Ceph mds.c for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:39.550 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 podman[64239]: 2024-04-30 23:10:39.348316295 +0000 UTC m=+0.018413390 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:39.551 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 podman[64239]: 2024-04-30 23:10:39.476112172 +0000 UTC m=+0.146209232 container create 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-04-30T23:10:39.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 -- 172.21.15.100:0/2292610357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844109a80 msgr2=0x7ff84410bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 --2- 172.21.15.100:0/2292610357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844109a80 0x7ff84410bea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009ca0 tx=0x7ff83c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 -- 172.21.15.100:0/2292610357 shutdown_connections 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 --2- 172.21.15.100:0/2292610357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844109a80 0x7ff84410bea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 --2- 172.21.15.100:0/2292610357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 0x7ff844105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 --2- 172.21.15.100:0/2292610357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844103b40 0x7ff844104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 -- 172.21.15.100:0/2292610357 >> 172.21.15.100:0/2292610357 conn(0x7ff8440fed30 msgr2=0x7ff8441011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 -- 172.21.15.100:0/2292610357 shutdown_connections 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.759+0000 7ff84babf640 1 -- 172.21.15.100:0/2292610357 wait complete. 2024-04-30T23:10:39.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 Processor -- start 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 -- start start 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 0x7ff84419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 0x7ff8441a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff84410f670 con 0x7ff844103b40 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff84410f4f0 con 0x7ff844109a80 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84babf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff84410f7f0 con 0x7ff844104d80 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38378/0 (socket says 172.21.15.100:38378) 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 -- 172.21.15.100:0/2580930004 learned_addr learned my addr 172.21.15.100:0/2580930004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84905a640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 0x7ff84419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84a05c640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 0x7ff8441a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:39.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 -- 172.21.15.100:0/2580930004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 msgr2=0x7ff84419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 0x7ff84419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 -- 172.21.15.100:0/2580930004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 msgr2=0x7ff8441a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 0x7ff8441a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 -- 172.21.15.100:0/2580930004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441a1d50 con 0x7ff844103b40 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84a05c640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 0x7ff8441a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.760+0000 7ff84985b640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d740 tx=0x7ff83400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.761+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834017070 con 0x7ff844103b40 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.761+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83400de50 con 0x7ff844103b40 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.761+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441a1fe0 con 0x7ff844103b40 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.761+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834003c20 con 0x7ff844103b40 2024-04-30T23:10:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.761+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441a24a0 con 0x7ff844103b40 2024-04-30T23:10:39.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.762+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff844108890 con 0x7ff844103b40 2024-04-30T23:10:39.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.763+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff834003dc0 con 0x7ff844103b40 2024-04-30T23:10:39.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.763+0000 7ff83affd640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 0x7ff8300a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:39.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.764+0000 7ff84905a640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 0x7ff8300a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:39.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.764+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff8340cf9b0 con 0x7ff844103b40 2024-04-30T23:10:39.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.764+0000 7ff84905a640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 0x7ff8300a60c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff84419b2b0 tx=0x7ff840005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.768+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff83409c830 con 0x7ff844103b40 2024-04-30T23:10:39.847 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 podman[64239]: 2024-04-30 23:10:39.728808909 +0000 UTC m=+0.398905982 container init 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-30T23:10:39.847 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 podman[64239]: 2024-04-30 23:10:39.731975935 +0000 UTC m=+0.402072996 container start 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-30T23:10:39.847 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 ceph-mds[64268]: -- 172.21.15.183:0/114020031 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558e098b9a40 con 0x558e09901a80 2024-04-30T23:10:39.847 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: starting mds.c at 2024-04-30T23:10:39.847 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 bash[64239]: 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 2024-04-30T23:10:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.993+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff84402db90 con 0x7ff844103b40 2024-04-30T23:10:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.994+0000 7ff83affd640 1 -- 172.21.15.100:0/2580930004 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5533 (secure 0 0 0) 0x7ff83409c130 con 0x7ff844103b40 2024-04-30T23:10:39.993 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:39.994 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-30T23:10:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 msgr2=0x7ff8300a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 0x7ff8300a60c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff84419b2b0 tx=0x7ff840005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 msgr2=0x7ff84419a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d740 tx=0x7ff83400dc00 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 shutdown_connections 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8300a3bb0 0x7ff8300a60c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff844109a80 0x7ff8441a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff844104d80 0x7ff84419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 --2- 172.21.15.100:0/2580930004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff844103b40 0x7ff84419a210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 >> 172.21.15.100:0/2580930004 conn(0x7ff8440fed30 msgr2=0x7ff844105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 shutdown_connections 2024-04-30T23:10:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:39.996+0000 7ff84babf640 1 -- 172.21.15.100:0/2580930004 wait complete. 2024-04-30T23:10:40.235 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:10:39 smithi183 systemd[1]: Started Ceph mds.c for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:40.854 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:40 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2580930004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:40 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2580930004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:40 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2580930004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:41.964 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:41 smithi104 ceph-mon[32987]: Deploying daemon mds.h on smithi104 2024-04-30T23:10:41.964 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:41 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:boot 2024-04-30T23:10:41.964 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:41 smithi104 ceph-mon[32987]: fsmap 7 up:standby 2024-04-30T23:10:41.964 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:41 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:10:42.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:42.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:41 smithi100 ceph-mon[29745]: Deploying daemon mds.h on smithi104 2024-04-30T23:10:42.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:41 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:boot 2024-04-30T23:10:42.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:41 smithi100 ceph-mon[29745]: fsmap 7 up:standby 2024-04-30T23:10:42.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:41 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:10:42.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:41 smithi183 ceph-mon[33560]: Deploying daemon mds.h on smithi104 2024-04-30T23:10:42.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:41 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:boot 2024-04-30T23:10:42.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:41 smithi183 ceph-mon[33560]: fsmap 7 up:standby 2024-04-30T23:10:42.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:41 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 -- 172.21.15.100:0/162753114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf8103990 msgr2=0x7f5bf8103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/162753114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf8103990 0x7f5bf8103e40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009900 tx=0x7f5bec02a410 comp rx=0 tx=0).stop 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 -- 172.21.15.100:0/162753114 shutdown_connections 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/162753114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf81044d0 0x7f5bf810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/162753114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf8103990 0x7f5bf8103e40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/162753114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf81033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 -- 172.21.15.100:0/162753114 >> 172.21.15.100:0/162753114 conn(0x7f5bf80fd3d0 msgr2=0x7f5bf80ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 -- 172.21.15.100:0/162753114 shutdown_connections 2024-04-30T23:10:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.130+0000 7f5bfe78d640 1 -- 172.21.15.100:0/162753114 wait complete. 2024-04-30T23:10:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 Processor -- start 2024-04-30T23:10:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 -- start start 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf8102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf8103990 0x7f5bf819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810e5a0 con 0x7f5bf81044d0 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810e420 con 0x7f5bf8103990 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfe78d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810e720 con 0x7f5bf8102fb0 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfcd2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfcd2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38392/0 (socket says 172.21.15.100:38392) 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf8103990 0x7f5bf819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.131+0000 7f5bfcd2a640 1 -- 172.21.15.100:0/2977721556 learned_addr learned my addr 172.21.15.100:0/2977721556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bf7fff640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf8102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:42.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 -- 172.21.15.100:0/2977721556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 msgr2=0x7f5bf8102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf8102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 -- 172.21.15.100:0/2977721556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf8103990 msgr2=0x7f5bf819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf8103990 0x7f5bf819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 -- 172.21.15.100:0/2977721556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a1d60 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bf7fff640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf8102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfcd2a640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000eb10 tx=0x7f5bf000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004b20 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bf0004cc0 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a1ff0 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0010670 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.132+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a2460 con 0x7f5bf81044d0 2024-04-30T23:10:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.133+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8107950 con 0x7f5bf81044d0 2024-04-30T23:10:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.134+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f5bf0005020 con 0x7f5bf81044d0 2024-04-30T23:10:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.135+0000 7f5bf57fa640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 0x7f5be00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.135+0000 7f5bf7fff640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 0x7f5be00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.135+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5bf00d0570 con 0x7f5bf81044d0 2024-04-30T23:10:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.136+0000 7f5bf7fff640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 0x7f5be00a60c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058c0 tx=0x7f5be8005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:42.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.140+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5bf009d3f0 con 0x7f5bf81044d0 2024-04-30T23:10:42.295 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 systemd[1]: Starting Ceph mds.h for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:42.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.358+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bf80637e0 con 0x7f5bf81044d0 2024-04-30T23:10:42.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.359+0000 7f5bf57fa640 1 -- 172.21.15.100:0/2977721556 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6361 (secure 0 0 0) 0x7f5bf009ccf0 con 0x7f5bf81044d0 2024-04-30T23:10:42.358 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:42.359 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-30T23:10:42.359 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 msgr2=0x7f5be00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 0x7f5be00a60c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058c0 tx=0x7f5be8005d30 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 msgr2=0x7f5bf81a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000eb10 tx=0x7f5bf000c2d0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 shutdown_connections 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5be00a3bb0 0x7f5be00a60c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf81044d0 0x7f5bf81a1540 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bf8103990 0x7f5bf819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 --2- 172.21.15.100:0/2977721556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf8102fb0 0x7f5bf8102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 >> 172.21.15.100:0/2977721556 conn(0x7f5bf80fd3d0 msgr2=0x7f5bf8104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 shutdown_connections 2024-04-30T23:10:42.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:42.361+0000 7f5bfe78d640 1 -- 172.21.15.100:0/2977721556 wait complete. 2024-04-30T23:10:42.616 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 podman[62927]: 2024-04-30 23:10:42.353427529 +0000 UTC m=+0.101434157 container create 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:10:42.616 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 podman[62927]: 2024-04-30 23:10:42.269955703 +0000 UTC m=+0.017962321 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:42.616 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 podman[62927]: 2024-04-30 23:10:42.581020056 +0000 UTC m=+0.329026642 container init 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:10:42.616 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 podman[62927]: 2024-04-30 23:10:42.583898698 +0000 UTC m=+0.331905287 container start 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:10:42.617 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 ceph-mds[62946]: -- 172.21.15.104:0/3383130588 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56274fe59a40 con 0x56274fea1a80 2024-04-30T23:10:43.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:42 smithi104 ceph-mon[32987]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:43.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:42 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2977721556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:43.045 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: starting mds.h at 2024-04-30T23:10:43.045 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 bash[62927]: 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a 2024-04-30T23:10:43.045 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:10:42 smithi104 systemd[1]: Started Ceph mds.h for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:42 smithi183 ceph-mon[33560]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:42 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2977721556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:43.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:42 smithi100 ceph-mon[29745]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:43.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:42 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2977721556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:boot 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: fsmap 8 up:standby 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:43.740 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:boot 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: fsmap 8 up:standby 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:44.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:44.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:boot 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: fsmap 8 up:standby 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:44.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:44.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 -- 172.21.15.100:0/2950213548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c108100 msgr2=0x7fc02c10a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 --2- 172.21.15.100:0/2950213548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c108100 0x7fc02c10a520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc024009ca0 tx=0x7fc02402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 -- 172.21.15.100:0/2950213548 shutdown_connections 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 --2- 172.21.15.100:0/2950213548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c108100 0x7fc02c10a520 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 --2- 172.21.15.100:0/2950213548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c103400 0x7fc02c103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 --2- 172.21.15.100:0/2950213548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c1021c0 0x7fc02c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 -- 172.21.15.100:0/2950213548 >> 172.21.15.100:0/2950213548 conn(0x7fc02c0fd3b0 msgr2=0x7fc02c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 -- 172.21.15.100:0/2950213548 shutdown_connections 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.494+0000 7fc03107f640 1 -- 172.21.15.100:0/2950213548 wait complete. 2024-04-30T23:10:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 Processor -- start 2024-04-30T23:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 -- start start 2024-04-30T23:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c1021c0 0x7fc02c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c108100 0x7fc02c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c10d450 con 0x7fc02c103400 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c10d2d0 con 0x7fc02c1021c0 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.495+0000 7fc03107f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c10d5d0 con 0x7fc02c108100 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40866/0 (socket says 172.21.15.100:40866) 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 -- 172.21.15.100:0/2081945641 learned_addr learned my addr 172.21.15.100:0/2081945641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02b59e640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c108100 0x7fc02c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02ad9d640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c1021c0 0x7fc02c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 -- 172.21.15.100:0/2081945641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c108100 msgr2=0x7fc02c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c108100 0x7fc02c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 -- 172.21.15.100:0/2081945641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c1021c0 msgr2=0x7fc02c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c1021c0 0x7fc02c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 -- 172.21.15.100:0/2081945641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c19fa90 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc02a59c640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc02000d950 tx=0x7fc02000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020017070 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc020009c30 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c19fd80 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02000f620 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.496+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a0210 con 0x7fc02c103400 2024-04-30T23:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.497+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c106f10 con 0x7fc02c103400 2024-04-30T23:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.499+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fc020010460 con 0x7fc02c103400 2024-04-30T23:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.499+0000 7fc013fff640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.500+0000 7fc02ad9d640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.500+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc0200cfac0 con 0x7fc02c103400 2024-04-30T23:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.500+0000 7fc02ad9d640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc02c102dc0 tx=0x7fc01c010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:44.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.503+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc020009de0 con 0x7fc02c103400 2024-04-30T23:10:44.705 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:44 smithi183 ceph-mon[33560]: Deploying daemon mds.i on smithi183 2024-04-30T23:10:44.705 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:44 smithi183 ceph-mon[33560]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.723+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc02c02db90 con 0x7fc02c103400 2024-04-30T23:10:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.723+0000 7fc013fff640 1 -- 172.21.15.100:0/2081945641 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7189 (secure 0 0 0) 0x7fc02009c2f0 con 0x7fc02c103400 2024-04-30T23:10:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:44.723 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-30T23:10:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-04-30T23:10:44.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 msgr2=0x7fc0140a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:44.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc02c102dc0 tx=0x7fc01c010040 comp rx=0 tx=0).stop 2024-04-30T23:10:44.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 msgr2=0x7fc02c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc02000d950 tx=0x7fc02000de10 comp rx=0 tx=0).stop 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 shutdown_connections 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc02c108100 0x7fc02c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c103400 0x7fc02c198490 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 --2- 172.21.15.100:0/2081945641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc02c1021c0 0x7fc02c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 >> 172.21.15.100:0/2081945641 conn(0x7fc02c0fd3b0 msgr2=0x7fc02c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 shutdown_connections 2024-04-30T23:10:44.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:44.726+0000 7fc03107f640 1 -- 172.21.15.100:0/2081945641 wait complete. 2024-04-30T23:10:44.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:44 smithi100 ceph-mon[29745]: Deploying daemon mds.i on smithi183 2024-04-30T23:10:44.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:44 smithi100 ceph-mon[29745]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:45.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:44 smithi104 ceph-mon[32987]: Deploying daemon mds.i on smithi183 2024-04-30T23:10:45.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:44 smithi104 ceph-mon[32987]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:45.050 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:44 smithi183 systemd[1]: Starting Ceph mds.i for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:45.377 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 podman[64556]: 2024-04-30 23:10:45.006271676 +0000 UTC m=+0.017921891 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:45.377 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 podman[64556]: 2024-04-30 23:10:45.113988549 +0000 UTC m=+0.125638740 container create c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-30T23:10:45.377 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 podman[64556]: 2024-04-30 23:10:45.341973985 +0000 UTC m=+0.353624181 container init c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-30T23:10:45.377 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 podman[64556]: 2024-04-30 23:10:45.344529645 +0000 UTC m=+0.356179834 container start c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True) 2024-04-30T23:10:45.648 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mds[64575]: -- 172.21.15.183:0/2905364543 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dee0c45a40 con 0x55dee0c8d600 2024-04-30T23:10:45.648 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: starting mds.i at 2024-04-30T23:10:45.648 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 bash[64556]: c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c 2024-04-30T23:10:45.648 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:10:45 smithi183 systemd[1]: Started Ceph mds.i for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:46.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2081945641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2081945641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:46.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:46.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2081945641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:46.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:46.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:46.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:46.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:46.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:46.761 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:46 smithi100 ceph-mon[29745]: Deploying daemon mds.g on smithi100 2024-04-30T23:10:46.762 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:46 smithi100 ceph-mon[29745]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:46.762 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:46 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:boot 2024-04-30T23:10:46.762 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:46 smithi100 ceph-mon[29745]: fsmap 9 up:standby 2024-04-30T23:10:46.762 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 -- 172.21.15.100:0/3047610850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898109a80 msgr2=0x7f289810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 --2- 172.21.15.100:0/3047610850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898109a80 0x7f289810bea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2890009ca0 tx=0x7f289002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 -- 172.21.15.100:0/3047610850 shutdown_connections 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 --2- 172.21.15.100:0/3047610850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898109a80 0x7f289810bea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 --2- 172.21.15.100:0/3047610850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898104d80 0x7f2898105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 --2- 172.21.15.100:0/3047610850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898103b40 0x7f2898104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 -- 172.21.15.100:0/3047610850 >> 172.21.15.100:0/3047610850 conn(0x7f28980fed50 msgr2=0x7f28981011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 -- 172.21.15.100:0/3047610850 shutdown_connections 2024-04-30T23:10:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.854+0000 7f289e089640 1 -- 172.21.15.100:0/3047610850 wait complete. 2024-04-30T23:10:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 Processor -- start 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 -- start start 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898103b40 0x7f289819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898109a80 0x7f28981a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f289810f6c0 con 0x7f2898104d80 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f289810f540 con 0x7f2898109a80 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f289e089640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f289810f840 con 0x7f2898103b40 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f2896ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f2896ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40886/0 (socket says 172.21.15.100:40886) 2024-04-30T23:10:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f2896ffd640 1 -- 172.21.15.100:0/465805943 learned_addr learned my addr 172.21.15.100:0/465805943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f28977fe640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898103b40 0x7f289819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.855+0000 7f2897fff640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898109a80 0x7f28981a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 -- 172.21.15.100:0/465805943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898103b40 msgr2=0x7f289819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898103b40 0x7f289819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 -- 172.21.15.100:0/465805943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898109a80 msgr2=0x7f28981a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898109a80 0x7f28981a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 -- 172.21.15.100:0/465805943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28981a1d20 con 0x7f2898104d80 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2896ffd640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f288c00d770 tx=0x7f288c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c017070 con 0x7f2898104d80 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28981a1fb0 con 0x7f2898104d80 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f288c0054d0 con 0x7f2898104d80 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c004c30 con 0x7f2898104d80 2024-04-30T23:10:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.856+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28981a2470 con 0x7f2898104d80 2024-04-30T23:10:46.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.857+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2898108890 con 0x7f2898104d80 2024-04-30T23:10:46.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.858+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f288c004dd0 con 0x7f2898104d80 2024-04-30T23:10:46.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.859+0000 7f2894ff9640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 0x7f28800a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:46.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.859+0000 7f28977fe640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 0x7f28800a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:46.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.859+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f288c0cfdb0 con 0x7f2898104d80 2024-04-30T23:10:46.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.859+0000 7f28977fe640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 0x7f28800a60c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2898104740 tx=0x7f2888005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:46.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:46.863+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f288c09c5e0 con 0x7f2898104d80 2024-04-30T23:10:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:46 smithi104 ceph-mon[32987]: Deploying daemon mds.g on smithi100 2024-04-30T23:10:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:46 smithi104 ceph-mon[32987]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:46 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:boot 2024-04-30T23:10:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:46 smithi104 ceph-mon[32987]: fsmap 9 up:standby 2024-04-30T23:10:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:10:47.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:46 smithi183 ceph-mon[33560]: Deploying daemon mds.g on smithi100 2024-04-30T23:10:47.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:46 smithi183 ceph-mon[33560]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:47.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:46 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:boot 2024-04-30T23:10:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:46 smithi183 ceph-mon[33560]: fsmap 9 up:standby 2024-04-30T23:10:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:10:47.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.083+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f289802db90 con 0x7f2898104d80 2024-04-30T23:10:47.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.083+0000 7f2894ff9640 1 -- 172.21.15.100:0/465805943 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8016 (secure 0 0 0) 0x7f288c0a08e0 con 0x7f2898104d80 2024-04-30T23:10:47.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:47.083 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-30T23:10:47.084 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 10 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 msgr2=0x7f28800a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 0x7f28800a60c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2898104740 tx=0x7f2888005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 msgr2=0x7f289819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f288c00d770 tx=0x7f288c00dc30 comp rx=0 tx=0).stop 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 shutdown_connections 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28800a3bb0 0x7f28800a60c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2898109a80 0x7f28981a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2898104d80 0x7f289819a7d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 --2- 172.21.15.100:0/465805943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2898103b40 0x7f289819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 >> 172.21.15.100:0/465805943 conn(0x7f28980fed50 msgr2=0x7f2898105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 shutdown_connections 2024-04-30T23:10:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:47.086+0000 7f289e089640 1 -- 172.21.15.100:0/465805943 wait complete. 2024-04-30T23:10:48.033 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:47 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/465805943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:48.034 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:47 smithi100 systemd[1]: Starting Ceph mds.g for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:48.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:47 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/465805943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:48.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:47 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/465805943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:48.310 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 podman[68870]: 2024-04-30 23:10:47.936404841 +0000 UTC m=+0.017804957 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:48.310 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 podman[68870]: 2024-04-30 23:10:48.047296228 +0000 UTC m=+0.128696343 container create dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:10:48.310 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 podman[68870]: 2024-04-30 23:10:48.275395211 +0000 UTC m=+0.356795326 container init dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:10:48.310 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 podman[68870]: 2024-04-30 23:10:48.277985771 +0000 UTC m=+0.359385889 container start dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:10:48.572 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mds[68889]: -- 172.21.15.100:0/2035682729 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613e01dfa40 con 0x5613e0227180 2024-04-30T23:10:48.572 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: starting mds.g at 2024-04-30T23:10:48.572 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 bash[68870]: dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd 2024-04-30T23:10:48.572 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:10:48 smithi100 systemd[1]: Started Ceph mds.g for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:49.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:49.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:49.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:49.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:49.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:49.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:49.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 -- 172.21.15.100:0/2661708574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac104730 msgr2=0x7f5dac10ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 --2- 172.21.15.100:0/2661708574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac104730 0x7f5dac10ae80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009ca0 tx=0x7f5da402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 -- 172.21.15.100:0/2661708574 shutdown_connections 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 --2- 172.21.15.100:0/2661708574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac104730 0x7f5dac10ae80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 --2- 172.21.15.100:0/2661708574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103bd0 0x7f5dac1040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 --2- 172.21.15.100:0/2661708574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac103070 0x7f5dac103480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.210+0000 7f5db2292640 1 -- 172.21.15.100:0/2661708574 >> 172.21.15.100:0/2661708574 conn(0x7f5dac0fd3f0 msgr2=0x7f5dac0ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.211+0000 7f5db2292640 1 -- 172.21.15.100:0/2661708574 shutdown_connections 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.211+0000 7f5db2292640 1 -- 172.21.15.100:0/2661708574 wait complete. 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.211+0000 7f5db2292640 1 Processor -- start 2024-04-30T23:10:49.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.211+0000 7f5db2292640 1 -- start start 2024-04-30T23:10:49.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103070 0x7f5dac199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:49.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:49.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac19f460 0x7f5dac1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10e770 con 0x7f5dac103bd0 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10e5f0 con 0x7f5dac103070 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10e8f0 con 0x7f5dac19f460 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40934/0 (socket says 172.21.15.100:40934) 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 -- 172.21.15.100:0/1504806029 learned_addr learned my addr 172.21.15.100:0/1504806029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db082f640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac19f460 0x7f5dac1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dabfff640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103070 0x7f5dac199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 -- 172.21.15.100:0/1504806029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac19f460 msgr2=0x7f5dac1a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac19f460 0x7f5dac1a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 -- 172.21.15.100:0/1504806029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103070 msgr2=0x7f5dac199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103070 0x7f5dac199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 -- 172.21.15.100:0/1504806029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac1a1ef0 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5dab7fe640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c890 tx=0x7f5da000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004220 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac1a21e0 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da00043c0 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004a00 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.212+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac1a2780 con 0x7f5dac103bd0 2024-04-30T23:10:49.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.214+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac06a1d0 con 0x7f5dac103bd0 2024-04-30T23:10:49.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.215+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f5da0004ba0 con 0x7f5dac103bd0 2024-04-30T23:10:49.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.215+0000 7f5da97fa640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 0x7f5d940a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:49.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.215+0000 7f5dabfff640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 0x7f5d940a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:49.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.215+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5da00cfcc0 con 0x7f5dac103bd0 2024-04-30T23:10:49.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.216+0000 7f5dabfff640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 0x7f5d940a60c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:49.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.220+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5da0014030 con 0x7f5dac103bd0 2024-04-30T23:10:49.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.458+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dac06b360 con 0x7f5dac103bd0 2024-04-30T23:10:49.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.459+0000 7f5da97fa640 1 -- 172.21.15.100:0/1504806029 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8845 (secure 0 0 0) 0x7f5da009cb40 con 0x7f5dac103bd0 2024-04-30T23:10:49.459 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:49.459 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-30T23:10:49.459 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 11 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 msgr2=0x7f5d940a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 0x7f5d940a60c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c005850 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 msgr2=0x7f5dac19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c890 tx=0x7f5da000cd50 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 shutdown_connections 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5d940a3bb0 0x7f5d940a60c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dac19f460 0x7f5dac1a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac103bd0 0x7f5dac19a4e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 --2- 172.21.15.100:0/1504806029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dac103070 0x7f5dac199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:49.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 >> 172.21.15.100:0/1504806029 conn(0x7f5dac0fd3f0 msgr2=0x7f5dac1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:49.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 shutdown_connections 2024-04-30T23:10:49.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:49.461+0000 7f5db2292640 1 -- 172.21.15.100:0/1504806029 wait complete. 2024-04-30T23:10:50.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:49 smithi104 ceph-mon[32987]: Deploying daemon mds.a on smithi100 2024-04-30T23:10:50.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:49 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6838/1668286182,v1:172.21.15.100:6839/1668286182] up:boot 2024-04-30T23:10:50.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:49 smithi104 ceph-mon[32987]: fsmap 10 up:standby 2024-04-30T23:10:50.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:10:50.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1504806029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:49 smithi183 ceph-mon[33560]: Deploying daemon mds.a on smithi100 2024-04-30T23:10:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:49 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6838/1668286182,v1:172.21.15.100:6839/1668286182] up:boot 2024-04-30T23:10:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:49 smithi183 ceph-mon[33560]: fsmap 10 up:standby 2024-04-30T23:10:50.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:10:50.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1504806029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:49 smithi100 ceph-mon[29745]: Deploying daemon mds.a on smithi100 2024-04-30T23:10:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:49 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6838/1668286182,v1:172.21.15.100:6839/1668286182] up:boot 2024-04-30T23:10:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:49 smithi100 ceph-mon[29745]: fsmap 10 up:standby 2024-04-30T23:10:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:10:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1504806029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:50.678 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:50 smithi100 systemd[1]: Starting Ceph mds.a for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:50.939 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:50 smithi100 ceph-mon[29745]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:50.940 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:50 smithi100 podman[69226]: 2024-04-30 23:10:50.721427085 +0000 UTC m=+0.018353455 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:50.940 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:50 smithi100 podman[69226]: 2024-04-30 23:10:50.837993297 +0000 UTC m=+0.134919713 container create 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-30T23:10:51.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:50 smithi104 ceph-mon[32987]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:50 smithi183 ceph-mon[33560]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:51.322 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 podman[69226]: 2024-04-30 23:10:51.049254132 +0000 UTC m=+0.346180502 container init 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-30T23:10:51.322 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 podman[69226]: 2024-04-30 23:10:51.051836922 +0000 UTC m=+0.348763298 container start 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:10:51.322 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 ceph-mds[69245]: -- 172.21.15.100:0/3882274574 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568bf59ba40 con 0x5568bf5e3180 2024-04-30T23:10:51.322 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: starting mds.a at 2024-04-30T23:10:51.322 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 bash[69226]: 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e 2024-04-30T23:10:51.323 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:10:51 smithi100 systemd[1]: Started Ceph mds.a for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:51.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:51.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 -- 172.21.15.100:0/3588243491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc1098f0 msgr2=0x7fb5bc10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:51.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/3588243491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc10bd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009ca0 tx=0x7fb5b402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 -- 172.21.15.100:0/3588243491 shutdown_connections 2024-04-30T23:10:51.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/3588243491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc10bd10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/3588243491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc1093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/3588243491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc104630 0x7fb5bc106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 -- 172.21.15.100:0/3588243491 >> 172.21.15.100:0/3588243491 conn(0x7fb5bc0fdc30 msgr2=0x7fb5bc1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 -- 172.21.15.100:0/3588243491 shutdown_connections 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.587+0000 7fb5c21eb640 1 -- 172.21.15.100:0/3588243491 wait complete. 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 Processor -- start 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 -- start start 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc10f670 con 0x7fb5bc104630 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc10f4f0 con 0x7fb5bc1098f0 2024-04-30T23:10:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5c21eb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc10f7f0 con 0x7fb5bc106f90 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40974/0 (socket says 172.21.15.100:40974) 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 -- 172.21.15.100:0/1808285508 learned_addr learned my addr 172.21.15.100:0/1808285508 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bbfff640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5b3fff640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 -- 172.21.15.100:0/1808285508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 msgr2=0x7fb5bc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 -- 172.21.15.100:0/1808285508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc1098f0 msgr2=0x7fb5bc1a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc1a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 -- 172.21.15.100:0/1808285508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc1a1cf0 con 0x7fb5bc104630 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5b3fff640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.588+0000 7fb5bb7fe640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00e9c0 tx=0x7fb5ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.589+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00cd80 con 0x7fb5bc104630 2024-04-30T23:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.589+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5ac0054d0 con 0x7fb5bc104630 2024-04-30T23:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.589+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc1a1fe0 con 0x7fb5bc104630 2024-04-30T23:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.589+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac010430 con 0x7fb5bc104630 2024-04-30T23:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.589+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc1a24a0 con 0x7fb5bc104630 2024-04-30T23:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.590+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc0ff750 con 0x7fb5bc104630 2024-04-30T23:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.591+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fb5ac004fb0 con 0x7fb5bc104630 2024-04-30T23:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.591+0000 7fb5b97fa640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 0x7fb5a80a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.592+0000 7fb5b3fff640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 0x7fb5a80a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.592+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb5ac0d0610 con 0x7fb5bc104630 2024-04-30T23:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.592+0000 7fb5b3fff640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 0x7fb5a80a6140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc19b250 tx=0x7fb5a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.595+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb5ac053ff0 con 0x7fb5bc104630 2024-04-30T23:10:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.814+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5bc02dde0 con 0x7fb5bc104630 2024-04-30T23:10:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.814+0000 7fb5b97fa640 1 -- 172.21.15.100:0/1808285508 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9674 (secure 0 0 0) 0x7fb5ac09d3f0 con 0x7fb5bc104630 2024-04-30T23:10:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:51.814 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-30T23:10:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 12 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 msgr2=0x7fb5a80a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 0x7fb5a80a6140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc19b250 tx=0x7fb5a4005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 msgr2=0x7fb5bc19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00e9c0 tx=0x7fb5ac00ee80 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 shutdown_connections 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5a80a3c30 0x7fb5a80a6140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5bc1098f0 0x7fb5bc1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5bc106f90 0x7fb5bc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 --2- 172.21.15.100:0/1808285508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5bc104630 0x7fb5bc19a1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 >> 172.21.15.100:0/1808285508 conn(0x7fb5bc0fdc30 msgr2=0x7fb5bc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:51.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 shutdown_connections 2024-04-30T23:10:51.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:51.816+0000 7fb5c21eb640 1 -- 172.21.15.100:0/1808285508 wait complete. 2024-04-30T23:10:52.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.545 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: Deploying daemon mds.b on smithi104 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:boot 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: fsmap 11 up:standby 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:10:52.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:52 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1808285508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:52.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.550 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: Deploying daemon mds.b on smithi104 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:boot 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: fsmap 11 up:standby 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:10:52.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:52 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1808285508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:52.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: Deploying daemon mds.b on smithi104 2024-04-30T23:10:52.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:52.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:boot 2024-04-30T23:10:52.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: fsmap 11 up:standby 2024-04-30T23:10:52.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:10:52.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:52 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1808285508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:53.545 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 systemd[1]: Starting Ceph mds.b for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:10:53.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:53.931 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 podman[63234]: 2024-04-30 23:10:53.549032754 +0000 UTC m=+0.018071275 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:10:53.931 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 podman[63234]: 2024-04-30 23:10:53.665774897 +0000 UTC m=+0.134813439 container create ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-30T23:10:53.931 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 podman[63234]: 2024-04-30 23:10:53.932546889 +0000 UTC m=+0.401585385 container init ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 -- 172.21.15.100:0/1991422919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd41050e0 msgr2=0x7f1fd41054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 --2- 172.21.15.100:0/1991422919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd41050e0 0x7f1fd41054f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009900 tx=0x7f1fd002a410 comp rx=0 tx=0).stop 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 -- 172.21.15.100:0/1991422919 shutdown_connections 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 --2- 172.21.15.100:0/1991422919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4102290 0x7f1fd410bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 --2- 172.21.15.100:0/1991422919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd4101790 0x7f1fd4101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 --2- 172.21.15.100:0/1991422919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd41050e0 0x7f1fd41054f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 -- 172.21.15.100:0/1991422919 >> 172.21.15.100:0/1991422919 conn(0x7f1fd40fd3b0 msgr2=0x7f1fd40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:53.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 -- 172.21.15.100:0/1991422919 shutdown_connections 2024-04-30T23:10:53.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.949+0000 7f1fdb813640 1 -- 172.21.15.100:0/1991422919 wait complete. 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 Processor -- start 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 -- start start 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4101790 0x7f1fd419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd41050e0 0x7f1fd41a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd410f650 con 0x7f1fd4102290 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd410f4d0 con 0x7f1fd4101790 2024-04-30T23:10:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fdb813640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd410f7d0 con 0x7f1fd41050e0 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fd8dae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fd8dae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54662/0 (socket says 172.21.15.100:54662) 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fd8dae640 1 -- 172.21.15.100:0/3752160025 learned_addr learned my addr 172.21.15.100:0/3752160025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fd95af640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4101790 0x7f1fd419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.950+0000 7f1fd9db0640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd41050e0 0x7f1fd41a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 -- 172.21.15.100:0/3752160025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd41050e0 msgr2=0x7f1fd41a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd41050e0 0x7f1fd41a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 -- 172.21.15.100:0/3752160025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4101790 msgr2=0x7f1fd419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4101790 0x7f1fd419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 -- 172.21.15.100:0/3752160025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd41a1dc0 con 0x7f1fd4102290 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fd8dae640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d770 tx=0x7f1fc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8017070 con 0x7f1fd4102290 2024-04-30T23:10:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fc80054d0 con 0x7f1fd4102290 2024-04-30T23:10:53.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd41a20b0 con 0x7f1fd4102290 2024-04-30T23:10:53.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8004c30 con 0x7f1fd4102290 2024-04-30T23:10:53.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.951+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd41a25b0 con 0x7f1fd4102290 2024-04-30T23:10:53.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.952+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd4108a70 con 0x7f1fd4102290 2024-04-30T23:10:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.953+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1fc8004dd0 con 0x7f1fd4102290 2024-04-30T23:10:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.954+0000 7f1fc67fc640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 0x7f1fc00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.954+0000 7f1fd95af640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 0x7f1fc00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.954+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1fc80cfe60 con 0x7f1fd4102290 2024-04-30T23:10:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.954+0000 7f1fd95af640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 0x7f1fc00a60c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0005ab0 tx=0x7f1fd0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:53.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:53.958+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fc809cce0 con 0x7f1fd4102290 2024-04-30T23:10:54.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.180+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fd402db90 con 0x7f1fd4102290 2024-04-30T23:10:54.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.180+0000 7f1fc67fc640 1 -- 172.21.15.100:0/3752160025 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9674 (secure 0 0 0) 0x7f1fc809c5e0 con 0x7f1fd4102290 2024-04-30T23:10:54.180 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:54.180 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-30T23:10:54.180 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 12 2024-04-30T23:10:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 msgr2=0x7f1fc00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 0x7f1fc00a60c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0005ab0 tx=0x7f1fd0031400 comp rx=0 tx=0).stop 2024-04-30T23:10:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 msgr2=0x7f1fd419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d770 tx=0x7f1fc800dc30 comp rx=0 tx=0).stop 2024-04-30T23:10:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 shutdown_connections 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fc00a3bb0 0x7f1fc00a60c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd41050e0 0x7f1fd41a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fd4102290 0x7f1fd419a830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.182+0000 7f1fdb813640 1 --2- 172.21.15.100:0/3752160025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4101790 0x7f1fd419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.183+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 >> 172.21.15.100:0/3752160025 conn(0x7f1fd40fd3b0 msgr2=0x7f1fd4105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.183+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 shutdown_connections 2024-04-30T23:10:54.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:54.183+0000 7f1fdb813640 1 -- 172.21.15.100:0/3752160025 wait complete. 2024-04-30T23:10:54.295 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 podman[63234]: 2024-04-30 23:10:53.935161681 +0000 UTC m=+0.404200175 container start ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-30T23:10:54.295 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 ceph-mds[63253]: -- 172.21.15.104:0/3488634710 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f67cbb9a40 con 0x55f67cc01a80 2024-04-30T23:10:54.295 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: starting mds.b at 2024-04-30T23:10:54.295 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:54 smithi104 bash[63234]: ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 2024-04-30T23:10:54.295 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:10:54 smithi104 systemd[1]: Started Ceph mds.b for a34a4a58-0745-11ef-bc93-c7b262605968. 2024-04-30T23:10:55.044 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3752160025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:55.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3752160025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:55.047 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3752160025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:55.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:56.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:55 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:boot 2024-04-30T23:10:56.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:55 smithi104 ceph-mon[32987]: fsmap 12 up:standby 2024-04-30T23:10:56.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:10:56.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:55 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:boot 2024-04-30T23:10:56.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:55 smithi183 ceph-mon[33560]: fsmap 12 up:standby 2024-04-30T23:10:56.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:10:56.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:55 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:boot 2024-04-30T23:10:56.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:55 smithi100 ceph-mon[29745]: fsmap 12 up:standby 2024-04-30T23:10:56.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:10:56.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:10:56.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 -- 172.21.15.100:0/2587562583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60103c60 msgr2=0x7fef60104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 --2- 172.21.15.100:0/2587562583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60103c60 0x7fef60104070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009900 tx=0x7fef4c02a410 comp rx=0 tx=0).stop 2024-04-30T23:10:56.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 -- 172.21.15.100:0/2587562583 shutdown_connections 2024-04-30T23:10:56.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 --2- 172.21.15.100:0/2587562583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60108960 0x7fef6010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 --2- 172.21.15.100:0/2587562583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60103c60 0x7fef60104070 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 --2- 172.21.15.100:0/2587562583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60102a20 0x7fef60103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 -- 172.21.15.100:0/2587562583 >> 172.21.15.100:0/2587562583 conn(0x7fef600fdc10 msgr2=0x7fef601000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 -- 172.21.15.100:0/2587562583 shutdown_connections 2024-04-30T23:10:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.307+0000 7fef66deb640 1 -- 172.21.15.100:0/2587562583 wait complete. 2024-04-30T23:10:56.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.308+0000 7fef66deb640 1 Processor -- start 2024-04-30T23:10:56.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.308+0000 7fef66deb640 1 -- start start 2024-04-30T23:10:56.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60103c60 0x7fef60199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60108960 0x7fef601a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010e550 con 0x7fef60102a20 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010e3d0 con 0x7fef60108960 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010e6d0 con 0x7fef60103c60 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54680/0 (socket says 172.21.15.100:54680) 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 -- 172.21.15.100:0/248178704 learned_addr learned my addr 172.21.15.100:0/248178704 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef5ffff640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60103c60 0x7fef60199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef65388640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60108960 0x7fef601a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 -- 172.21.15.100:0/248178704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60103c60 msgr2=0x7fef60199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60103c60 0x7fef60199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 -- 172.21.15.100:0/248178704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60108960 msgr2=0x7fef601a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60108960 0x7fef601a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 -- 172.21.15.100:0/248178704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef601a0c60 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef64b87640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9f0 tx=0x7fef5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400ccc0 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef540035f0 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef601a0f50 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.309+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400ce60 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.310+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601a1410 con 0x7fef60102a20 2024-04-30T23:10:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.311+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef60107770 con 0x7fef60102a20 2024-04-30T23:10:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.311+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fef54003aa0 con 0x7fef60102a20 2024-04-30T23:10:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.312+0000 7fef5dffb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 0x7fef500a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.313+0000 7fef5ffff640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 0x7fef500a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.313+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fef540d0210 con 0x7fef60102a20 2024-04-30T23:10:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.313+0000 7fef5ffff640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 0x7fef500a6140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009230 tx=0x7fef4c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:56.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.317+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef5409cff0 con 0x7fef60102a20 2024-04-30T23:10:56.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.542+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef600637e0 con 0x7fef60102a20 2024-04-30T23:10:56.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.543+0000 7fef5dffb640 1 -- 172.21.15.100:0/248178704 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10503 (secure 0 0 0) 0x7fef5409c8f0 con 0x7fef60102a20 2024-04-30T23:10:56.542 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:56.543 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-30T23:10:56.543 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 msgr2=0x7fef500a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 0x7fef500a6140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009230 tx=0x7fef4c031400 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 msgr2=0x7fef60199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9f0 tx=0x7fef5400eeb0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 shutdown_connections 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fef500a3c30 0x7fef500a6140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef60108960 0x7fef601a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef60103c60 0x7fef60199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 --2- 172.21.15.100:0/248178704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef60102a20 0x7fef60199120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 >> 172.21.15.100:0/248178704 conn(0x7fef600fdc10 msgr2=0x7fef60104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 shutdown_connections 2024-04-30T23:10:56.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.545+0000 7fef66deb640 1 -- 172.21.15.100:0/248178704 wait complete. 2024-04-30T23:10:56.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 -- 172.21.15.100:0/2083606816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c104490 msgr2=0x7fc94c10abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2083606816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c104490 0x7fc94c10abe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc944009ca0 tx=0x7fc94402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 -- 172.21.15.100:0/2083606816 shutdown_connections 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2083606816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c104490 0x7fc94c10abe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2083606816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2083606816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 0x7fc94c103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 -- 172.21.15.100:0/2083606816 >> 172.21.15.100:0/2083606816 conn(0x7fc94c0fd370 msgr2=0x7fc94c0ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 -- 172.21.15.100:0/2083606816 shutdown_connections 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 -- 172.21.15.100:0/2083606816 wait complete. 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.676+0000 7fc9513b2640 1 Processor -- start 2024-04-30T23:10:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 -- start start 2024-04-30T23:10:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 0x7fc94c102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e560 con 0x7fc94c19f0b0 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e3e0 con 0x7fc94c102f50 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc9513b2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e6e0 con 0x7fc94c103930 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54698/0 (socket says 172.21.15.100:54698) 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94b7fe640 1 -- 172.21.15.100:0/2190941569 learned_addr learned my addr 172.21.15.100:0/2190941569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94affd640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 0x7fc94c102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 -- 172.21.15.100:0/2190941569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 msgr2=0x7fc94c102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 0x7fc94c102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 -- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 msgr2=0x7fc94c1a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94a7fc640 1 -- 172.21.15.100:0/2190941569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c1a1d10 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.677+0000 7fc94b7fe640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc94a7fc640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c19eb70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc94000e9f0 tx=0x7fc94000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94000ccc0 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94c1a1fa0 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc940005020 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940004a00 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.678+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94c1a2440 con 0x7fc94c103930 2024-04-30T23:10:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.679+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94c109900 con 0x7fc94c103930 2024-04-30T23:10:56.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.680+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fc940004ba0 con 0x7fc94c103930 2024-04-30T23:10:56.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.681+0000 7fc933fff640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 0x7fc9340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:56.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.681+0000 7fc94affd640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 0x7fc9340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:56.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.681+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc9400cfef0 con 0x7fc94c103930 2024-04-30T23:10:56.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.681+0000 7fc94affd640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 0x7fc9340a60c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc94c069c50 tx=0x7fc93c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.686+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc94009cd50 con 0x7fc94c103930 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:56.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:56.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:56.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:56 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/248178704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:56.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.870+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc94c02dde0 con 0x7fc94c103930 2024-04-30T23:10:56.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.872+0000 7fc933fff640 1 -- 172.21.15.100:0/2190941569 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18475 (secure 0 0 0) 0x7fc94009c650 con 0x7fc94c103930 2024-04-30T23:10:56.872 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:56.872 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:10:10.651018+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 msgr2=0x7fc9340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 0x7fc9340a60c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc94c069c50 tx=0x7fc93c005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 msgr2=0x7fc94c19eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c19eb70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc94000e9f0 tx=0x7fc94000eeb0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 shutdown_connections 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc9340a3bb0 0x7fc9340a60c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94c19f0b0 0x7fc94c1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc94c103930 0x7fc94c19eb70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 --2- 172.21.15.100:0/2190941569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc94c102f50 0x7fc94c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 >> 172.21.15.100:0/2190941569 conn(0x7fc94c0fd370 msgr2=0x7fc94c106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 shutdown_connections 2024-04-30T23:10:56.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:56.874+0000 7fc9513b2640 1 -- 172.21.15.100:0/2190941569 wait complete. 2024-04-30T23:10:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T23:10:56.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/3654444499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 msgr2=0x7fe5c8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/3654444499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c8104080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009860 tx=0x7fe5bc02a340 comp rx=0 tx=0).stop 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/3654444499 shutdown_connections 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/3654444499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8108970 0x7fe5c810ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/3654444499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c8104080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/3654444499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8102a30 0x7fe5c8103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/3654444499 >> 172.21.15.100:0/3654444499 conn(0x7fe5c80fdc40 msgr2=0x7fe5c81000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/3654444499 shutdown_connections 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.003+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/3654444499 wait complete. 2024-04-30T23:10:57.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 Processor -- start 2024-04-30T23:10:57.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 -- start start 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 0x7fe5c806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8108970 0x7fe5c81a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810e550 con 0x7fe5c8103c70 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810e3d0 con 0x7fe5c8102a30 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5cdfd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810e6d0 con 0x7fe5c8108970 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54710/0 (socket says 172.21.15.100:54710) 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 -- 172.21.15.100:0/1667911787 learned_addr learned my addr 172.21.15.100:0/1667911787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c7fff640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8108970 0x7fe5c81a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 0x7fe5c806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 -- 172.21.15.100:0/1667911787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8108970 msgr2=0x7fe5c81a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8108970 0x7fe5c81a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 -- 172.21.15.100:0/1667911787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 msgr2=0x7fe5c806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 0x7fe5c806bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.004+0000 7fe5c6ffd640 1 -- 172.21.15.100:0/1667911787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c81a1d80 con 0x7fe5c8103c70 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 0x7fe5c806bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5c6ffd640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009980 tx=0x7fe5bc032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc040020 con 0x7fe5c8103c70 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5bc030dd0 con 0x7fe5c8103c70 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c81a2010 con 0x7fe5c8103c70 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc037040 con 0x7fe5c8103c70 2024-04-30T23:10:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.005+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c81a2550 con 0x7fe5c8103c70 2024-04-30T23:10:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.006+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c8107780 con 0x7fe5c8103c70 2024-04-30T23:10:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.008+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe5bc043020 con 0x7fe5c8103c70 2024-04-30T23:10:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.008+0000 7fe5c4ff9640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 0x7fe5b00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.008+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 0x7fe5b00a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.008+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe5bc0f03e0 con 0x7fe5c8103c70 2024-04-30T23:10:57.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.009+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 0x7fe5b00a6140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8103630 tx=0x7fe5b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.012+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5bc04a020 con 0x7fe5c8103c70 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:57.016 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:56 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/248178704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:57.032 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:57.032 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.032 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.032 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:10:57.033 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:56 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/248178704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:10:57.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.199+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5c802dd20 con 0x7fe5c8103c70 2024-04-30T23:10:57.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.200+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/1667911787 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fe5bc0bd2e0 con 0x7fe5c8103c70 2024-04-30T23:10:57.199 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:10:57.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 msgr2=0x7fe5b00a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 0x7fe5b00a6140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8103630 tx=0x7fe5b8009260 comp rx=0 tx=0).stop 2024-04-30T23:10:57.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 msgr2=0x7fe5c819eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009980 tx=0x7fe5bc032dc0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 shutdown_connections 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3c30 0x7fe5b00a6140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8108970 0x7fe5c81a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c70 0x7fe5c819eff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 --2- 172.21.15.100:0/1667911787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a30 0x7fe5c806bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 >> 172.21.15.100:0/1667911787 conn(0x7fe5c80fdc40 msgr2=0x7fe5c8104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 shutdown_connections 2024-04-30T23:10:57.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.202+0000 7fe5cdfd7640 1 -- 172.21.15.100:0/1667911787 wait complete. 2024-04-30T23:10:57.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T23:10:57.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 -- 172.21.15.100:0/2470906516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 msgr2=0x7ff208104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/2470906516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff208104090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009900 tx=0x7ff1f802a410 comp rx=0 tx=0).stop 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 -- 172.21.15.100:0/2470906516 shutdown_connections 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/2470906516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 0x7ff20810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/2470906516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff208104090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/2470906516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 0x7ff208103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 -- 172.21.15.100:0/2470906516 >> 172.21.15.100:0/2470906516 conn(0x7ff2080fdc30 msgr2=0x7ff2081000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 -- 172.21.15.100:0/2470906516 shutdown_connections 2024-04-30T23:10:57.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.321+0000 7ff20cd5e640 1 -- 172.21.15.100:0/2470906516 wait complete. 2024-04-30T23:10:57.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 Processor -- start 2024-04-30T23:10:57.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 -- start start 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 0x7ff20819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 0x7ff2081a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff20810f670 con 0x7ff208103c80 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff20810f4f0 con 0x7ff208108980 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20cd5e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff20810f7f0 con 0x7ff208102a40 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54736/0 (socket says 172.21.15.100:54736) 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 -- 172.21.15.100:0/1770231940 learned_addr learned my addr 172.21.15.100:0/1770231940 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff206d9d640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 0x7ff2081a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff20659c640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 0x7ff20819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 -- 172.21.15.100:0/1770231940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 msgr2=0x7ff20819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 0x7ff20819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 -- 172.21.15.100:0/1770231940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 msgr2=0x7ff2081a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 0x7ff2081a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 -- 172.21.15.100:0/1770231940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2081a1d60 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.322+0000 7ff205d9b640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8006010 tx=0x7ff1f8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.323+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f803f030 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.323+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1f8003cb0 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.323+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2081a1ff0 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.323+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8035070 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.323+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2081a2400 con 0x7ff208103c80 2024-04-30T23:10:57.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.324+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff208107790 con 0x7ff208103c80 2024-04-30T23:10:57.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.325+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff1f8042030 con 0x7ff208103c80 2024-04-30T23:10:57.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.326+0000 7ff1f77fe640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 0x7ff1f00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.326+0000 7ff20659c640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 0x7ff1f00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.326+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff1f80f0c60 con 0x7ff208103c80 2024-04-30T23:10:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.326+0000 7ff20659c640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 0x7ff1f00a60c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005d00 tx=0x7ff1fc005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.329+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1f80bdae0 con 0x7ff208103c80 2024-04-30T23:10:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.530+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff20802dd60 con 0x7ff208103c80 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.530+0000 7ff1f77fe640 1 -- 172.21.15.100:0/1770231940 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7ff1f8003e60 con 0x7ff208103c80 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-04-30T23:10:57.530 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-04-30T23:10:57.531 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:10:57.531 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 msgr2=0x7ff1f00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 0x7ff1f00a60c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005d00 tx=0x7ff1fc005c50 comp rx=0 tx=0).stop 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 msgr2=0x7ff20819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8006010 tx=0x7ff1f8004340 comp rx=0 tx=0).stop 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 shutdown_connections 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1f00a3bb0 0x7ff1f00a60c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff208108980 0x7ff2081a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff208103c80 0x7ff20819a760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 --2- 172.21.15.100:0/1770231940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff208102a40 0x7ff20819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 >> 172.21.15.100:0/1770231940 conn(0x7ff2080fdc30 msgr2=0x7ff208104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 shutdown_connections 2024-04-30T23:10:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.532+0000 7ff20cd5e640 1 -- 172.21.15.100:0/1770231940 wait complete. 2024-04-30T23:10:57.543 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T23:10:57.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 -- 172.21.15.100:0/4220173199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 msgr2=0x7fe778104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/4220173199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe778104820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe768009900 tx=0x7fe76802a410 comp rx=0 tx=0).stop 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 -- 172.21.15.100:0/4220173199 shutdown_connections 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/4220173199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778109a60 0x7fe77810be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/4220173199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778104d60 0x7fe778105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/4220173199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe778104820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 -- 172.21.15.100:0/4220173199 >> 172.21.15.100:0/4220173199 conn(0x7fe7780fed10 msgr2=0x7fe7781011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 -- 172.21.15.100:0/4220173199 shutdown_connections 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.674+0000 7fe77f7b2640 1 -- 172.21.15.100:0/4220173199 wait complete. 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 Processor -- start 2024-04-30T23:10:57.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 -- start start 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 0x7fe77819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778109a60 0x7fe7781a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f620 con 0x7fe778103b20 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f4a0 con 0x7fe778104d60 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77f7b2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f7a0 con 0x7fe778109a60 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54750/0 (socket says 172.21.15.100:54750) 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 -- 172.21.15.100:0/3087180695 learned_addr learned my addr 172.21.15.100:0/3087180695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77cd4d640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 0x7fe77819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77dd4f640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778109a60 0x7fe7781a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 -- 172.21.15.100:0/3087180695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778109a60 msgr2=0x7fe7781a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778109a60 0x7fe7781a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 -- 172.21.15.100:0/3087180695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 msgr2=0x7fe77819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 0x7fe77819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77d54e640 1 -- 172.21.15.100:0/3087180695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7781a1db0 con 0x7fe778103b20 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.675+0000 7fe77cd4d640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 0x7fe77819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe77d54e640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe768006010 tx=0x7fe768004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76803f030 con 0x7fe778103b20 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781a2040 con 0x7fe778103b20 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe768031910 con 0x7fe778103b20 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768035070 con 0x7fe778103b20 2024-04-30T23:10:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.676+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a2580 con 0x7fe778103b20 2024-04-30T23:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.677+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778108870 con 0x7fe778103b20 2024-04-30T23:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.679+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe768042030 con 0x7fe778103b20 2024-04-30T23:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.680+0000 7fe76e7fc640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 0x7fe7640a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.680+0000 7fe77cd4d640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 0x7fe7640a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.680+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe7680f0650 con 0x7fe778103b20 2024-04-30T23:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.680+0000 7fe77cd4d640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 0x7fe7640a60c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe77819b310 tx=0x7fe774005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:57.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.685+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe7680bce80 con 0x7fe778103b20 2024-04-30T23:10:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2190941569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1667911787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:57 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1770231940' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-30T23:10:57.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:57.896+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe77802db90 con 0x7fe778103b20 2024-04-30T23:10:58.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2190941569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:58.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1667911787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:58.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:57 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1770231940' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-30T23:10:58.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2190941569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:10:58.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1667911787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:10:58.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:57 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1770231940' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-30T23:10:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.871+0000 7fe76e7fc640 1 -- 172.21.15.100:0/3087180695 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fe7680c1180 con 0x7fe778103b20 2024-04-30T23:10:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 msgr2=0x7fe7640a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 0x7fe7640a60c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe77819b310 tx=0x7fe774005f90 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 msgr2=0x7fe77819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe768006010 tx=0x7fe768004270 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 shutdown_connections 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe7640a3bb0 0x7fe7640a60c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe778109a60 0x7fe7781a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe778104d60 0x7fe77819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 --2- 172.21.15.100:0/3087180695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe778103b20 0x7fe77819a270 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 >> 172.21.15.100:0/3087180695 conn(0x7fe7780fed10 msgr2=0x7fe778105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 shutdown_connections 2024-04-30T23:10:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:58.874+0000 7fe77f7b2640 1 -- 172.21.15.100:0/3087180695 wait complete. 2024-04-30T23:10:58.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-30T23:10:58.912 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:58.912 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.912 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.912 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:58.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:58 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-30T23:10:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 -- 172.21.15.100:0/3214726608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70108980 msgr2=0x7fca7010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 --2- 172.21.15.100:0/3214726608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70108980 0x7fca7010ada0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca68009ca0 tx=0x7fca6802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 -- 172.21.15.100:0/3214726608 shutdown_connections 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 --2- 172.21.15.100:0/3214726608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70108980 0x7fca7010ada0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 --2- 172.21.15.100:0/3214726608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70103c80 0x7fca70104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 --2- 172.21.15.100:0/3214726608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 0x7fca70103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 -- 172.21.15.100:0/3214726608 >> 172.21.15.100:0/3214726608 conn(0x7fca700fdc30 msgr2=0x7fca701000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 -- 172.21.15.100:0/3214726608 shutdown_connections 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.010+0000 7fca7657e640 1 -- 172.21.15.100:0/3214726608 wait complete. 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 Processor -- start 2024-04-30T23:10:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 -- start start 2024-04-30T23:10:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 0x7fca7019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70108980 0x7fca701a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010f670 con 0x7fca70103c80 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010f4f0 con 0x7fca70108980 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.011+0000 7fca7657e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010f7f0 con 0x7fca70102a40 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54776/0 (socket says 172.21.15.100:54776) 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 -- 172.21.15.100:0/825417536 learned_addr learned my addr 172.21.15.100:0/825417536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6ffff640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 0x7fca7019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca74b1b640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70108980 0x7fca701a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 -- 172.21.15.100:0/825417536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 msgr2=0x7fca7019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 0x7fca7019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 -- 172.21.15.100:0/825417536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70108980 msgr2=0x7fca701a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70108980 0x7fca701a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 -- 172.21.15.100:0/825417536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701a1cd0 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6f7fe640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca5800d950 tx=0x7fca5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58017030 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca58004020 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701a1fc0 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca580047a0 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.012+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a2430 con 0x7fca70103c80 2024-04-30T23:10:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.013+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca70107790 con 0x7fca70103c80 2024-04-30T23:10:59.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.015+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fca58009a30 con 0x7fca70103c80 2024-04-30T23:10:59.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.016+0000 7fca6d7fa640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 0x7fca5c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:10:59.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.016+0000 7fca6ffff640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 0x7fca5c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:10:59.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.016+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7fca580d02c0 con 0x7fca70103c80 2024-04-30T23:10:59.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.016+0000 7fca6ffff640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 0x7fca5c0a60c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca60005fd0 tx=0x7fca60005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:10:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.020+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca5809cf30 con 0x7fca70103c80 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:58 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-30T23:10:59.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:10:59.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:10:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:58 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-30T23:10:59.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.198+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fca7002db90 con 0x7fca70103c80 2024-04-30T23:10:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.877+0000 7fca6d7fa640 1 -- 172.21.15.100:0/825417536 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7fca5809c830 con 0x7fca70103c80 2024-04-30T23:10:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-04-30T23:10:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 msgr2=0x7fca5c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 0x7fca5c0a60c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca60005fd0 tx=0x7fca60005850 comp rx=0 tx=0).stop 2024-04-30T23:10:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 msgr2=0x7fca7019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca5800d950 tx=0x7fca5800de10 comp rx=0 tx=0).stop 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 shutdown_connections 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca5c0a3bb0 0x7fca5c0a60c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca70108980 0x7fca701a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70103c80 0x7fca7019a6d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 --2- 172.21.15.100:0/825417536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca70102a40 0x7fca7019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:10:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.880+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 >> 172.21.15.100:0/825417536 conn(0x7fca700fdc30 msgr2=0x7fca70104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:10:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.881+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 shutdown_connections 2024-04-30T23:10:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:10:59.881+0000 7fca7657e640 1 -- 172.21.15.100:0/825417536 wait complete. 2024-04-30T23:10:59.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 -- 172.21.15.100:0/2638014680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 msgr2=0x7fd650104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 --2- 172.21.15.100:0/2638014680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd650104070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd640009900 tx=0x7fd64002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 -- 172.21.15.100:0/2638014680 shutdown_connections 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 --2- 172.21.15.100:0/2638014680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 0x7fd65010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 --2- 172.21.15.100:0/2638014680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd650104070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 --2- 172.21.15.100:0/2638014680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 0x7fd650103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 -- 172.21.15.100:0/2638014680 >> 172.21.15.100:0/2638014680 conn(0x7fd6500fdc10 msgr2=0x7fd6501000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 -- 172.21.15.100:0/2638014680 shutdown_connections 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.053+0000 7fd65814d640 1 -- 172.21.15.100:0/2638014680 wait complete. 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 Processor -- start 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 -- start start 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 0x7fd65006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 0x7fd6501a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd65010e520 con 0x7fd650103c60 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd65010e3a0 con 0x7fd650108960 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd65814d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd65010e6a0 con 0x7fd650102a20 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd6556e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:00.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd6556e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54800/0 (socket says 172.21.15.100:54800) 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd6556e8640 1 -- 172.21.15.100:0/2034505009 learned_addr learned my addr 172.21.15.100:0/2034505009 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd655ee9640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 0x7fd65006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.054+0000 7fd6566ea640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 0x7fd6501a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 -- 172.21.15.100:0/2034505009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 msgr2=0x7fd65006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 0x7fd65006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 -- 172.21.15.100:0/2034505009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 msgr2=0x7fd6501a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 0x7fd6501a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 -- 172.21.15.100:0/2034505009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6501a20b0 con 0x7fd650103c60 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd6556e8640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd640006010 tx=0x7fd640004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64003f030 con 0x7fd650103c60 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6501a2340 con 0x7fd650103c60 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd640003cb0 con 0x7fd650103c60 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640035070 con 0x7fd650103c60 2024-04-30T23:11:00.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.055+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6501a2880 con 0x7fd650103c60 2024-04-30T23:11:00.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.056+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd650107770 con 0x7fd650103c60 2024-04-30T23:11:00.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.058+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd640042030 con 0x7fd650103c60 2024-04-30T23:11:00.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.058+0000 7fd646ffd640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 0x7fd63c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:00.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.058+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7fd6400f0ea0 con 0x7fd650103c60 2024-04-30T23:11:00.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.058+0000 7fd655ee9640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 0x7fd63c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:00.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.059+0000 7fd655ee9640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 0x7fd63c0a60c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd650103620 tx=0x7fd64c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.062+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd640003e60 con 0x7fd650103c60 2024-04-30T23:11:00.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:59 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-30T23:11:00.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:59 smithi100 ceph-mon[29745]: osdmap e82: 12 total, 12 up, 12 in 2024-04-30T23:11:00.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:59 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-30T23:11:00.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:10:59 smithi100 ceph-mon[29745]: pgmap v284: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:00.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.288+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd65006c2e0 con 0x7fd650103c60 2024-04-30T23:11:00.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:59 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-30T23:11:00.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:59 smithi104 ceph-mon[32987]: osdmap e82: 12 total, 12 up, 12 in 2024-04-30T23:11:00.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:59 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-30T23:11:00.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:10:59 smithi104 ceph-mon[32987]: pgmap v284: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:00.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:59 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3087180695' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-30T23:11:00.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:59 smithi183 ceph-mon[33560]: osdmap e82: 12 total, 12 up, 12 in 2024-04-30T23:11:00.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:59 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-30T23:11:00.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:10:59 smithi183 ceph-mon[33560]: pgmap v284: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.880+0000 7fd646ffd640 1 -- 172.21.15.100:0/2034505009 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fd6400bd3e0 con 0x7fd650103c60 2024-04-30T23:11:00.880 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-04-30T23:11:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.883+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 msgr2=0x7fd63c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.883+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 0x7fd63c0a60c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd650103620 tx=0x7fd64c00b390 comp rx=0 tx=0).stop 2024-04-30T23:11:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.883+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 msgr2=0x7fd65019f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.883+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd640006010 tx=0x7fd640004340 comp rx=0 tx=0).stop 2024-04-30T23:11:00.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 shutdown_connections 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd63c0a3bb0 0x7fd63c0a60c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd650108960 0x7fd6501a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd650103c60 0x7fd65019f390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 --2- 172.21.15.100:0/2034505009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd650102a20 0x7fd65006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 >> 172.21.15.100:0/2034505009 conn(0x7fd6500fdc10 msgr2=0x7fd650104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 shutdown_connections 2024-04-30T23:11:00.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:00.884+0000 7fd65814d640 1 -- 172.21.15.100:0/2034505009 wait complete. 2024-04-30T23:11:00.902 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-30T23:11:00.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-30T23:11:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 -- 172.21.15.100:0/1452026557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0103c70 msgr2=0x7f28e0104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 --2- 172.21.15.100:0/1452026557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0103c70 0x7f28e0104080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009900 tx=0x7f28d402a410 comp rx=0 tx=0).stop 2024-04-30T23:11:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 -- 172.21.15.100:0/1452026557 shutdown_connections 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 --2- 172.21.15.100:0/1452026557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0108970 0x7f28e010ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 --2- 172.21.15.100:0/1452026557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0103c70 0x7f28e0104080 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 --2- 172.21.15.100:0/1452026557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 0x7f28e0103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 -- 172.21.15.100:0/1452026557 >> 172.21.15.100:0/1452026557 conn(0x7f28e00fdc00 msgr2=0x7f28e01000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 -- 172.21.15.100:0/1452026557 shutdown_connections 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.024+0000 7f28e6013640 1 -- 172.21.15.100:0/1452026557 wait complete. 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 Processor -- start 2024-04-30T23:11:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 -- start start 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 0x7f28e0199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0103c70 0x7f28e01996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010e550 con 0x7f28e0108970 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010e3d0 con 0x7f28e0103c70 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28e6013640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010e6d0 con 0x7f28e0102a30 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54808/0 (socket says 172.21.15.100:54808) 2024-04-30T23:11:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28dffff640 1 -- 172.21.15.100:0/1941535342 learned_addr learned my addr 172.21.15.100:0/1941535342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.025+0000 7f28deffd640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0103c70 0x7f28e01996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28df7fe640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 0x7f28e0199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 -- 172.21.15.100:0/1941535342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 msgr2=0x7f28e0199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 0x7f28e0199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 -- 172.21.15.100:0/1941535342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0103c70 msgr2=0x7f28e01996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0103c70 0x7f28e01996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 -- 172.21.15.100:0/1941535342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e01a0cc0 con 0x7f28e0108970 2024-04-30T23:11:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dffff640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28d800eaa0 tx=0x7f28d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d800cdb0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28d8005020 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e01a0fb0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80116d0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.026+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e01a13c0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.027+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e006a1a0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.028+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f28d80051d0 con 0x7f28e0108970 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.029+0000 7f28dcff9640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 0x7f28c80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.029+0000 7f28df7fe640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 0x7f28c80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.029+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f28d80d08a0 con 0x7f28e0108970 2024-04-30T23:11:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.030+0000 7f28df7fe640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 0x7f28c80a60c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28d00058c0 tx=0x7f28d000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.033+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f28d8016030 con 0x7f28e0108970 2024-04-30T23:11:01.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.220+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f28e0107780 con 0x7f28e0108970 2024-04-30T23:11:01.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:00 smithi104 ceph-mon[32987]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:01.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:00 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-30T23:11:01.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:00 smithi104 ceph-mon[32987]: osdmap e83: 12 total, 12 up, 12 in 2024-04-30T23:11:01.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:00 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-30T23:11:01.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:00 smithi104 ceph-mon[32987]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-30T23:11:01.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:00 smithi183 ceph-mon[33560]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:01.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:00 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-30T23:11:01.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:00 smithi183 ceph-mon[33560]: osdmap e83: 12 total, 12 up, 12 in 2024-04-30T23:11:01.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:00 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-30T23:11:01.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:00 smithi183 ceph-mon[33560]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-30T23:11:01.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:00 smithi100 ceph-mon[29745]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:01.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:00 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/825417536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-30T23:11:01.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:00 smithi100 ceph-mon[29745]: osdmap e83: 12 total, 12 up, 12 in 2024-04-30T23:11:01.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:00 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-30T23:11:01.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:00 smithi100 ceph-mon[29745]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-30T23:11:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.898+0000 7f28dcff9640 1 -- 172.21.15.100:0/1941535342 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f28e0107780 con 0x7f28e0108970 2024-04-30T23:11:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 msgr2=0x7f28c80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 0x7f28c80a60c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28d00058c0 tx=0x7f28d000a4c0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 msgr2=0x7f28e01a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28d800eaa0 tx=0x7f28d800ef60 comp rx=0 tx=0).stop 2024-04-30T23:11:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 shutdown_connections 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f28c80a3bb0 0x7f28c80a60c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28e0108970 0x7f28e01a0650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28e0103c70 0x7f28e01996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 --2- 172.21.15.100:0/1941535342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28e0102a30 0x7f28e0199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.902+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 >> 172.21.15.100:0/1941535342 conn(0x7f28e00fdc00 msgr2=0x7f28e0104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.903+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 shutdown_connections 2024-04-30T23:11:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:01.903+0000 7f28e6013640 1 -- 172.21.15.100:0/1941535342 wait complete. 2024-04-30T23:11:01.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 -- 172.21.15.100:0/379275134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 msgr2=0x7fcde4103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 --2- 172.21.15.100:0/379275134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde4103e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009900 tx=0x7fcdd402a410 comp rx=0 tx=0).stop 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 -- 172.21.15.100:0/379275134 shutdown_connections 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 --2- 172.21.15.100:0/379275134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 --2- 172.21.15.100:0/379275134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde4103e40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:02.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 --2- 172.21.15.100:0/379275134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 0x7fcde41033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:02.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 -- 172.21.15.100:0/379275134 >> 172.21.15.100:0/379275134 conn(0x7fcde40fd3b0 msgr2=0x7fcde40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:02.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 -- 172.21.15.100:0/379275134 shutdown_connections 2024-04-30T23:11:02.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.035+0000 7fcde8947640 1 -- 172.21.15.100:0/379275134 wait complete. 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 Processor -- start 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 -- start start 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 0x7fcde410d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcde410f6b0 con 0x7fcde4103990 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcde410f530 con 0x7fcde41044d0 2024-04-30T23:11:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde8947640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcde410f830 con 0x7fcde4102fb0 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54822/0 (socket says 172.21.15.100:54822) 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.036+0000 7fcde1d9b640 1 -- 172.21.15.100:0/152533800 learned_addr learned my addr 172.21.15.100:0/152533800 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde259c640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 0x7fcde410d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde2d9d640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 -- 172.21.15.100:0/152533800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 msgr2=0x7fcde410d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 0x7fcde410d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 -- 172.21.15.100:0/152533800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 msgr2=0x7fcde410bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 -- 172.21.15.100:0/152533800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde410c640 con 0x7fcde4103990 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde2d9d640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde1d9b640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006010 tx=0x7fcdd40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd403f030 con 0x7fcde4103990 2024-04-30T23:11:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd4003cb0 con 0x7fcde4103990 2024-04-30T23:11:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde41a4310 con 0x7fcde4103990 2024-04-30T23:11:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4035070 con 0x7fcde4103990 2024-04-30T23:11:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.037+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41a4710 con 0x7fcde4103990 2024-04-30T23:11:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.038+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde406a240 con 0x7fcde4103990 2024-04-30T23:11:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.039+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fcdd4042030 con 0x7fcde4103990 2024-04-30T23:11:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.040+0000 7fcdd37fe640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 0x7fcdcc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.040+0000 7fcde259c640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 0x7fcdcc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.040+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fcdd40f0c80 con 0x7fcde4103990 2024-04-30T23:11:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.040+0000 7fcde259c640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 0x7fcdcc0a60c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8005fd0 tx=0x7fcdd8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.045+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcdd40bd630 con 0x7fcde4103990 2024-04-30T23:11:02.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:02.222+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcde40637e0 con 0x7fcde4103990 2024-04-30T23:11:02.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-30T23:11:02.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: osdmap e84: 12 total, 12 up, 12 in 2024-04-30T23:11:02.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-30T23:11:02.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-30T23:11:02.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-30T23:11:02.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:01 smithi104 ceph-mon[32987]: pgmap v287: 97 pgs: 14 active+clean, 40 creating+peering, 43 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:02.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-30T23:11:02.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: osdmap e84: 12 total, 12 up, 12 in 2024-04-30T23:11:02.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-30T23:11:02.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-30T23:11:02.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-30T23:11:02.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:01 smithi183 ceph-mon[33560]: pgmap v287: 97 pgs: 14 active+clean, 40 creating+peering, 43 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:02.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2034505009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-30T23:11:02.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: osdmap e84: 12 total, 12 up, 12 in 2024-04-30T23:11:02.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-30T23:11:02.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-30T23:11:02.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-30T23:11:02.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:01 smithi100 ceph-mon[29745]: pgmap v287: 97 pgs: 14 active+clean, 40 creating+peering, 43 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:11:03.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:03.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: Cluster is now healthy 2024-04-30T23:11:03.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:active 2024-04-30T23:11:03.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:03.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-30T23:11:03.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: osdmap e85: 12 total, 12 up, 12 in 2024-04-30T23:11:03.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:02 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: Cluster is now healthy 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:active 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-30T23:11:03.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: osdmap e85: 12 total, 12 up, 12 in 2024-04-30T23:11:03.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:02 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: Cluster is now healthy 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] up:active 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1941535342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: osdmap e85: 12 total, 12 up, 12 in 2024-04-30T23:11:03.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:02 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-30T23:11:03.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.901+0000 7fcdd37fe640 1 -- 172.21.15.100:0/152533800 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7fcdd40bcf30 con 0x7fcde4103990 2024-04-30T23:11:03.901 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' created 2024-04-30T23:11:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.903+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 msgr2=0x7fcdcc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.903+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 0x7fcdcc0a60c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8005fd0 tx=0x7fcdd8005e20 comp rx=0 tx=0).stop 2024-04-30T23:11:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.903+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 msgr2=0x7fcde410b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.903+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006010 tx=0x7fcdd40043b0 comp rx=0 tx=0).stop 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 shutdown_connections 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcdcc0a3bb0 0x7fcdcc0a60c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcde41044d0 0x7fcde410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde4103990 0x7fcde410b9d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 --2- 172.21.15.100:0/152533800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcde4102fb0 0x7fcde410d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 >> 172.21.15.100:0/152533800 conn(0x7fcde40fd3b0 msgr2=0x7fcde4104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 shutdown_connections 2024-04-30T23:11:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:03.904+0000 7fcde8947640 1 -- 172.21.15.100:0/152533800 wait complete. 2024-04-30T23:11:03.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-30T23:11:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 -- 172.21.15.100:0/241472376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 msgr2=0x7ff3b810ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 --2- 172.21.15.100:0/241472376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b810ad80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009ca0 tx=0x7ff3b002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 -- 172.21.15.100:0/241472376 shutdown_connections 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 --2- 172.21.15.100:0/241472376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b810ad80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 --2- 172.21.15.100:0/241472376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 0x7ff3b8104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 --2- 172.21.15.100:0/241472376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 0x7ff3b8103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.040+0000 7ff3bed76640 1 -- 172.21.15.100:0/241472376 >> 172.21.15.100:0/241472376 conn(0x7ff3b80fdc10 msgr2=0x7ff3b81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- 172.21.15.100:0/241472376 shutdown_connections 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- 172.21.15.100:0/241472376 wait complete. 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 Processor -- start 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- start start 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 0x7ff3b819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 0x7ff3b819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b810e550 con 0x7ff3b8108960 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b810e3d0 con 0x7ff3b8103c60 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bed76640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b810e6d0 con 0x7ff3b8102a20 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bd313640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bd313640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38206/0 (socket says 172.21.15.100:38206) 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.041+0000 7ff3bd313640 1 -- 172.21.15.100:0/1531316669 learned_addr learned my addr 172.21.15.100:0/1531316669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bcb12640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 0x7ff3b819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3b7fff640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 0x7ff3b819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 -- 172.21.15.100:0/1531316669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 msgr2=0x7ff3b819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 0x7ff3b819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 -- 172.21.15.100:0/1531316669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 msgr2=0x7ff3b819a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 0x7ff3b819a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 -- 172.21.15.100:0/1531316669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b81a1e00 con 0x7ff3b8108960 2024-04-30T23:11:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bd313640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0006010 tx=0x7ff3b002f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0003c70 con 0x7ff3b8108960 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b0003e10 con 0x7ff3b8108960 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b81a2090 con 0x7ff3b8108960 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b002fcc0 con 0x7ff3b8108960 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.042+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b81a2630 con 0x7ff3b8108960 2024-04-30T23:11:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.043+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b81a2890 con 0x7ff3b8108960 2024-04-30T23:11:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.045+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff3b0004710 con 0x7ff3b8108960 2024-04-30T23:11:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.045+0000 7ff3b5ffb640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 0x7ff3a00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.045+0000 7ff3bcb12640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 0x7ff3a00a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.045+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7ff3b00f1f60 con 0x7ff3b8108960 2024-04-30T23:11:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.046+0000 7ff3bcb12640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 0x7ff3a00a6140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8005fd0 tx=0x7ff3a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:04.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.049+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3b00be720 con 0x7ff3b8108960 2024-04-30T23:11:04.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.228+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff3b81a2a60 con 0x7ff3b8108960 2024-04-30T23:11:04.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:03 smithi104 ceph-mon[32987]: osdmap e86: 12 total, 12 up, 12 in 2024-04-30T23:11:04.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:03 smithi104 ceph-mon[32987]: pgmap v290: 97 pgs: 42 active+clean, 40 creating+peering, 15 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-04-30T23:11:04.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:03 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-30T23:11:04.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:03 smithi104 ceph-mon[32987]: osdmap e87: 12 total, 12 up, 12 in 2024-04-30T23:11:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:03 smithi183 ceph-mon[33560]: osdmap e86: 12 total, 12 up, 12 in 2024-04-30T23:11:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:03 smithi183 ceph-mon[33560]: pgmap v290: 97 pgs: 42 active+clean, 40 creating+peering, 15 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-04-30T23:11:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:03 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-30T23:11:04.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:03 smithi183 ceph-mon[33560]: osdmap e87: 12 total, 12 up, 12 in 2024-04-30T23:11:04.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:03 smithi100 ceph-mon[29745]: osdmap e86: 12 total, 12 up, 12 in 2024-04-30T23:11:04.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:03 smithi100 ceph-mon[29745]: pgmap v290: 97 pgs: 42 active+clean, 40 creating+peering, 15 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-04-30T23:11:04.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:03 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/152533800' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-30T23:11:04.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:03 smithi100 ceph-mon[29745]: osdmap e87: 12 total, 12 up, 12 in 2024-04-30T23:11:04.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.902+0000 7ff3b5ffb640 1 -- 172.21.15.100:0/1531316669 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7ff3b00be020 con 0x7ff3b8108960 2024-04-30T23:11:04.903 INFO:teuthology.orchestra.run.smithi100.stderr:set pool 4 allow_ec_overwrites to true 2024-04-30T23:11:04.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 msgr2=0x7ff3a00a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 0x7ff3a00a6140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8005fd0 tx=0x7ff3a800b390 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 msgr2=0x7ff3b81a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0006010 tx=0x7ff3b002f3e0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 shutdown_connections 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff3a00a3c30 0x7ff3a00a6140 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8108960 0x7ff3b81a1790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3b8103c60 0x7ff3b819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 --2- 172.21.15.100:0/1531316669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b8102a20 0x7ff3b819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 >> 172.21.15.100:0/1531316669 conn(0x7ff3b80fdc10 msgr2=0x7ff3b8109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 shutdown_connections 2024-04-30T23:11:04.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:04.905+0000 7ff3bed76640 1 -- 172.21.15.100:0/1531316669 wait complete. 2024-04-30T23:11:04.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-30T23:11:04.929 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:11:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: 2024-04-30T23:11:04.641+0000 7f1ae5f84700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T23:11:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.043+0000 7f8f67896640 1 -- 172.21.15.100:0/2493412933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 msgr2=0x7f8f60105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.043+0000 7f8f67896640 1 --2- 172.21.15.100:0/2493412933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f60105190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009900 tx=0x7f8f5002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.043+0000 7f8f67896640 1 -- 172.21.15.100:0/2493412933 shutdown_connections 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.043+0000 7f8f67896640 1 --2- 172.21.15.100:0/2493412933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60109a80 0x7f8f6010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 --2- 172.21.15.100:0/2493412933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f60105190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 --2- 172.21.15.100:0/2493412933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60103b40 0x7f8f60104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- 172.21.15.100:0/2493412933 >> 172.21.15.100:0/2493412933 conn(0x7f8f600fed50 msgr2=0x7f8f601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- 172.21.15.100:0/2493412933 shutdown_connections 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- 172.21.15.100:0/2493412933 wait complete. 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 Processor -- start 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- start start 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60103b40 0x7f8f6019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60109a80 0x7f8f601a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6010f6c0 con 0x7f8f60104d80 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6010f540 con 0x7f8f60103b40 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f67896640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6010f840 con 0x7f8f60109a80 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.044+0000 7f8f64e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38228/0 (socket says 172.21.15.100:38228) 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 -- 172.21.15.100:0/2824994433 learned_addr learned my addr 172.21.15.100:0/2824994433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f65e33640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60109a80 0x7f8f601a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f65632640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60103b40 0x7f8f6019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 -- 172.21.15.100:0/2824994433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60109a80 msgr2=0x7f8f601a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60109a80 0x7f8f601a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 -- 172.21.15.100:0/2824994433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60103b40 msgr2=0x7f8f6019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60103b40 0x7f8f6019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 -- 172.21.15.100:0/2824994433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f601a40f0 con 0x7f8f60104d80 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f64e31640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f50006010 tx=0x7f8f50004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5003f030 con 0x7f8f60104d80 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f50003cb0 con 0x7f8f60104d80 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f601a4380 con 0x7f8f60104d80 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50035070 con 0x7f8f60104d80 2024-04-30T23:11:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.045+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f601a48c0 con 0x7f8f60104d80 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.046+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f601a4b20 con 0x7f8f60104d80 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.048+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8f50042030 con 0x7f8f60104d80 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.048+0000 7f8f567fc640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 0x7f8f4c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.049+0000 7f8f65632640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 0x7f8f4c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.049+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f8f500f0ea0 con 0x7f8f60104d80 2024-04-30T23:11:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.049+0000 7f8f65632640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 0x7f8f4c0a6140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f60104740 tx=0x7f8f5c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:05.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.052+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8f500bd660 con 0x7f8f60104d80 2024-04-30T23:11:05.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.268+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8f601a4cf0 con 0x7f8f60104d80 2024-04-30T23:11:05.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:04 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-30T23:11:05.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:04 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-30T23:11:05.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:04 smithi104 ceph-mon[32987]: osdmap e88: 12 total, 12 up, 12 in 2024-04-30T23:11:05.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:04 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-30T23:11:05.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:04 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-30T23:11:05.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:04 smithi183 ceph-mon[33560]: osdmap e88: 12 total, 12 up, 12 in 2024-04-30T23:11:05.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:04 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-30T23:11:05.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:04 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1531316669' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-30T23:11:05.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:04 smithi100 ceph-mon[29745]: osdmap e88: 12 total, 12 up, 12 in 2024-04-30T23:11:05.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.937+0000 7f8f567fc640 1 -- 172.21.15.100:0/2824994433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7f8f500bcf60 con 0x7f8f60104d80 2024-04-30T23:11:05.938 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 4 to fsmap 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 msgr2=0x7f8f4c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 0x7f8f4c0a6140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f60104740 tx=0x7f8f5c008040 comp rx=0 tx=0).stop 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 msgr2=0x7f8f6019caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f50006010 tx=0x7f8f50004340 comp rx=0 tx=0).stop 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 shutdown_connections 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f4c0a3c30 0x7f8f4c0a6140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f60109a80 0x7f8f601a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f60104d80 0x7f8f6019caf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 --2- 172.21.15.100:0/2824994433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f60103b40 0x7f8f6019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 >> 172.21.15.100:0/2824994433 conn(0x7f8f600fed50 msgr2=0x7f8f600ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 shutdown_connections 2024-04-30T23:11:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:05.940+0000 7f8f67896640 1 -- 172.21.15.100:0/2824994433 wait complete. 2024-04-30T23:11:05.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:11:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 -- 172.21.15.100:0/1847245196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801080e0 msgr2=0x7ff88010a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1847245196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801080e0 0x7ff88010a500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff878009900 tx=0x7ff87802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 -- 172.21.15.100:0/1847245196 shutdown_connections 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1847245196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801080e0 0x7ff88010a500 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1847245196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801033e0 0x7ff8801037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1847245196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801021a0 0x7ff880102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 -- 172.21.15.100:0/1847245196 >> 172.21.15.100:0/1847245196 conn(0x7ff8800fd370 msgr2=0x7ff8800ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 -- 172.21.15.100:0/1847245196 shutdown_connections 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.066+0000 7ff884bb5640 1 -- 172.21.15.100:0/1847245196 wait complete. 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 Processor -- start 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 -- start start 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801021a0 0x7ff88019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801080e0 0x7ff8801a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010f640 con 0x7ff8801033e0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010f4c0 con 0x7ff8801021a0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff884bb5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010f7c0 con 0x7ff8801080e0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38246/0 (socket says 172.21.15.100:38246) 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 -- 172.21.15.100:0/1972104663 learned_addr learned my addr 172.21.15.100:0/1972104663 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87e59c640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801021a0 0x7ff88019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87ed9d640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801080e0 0x7ff8801a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 -- 172.21.15.100:0/1972104663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801080e0 msgr2=0x7ff8801a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801080e0 0x7ff8801a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 -- 172.21.15.100:0/1972104663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801021a0 msgr2=0x7ff88019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801021a0 0x7ff88019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 -- 172.21.15.100:0/1972104663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8801a1d30 con 0x7ff8801033e0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff87dd9b640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d950 tx=0x7ff87400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874017030 con 0x7ff8801033e0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.067+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff874004020 con 0x7ff8801033e0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.068+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8801a1fc0 con 0x7ff8801033e0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.068+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740047a0 con 0x7ff8801033e0 2024-04-30T23:11:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.068+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8801a24b0 con 0x7ff8801033e0 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.069+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff880069350 con 0x7ff8801033e0 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.070+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff874009a30 con 0x7ff8801033e0 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.070+0000 7ff86f7fe640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 0x7ff8680a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.070+0000 7ff87e59c640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 0x7ff8680a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.070+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff8740d0140 con 0x7ff8801033e0 2024-04-30T23:11:06.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.071+0000 7ff87e59c640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 0x7ff8680a60c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff880102da0 tx=0x7ff870009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.075+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff87409c8e0 con 0x7ff8801033e0 2024-04-30T23:11:06.202 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:05 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-30T23:11:06.202 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:05 smithi183 ceph-mon[33560]: pgmap v293: 129 pgs: 74 active+clean, 36 creating+peering, 19 unknown; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-04-30T23:11:06.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.290+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff880106ef0 con 0x7ff8801033e0 2024-04-30T23:11:06.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.291+0000 7ff86f7fe640 1 -- 172.21.15.100:0/1972104663 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11821 (secure 0 0 0) 0x7ff87409c1e0 con 0x7ff8801033e0 2024-04-30T23:11:06.291 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:06.292 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:05.270526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24545,"qdb_cluster":[24545]},"id":1}]} 2024-04-30T23:11:06.292 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-04-30T23:11:06.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 msgr2=0x7ff8680a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 0x7ff8680a60c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff880102da0 tx=0x7ff870009870 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 msgr2=0x7ff88019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d950 tx=0x7ff87400de10 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 shutdown_connections 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8680a3bb0 0x7ff8680a60c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8801080e0 0x7ff8801a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8801033e0 0x7ff88019a730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 --2- 172.21.15.100:0/1972104663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8801021a0 0x7ff88019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 >> 172.21.15.100:0/1972104663 conn(0x7ff8800fd370 msgr2=0x7ff8801040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 shutdown_connections 2024-04-30T23:11:06.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.293+0000 7ff884bb5640 1 -- 172.21.15.100:0/1972104663 wait complete. 2024-04-30T23:11:06.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:05 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-30T23:11:06.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:05 smithi104 ceph-mon[32987]: pgmap v293: 129 pgs: 74 active+clean, 36 creating+peering, 19 unknown; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-04-30T23:11:06.303 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:05 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-30T23:11:06.303 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:05 smithi100 ceph-mon[29745]: pgmap v293: 129 pgs: 74 active+clean, 36 creating+peering, 19 unknown; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-04-30T23:11:06.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 -- 172.21.15.100:0/1818657731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34102a20 msgr2=0x7f5b34103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/1818657731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34102a20 0x7f5b34103720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009900 tx=0x7f5b2802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 -- 172.21.15.100:0/1818657731 shutdown_connections 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/1818657731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34108960 0x7f5b3410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/1818657731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34103c60 0x7f5b34104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/1818657731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34102a20 0x7f5b34103720 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 -- 172.21.15.100:0/1818657731 >> 172.21.15.100:0/1818657731 conn(0x7f5b340fdc30 msgr2=0x7f5b341000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 -- 172.21.15.100:0/1818657731 shutdown_connections 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.410+0000 7f5b3bf46640 1 -- 172.21.15.100:0/1818657731 wait complete. 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 Processor -- start 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 -- start start 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34102a20 0x7f5b34199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34108960 0x7f5b341a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3410e520 con 0x7f5b34103c60 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3410e3a0 con 0x7f5b34102a20 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3bf46640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3410e6a0 con 0x7f5b34108960 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38264/0 (socket says 172.21.15.100:38264) 2024-04-30T23:11:06.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 -- 172.21.15.100:0/2756364906 learned_addr learned my addr 172.21.15.100:0/2756364906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b39ce2640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34102a20 0x7f5b34199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b3a4e3640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34108960 0x7f5b341a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 -- 172.21.15.100:0/2756364906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34108960 msgr2=0x7f5b341a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34108960 0x7f5b341a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 -- 172.21.15.100:0/2756364906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34102a20 msgr2=0x7f5b34199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34102a20 0x7f5b34199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.411+0000 7f5b394e1640 1 -- 172.21.15.100:0/2756364906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b341a0ca0 con 0x7f5b34103c60 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b394e1640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000e9f0 tx=0x7f5b3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000cd80 con 0x7f5b34103c60 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b300054d0 con 0x7f5b34103c60 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30010690 con 0x7f5b34103c60 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b341a0f90 con 0x7f5b34103c60 2024-04-30T23:11:06.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.412+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341a13a0 con 0x7f5b34103c60 2024-04-30T23:11:06.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.413+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34107770 con 0x7f5b34103c60 2024-04-30T23:11:06.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.414+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f5b30004e30 con 0x7f5b34103c60 2024-04-30T23:11:06.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.415+0000 7f5b26ffd640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 0x7f5b200a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.415+0000 7f5b39ce2640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 0x7f5b200a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.415+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f5b300d0c20 con 0x7f5b34103c60 2024-04-30T23:11:06.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.415+0000 7f5b39ce2640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 0x7f5b200a60c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b28005ab0 tx=0x7f5b28031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.419+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b30053ff0 con 0x7f5b34103c60 2024-04-30T23:11:06.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.599+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b3402dd60 con 0x7f5b34103c60 2024-04-30T23:11:06.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.600+0000 7f5b26ffd640 1 -- 172.21.15.100:0/2756364906 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f5b3009d3c0 con 0x7f5b34103c60 2024-04-30T23:11:06.601 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:06.601 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 msgr2=0x7f5b200a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 0x7f5b200a60c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b28005ab0 tx=0x7f5b28031400 comp rx=0 tx=0).stop 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 msgr2=0x7f5b34199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000e9f0 tx=0x7f5b3000edf0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 shutdown_connections 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b200a3bb0 0x7f5b200a60c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b34108960 0x7f5b341a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b34103c60 0x7f5b34199750 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 --2- 172.21.15.100:0/2756364906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b34102a20 0x7f5b34199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 >> 172.21.15.100:0/2756364906 conn(0x7f5b340fdc30 msgr2=0x7f5b34104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 shutdown_connections 2024-04-30T23:11:06.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.602+0000 7f5b3bf46640 1 -- 172.21.15.100:0/2756364906 wait complete. 2024-04-30T23:11:06.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 -- 172.21.15.100:0/3349632989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 msgr2=0x7f4b50105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 --2- 172.21.15.100:0/3349632989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b50105500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009900 tx=0x7f4b4002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 -- 172.21.15.100:0/3349632989 shutdown_connections 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 --2- 172.21.15.100:0/3349632989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 --2- 172.21.15.100:0/3349632989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 0x7f4b50101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 --2- 172.21.15.100:0/3349632989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b50105500 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 -- 172.21.15.100:0/3349632989 >> 172.21.15.100:0/3349632989 conn(0x7f4b500fd3a0 msgr2=0x7f4b500ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 -- 172.21.15.100:0/3349632989 shutdown_connections 2024-04-30T23:11:06.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.722+0000 7f4b56449640 1 -- 172.21.15.100:0/3349632989 wait complete. 2024-04-30T23:11:06.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 Processor -- start 2024-04-30T23:11:06.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 -- start start 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 0x7f4b5019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5010f660 con 0x7f4b501050f0 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5010f4e0 con 0x7f4b501022a0 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b56449640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5010f7e0 con 0x7f4b501017a0 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38288/0 (socket says 172.21.15.100:38288) 2024-04-30T23:11:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 -- 172.21.15.100:0/3337999959 learned_addr learned my addr 172.21.15.100:0/3337999959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b4ffff640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 0x7f4b5019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b4f7fe640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 -- 172.21.15.100:0/3337999959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 msgr2=0x7f4b5019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 0x7f4b5019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 -- 172.21.15.100:0/3337999959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 msgr2=0x7f4b5019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b549e6640 1 -- 172.21.15.100:0/3337999959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b501a1da0 con 0x7f4b501050f0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.723+0000 7f4b4f7fe640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b549e6640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800cad0 tx=0x7f4b4800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800ae20 con 0x7f4b501050f0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b501a2090 con 0x7f4b501050f0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b48005020 con 0x7f4b501050f0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800f6b0 con 0x7f4b501050f0 2024-04-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.724+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b501a25e0 con 0x7f4b501050f0 2024-04-30T23:11:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.725+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b50108a80 con 0x7f4b501050f0 2024-04-30T23:11:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.726+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f4b480051d0 con 0x7f4b501050f0 2024-04-30T23:11:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.727+0000 7f4b4d7fa640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 0x7f4b380a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.727+0000 7f4b4ffff640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 0x7f4b380a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.727+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f4b480d0700 con 0x7f4b501050f0 2024-04-30T23:11:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.727+0000 7f4b4ffff640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 0x7f4b380a60c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005ab0 tx=0x7f4b40031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.731+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b48014030 con 0x7f4b501050f0 2024-04-30T23:11:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.909+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b500637e0 con 0x7f4b501050f0 2024-04-30T23:11:06.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.911+0000 7f4b4d7fa640 1 -- 172.21.15.100:0/3337999959 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f4b4809cea0 con 0x7f4b501050f0 2024-04-30T23:11:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:06.912 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 msgr2=0x7f4b380a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 0x7f4b380a60c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005ab0 tx=0x7f4b40031400 comp rx=0 tx=0).stop 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 msgr2=0x7f4b501a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800cad0 tx=0x7f4b4800cf90 comp rx=0 tx=0).stop 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 shutdown_connections 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4b380a3bb0 0x7f4b380a60c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b501050f0 0x7f4b501a1730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b501022a0 0x7f4b5019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 --2- 172.21.15.100:0/3337999959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b501017a0 0x7f4b5019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 >> 172.21.15.100:0/3337999959 conn(0x7f4b500fd3a0 msgr2=0x7f4b50105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 shutdown_connections 2024-04-30T23:11:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:06.913+0000 7f4b56449640 1 -- 172.21.15.100:0/3337999959 wait complete. 2024-04-30T23:11:06.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 -- 172.21.15.100:0/506108375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103010 msgr2=0x7fe3e4103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/506108375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103010 0x7fe3e4103420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009900 tx=0x7fe3dc02a410 comp rx=0 tx=0).stop 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 -- 172.21.15.100:0/506108375 shutdown_connections 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/506108375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e41046d0 0x7fe3e410ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/506108375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103b70 0x7fe3e4104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/506108375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103010 0x7fe3e4103420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 -- 172.21.15.100:0/506108375 >> 172.21.15.100:0/506108375 conn(0x7fe3e40fd3b0 msgr2=0x7fe3e40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 -- 172.21.15.100:0/506108375 shutdown_connections 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.048+0000 7fe3e89dc640 1 -- 172.21.15.100:0/506108375 wait complete. 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 Processor -- start 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 -- start start 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103010 0x7fe3e4198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e419e420 0x7fe3e41a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410e770 con 0x7fe3e4103b70 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410e5f0 con 0x7fe3e419e420 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e89dc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410e8f0 con 0x7fe3e4103010 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38310/0 (socket says 172.21.15.100:38310) 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103010 0x7fe3e4198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 -- 172.21.15.100:0/1005542999 learned_addr learned my addr 172.21.15.100:0/1005542999 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e2d9d640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e419e420 0x7fe3e41a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 -- 172.21.15.100:0/1005542999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103010 msgr2=0x7fe3e4198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103010 0x7fe3e4198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 -- 172.21.15.100:0/1005542999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e419e420 msgr2=0x7fe3e41a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e419e420 0x7fe3e41a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.049+0000 7fe3e1d9b640 1 -- 172.21.15.100:0/1005542999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e41a0eb0 con 0x7fe3e4103b70 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3e1d9b640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e9f0 tx=0x7fe3d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800cd80 con 0x7fe3e4103b70 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d80054d0 con 0x7fe3e4103b70 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e41a11a0 con 0x7fe3e4103b70 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8010690 con 0x7fe3e4103b70 2024-04-30T23:11:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.050+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e41a16a0 con 0x7fe3e4103b70 2024-04-30T23:11:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.051+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e406b3e0 con 0x7fe3e4103b70 2024-04-30T23:11:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.052+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe3d8004e90 con 0x7fe3e4103b70 2024-04-30T23:11:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.053+0000 7fe3d37fe640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 0x7fe3cc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.053+0000 7fe3e259c640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 0x7fe3cc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.053+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fe3d80d0a30 con 0x7fe3e4103b70 2024-04-30T23:11:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.053+0000 7fe3e259c640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 0x7fe3cc0a60c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009230 tx=0x7fe3dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.058+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe3d809d1d0 con 0x7fe3e4103b70 2024-04-30T23:11:07.196 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:07.196 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: osdmap e89: 12 total, 12 up, 12 in 2024-04-30T23:11:07.196 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-30T23:11:07.197 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:07.197 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1972104663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.197 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2756364906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.197 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:06 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3337999959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.273+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3e402dde0 con 0x7fe3e4103b70 2024-04-30T23:11:07.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.274+0000 7fe3d37fe640 1 -- 172.21.15.100:0/1005542999 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11821 (secure 0 0 0) 0x7fe3d809cad0 con 0x7fe3e4103b70 2024-04-30T23:11:07.275 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:07.275 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:05.270526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24545,"qdb_cluster":[24545]},"id":1}]} 2024-04-30T23:11:07.275 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 msgr2=0x7fe3cc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 0x7fe3cc0a60c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009230 tx=0x7fe3dc031400 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 msgr2=0x7fe3e41994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e9f0 tx=0x7fe3d800edf0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 shutdown_connections 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3cc0a3bb0 0x7fe3cc0a60c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e419e420 0x7fe3e41a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e4103b70 0x7fe3e41994a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 --2- 172.21.15.100:0/1005542999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e4103010 0x7fe3e4198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 >> 172.21.15.100:0/1005542999 conn(0x7fe3e40fd3b0 msgr2=0x7fe3e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 shutdown_connections 2024-04-30T23:11:07.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.276+0000 7fe3e89dc640 1 -- 172.21.15.100:0/1005542999 wait complete. 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: osdmap e89: 12 total, 12 up, 12 in 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1972104663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2756364906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:06 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3337999959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:07.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-30T23:11:07.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: osdmap e89: 12 total, 12 up, 12 in 2024-04-30T23:11:07.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2824994433' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-30T23:11:07.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:07.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1972104663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2756364906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:06 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3337999959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 -- 172.21.15.100:0/809124306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f4101790 msgr2=0x7f52f4101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/809124306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f4101790 0x7f52f4101c00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009900 tx=0x7f52e802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 -- 172.21.15.100:0/809124306 shutdown_connections 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/809124306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4102290 0x7f52f410bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/809124306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f4101790 0x7f52f4101c00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/809124306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f41050e0 0x7f52f41054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 -- 172.21.15.100:0/809124306 >> 172.21.15.100:0/809124306 conn(0x7f52f40fd3b0 msgr2=0x7f52f40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 -- 172.21.15.100:0/809124306 shutdown_connections 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.396+0000 7f52f9cf0640 1 -- 172.21.15.100:0/809124306 wait complete. 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 Processor -- start 2024-04-30T23:11:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 -- start start 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4101790 0x7f52f419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f4102290 0x7f52f419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52f410f650 con 0x7f52f41050e0 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f52f410f4d0 con 0x7f52f4101790 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f9cf0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f52f410f7d0 con 0x7f52f4102290 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38330/0 (socket says 172.21.15.100:38330) 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f3fff640 1 -- 172.21.15.100:0/756962542 learned_addr learned my addr 172.21.15.100:0/756962542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f37fe640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4101790 0x7f52f419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.397+0000 7f52f2ffd640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f4102290 0x7f52f419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 -- 172.21.15.100:0/756962542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f4102290 msgr2=0x7f52f419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f4102290 0x7f52f419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 -- 172.21.15.100:0/756962542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4101790 msgr2=0x7f52f419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4101790 0x7f52f419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 -- 172.21.15.100:0/756962542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f41a1d70 con 0x7f52f41050e0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f3fff640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00eaa0 tx=0x7f52ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00cdb0 con 0x7f52f41050e0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ec005020 con 0x7f52f41050e0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f41a2060 con 0x7f52f41050e0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0116d0 con 0x7f52f41050e0 2024-04-30T23:11:07.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.398+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f41a2560 con 0x7f52f41050e0 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.399+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f4108a70 con 0x7f52f41050e0 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.400+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f52ec0051d0 con 0x7f52f41050e0 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.401+0000 7f52f0ff9640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 0x7f52dc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.401+0000 7f52f37fe640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 0x7f52dc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.401+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f52ec0d0790 con 0x7f52f41050e0 2024-04-30T23:11:07.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.401+0000 7f52f37fe640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 0x7f52dc0a60c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52f406b360 tx=0x7f52e400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.405+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f52ec016030 con 0x7f52f41050e0 2024-04-30T23:11:07.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.584+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52f40637e0 con 0x7f52f41050e0 2024-04-30T23:11:07.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.586+0000 7f52f0ff9640 1 -- 172.21.15.100:0/756962542 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f52ec09c8e0 con 0x7f52f41050e0 2024-04-30T23:11:07.587 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:07.587 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 msgr2=0x7f52dc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 0x7f52dc0a60c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52f406b360 tx=0x7f52e400b390 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 msgr2=0x7f52f41a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00eaa0 tx=0x7f52ec00ef60 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 shutdown_connections 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52dc0a3bb0 0x7f52dc0a60c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52f41050e0 0x7f52f41a1700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52f4102290 0x7f52f419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 --2- 172.21.15.100:0/756962542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f4101790 0x7f52f419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 >> 172.21.15.100:0/756962542 conn(0x7f52f40fd3b0 msgr2=0x7f52f4105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 shutdown_connections 2024-04-30T23:11:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.588+0000 7f52f9cf0640 1 -- 172.21.15.100:0/756962542 wait complete. 2024-04-30T23:11:07.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T23:11:00.289657+0000', 'modified': '2024-04-30T23:11:05.270526+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24545': {'gid': 24545, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6839/1200691747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6838', 'nonce': 1200691747}, {'type': 'v1', 'addr': '172.21.15.104:6839', 'nonce': 1200691747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24545, 'qdb_cluster': [24545]} 2024-04-30T23:11:07.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T23:11:07.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/3883994267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0102a30 msgr2=0x7ff8a0103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/3883994267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0102a30 0x7ff8a0103730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff890009900 tx=0x7ff89002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/3883994267 shutdown_connections 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/3883994267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0108970 0x7ff8a010ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/3883994267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 0x7ff8a0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/3883994267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0102a30 0x7ff8a0103730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/3883994267 >> 172.21.15.100:0/3883994267 conn(0x7ff8a00fdc00 msgr2=0x7ff8a01000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/3883994267 shutdown_connections 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.709+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/3883994267 wait complete. 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 Processor -- start 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 -- start start 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 0x7ff8a00758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 0x7ff8a019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010e530 con 0x7ff8a0108970 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010e3b0 con 0x7ff8a0103c70 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff8a5d3f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010e6b0 con 0x7ff8a0102a30 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38342/0 (socket says 172.21.15.100:38342) 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff89ffff640 1 -- 172.21.15.100:0/1020815670 learned_addr learned my addr 172.21.15.100:0/1020815670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff89effd640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 0x7ff8a019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.710+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 0x7ff8a00758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 -- 172.21.15.100:0/1020815670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 msgr2=0x7ff8a00758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 0x7ff8a00758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 -- 172.21.15.100:0/1020815670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 msgr2=0x7ff8a019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 0x7ff8a019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 -- 172.21.15.100:0/1020815670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a01a1d80 con 0x7ff8a0108970 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 0x7ff8a00758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff89800eb10 tx=0x7ff89800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89cff9640 1 -- 172.21.15.100:0/1020815670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898004b20 con 0x7ff8a0108970 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a01a2070 con 0x7ff8a0108970 2024-04-30T23:11:07.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89cff9640 1 -- 172.21.15.100:0/1020815670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff898004cc0 con 0x7ff8a0108970 2024-04-30T23:11:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff89cff9640 1 -- 172.21.15.100:0/1020815670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898010690 con 0x7ff8a0108970 2024-04-30T23:11:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.711+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01a25c0 con 0x7ff8a0108970 2024-04-30T23:11:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.713+0000 7ff89cff9640 1 -- 172.21.15.100:0/1020815670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff898005020 con 0x7ff8a0108970 2024-04-30T23:11:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 Processor -- start 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 -- start start 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89cff9640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 0x7ff8880a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec100fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1016920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ec0f70740 con 0x556ec0c6a270 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ec0f0c3a0 con 0x556ec0c49590 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ec0f6c700 con 0x556ec0c413b0 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89effd640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 0x7ff8880a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89cff9640 1 -- 172.21.15.100:0/1020815670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff8980d0c30 con 0x7ff8a0108970 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38350/0 (socket says 172.21.15.100:38350) 2024-04-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 -- 172.21.15.100:0/1753343534 learned_addr learned my addr 172.21.15.100:0/1753343534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89effd640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec100fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1016920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 -- 172.21.15.100:0/1753343534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 msgr2=0x556ec100fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec100fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 -- 172.21.15.100:0/1753343534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 msgr2=0x556ec1016920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1016920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89f7fe640 1 -- 172.21.15.100:0/1753343534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec0f28750 con 0x556ec0c6a270 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89effd640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 0x7ff8880a60c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0075240 tx=0x7ff894013880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.714+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1016920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff890033000 tx=0x7ff890032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f782f98d943e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff885ffb640 1 -- 172.21.15.100:0/1753343534 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89003f030 con 0x556ec0c6a270 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff885ffb640 1 -- 172.21.15.100:0/1753343534 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff890032d30 con 0x556ec0c6a270 2024-04-30T23:11:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff885ffb640 1 -- 172.21.15.100:0/1753343534 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890035070 con 0x556ec0c6a270 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1753343534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 msgr2=0x556ec100f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff890033000 tx=0x7ff890032b90 comp rx=0 tx=0).stop 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1753343534 shutdown_connections 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1016920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec100fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.715+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1753343534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c6a270 0x556ec100f4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1753343534 >> 172.21.15.100:0/1753343534 conn(0x556ec0c5e3c0 msgr2=0x556ec1006a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1753343534 shutdown_connections 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1753343534 wait complete. 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- start start 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 Processor -- start 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1019840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c6a270 0x556ec10207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ec1017310 con 0x556ec0c413b0 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ec0ef7fe0 con 0x556ec0c49590 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ec1017490 con 0x556ec0c6a270 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff8acbf2740 10 client.0 _ll_register_callbacks cb 0x556ec0f17c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38358/0 (socket says 172.21.15.100:38358) 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.716+0000 7ff89f7fe640 1 -- 172.21.15.100:0/3468163882 learned_addr learned my addr 172.21.15.100:0/3468163882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89effd640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1019840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89ffff640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c6a270 0x556ec10207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 -- 172.21.15.100:0/3468163882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c6a270 msgr2=0x556ec10207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c6a270 0x556ec10207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 -- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 msgr2=0x556ec1019840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1019840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 -- 172.21.15.100:0/3468163882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec0c822d0 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff890009900 tx=0x7ff8900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec221891b4a312c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff87effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890035050 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff8900317a0 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff890032d30 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ff89003f040 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff8acbf2740 10 client.14790 fetch_fsmap learned FSMap version 16 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x556ec0d4c6b0 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.717+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff890032d30 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) ==== 8342+0+0 (secure 0 0 0) 0x7ff890004c30 con 0x556ec0c413b0 2024-04-30T23:11:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 10 client.14790 fetch_fsmap finished waiting for FSMap version 16 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 10 client.14790 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 20 client.14790 populate_metadata read hostname 'smithi100' 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c28e40 0x556ec1026f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 4 client.14790 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ec0f7e350 con 0x556ec0c28e40 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff89effd640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c28e40 0x556ec1026f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff87effd640 10 client.14790 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.718+0000 7ff89effd640 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c28e40 0x556ec1026f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=663a43015d229264 server_cookie=1caeae542db40100 in_seq=0 out_seq=0 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.719+0000 7ff87effd640 1 -- 172.21.15.100:0/3468163882 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556ec0f7e350 con 0x556ec0c28e40 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.719+0000 7ff87effd640 10 client.14790 handle_command_reply: tid=0 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.719+0000 7ff8acbf2740 1 client.14790 shutdown 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.719+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 msgr2=0x556ec1019300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff890009900 tx=0x7ff8900042f0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 shutdown_connections 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c28e40 0x556ec1026f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c6a270 0x556ec10207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec1019840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff87effd640 0 client.14790 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/3468163882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c413b0 0x556ec1019300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 >> 172.21.15.100:0/3468163882 conn(0x556ec0c5e3c0 msgr2=0x556ec1005c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 shutdown_connections 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 1 -- 172.21.15.100:0/3468163882 wait complete. 2024-04-30T23:11:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.720+0000 7ff8acbf2740 20 client.14790 trim_cache size 0 max 16384 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 Processor -- start 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 -- start start 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c413b0 0x556ec10206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c49590 0x556ec1018ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ec1025250 con 0x556ec0c5e3c0 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ec1025920 con 0x556ec0c413b0 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ec1025ff0 con 0x556ec0c49590 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38368/0 (socket says 172.21.15.100:38368) 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 -- 172.21.15.100:0/2822428910 learned_addr learned my addr 172.21.15.100:0/2822428910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89ffff640 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c49590 0x556ec1018ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 -- 172.21.15.100:0/2822428910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c49590 msgr2=0x556ec1018ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c49590 0x556ec1018ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 -- 172.21.15.100:0/2822428910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c413b0 msgr2=0x556ec10206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c413b0 0x556ec10206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 -- 172.21.15.100:0/2822428910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec1018380 con 0x556ec0c5e3c0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.738+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff890004290 tx=0x7ff890003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d6acc3f4779c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8857fa640 1 -- 172.21.15.100:0/2822428910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890035070 con 0x556ec0c5e3c0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8857fa640 1 -- 172.21.15.100:0/2822428910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff890004360 con 0x556ec0c5e3c0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8857fa640 1 -- 172.21.15.100:0/2822428910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900052a0 con 0x556ec0c5e3c0 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 -- 172.21.15.100:0/2822428910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 msgr2=0x556ec1018590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff890004290 tx=0x7ff890003730 comp rx=0 tx=0).stop 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 -- 172.21.15.100:0/2822428910 shutdown_connections 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c49590 0x556ec1018ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c413b0 0x556ec10206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/2822428910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec1018590 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 -- 172.21.15.100:0/2822428910 >> 172.21.15.100:0/2822428910 conn(0x556ec1001ce0 msgr2=0x556ec1013780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 -- 172.21.15.100:0/2822428910 shutdown_connections 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.739+0000 7ff8acbf2740 1 -- 172.21.15.100:0/2822428910 wait complete. 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 -- start start 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 Processor -- start 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec101b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec101baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ec1026d90 con 0x556ec0c5e3c0 2024-04-30T23:11:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ec10266c0 con 0x556ec0c49590 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ec1027460 con 0x556ec0c413b0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff8acbf2740 10 client.0 _ll_register_callbacks cb 0x7ff8980093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38376/0 (socket says 172.21.15.100:38376) 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 -- 172.21.15.100:0/1339791821 learned_addr learned my addr 172.21.15.100:0/1339791821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec101b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89effd640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec101baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 -- 172.21.15.100:0/1339791821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 msgr2=0x556ec101b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec101b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 -- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 msgr2=0x556ec101baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec101baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.740+0000 7ff89ffff640 1 -- 172.21.15.100:0/1339791821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec108c1b0 con 0x556ec0c5e3c0 2024-04-30T23:11:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff89ffff640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff898099130 tx=0x7ff89800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7879a666935250f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8980a1080 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff89809cf30 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff890004360 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ff8980a5940 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 10 client.14796 fetch_fsmap learned FSMap version 16 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x556ec108d3d0 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff890004360 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) ==== 8342+0+0 (secure 0 0 0) 0x7ff8980bd0b0 con 0x556ec0c5e3c0 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 10 client.14796 fetch_fsmap finished waiting for FSMap version 16 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 10 client.14796 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 20 client.14796 populate_metadata read hostname 'smithi100' 2024-04-30T23:11:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c6a270 0x556ec1090bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 4 client.14796 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.741+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "status"}) -- 0x556ec0f781c0 con 0x556ec0c6a270 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c6a270 0x556ec1090bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff87effd640 10 client.14796 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff89f7fe640 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c6a270 0x556ec1090bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8347ea22bf9ba7ad server_cookie=81a20d4165a2684d in_seq=0 out_seq=0 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff87effd640 1 -- 172.21.15.100:0/1339791821 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556ec0f781c0 con 0x556ec0c6a270 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff87effd640 10 client.14796 handle_command_reply: tid=0 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 client.14796 shutdown 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 msgr2=0x556ec108bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff898099130 tx=0x7ff89800cee0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 shutdown_connections 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ec0c6a270 0x556ec1090bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.742+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ec0c5e3c0 0x556ec108bc70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff87effd640 0 client.14796 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ec0c49590 0x556ec101baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 1 --2- 172.21.15.100:0/1339791821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ec0c413b0 0x556ec101b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 >> 172.21.15.100:0/1339791821 conn(0x556ec1001ce0 msgr2=0x556ec1009970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 shutdown_connections 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 1 -- 172.21.15.100:0/1339791821 wait complete. 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8acbf2740 20 client.14796 trim_cache size 0 max 16384 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:11:07.750 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24545, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 6.8613098670000001, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 16, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 89, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 13.772920493999999 2024-04-30T23:11:07.751 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 msgr2=0x7ff8880a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 0x7ff8880a60c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0075240 tx=0x7ff894013880 comp rx=0 tx=0).stop 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 msgr2=0x7ff8a01a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff89800eb10 tx=0x7ff89800c2d0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 shutdown_connections 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8880a3bb0 0x7ff8880a60c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a0108970 0x7ff8a01a1560 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8a0103c70 0x7ff8a019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 --2- 172.21.15.100:0/1020815670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a0102a30 0x7ff8a00758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 >> 172.21.15.100:0/1020815670 conn(0x7ff8a00fdc00 msgr2=0x7ff8a0104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 shutdown_connections 2024-04-30T23:11:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:07.743+0000 7ff8a5d3f640 1 -- 172.21.15.100:0/1020815670 wait complete. 2024-04-30T23:11:07.755 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T23:11:07.755 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:07.755 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-30T23:11:07.993 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:08.208 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:07 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1005542999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:08.209 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:07 smithi104 ceph-mon[32987]: pgmap v295: 129 pgs: 112 active+clean, 9 creating+peering, 8 unknown; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 5 op/s 2024-04-30T23:11:08.209 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:07 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/756962542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:08.250 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:07 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1005542999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:08.250 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:07 smithi100 ceph-mon[29745]: pgmap v295: 129 pgs: 112 active+clean, 9 creating+peering, 8 unknown; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 5 op/s 2024-04-30T23:11:08.250 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:07 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/756962542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:08.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:07 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1005542999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:08.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:07 smithi183 ceph-mon[33560]: pgmap v295: 129 pgs: 112 active+clean, 9 creating+peering, 8 unknown; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 5 op/s 2024-04-30T23:11:08.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:07 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/756962542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:09.143 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:08 smithi100 ceph-mon[29745]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:09.143 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:08 smithi100 ceph-mon[29745]: Cluster is now healthy 2024-04-30T23:11:09.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:08 smithi104 ceph-mon[32987]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:09.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:08 smithi104 ceph-mon[32987]: Cluster is now healthy 2024-04-30T23:11:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:08 smithi183 ceph-mon[33560]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-30T23:11:09.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:08 smithi183 ceph-mon[33560]: Cluster is now healthy 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- 172.21.15.100:0/2001971331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 msgr2=0x7f3f38109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2001971331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f38109230 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0099c0 tx=0x7f3f2c009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- 172.21.15.100:0/2001971331 shutdown_connections 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2001971331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f381110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2001971331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 0x7f3f38104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2001971331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f38109230 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- 172.21.15.100:0/2001971331 >> 172.21.15.100:0/2001971331 conn(0x7f3f380ffde0 msgr2=0x7f3f38102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- 172.21.15.100:0/2001971331 shutdown_connections 2024-04-30T23:11:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- 172.21.15.100:0/2001971331 wait complete. 2024-04-30T23:11:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 Processor -- start 2024-04-30T23:11:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.666+0000 7f3f3e778700 1 -- start start 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 0x7f3f3819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f3819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f381143f0 con 0x7f3f38108e20 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38114270 con 0x7f3f381044f0 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3e778700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38114570 con 0x7f3f38109770 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38400/0 (socket says 172.21.15.100:38400) 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 -- 172.21.15.100:0/2855506734 learned_addr learned my addr 172.21.15.100:0/2855506734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f37fff700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 0x7f3f3819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3cd15700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f3819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 -- 172.21.15.100:0/2855506734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 msgr2=0x7f3f3819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f3819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 -- 172.21.15.100:0/2855506734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 msgr2=0x7f3f3819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 0x7f3f3819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 -- 172.21.15.100:0/2855506734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3819fba0 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f3cd15700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f3819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.667+0000 7f3f377fe700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009f50 tx=0x7f3f2c0037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.668+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c027070 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.668+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3819fe30 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.668+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2c004140 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.668+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00f460 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.668+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f381a0360 con 0x7f3f38108e20 2024-04-30T23:11:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.669+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f380511d0 con 0x7f3f38108e20 2024-04-30T23:11:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.670+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3f2c02a070 con 0x7f3f38108e20 2024-04-30T23:11:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.671+0000 7f3f357fa700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 0x7f3f200a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.671+0000 7f3f37fff700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 0x7f3f200a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.671+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f3f2c0d1a00 con 0x7f3f38108e20 2024-04-30T23:11:09.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.672+0000 7f3f37fff700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 0x7f3f200a6150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005ea0 tx=0x7f3f28005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:09.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.675+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f2c013070 con 0x7f3f38108e20 2024-04-30T23:11:09.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.922+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f3802e550 con 0x7f3f38108e20 2024-04-30T23:11:09.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.923+0000 7f3f357fa700 1 -- 172.21.15.100:0/2855506734 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f3f2c09e1d0 con 0x7f3f38108e20 2024-04-30T23:11:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-30T23:11:09.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 msgr2=0x7f3f200a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 0x7f3f200a6150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005ea0 tx=0x7f3f28005e30 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 msgr2=0x7f3f3819b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009f50 tx=0x7f3f2c0037c0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 shutdown_connections 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f200a3c40 0x7f3f200a6150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f38109770 0x7f3f3819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f381044f0 0x7f3f3819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 --2- 172.21.15.100:0/2855506734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f38108e20 0x7f3f3819b320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 >> 172.21.15.100:0/2855506734 conn(0x7f3f380ffde0 msgr2=0x7f3f3810a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 shutdown_connections 2024-04-30T23:11:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:09.925+0000 7f3f3e778700 1 -- 172.21.15.100:0/2855506734 wait complete. 2024-04-30T23:11:10.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:09 smithi104 ceph-mon[32987]: pgmap v296: 129 pgs: 127 active+clean, 2 creating+peering; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-30T23:11:10.295 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:09 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2855506734' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:11:10.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:09 smithi183 ceph-mon[33560]: pgmap v296: 129 pgs: 127 active+clean, 2 creating+peering; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-30T23:11:10.300 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:09 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2855506734' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:11:10.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:09 smithi100 ceph-mon[29745]: pgmap v296: 129 pgs: 127 active+clean, 2 creating+peering; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-30T23:11:10.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:09 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2855506734' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T23:11:10.613 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-30T23:11:10.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:10.614 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:11:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::9f2f:e944:c89b:fa12/64 scope link noprefixroute 2024-04-30T23:11:10.631 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:11:10.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-30T23:11:10.632 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:11:10.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:11:10.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:10.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:10.809 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T23:11:10.832 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-04-30T23:11:10.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:10.834 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-04-30T23:11:10.906 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-04-30T23:11:10.906 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T23:11:10.906 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T23:11:10.906 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T23:11:10.906 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T23:11:10.907 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:11:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:11:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:11.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:11.163 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-30T23:11:11.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:11.178 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-04-30T23:11:11.232 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:11:11.232 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:11:11.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:11:11.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-30T23:11:11.232 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:11:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:11:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:11.348 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-30T23:11:11.348 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:11:11.348 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:11:11.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-30T23:11:11.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-30T23:11:11.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-30T23:11:11.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-30T23:11:11.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-30T23:11:11.349 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:11:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:11:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:11.481 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:11:11.482 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:11:11.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-04-30T23:11:11.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-04-30T23:11:11.482 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:11:11.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:11:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:11.557 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-30T23:11:11.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T23:11:11.557 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:11.571 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-30T23:11:11.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T23:11:11.571 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:11.622 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-04-30T23:11:11.688 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-04-30T23:11:11.745 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-04-30T23:11:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysusers.service 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/42a618425dd860284e4d5dfef4da8b1bcf615a48004962fcfe151dd0dce5e2d2/merged 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/59fd862ff73c44084383fb61cb108e544a1c0d69d0a976727558396b90ae2ff8/merged 2024-04-30T23:11:11.747 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/0 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/39e765aa11b39b80766b731931e4561b63a0759dac0ed0c295ef81194dc3f9ef/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/93dc1416bb7eb18dc502bcbdab8fe6d553a17907837a09cef63847ef0312aa16/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/23d462ef64a83fefba695b701cd5397d6e24a45a421493c0ad284c284ce4cd50/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e2e06aac8e21f090422d3bceb6ef1672099c081ebdcb26a5afa44adab4fa086b/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/f2394a26343d6d9b3e36dfd1ee31c3fee4176ab0cd66d9d702577580f38c0e39/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/6116a2b2d161c7b4ba66cd318f918da6bf472b33fb1e5ce6558680c3705c6fb3/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e7362e58a5286d9a5424b0223ee1908f95d79594f6856afca99730bd8ce252f4/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/c6c4d2e808bb416f23aeab43729866c7bbfd390053106a09995aebef07ba7324/merged 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:11:11.748 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:11:11.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:11.749 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-04-30T23:11:11.799 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-30T23:11:11.800 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-30T23:11:11.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-04-30T23:11:11.864 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-04-30T23:11:11.920 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysusers.service 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-30T23:11:11.921 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/42a618425dd860284e4d5dfef4da8b1bcf615a48004962fcfe151dd0dce5e2d2/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/59fd862ff73c44084383fb61cb108e544a1c0d69d0a976727558396b90ae2ff8/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/0 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/39e765aa11b39b80766b731931e4561b63a0759dac0ed0c295ef81194dc3f9ef/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/93dc1416bb7eb18dc502bcbdab8fe6d553a17907837a09cef63847ef0312aa16/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/23d462ef64a83fefba695b701cd5397d6e24a45a421493c0ad284c284ce4cd50/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e2e06aac8e21f090422d3bceb6ef1672099c081ebdcb26a5afa44adab4fa086b/merged 2024-04-30T23:11:11.922 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/f2394a26343d6d9b3e36dfd1ee31c3fee4176ab0cd66d9d702577580f38c0e39/merged 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/6116a2b2d161c7b4ba66cd318f918da6bf472b33fb1e5ce6558680c3705c6fb3/merged 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e7362e58a5286d9a5424b0223ee1908f95d79594f6856afca99730bd8ce252f4/merged 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/c6c4d2e808bb416f23aeab43729866c7bbfd390053106a09995aebef07ba7324/merged 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:11:11.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:11.923 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-04-30T23:11:11.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:2024-04-30T23:11:11.941+0000 7fa67d1e3480 -1 init, newargv = 0x7fa66c0046a0 newargc=15 2024-04-30T23:11:11.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[71401]: starting ceph client 2024-04-30T23:11:11.948 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[71401]: starting fuse 2024-04-30T23:11:11.959 INFO:teuthology.orchestra.run.smithi100.stdout:115 2024-04-30T23:11:11.959 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-30T23:11:11.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-04-30T23:11:11.959 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-04-30T23:11:11.959 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-30T23:11:11.960 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.admin")) 2024-04-30T23:11:11.961 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-04-30T23:11:12.077 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.admin.71401.asok 2024-04-30T23:11:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:12.087 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.71401.asok 2024-04-30T23:11:12.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:12.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.71401.asok status 2024-04-30T23:11:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:11:12.228 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-04-30T23:11:12.228 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8505bf412a33fc9b7838e91f3a227044bc06f5ed", 2024-04-30T23:11:12.228 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.0.0-3308-g8505bf41 (8505bf412a33fc9b7838e91f3a227044bc06f5ed) squid (dev)", 2024-04-30T23:11:12.228 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "admin", 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "71401", 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 14808, 2024-04-30T23:11:12.229 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 14808 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2450068297 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-04-30T23:11:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2450068297 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.14808 192.168.0.1:0/2450068297", 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/2450068297", 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 16, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 89, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-04-30T23:11:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:11:12.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:12.237 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-04-30T23:11:12.237 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-04-30T23:11:12.253 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:12.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:12.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:12.317 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-30T23:11:12.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T23:11:12.432 INFO:teuthology.orchestra.run.smithi100.stdout:# file: . 2024-04-30T23:11:12.432 INFO:teuthology.orchestra.run.smithi100.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-30T23:11:12.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:12.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:11:12.438 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:11:12.438 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:11:12.453 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 -- 172.21.15.100:0/2906654290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988104d80 msgr2=0x7f2988105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 --2- 172.21.15.100:0/2906654290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988104d80 0x7f2988105190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f297c009900 tx=0x7f297c02a410 comp rx=0 tx=0).stop 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 -- 172.21.15.100:0/2906654290 shutdown_connections 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 --2- 172.21.15.100:0/2906654290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988109a80 0x7f298810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 --2- 172.21.15.100:0/2906654290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988104d80 0x7f2988105190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 --2- 172.21.15.100:0/2906654290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988103b40 0x7f2988104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 -- 172.21.15.100:0/2906654290 >> 172.21.15.100:0/2906654290 conn(0x7f29880fed50 msgr2=0x7f29881011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 -- 172.21.15.100:0/2906654290 shutdown_connections 2024-04-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.601+0000 7f298de8b640 1 -- 172.21.15.100:0/2906654290 wait complete. 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 Processor -- start 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 -- start start 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988103b40 0x7f298819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988104d80 0x7f298819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f298810f6c0 con 0x7f2988109a80 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f298810f540 con 0x7f2988104d80 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f298de8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f298810f840 con 0x7f2988103b40 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2987fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2987fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38406/0 (socket says 172.21.15.100:38406) 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2987fff640 1 -- 172.21.15.100:0/510589322 learned_addr learned my addr 172.21.15.100:0/510589322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2986ffd640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988104d80 0x7f298819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f29877fe640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988103b40 0x7f298819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2987fff640 1 -- 172.21.15.100:0/510589322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988103b40 msgr2=0x7f298819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.602+0000 7f2987fff640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988103b40 0x7f298819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2987fff640 1 -- 172.21.15.100:0/510589322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988104d80 msgr2=0x7f298819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2987fff640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988104d80 0x7f298819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2987fff640 1 -- 172.21.15.100:0/510589322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29881a1d90 con 0x7f2988109a80 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2987fff640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f298000b970 tx=0x7f298000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980019070 con 0x7f2988109a80 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29881a2080 con 0x7f2988109a80 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2980014440 con 0x7f2988109a80 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29800075d0 con 0x7f2988109a80 2024-04-30T23:11:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.603+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29881a2650 con 0x7f2988109a80 2024-04-30T23:11:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.604+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2988108890 con 0x7f2988109a80 2024-04-30T23:11:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.605+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f298001c070 con 0x7f2988109a80 2024-04-30T23:11:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.606+0000 7f2984ff9640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 0x7f29700a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.606+0000 7f29877fe640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 0x7f29700a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.606+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f29800d00d0 con 0x7f2988109a80 2024-04-30T23:11:12.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.606+0000 7f29877fe640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 0x7f29700a60c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f29780058c0 tx=0x7f2978005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:12.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.610+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f298009c220 con 0x7f2988109a80 2024-04-30T23:11:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.792+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f298802dd10 con 0x7f2988109a80 2024-04-30T23:11:12.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.794+0000 7f2984ff9640 1 -- 172.21.15.100:0/510589322 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f29800a0520 con 0x7f2988109a80 2024-04-30T23:11:12.794 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:12.795 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.795+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 msgr2=0x7f29700a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.795+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 0x7f29700a60c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f29780058c0 tx=0x7f2978005850 comp rx=0 tx=0).stop 2024-04-30T23:11:12.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.795+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 msgr2=0x7f29881a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.795+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f298000b970 tx=0x7f298000be30 comp rx=0 tx=0).stop 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 shutdown_connections 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f29700a3bb0 0x7f29700a60c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2988109a80 0x7f29881a17d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988104d80 0x7f298819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 --2- 172.21.15.100:0/510589322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2988103b40 0x7f298819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 >> 172.21.15.100:0/510589322 conn(0x7f29880fed50 msgr2=0x7f2988105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 shutdown_connections 2024-04-30T23:11:12.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.796+0000 7f298de8b640 1 -- 172.21.15.100:0/510589322 wait complete. 2024-04-30T23:11:12.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:11:12.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:11:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- 172.21.15.100:0/106337556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 msgr2=0x7f54c01093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/106337556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c01093a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009900 tx=0x7f54a802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- 172.21.15.100:0/106337556 shutdown_connections 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/106337556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c01098e0 0x7f54c010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/106337556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c01093a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/106337556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c0104620 0x7f54c0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- 172.21.15.100:0/106337556 >> 172.21.15.100:0/106337556 conn(0x7f54c00fdc20 msgr2=0x7f54c01000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- 172.21.15.100:0/106337556 shutdown_connections 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- 172.21.15.100:0/106337556 wait complete. 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 Processor -- start 2024-04-30T23:11:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.918+0000 7f54c5d7e640 1 -- start start 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c0104620 0x7f54c0103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c01098e0 0x7f54c0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54c010f660 con 0x7f54c0106f80 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f54c010f4e0 con 0x7f54c01098e0 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54c5d7e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54c010f7e0 con 0x7f54c0104620 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38416/0 (socket says 172.21.15.100:38416) 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 -- 172.21.15.100:0/3617088059 learned_addr learned my addr 172.21.15.100:0/3617088059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54bf7fe640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c0104620 0x7f54c0103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54bffff640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c01098e0 0x7f54c0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 -- 172.21.15.100:0/3617088059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c0104620 msgr2=0x7f54c0103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c0104620 0x7f54c0103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 -- 172.21.15.100:0/3617088059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c01098e0 msgr2=0x7f54c0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c01098e0 0x7f54c0102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 -- 172.21.15.100:0/3617088059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c0102d80 con 0x7f54c0106f80 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.919+0000 7f54b6ffd640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006010 tx=0x7f54a8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.920+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a803f030 con 0x7f54c0106f80 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.920+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c01a4390 con 0x7f54c0106f80 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.920+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54a8003aa0 con 0x7f54c0106f80 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.920+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8035070 con 0x7f54c0106f80 2024-04-30T23:11:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.920+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01a4790 con 0x7f54c0106f80 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.921+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c0069320 con 0x7f54c0106f80 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.922+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f54a8042030 con 0x7f54c0106f80 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.923+0000 7f54bd7fa640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 0x7f54ac0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.923+0000 7f54bf7fe640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 0x7f54ac0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.923+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f54a80f0e80 con 0x7f54c0106f80 2024-04-30T23:11:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.923+0000 7f54bf7fe640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 0x7f54ac0a60c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54c006bd10 tx=0x7f54b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:12.927+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f54a80bd620 con 0x7f54c0106f80 2024-04-30T23:11:13.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:12 smithi104 ceph-mon[32987]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-30T23:11:13.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:12 smithi183 ceph-mon[33560]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-30T23:11:13.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:12 smithi100 ceph-mon[29745]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-30T23:11:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.109+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f54c00637e0 con 0x7f54c0106f80 2024-04-30T23:11:13.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.110+0000 7f54bd7fa640 1 -- 172.21.15.100:0/3617088059 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f54a80bcf20 con 0x7f54c0106f80 2024-04-30T23:11:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:11:13.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 msgr2=0x7f54ac0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 0x7f54ac0a60c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54c006bd10 tx=0x7f54b0005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 msgr2=0x7f54c0102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006010 tx=0x7f54a8031a50 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 shutdown_connections 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54ac0a3bb0 0x7f54ac0a60c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c01098e0 0x7f54c0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c0106f80 0x7f54c0102110 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 --2- 172.21.15.100:0/3617088059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c0104620 0x7f54c0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 >> 172.21.15.100:0/3617088059 conn(0x7f54c00fdc20 msgr2=0x7f54c0105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 shutdown_connections 2024-04-30T23:11:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.112+0000 7f54c5d7e640 1 -- 172.21.15.100:0/3617088059 wait complete. 2024-04-30T23:11:13.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:11:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 -- 172.21.15.100:0/3501032882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138102a20 msgr2=0x7f8138103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 --2- 172.21.15.100:0/3501032882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138102a20 0x7f8138103720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8128009900 tx=0x7f812802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 -- 172.21.15.100:0/3501032882 shutdown_connections 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 --2- 172.21.15.100:0/3501032882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 0x7f813810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 --2- 172.21.15.100:0/3501032882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138103c60 0x7f8138104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 --2- 172.21.15.100:0/3501032882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138102a20 0x7f8138103720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 -- 172.21.15.100:0/3501032882 >> 172.21.15.100:0/3501032882 conn(0x7f81380fdc10 msgr2=0x7f81381000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 -- 172.21.15.100:0/3501032882 shutdown_connections 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 -- 172.21.15.100:0/3501032882 wait complete. 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.234+0000 7f813f04a640 1 Processor -- start 2024-04-30T23:11:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 -- start start 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138102a20 0x7f813806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 0x7f81381a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f813810e500 con 0x7f8138103c60 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f813810e380 con 0x7f8138108960 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813f04a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f813810e680 con 0x7f8138102a20 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38442/0 (socket says 172.21.15.100:38442) 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 -- 172.21.15.100:0/3810007876 learned_addr learned my addr 172.21.15.100:0/3810007876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813cde6640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138102a20 0x7f813806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 -- 172.21.15.100:0/3810007876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138102a20 msgr2=0x7f813806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138102a20 0x7f813806a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 -- 172.21.15.100:0/3810007876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 msgr2=0x7f81381a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f813d5e7640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 0x7f81381a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 0x7f81381a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 -- 172.21.15.100:0/3810007876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381a2080 con 0x7f8138103c60 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.235+0000 7f8137fff640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f812c00d950 tx=0x7f812c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.236+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c017030 con 0x7f8138103c60 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.236+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381a2370 con 0x7f8138103c60 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.236+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f812c004020 con 0x7f8138103c60 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.236+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0047a0 con 0x7f8138103c60 2024-04-30T23:11:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.236+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a2910 con 0x7f8138103c60 2024-04-30T23:11:13.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.237+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8138107770 con 0x7f8138103c60 2024-04-30T23:11:13.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.238+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f812c009a30 con 0x7f8138103c60 2024-04-30T23:11:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.238+0000 7f8135ffb640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 0x7f81200a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.239+0000 7f813cde6640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 0x7f81200a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.239+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f812c0d00f0 con 0x7f8138103c60 2024-04-30T23:11:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.239+0000 7f813cde6640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 0x7f81200a60c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8128005ab0 tx=0x7f8128031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.243+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f812c09c890 con 0x7f8138103c60 2024-04-30T23:11:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.418+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f813802dcd0 con 0x7f8138103c60 2024-04-30T23:11:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.419+0000 7f8135ffb640 1 -- 172.21.15.100:0/3810007876 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f812c09c190 con 0x7f8138103c60 2024-04-30T23:11:13.420 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 msgr2=0x7f81200a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 0x7f81200a60c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8128005ab0 tx=0x7f8128031400 comp rx=0 tx=0).stop 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 msgr2=0x7f813819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f812c00d950 tx=0x7f812c00de10 comp rx=0 tx=0).stop 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 shutdown_connections 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f81200a3bb0 0x7f81200a60c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8138108960 0x7f81381a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138103c60 0x7f813819f310 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 --2- 172.21.15.100:0/3810007876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138102a20 0x7f813806a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 >> 172.21.15.100:0/3810007876 conn(0x7f81380fdc10 msgr2=0x7f8138104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 shutdown_connections 2024-04-30T23:11:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.421+0000 7f813f04a640 1 -- 172.21.15.100:0/3810007876 wait complete. 2024-04-30T23:11:13.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 -- 172.21.15.100:0/3296336936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 msgr2=0x7f69c41033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 --2- 172.21.15.100:0/3296336936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c41033d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009ca0 tx=0x7f69bc02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 -- 172.21.15.100:0/3296336936 shutdown_connections 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 --2- 172.21.15.100:0/3296336936 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 --2- 172.21.15.100:0/3296336936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 0x7f69c4103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 --2- 172.21.15.100:0/3296336936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c41033d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 -- 172.21.15.100:0/3296336936 >> 172.21.15.100:0/3296336936 conn(0x7f69c40fd3c0 msgr2=0x7f69c40ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 -- 172.21.15.100:0/3296336936 shutdown_connections 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.542+0000 7f69caf15640 1 -- 172.21.15.100:0/3296336936 wait complete. 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 Processor -- start 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 -- start start 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 0x7f69c419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c41a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410e560 con 0x7f69c4102fc0 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410e3e0 con 0x7f69c41044c0 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69caf15640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69c410e6e0 con 0x7f69c41039a0 2024-04-30T23:11:13.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69c8cb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69c8cb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38460/0 (socket says 172.21.15.100:38460) 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69c8cb1640 1 -- 172.21.15.100:0/1218154387 learned_addr learned my addr 172.21.15.100:0/1218154387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.543+0000 7f69c3fff640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 0x7f69c419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c94b2640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c41a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 -- 172.21.15.100:0/1218154387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 msgr2=0x7f69c419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 0x7f69c419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 -- 172.21.15.100:0/1218154387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 msgr2=0x7f69c41a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c41a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 -- 172.21.15.100:0/1218154387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c41a1d90 con 0x7f69c4102fc0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c94b2640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c41a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c8cb1640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02ade0 tx=0x7f69bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc02f380 con 0x7f69c4102fc0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c41a2020 con 0x7f69c4102fc0 2024-04-30T23:11:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69bc0317c0 con 0x7f69c4102fc0 2024-04-30T23:11:13.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc02fc60 con 0x7f69c4102fc0 2024-04-30T23:11:13.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.544+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c41a25c0 con 0x7f69c4102fc0 2024-04-30T23:11:13.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.545+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c41a28e0 con 0x7f69c4102fc0 2024-04-30T23:11:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.547+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f69bc004040 con 0x7f69c4102fc0 2024-04-30T23:11:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.547+0000 7f69c1ffb640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 0x7f69ac0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.547+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f69bc0f1da0 con 0x7f69c4102fc0 2024-04-30T23:11:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.547+0000 7f69c3fff640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 0x7f69ac0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.548+0000 7f69c3fff640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 0x7f69ac0a6260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69c419b2f0 tx=0x7f69b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.551+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f69bc0be540 con 0x7f69c4102fc0 2024-04-30T23:11:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.734+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f69c41a2ab0 con 0x7f69c4102fc0 2024-04-30T23:11:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.734+0000 7f69c1ffb640 1 -- 172.21.15.100:0/1218154387 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f69bc0bde40 con 0x7f69c4102fc0 2024-04-30T23:11:13.735 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 msgr2=0x7f69ac0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 0x7f69ac0a6260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69c419b2f0 tx=0x7f69b8005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 msgr2=0x7f69c419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02ade0 tx=0x7f69bc003ba0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 shutdown_connections 2024-04-30T23:11:13.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69ac0a3d50 0x7f69ac0a6260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69c41044c0 0x7f69c41a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69c41039a0 0x7f69c419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 --2- 172.21.15.100:0/1218154387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69c4102fc0 0x7f69c419a250 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 >> 172.21.15.100:0/1218154387 conn(0x7f69c40fd3c0 msgr2=0x7f69c41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 shutdown_connections 2024-04-30T23:11:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.737+0000 7f69caf15640 1 -- 172.21.15.100:0/1218154387 wait complete. 2024-04-30T23:11:13.746 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/510589322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:13.747 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3617088059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:13.747 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3810007876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:13.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:11:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/1003380134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc1044c0 msgr2=0x7ff9cc10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/1003380134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc1044c0 0x7ff9cc10ac10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009ca0 tx=0x7ff9c402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/1003380134 shutdown_connections 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/1003380134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc1044c0 0x7ff9cc10ac10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/1003380134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9cc1039a0 0x7ff9cc103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/1003380134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc1033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/1003380134 >> 172.21.15.100:0/1003380134 conn(0x7ff9cc0fd3c0 msgr2=0x7ff9cc0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/1003380134 shutdown_connections 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/1003380134 wait complete. 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 Processor -- start 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.857+0000 7ff9d2c4c640 1 -- start start 2024-04-30T23:11:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc1039a0 0x7ff9cc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9cc1044c0 0x7ff9cc1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10e590 con 0x7ff9cc102fc0 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10e410 con 0x7ff9cc1044c0 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10e710 con 0x7ff9cc1039a0 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38466/0 (socket says 172.21.15.100:38466) 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 -- 172.21.15.100:0/3987213793 learned_addr learned my addr 172.21.15.100:0/3987213793 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9cbfff640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc1039a0 0x7ff9cc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 -- 172.21.15.100:0/3987213793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc1039a0 msgr2=0x7ff9cc19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc1039a0 0x7ff9cc19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 -- 172.21.15.100:0/3987213793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9cc1044c0 msgr2=0x7ff9cc1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9cc1044c0 0x7ff9cc1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 -- 172.21.15.100:0/3987213793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc1a1d40 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d09e8640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000d740 tx=0x7ff9c000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0017070 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc1a1fd0 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9c000de50 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.858+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004ce0 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.859+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc1a2440 con 0x7ff9cc102fc0 2024-04-30T23:11:13.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.860+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc1a26a0 con 0x7ff9cc102fc0 2024-04-30T23:11:13.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.861+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff9c0004e80 con 0x7ff9cc102fc0 2024-04-30T23:11:13.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.861+0000 7ff9c9ffb640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 0x7ff9bc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:13.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.861+0000 7ff9cbfff640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 0x7ff9bc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:13.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.861+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff9c00d03d0 con 0x7ff9cc102fc0 2024-04-30T23:11:13.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.862+0000 7ff9cbfff640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 0x7ff9bc0a60c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc19b2a0 tx=0x7ff9b800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:13.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:13.866+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff9c009cb70 con 0x7ff9cc102fc0 2024-04-30T23:11:14.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.041+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff9cc1a2870 con 0x7ff9cc102fc0 2024-04-30T23:11:14.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.041+0000 7ff9c9ffb640 1 -- 172.21.15.100:0/3987213793 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7ff9c009c470 con 0x7ff9cc102fc0 2024-04-30T23:11:14.042 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 msgr2=0x7ff9bc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 0x7ff9bc0a60c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc19b2a0 tx=0x7ff9b800b390 comp rx=0 tx=0).stop 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 msgr2=0x7ff9cc19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000d740 tx=0x7ff9c000dc00 comp rx=0 tx=0).stop 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 shutdown_connections 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9bc0a3bb0 0x7ff9bc0a60c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9cc1044c0 0x7ff9cc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9cc1039a0 0x7ff9cc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 --2- 172.21.15.100:0/3987213793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc102fc0 0x7ff9cc19a200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 >> 172.21.15.100:0/3987213793 conn(0x7ff9cc0fd3c0 msgr2=0x7ff9cc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 shutdown_connections 2024-04-30T23:11:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.044+0000 7ff9d2c4c640 1 -- 172.21.15.100:0/3987213793 wait complete. 2024-04-30T23:11:14.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/510589322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:14.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3617088059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:14.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3810007876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:14.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/510589322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:14.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3617088059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:14.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3810007876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:14.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 -- 172.21.15.100:0/2109366444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 msgr2=0x7fcb5c10bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2109366444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c10bcf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009ca0 tx=0x7fcb5402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 -- 172.21.15.100:0/2109366444 shutdown_connections 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2109366444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c10bcf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2109366444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c106f70 0x7fcb5c109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2109366444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c104610 0x7fcb5c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 -- 172.21.15.100:0/2109366444 >> 172.21.15.100:0/2109366444 conn(0x7fcb5c0fdc10 msgr2=0x7fcb5c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 -- 172.21.15.100:0/2109366444 shutdown_connections 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 -- 172.21.15.100:0/2109366444 wait complete. 2024-04-30T23:11:14.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.165+0000 7fcb63f84640 1 Processor -- start 2024-04-30T23:11:14.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 -- start start 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 0x7fcb5c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c106f70 0x7fcb5c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10f650 con 0x7fcb5c1098d0 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10f4d0 con 0x7fcb5c104610 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb63f84640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10f7d0 con 0x7fcb5c106f70 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38474/0 (socket says 172.21.15.100:38474) 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 -- 172.21.15.100:0/2222217958 learned_addr learned my addr 172.21.15.100:0/2222217958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb6151f640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c106f70 0x7fcb5c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb61d20640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 0x7fcb5c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 -- 172.21.15.100:0/2222217958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c106f70 msgr2=0x7fcb5c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c106f70 0x7fcb5c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 -- 172.21.15.100:0/2222217958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 msgr2=0x7fcb5c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 0x7fcb5c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 -- 172.21.15.100:0/2222217958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c1a20c0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb61d20640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 0x7fcb5c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb62521640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009430 tx=0x7fcb54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.166+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5402f380 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.167+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb540317c0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.167+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c1a2350 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.167+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5402fcd0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.167+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c1a28a0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.167+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c06c2e0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.169+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fcb54004040 con 0x7fcb5c1098d0 2024-04-30T23:11:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.170+0000 7fcb52ffd640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 0x7fcb480a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.170+0000 7fcb61d20640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 0x7fcb480a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.170+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fcb540f1ea0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.170+0000 7fcb61d20640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 0x7fcb480a6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c06a8f0 tx=0x7fcb58005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.174+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcb540be640 con 0x7fcb5c1098d0 2024-04-30T23:11:14.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.363+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb5c1a2b00 con 0x7fcb5c1098d0 2024-04-30T23:11:14.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.364+0000 7fcb52ffd640 1 -- 172.21.15.100:0/2222217958 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+597 (secure 0 0 0) 0x7fcb540098b0 con 0x7fcb5c1098d0 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/57412019 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4139962241 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3231236282 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3389524928 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/820034739 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1429245117 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:14.364 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:14.365 INFO:teuthology.orchestra.run.smithi100.stderr:listed 10 entries 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 msgr2=0x7fcb480a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 0x7fcb480a6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c06a8f0 tx=0x7fcb58005e50 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 msgr2=0x7fcb5c1a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009430 tx=0x7fcb54003ba0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 shutdown_connections 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb480a3d50 0x7fcb480a6260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb5c1098d0 0x7fcb5c1a1a50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5c106f70 0x7fcb5c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 --2- 172.21.15.100:0/2222217958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb5c104610 0x7fcb5c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 >> 172.21.15.100:0/2222217958 conn(0x7fcb5c0fdc10 msgr2=0x7fcb5c105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 shutdown_connections 2024-04-30T23:11:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.366+0000 7fcb63f84640 1 -- 172.21.15.100:0/2222217958 wait complete. 2024-04-30T23:11:14.377 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:11:14.377 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:11:14.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 -- 172.21.15.100:0/2855689650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 msgr2=0x7f6058105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 --2- 172.21.15.100:0/2855689650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f6058105180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6048009900 tx=0x7f604802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 -- 172.21.15.100:0/2855689650 shutdown_connections 2024-04-30T23:11:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 --2- 172.21.15.100:0/2855689650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058109a70 0x7f605810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 --2- 172.21.15.100:0/2855689650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f6058105180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 --2- 172.21.15.100:0/2855689650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058103b30 0x7f6058104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 -- 172.21.15.100:0/2855689650 >> 172.21.15.100:0/2855689650 conn(0x7f60580fed80 msgr2=0x7f60581011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 -- 172.21.15.100:0/2855689650 shutdown_connections 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.541+0000 7f605e773640 1 -- 172.21.15.100:0/2855689650 wait complete. 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 Processor -- start 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 -- start start 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058103b30 0x7f605819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058109a70 0x7f60581a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f605810f650 con 0x7f6058104d70 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f605810f4d0 con 0x7f6058103b30 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f605e773640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f605810f7d0 con 0x7f6058109a70 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f60577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f60577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38496/0 (socket says 172.21.15.100:38496) 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.542+0000 7f60577fe640 1 -- 172.21.15.100:0/69640943 learned_addr learned my addr 172.21.15.100:0/69640943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f605cd10640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058109a70 0x7f60581a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f6057fff640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058103b30 0x7f605819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 -- 172.21.15.100:0/69640943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058109a70 msgr2=0x7f60581a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058109a70 0x7f60581a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 -- 172.21.15.100:0/69640943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058103b30 msgr2=0x7f605819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058103b30 0x7f605819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 -- 172.21.15.100:0/69640943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60581a1dc0 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60577fe640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6048006010 tx=0x7f6048031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604803f030 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6048003aa0 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60581a2050 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048035070 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.543+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60581a2540 con 0x7f6058104d70 2024-04-30T23:11:14.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.544+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605806a1d0 con 0x7f6058104d70 2024-04-30T23:11:14.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.545+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f6048042030 con 0x7f6058104d70 2024-04-30T23:11:14.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.546+0000 7f60557fa640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 0x7f60400a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.546+0000 7f6057fff640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 0x7f60400a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.546+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f60480f0c80 con 0x7f6058104d70 2024-04-30T23:11:14.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.546+0000 7f6057fff640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 0x7f60400a60c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f604c005fd0 tx=0x7f604c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.551+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f60480bd420 con 0x7f6058104d70 2024-04-30T23:11:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.736+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60580639a0 con 0x7f6058104d70 2024-04-30T23:11:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.738+0000 7f60557fa640 1 -- 172.21.15.100:0/69640943 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f60480bcd20 con 0x7f6058104d70 2024-04-30T23:11:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:14.738 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 msgr2=0x7f60400a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 0x7f60400a60c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f604c005fd0 tx=0x7f604c005850 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 msgr2=0x7f605819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6048006010 tx=0x7f6048031a50 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 shutdown_connections 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60400a3bb0 0x7f60400a60c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6058109a70 0x7f60581a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6058104d70 0x7f605819a7c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 --2- 172.21.15.100:0/69640943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6058103b30 0x7f605819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 >> 172.21.15.100:0/69640943 conn(0x7f60580fed80 msgr2=0x7f6058105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 shutdown_connections 2024-04-30T23:11:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.740+0000 7f605e773640 1 -- 172.21.15.100:0/69640943 wait complete. 2024-04-30T23:11:14.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:11:14.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 -- 172.21.15.100:0/1658639452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1941021d0 msgr2=0x7fa194102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/1658639452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1941021d0 0x7fa194102ed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa190009900 tx=0x7fa19002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 -- 172.21.15.100:0/1658639452 shutdown_connections 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/1658639452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 0x7fa19410a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/1658639452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa194103410 0x7fa194103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/1658639452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1941021d0 0x7fa194102ed0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.862+0000 7fa19c4a8640 1 -- 172.21.15.100:0/1658639452 >> 172.21.15.100:0/1658639452 conn(0x7fa1940fd3c0 msgr2=0x7fa1940ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:14.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- 172.21.15.100:0/1658639452 shutdown_connections 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- 172.21.15.100:0/1658639452 wait complete. 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 Processor -- start 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- start start 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1941021d0 0x7fa19410a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 0x7fa1941a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa19410dcf0 con 0x7fa194103410 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa19410db70 con 0x7fa1941021d0 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa19c4a8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa19410de70 con 0x7fa194108110 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa199a43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa199a43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38512/0 (socket says 172.21.15.100:38512) 2024-04-30T23:11:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.863+0000 7fa199a43640 1 -- 172.21.15.100:0/573458419 learned_addr learned my addr 172.21.15.100:0/573458419 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa19a244640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1941021d0 0x7fa19410a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa19aa45640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 0x7fa1941a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 -- 172.21.15.100:0/573458419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 msgr2=0x7fa1941a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 0x7fa1941a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 -- 172.21.15.100:0/573458419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1941021d0 msgr2=0x7fa19410a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1941021d0 0x7fa19410a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 -- 172.21.15.100:0/573458419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1941a3ff0 con 0x7fa194103410 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa199a43640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa18400d950 tx=0x7fa18400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184017030 con 0x7fa194103410 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa184004020 con 0x7fa194103410 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1941a42e0 con 0x7fa194103410 2024-04-30T23:11:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1840047a0 con 0x7fa194103410 2024-04-30T23:11:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.864+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1941a4830 con 0x7fa194103410 2024-04-30T23:11:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.865+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194107810 con 0x7fa194103410 2024-04-30T23:11:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.867+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fa184009a30 con 0x7fa194103410 2024-04-30T23:11:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.868+0000 7fa18b7fe640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 0x7fa1800a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:14.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.868+0000 7fa19a244640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 0x7fa1800a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:14.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.868+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa1840d0770 con 0x7fa194103410 2024-04-30T23:11:14.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.868+0000 7fa19a244640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 0x7fa1800a60c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa190005ab0 tx=0x7fa190031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:14.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:14.871+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa18409cf10 con 0x7fa194103410 2024-04-30T23:11:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:14 smithi104 ceph-mon[32987]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-04-30T23:11:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1218154387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3987213793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2222217958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.046+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1940637e0 con 0x7fa194103410 2024-04-30T23:11:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.047+0000 7fa18b7fe640 1 -- 172.21.15.100:0/573458419 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fa18409c810 con 0x7fa194103410 2024-04-30T23:11:15.047 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 msgr2=0x7fa1800a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 0x7fa1800a60c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa190005ab0 tx=0x7fa190031400 comp rx=0 tx=0).stop 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 msgr2=0x7fa1941a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa18400d950 tx=0x7fa18400de10 comp rx=0 tx=0).stop 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 shutdown_connections 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa1800a3bb0 0x7fa1800a60c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa194108110 0x7fa1941a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194103410 0x7fa1941a1460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 --2- 172.21.15.100:0/573458419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1941021d0 0x7fa19410a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 >> 172.21.15.100:0/573458419 conn(0x7fa1940fd3c0 msgr2=0x7fa1940fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 shutdown_connections 2024-04-30T23:11:15.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.049+0000 7fa19c4a8640 1 -- 172.21.15.100:0/573458419 wait complete. 2024-04-30T23:11:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:14 smithi183 ceph-mon[33560]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-04-30T23:11:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1218154387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3987213793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2222217958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:15.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:14 smithi100 ceph-mon[29745]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-04-30T23:11:15.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1218154387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3987213793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:15.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2222217958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:15.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 -- 172.21.15.100:0/804663880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148103c80 msgr2=0x7f9148104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 --2- 172.21.15.100:0/804663880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148103c80 0x7f9148104090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9138009900 tx=0x7f913802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 -- 172.21.15.100:0/804663880 shutdown_connections 2024-04-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 --2- 172.21.15.100:0/804663880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 0x7f914810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 --2- 172.21.15.100:0/804663880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148103c80 0x7f9148104090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 --2- 172.21.15.100:0/804663880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148102a40 0x7f9148103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 -- 172.21.15.100:0/804663880 >> 172.21.15.100:0/804663880 conn(0x7f91480fdc30 msgr2=0x7f91481000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 -- 172.21.15.100:0/804663880 shutdown_connections 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.171+0000 7f914f4aa640 1 -- 172.21.15.100:0/804663880 wait complete. 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 Processor -- start 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 -- start start 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148103c80 0x7f9148199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 0x7f91481a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e540 con 0x7f9148102a40 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e3c0 con 0x7f9148108980 2024-04-30T23:11:15.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914f4aa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e6c0 con 0x7f9148103c80 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914d246640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914d246640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38534/0 (socket says 172.21.15.100:38534) 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914d246640 1 -- 172.21.15.100:0/2334200922 learned_addr learned my addr 172.21.15.100:0/2334200922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914da47640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 0x7f91481a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.172+0000 7f914ca45640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148103c80 0x7f9148199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 -- 172.21.15.100:0/2334200922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148103c80 msgr2=0x7f9148199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148103c80 0x7f9148199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 -- 172.21.15.100:0/2334200922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 msgr2=0x7f91481a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 0x7f91481a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 -- 172.21.15.100:0/2334200922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91481a0ba0 con 0x7f9148102a40 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914d246640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f914400c970 tx=0x7f914400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144007c70 con 0x7f9148102a40 2024-04-30T23:11:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9144007e10 con 0x7f9148102a40 2024-04-30T23:11:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91481a0e90 con 0x7f9148102a40 2024-04-30T23:11:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91440187b0 con 0x7f9148102a40 2024-04-30T23:11:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.173+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481a12f0 con 0x7f9148102a40 2024-04-30T23:11:15.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.174+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914806a1d0 con 0x7f9148102a40 2024-04-30T23:11:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.175+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f914400fab0 con 0x7f9148102a40 2024-04-30T23:11:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.176+0000 7f913e7fc640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 0x7f91340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.176+0000 7f914ca45640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 0x7f91340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.176+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f91440d0890 con 0x7f9148102a40 2024-04-30T23:11:15.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.176+0000 7f914ca45640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 0x7f91340a60c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f9138031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.180+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f914806a1d0 con 0x7f9148102a40 2024-04-30T23:11:15.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.357+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f914802dc30 con 0x7f9148102a40 2024-04-30T23:11:15.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.357+0000 7f913e7fc640 1 -- 172.21.15.100:0/2334200922 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f9144014030 con 0x7f9148102a40 2024-04-30T23:11:15.357 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:11:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 msgr2=0x7f91340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 0x7f91340a60c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f9138031400 comp rx=0 tx=0).stop 2024-04-30T23:11:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 msgr2=0x7f9148199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f914400c970 tx=0x7f914400ce30 comp rx=0 tx=0).stop 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 shutdown_connections 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91340a3bb0 0x7f91340a60c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9148108980 0x7f91481a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9148103c80 0x7f9148199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 --2- 172.21.15.100:0/2334200922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9148102a40 0x7f9148199110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 >> 172.21.15.100:0/2334200922 conn(0x7f91480fdc30 msgr2=0x7f9148104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 shutdown_connections 2024-04-30T23:11:15.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.359+0000 7f914f4aa640 1 -- 172.21.15.100:0/2334200922 wait complete. 2024-04-30T23:11:15.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:11:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 -- 172.21.15.100:0/2424331134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba41021d0 msgr2=0x7ffba4102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 --2- 172.21.15.100:0/2424331134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba41021d0 0x7ffba4102ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffba000aa10 tx=0x7ffba002b720 comp rx=0 tx=0).stop 2024-04-30T23:11:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 -- 172.21.15.100:0/2424331134 shutdown_connections 2024-04-30T23:11:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 --2- 172.21.15.100:0/2424331134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba4108110 0x7ffba410a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 --2- 172.21.15.100:0/2424331134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4103410 0x7ffba4103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 --2- 172.21.15.100:0/2424331134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba41021d0 0x7ffba4102ed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 -- 172.21.15.100:0/2424331134 >> 172.21.15.100:0/2424331134 conn(0x7ffba40fd3c0 msgr2=0x7ffba40ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 -- 172.21.15.100:0/2424331134 shutdown_connections 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.481+0000 7ffbab429640 1 -- 172.21.15.100:0/2424331134 wait complete. 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 Processor -- start 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 -- start start 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba41021d0 0x7ffba4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 0x7ffba419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d460 con 0x7ffba4103410 2024-04-30T23:11:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d2e0 con 0x7ffba4108110 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffbab429640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410d5e0 con 0x7ffba41021d0 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffba89c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffba89c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38552/0 (socket says 172.21.15.100:38552) 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffba89c4640 1 -- 172.21.15.100:0/3515190240 learned_addr learned my addr 172.21.15.100:0/3515190240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.482+0000 7ffba99c6640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 0x7ffba419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba91c5640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba41021d0 0x7ffba4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 -- 172.21.15.100:0/3515190240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba41021d0 msgr2=0x7ffba4198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba41021d0 0x7ffba4198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 -- 172.21.15.100:0/3515190240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 msgr2=0x7ffba419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 0x7ffba419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 -- 172.21.15.100:0/3515190240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba419fbd0 con 0x7ffba4103410 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba99c6640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 0x7ffba419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffba89c4640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400eb00 tx=0x7ffb94009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9401c070 con 0x7ffba4103410 2024-04-30T23:11:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9400bc30 con 0x7ffba4103410 2024-04-30T23:11:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94016610 con 0x7ffba4103410 2024-04-30T23:11:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba419fec0 con 0x7ffba4103410 2024-04-30T23:11:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.483+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41a0380 con 0x7ffba4103410 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.484+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba4106f20 con 0x7ffba4103410 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.485+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ffb9401f070 con 0x7ffba4103410 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.486+0000 7ffb9a7fc640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 0x7ffb900a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.486+0000 7ffba91c5640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 0x7ffb900a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.486+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ffb940d1c30 con 0x7ffba4103410 2024-04-30T23:11:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.486+0000 7ffba91c5640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 0x7ffb900a6140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffba000a340 tx=0x7ffba0030510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.491+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffb9400bde0 con 0x7ffba4103410 2024-04-30T23:11:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.673+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffba40637e0 con 0x7ffba4103410 2024-04-30T23:11:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.673+0000 7ffb9a7fc640 1 -- 172.21.15.100:0/3515190240 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7ffb9409e3d0 con 0x7ffba4103410 2024-04-30T23:11:15.673 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:11:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 msgr2=0x7ffb900a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 0x7ffb900a6140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffba000a340 tx=0x7ffba0030510 comp rx=0 tx=0).stop 2024-04-30T23:11:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 msgr2=0x7ffba41985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400eb00 tx=0x7ffb94009f20 comp rx=0 tx=0).stop 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 shutdown_connections 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ffb900a3c30 0x7ffb900a6140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffba4108110 0x7ffba419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffba4103410 0x7ffba41985d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 --2- 172.21.15.100:0/3515190240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffba41021d0 0x7ffba4198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.675+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 >> 172.21.15.100:0/3515190240 conn(0x7ffba40fd3c0 msgr2=0x7ffba41040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.676+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 shutdown_connections 2024-04-30T23:11:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.676+0000 7ffbab429640 1 -- 172.21.15.100:0/3515190240 wait complete. 2024-04-30T23:11:15.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:11:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 -- 172.21.15.100:0/199199939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40108980 msgr2=0x7f7a4010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 --2- 172.21.15.100:0/199199939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40108980 0x7f7a4010ada0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009ca0 tx=0x7f7a3802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 -- 172.21.15.100:0/199199939 shutdown_connections 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 --2- 172.21.15.100:0/199199939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40108980 0x7f7a4010ada0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 --2- 172.21.15.100:0/199199939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 0x7f7a40104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 --2- 172.21.15.100:0/199199939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40102a40 0x7f7a40103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.797+0000 7f7a45670640 1 -- 172.21.15.100:0/199199939 >> 172.21.15.100:0/199199939 conn(0x7f7a400fdc30 msgr2=0x7f7a401000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- 172.21.15.100:0/199199939 shutdown_connections 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- 172.21.15.100:0/199199939 wait complete. 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 Processor -- start 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- start start 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 0x7f7a40199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40108980 0x7f7a401a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4010e550 con 0x7f7a40102a40 2024-04-30T23:11:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4010e3d0 con 0x7f7a40103c80 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a45670640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4010e6d0 con 0x7f7a40108980 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38576/0 (socket says 172.21.15.100:38576) 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.798+0000 7f7a3effd640 1 -- 172.21.15.100:0/3292678145 learned_addr learned my addr 172.21.15.100:0/3292678145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a37fff640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 0x7f7a40199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3f7fe640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40108980 0x7f7a401a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 -- 172.21.15.100:0/3292678145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40108980 msgr2=0x7f7a401a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40108980 0x7f7a401a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 -- 172.21.15.100:0/3292678145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 msgr2=0x7f7a40199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 0x7f7a40199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 -- 172.21.15.100:0/3292678145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a401a0c90 con 0x7f7a40102a40 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3effd640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000e9f0 tx=0x7f7a3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000ccc0 con 0x7f7a40102a40 2024-04-30T23:11:15.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a300035f0 con 0x7f7a40102a40 2024-04-30T23:11:15.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a401a0f80 con 0x7f7a40102a40 2024-04-30T23:11:15.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000ce60 con 0x7f7a40102a40 2024-04-30T23:11:15.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.799+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a401a13e0 con 0x7f7a40102a40 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.800+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4006a1a0 con 0x7f7a40102a40 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.802+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f7a30003aa0 con 0x7f7a40102a40 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.803+0000 7f7a3cff9640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 0x7f7a2c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.803+0000 7f7a37fff640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 0x7f7a2c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.803+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f7a300d0ab0 con 0x7f7a40102a40 2024-04-30T23:11:15.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.803+0000 7f7a37fff640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 0x7f7a2c0a60c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a4019a1f0 tx=0x7f7a28005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.807+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a3009d250 con 0x7f7a40102a40 2024-04-30T23:11:15.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.987+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7a401074e0 con 0x7f7a40102a40 2024-04-30T23:11:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.988+0000 7f7a3cff9640 1 -- 172.21.15.100:0/3292678145 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f7a3009cb50 con 0x7f7a40102a40 2024-04-30T23:11:15.987 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:11:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 msgr2=0x7f7a2c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 0x7f7a2c0a60c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a4019a1f0 tx=0x7f7a28005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 msgr2=0x7f7a40199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000e9f0 tx=0x7f7a3000eeb0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 shutdown_connections 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a2c0a3bb0 0x7f7a2c0a60c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a40108980 0x7f7a401a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a40103c80 0x7f7a40199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 --2- 172.21.15.100:0/3292678145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a40102a40 0x7f7a40199150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 >> 172.21.15.100:0/3292678145 conn(0x7f7a400fdc30 msgr2=0x7f7a40104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 shutdown_connections 2024-04-30T23:11:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:15.990+0000 7f7a45670640 1 -- 172.21.15.100:0/3292678145 wait complete. 2024-04-30T23:11:16.000 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/69640943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:16.000 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/573458419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.000 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2334200922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T23:11:16.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/69640943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/573458419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2334200922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/69640943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/573458419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2334200922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 -- 172.21.15.100:0/1624406624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8103b20 msgr2=0x7f88f8104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/1624406624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8103b20 0x7f88f8104820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009900 tx=0x7f88e802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 -- 172.21.15.100:0/1624406624 shutdown_connections 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/1624406624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8109a60 0x7f88f810be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/1624406624 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8104d60 0x7f88f8105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/1624406624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8103b20 0x7f88f8104820 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 -- 172.21.15.100:0/1624406624 >> 172.21.15.100:0/1624406624 conn(0x7f88f80fed10 msgr2=0x7f88f81011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 -- 172.21.15.100:0/1624406624 shutdown_connections 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.110+0000 7f88fd4aa640 1 -- 172.21.15.100:0/1624406624 wait complete. 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 Processor -- start 2024-04-30T23:11:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 -- start start 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8103b20 0x7f88f8076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8104d60 0x7f88f8074f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f88f810f600 con 0x7f88f8109a60 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88f810f480 con 0x7f88f8103b20 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88fd4aa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88f810f780 con 0x7f88f8104d60 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38602/0 (socket says 172.21.15.100:38602) 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88f77fe640 1 -- 172.21.15.100:0/4277906725 learned_addr learned my addr 172.21.15.100:0/4277906725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88f6ffd640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8103b20 0x7f88f8076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.111+0000 7f88f67fc640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8104d60 0x7f88f8074f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 -- 172.21.15.100:0/4277906725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8104d60 msgr2=0x7f88f8074f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:16.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8104d60 0x7f88f8074f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 -- 172.21.15.100:0/4277906725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8103b20 msgr2=0x7f88f8076890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8103b20 0x7f88f8076890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 -- 172.21.15.100:0/4277906725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f8075ba0 con 0x7f88f8109a60 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88f77fe640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f88f000eaa0 tx=0x7f88f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f000cdb0 con 0x7f88f8109a60 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f81a4310 con 0x7f88f8109a60 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f0005020 con 0x7f88f8109a60 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00116d0 con 0x7f88f8109a60 2024-04-30T23:11:16.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.112+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f81a47d0 con 0x7f88f8109a60 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.113+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f8108870 con 0x7f88f8109a60 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.114+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f88f00051d0 con 0x7f88f8109a60 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.115+0000 7f88dffff640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 0x7f88e00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.115+0000 7f88f6ffd640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 0x7f88e00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.115+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f88f00d0d00 con 0x7f88f8109a60 2024-04-30T23:11:16.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.115+0000 7f88f6ffd640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 0x7f88e00a60c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009230 tx=0x7f88e8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.119+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88f0016030 con 0x7f88f8109a60 2024-04-30T23:11:16.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.307+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f88f802db90 con 0x7f88f8109a60 2024-04-30T23:11:16.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.308+0000 7f88dffff640 1 -- 172.21.15.100:0/4277906725 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+597 (secure 0 0 0) 0x7f88f009d440 con 0x7f88f8109a60 2024-04-30T23:11:16.307 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/57412019 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4139962241 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3231236282 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3389524928 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/820034739 2024-05-01T23:03:28.524392+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1429245117 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:11:16.308 INFO:teuthology.orchestra.run.smithi100.stderr:listed 10 entries 2024-04-30T23:11:16.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 msgr2=0x7f88e00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 0x7f88e00a60c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009230 tx=0x7f88e8031400 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 msgr2=0x7f88f8075470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f88f000eaa0 tx=0x7f88f000ef60 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 shutdown_connections 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f88e00a3bb0 0x7f88e00a60c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f8109a60 0x7f88f8075470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88f8104d60 0x7f88f8074f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 --2- 172.21.15.100:0/4277906725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88f8103b20 0x7f88f8076890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 >> 172.21.15.100:0/4277906725 conn(0x7f88f80fed10 msgr2=0x7f88f8105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 shutdown_connections 2024-04-30T23:11:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:16.310+0000 7f88fd4aa640 1 -- 172.21.15.100:0/4277906725 wait complete. 2024-04-30T23:11:16.321 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-04-30T23:11:16.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:16.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-30T23:11:16.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[71401]: fuse finished with error 0 and tester_r 0 2024-04-30T23:11:16.345 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T23:11:16.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:16 smithi183 ceph-mon[33560]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-30T23:11:16.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3515190240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3292678145' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:16.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4277906725' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:17.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:16 smithi104 ceph-mon[32987]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-30T23:11:17.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3515190240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:17.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3292678145' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4277906725' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:17.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:16 smithi100 ceph-mon[29745]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-30T23:11:17.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3515190240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:11:17.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3292678145' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:11:17.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4277906725' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:11:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:18 smithi104 ceph-mon[32987]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 263 B/s wr, 0 op/s 2024-04-30T23:11:19.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:18 smithi183 ceph-mon[33560]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 263 B/s wr, 0 op/s 2024-04-30T23:11:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:18 smithi100 ceph-mon[29745]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 263 B/s wr, 0 op/s 2024-04-30T23:11:21.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:20 smithi104 ceph-mon[32987]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-30T23:11:21.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:20 smithi183 ceph-mon[33560]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-30T23:11:21.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:20 smithi100 ceph-mon[29745]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-30T23:11:22.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:11:22.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:11:22.448 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-30T23:11:22.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 -- 172.21.15.100:0/3828457242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc109a80 msgr2=0x7faddc10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 --2- 172.21.15.100:0/3828457242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc109a80 0x7faddc10bea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009ca0 tx=0x7fadd402a8e0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 -- 172.21.15.100:0/3828457242 shutdown_connections 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 --2- 172.21.15.100:0/3828457242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc109a80 0x7faddc10bea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 --2- 172.21.15.100:0/3828457242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc104d80 0x7faddc105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 --2- 172.21.15.100:0/3828457242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc103b40 0x7faddc104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 -- 172.21.15.100:0/3828457242 >> 172.21.15.100:0/3828457242 conn(0x7faddc0fed50 msgr2=0x7faddc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 -- 172.21.15.100:0/3828457242 shutdown_connections 2024-04-30T23:11:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.636+0000 7fade0870640 1 -- 172.21.15.100:0/3828457242 wait complete. 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 Processor -- start 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 -- start start 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc103b40 0x7faddc19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 0x7faddc1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faddc10f710 con 0x7faddc104d80 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faddc10f590 con 0x7faddc103b40 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fade0870640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faddc10f890 con 0x7faddc109a80 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38612/0 (socket says 172.21.15.100:38612) 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 -- 172.21.15.100:0/2962333499 learned_addr learned my addr 172.21.15.100:0/2962333499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7faddad9d640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 0x7faddc1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadda59c640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc103b40 0x7faddc19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 -- 172.21.15.100:0/2962333499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 msgr2=0x7faddc1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 0x7faddc1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 -- 172.21.15.100:0/2962333499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc103b40 msgr2=0x7faddc19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc103b40 0x7faddc19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7fadd9d9b640 1 -- 172.21.15.100:0/2962333499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc1a1d70 con 0x7faddc104d80 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.637+0000 7faddad9d640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 0x7faddc1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fadd9d9b640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c920 tx=0x7fadd000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0007c70 con 0x7faddc104d80 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd0007e10 con 0x7faddc104d80 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0018820 con 0x7faddc104d80 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faddc1a2060 con 0x7faddc104d80 2024-04-30T23:11:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.638+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faddc1a2560 con 0x7faddc104d80 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.639+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faddc108890 con 0x7faddc104d80 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.640+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fadd000f450 con 0x7faddc104d80 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.641+0000 7fadcb7fe640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 0x7fadc40a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.641+0000 7fadda59c640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 0x7fadc40a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.641+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fadd00d0a80 con 0x7faddc104d80 2024-04-30T23:11:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.641+0000 7fadda59c640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 0x7fadc40a6140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faddc104740 tx=0x7fadcc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.644+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fadd0014030 con 0x7faddc104d80 2024-04-30T23:11:22.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:22 smithi100 ceph-mon[29745]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:22.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.825+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faddc0637e0 con 0x7faddc104d80 2024-04-30T23:11:22.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.827+0000 7fadcb7fe640 1 -- 172.21.15.100:0/2962333499 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7fadd001f300 con 0x7faddc104d80 2024-04-30T23:11:22.827 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:22.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 msgr2=0x7fadc40a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 0x7fadc40a6140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faddc104740 tx=0x7fadcc008040 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 msgr2=0x7faddc19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c920 tx=0x7fadd000cde0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 shutdown_connections 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fadc40a3c30 0x7fadc40a6140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faddc109a80 0x7faddc1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faddc104d80 0x7faddc19a820 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 --2- 172.21.15.100:0/2962333499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faddc103b40 0x7faddc19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 >> 172.21.15.100:0/2962333499 conn(0x7faddc0fed50 msgr2=0x7faddc105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 shutdown_connections 2024-04-30T23:11:22.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.829+0000 7fade0870640 1 -- 172.21.15.100:0/2962333499 wait complete. 2024-04-30T23:11:22.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- 172.21.15.100:0/132412872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 msgr2=0x7f3f1810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 --2- 172.21.15.100:0/132412872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f1810bcb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009ca0 tx=0x7f3f1002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- 172.21.15.100:0/132412872 shutdown_connections 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 --2- 172.21.15.100:0/132412872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f1810bcb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 --2- 172.21.15.100:0/132412872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18102380 0x7f3f18109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 --2- 172.21.15.100:0/132412872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18101e80 0x7f3f18106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- 172.21.15.100:0/132412872 >> 172.21.15.100:0/132412872 conn(0x7f3f180fd370 msgr2=0x7f3f180ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- 172.21.15.100:0/132412872 shutdown_connections 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- 172.21.15.100:0/132412872 wait complete. 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 Processor -- start 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.949+0000 7f3f205d7640 1 -- start start 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 0x7f3f1819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18102380 0x7f3f1819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810f610 con 0x7f3f181097a0 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810f490 con 0x7f3f18102380 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810f790 con 0x7f3f18101e80 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38632/0 (socket says 172.21.15.100:38632) 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 -- 172.21.15.100:0/690837609 learned_addr learned my addr 172.21.15.100:0/690837609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1e373640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 0x7f3f1819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1db72640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18102380 0x7f3f1819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 -- 172.21.15.100:0/690837609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 msgr2=0x7f3f1819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 0x7f3f1819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 -- 172.21.15.100:0/690837609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18102380 msgr2=0x7f3f1819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18102380 0x7f3f1819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 -- 172.21.15.100:0/690837609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f181a1c40 con 0x7f3f181097a0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1e373640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 0x7f3f1819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f1eb74640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f100097b0 tx=0x7f3f10003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004240 con 0x7f3f181097a0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f100317c0 con 0x7f3f181097a0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1002fde0 con 0x7f3f181097a0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f181a1ed0 con 0x7f3f181097a0 2024-04-30T23:11:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.950+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181a2390 con 0x7f3f181097a0 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.951+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f180fee90 con 0x7f3f181097a0 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.953+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3f100043e0 con 0x7f3f181097a0 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.954+0000 7f3f0f7fe640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 0x7f3f040a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.954+0000 7f3f1e373640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 0x7f3f040a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.954+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f3f100f2130 con 0x7f3f181097a0 2024-04-30T23:11:22.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.954+0000 7f3f1e373640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 0x7f3f040a6140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400baa0 tx=0x7f3f14005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:22.958+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f100be8d0 con 0x7f3f181097a0 2024-04-30T23:11:23.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:22 smithi104 ceph-mon[32987]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:23.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:22 smithi183 ceph-mon[33560]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:23.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.138+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f180637e0 con 0x7f3f181097a0 2024-04-30T23:11:23.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.139+0000 7f3f0f7fe640 1 -- 172.21.15.100:0/690837609 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f3f100be1d0 con 0x7f3f181097a0 2024-04-30T23:11:23.139 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:23.139 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 msgr2=0x7f3f040a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 0x7f3f040a6140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400baa0 tx=0x7f3f14005d90 comp rx=0 tx=0).stop 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 msgr2=0x7f3f181a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f100097b0 tx=0x7f3f10003c20 comp rx=0 tx=0).stop 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 shutdown_connections 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3f040a3c30 0x7f3f040a6140 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f181097a0 0x7f3f181a1680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f18102380 0x7f3f1819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 --2- 172.21.15.100:0/690837609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f18101e80 0x7f3f1819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 >> 172.21.15.100:0/690837609 conn(0x7f3f180fd370 msgr2=0x7f3f18105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 shutdown_connections 2024-04-30T23:11:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.141+0000 7f3f205d7640 1 -- 172.21.15.100:0/690837609 wait complete. 2024-04-30T23:11:23.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 -- 172.21.15.100:0/3092089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44104500 msgr2=0x7feb4410ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3092089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44104500 0x7feb4410ac50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009ca0 tx=0x7feb3c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 -- 172.21.15.100:0/3092089708 shutdown_connections 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3092089708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44104500 0x7feb4410ac50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3092089708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb441039a0 0x7feb44103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3092089708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb44102e40 0x7feb44103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 -- 172.21.15.100:0/3092089708 >> 172.21.15.100:0/3092089708 conn(0x7feb440fd1e0 msgr2=0x7feb440ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 -- 172.21.15.100:0/3092089708 shutdown_connections 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.265+0000 7feb4af9f640 1 -- 172.21.15.100:0/3092089708 wait complete. 2024-04-30T23:11:23.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 Processor -- start 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 -- start start 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 0x7feb44102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb4419f0f0 0x7feb441a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb4410e600 con 0x7feb441039a0 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb4410e480 con 0x7feb44102e40 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4af9f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feb4410e780 con 0x7feb4419f0f0 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4979c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4979c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38660/0 (socket says 172.21.15.100:38660) 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4979c640 1 -- 172.21.15.100:0/3822626025 learned_addr learned my addr 172.21.15.100:0/3822626025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.266+0000 7feb4a79e640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb4419f0f0 0x7feb441a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb49f9d640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 0x7feb44102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 -- 172.21.15.100:0/3822626025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb4419f0f0 msgr2=0x7feb441a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb4419f0f0 0x7feb441a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 -- 172.21.15.100:0/3822626025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 msgr2=0x7feb44102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 0x7feb44102100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 -- 172.21.15.100:0/3822626025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb441a1d50 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb49f9d640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 0x7feb44102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4979c640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e9f0 tx=0x7feb3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3400cd80 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb340108e0 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb441a1fe0 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34018980 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.267+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb441a24d0 con 0x7feb441039a0 2024-04-30T23:11:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.268+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4406b2a0 con 0x7feb441039a0 2024-04-30T23:11:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.270+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7feb34010430 con 0x7feb441039a0 2024-04-30T23:11:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.271+0000 7feb3affd640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 0x7feb300a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.271+0000 7feb49f9d640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 0x7feb300a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.271+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7feb340d0ec0 con 0x7feb441039a0 2024-04-30T23:11:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.271+0000 7feb49f9d640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 0x7feb300a60b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb400058c0 tx=0x7feb40005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.274+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb3409d660 con 0x7feb441039a0 2024-04-30T23:11:23.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.492+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feb44109970 con 0x7feb441039a0 2024-04-30T23:11:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.663+0000 7feb3affd640 1 -- 172.21.15.100:0/3822626025 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7feb3409cf60 con 0x7feb441039a0 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 msgr2=0x7feb300a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 0x7feb300a60b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb400058c0 tx=0x7feb40005850 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 msgr2=0x7feb4419ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e9f0 tx=0x7feb3400eeb0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 shutdown_connections 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7feb300a3ba0 0x7feb300a60b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb4419f0f0 0x7feb441a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb441039a0 0x7feb4419ebb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 --2- 172.21.15.100:0/3822626025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb44102e40 0x7feb44102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 >> 172.21.15.100:0/3822626025 conn(0x7feb440fd1e0 msgr2=0x7feb44106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:23.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 shutdown_connections 2024-04-30T23:11:23.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.665+0000 7feb4af9f640 1 -- 172.21.15.100:0/3822626025 wait complete. 2024-04-30T23:11:23.676 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-30T23:11:23.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-30T23:11:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 -- 172.21.15.100:0/582120220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28104d70 msgr2=0x7f1f28105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/582120220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28104d70 0x7f1f28105180 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009900 tx=0x7f1f1802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 -- 172.21.15.100:0/582120220 shutdown_connections 2024-04-30T23:11:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/582120220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28109a70 0x7f1f2810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/582120220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28104d70 0x7f1f28105180 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/582120220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f28104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 -- 172.21.15.100:0/582120220 >> 172.21.15.100:0/582120220 conn(0x7f1f280fed20 msgr2=0x7f1f281011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 -- 172.21.15.100:0/582120220 shutdown_connections 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.787+0000 7f1f2f98d640 1 -- 172.21.15.100:0/582120220 wait complete. 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 Processor -- start 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 -- start start 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f2819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 0x7f1f2819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810f660 con 0x7f1f28109a70 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810f4e0 con 0x7f1f28103b30 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2f98d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810f7e0 con 0x7f1f28104d70 2024-04-30T23:11:23.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2df2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2df2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54114/0 (socket says 172.21.15.100:54114) 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2df2a640 1 -- 172.21.15.100:0/3888811825 learned_addr learned my addr 172.21.15.100:0/3888811825 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2d729640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f2819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.788+0000 7f1f2cf28640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 0x7f1f2819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 -- 172.21.15.100:0/3888811825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 msgr2=0x7f1f2819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 0x7f1f2819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 -- 172.21.15.100:0/3888811825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 msgr2=0x7f1f2819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f2819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 -- 172.21.15.100:0/3888811825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f281a1d70 con 0x7f1f28109a70 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2cf28640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 0x7f1f2819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2d729640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f2819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2df2a640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cad0 tx=0x7f1f2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:23.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000ae20 con 0x7f1f28109a70 2024-04-30T23:11:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f20005020 con 0x7f1f28109a70 2024-04-30T23:11:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f281a2060 con 0x7f1f28109a70 2024-04-30T23:11:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000f6b0 con 0x7f1f28109a70 2024-04-30T23:11:23.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.789+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a25b0 con 0x7f1f28109a70 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.790+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f28108880 con 0x7f1f28109a70 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.791+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1f200051d0 con 0x7f1f28109a70 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.792+0000 7f1f1e7fc640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 0x7f1f140a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.792+0000 7f1f2d729640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 0x7f1f140a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.792+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1f200d0700 con 0x7f1f28109a70 2024-04-30T23:11:23.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.792+0000 7f1f2d729640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 0x7f1f140a60c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f240058c0 tx=0x7f1f24005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:23.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:23.796+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f20014030 con 0x7f1f28109a70 2024-04-30T23:11:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.016+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f1f280637e0 con 0x7f1f28109a70 2024-04-30T23:11:24.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:23 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2962333499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:23 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/690837609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:23 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-30T23:11:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:23 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2962333499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:23 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/690837609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:23 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-30T23:11:24.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2962333499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/690837609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:24.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-30T23:11:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.664+0000 7f1f1e7fc640 1 -- 172.21.15.100:0/3888811825 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f1f2009cea0 con 0x7f1f28109a70 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 msgr2=0x7f1f140a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 0x7f1f140a60c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f240058c0 tx=0x7f1f24005850 comp rx=0 tx=0).stop 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 msgr2=0x7f1f281a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cad0 tx=0x7f1f2000cf90 comp rx=0 tx=0).stop 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 shutdown_connections 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f140a3bb0 0x7f1f140a60c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f28109a70 0x7f1f281a1700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f28104d70 0x7f1f2819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 --2- 172.21.15.100:0/3888811825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f28103b30 0x7f1f2819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 >> 172.21.15.100:0/3888811825 conn(0x7f1f280fed20 msgr2=0x7f1f28105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 shutdown_connections 2024-04-30T23:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.667+0000 7f1f2f98d640 1 -- 172.21.15.100:0/3888811825 wait complete. 2024-04-30T23:11:24.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-30T23:11:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 -- 172.21.15.100:0/3172166897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc103c80 msgr2=0x7f59fc104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 --2- 172.21.15.100:0/3172166897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc103c80 0x7f59fc104090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009900 tx=0x7f59e402a410 comp rx=0 tx=0).stop 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 -- 172.21.15.100:0/3172166897 shutdown_connections 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 --2- 172.21.15.100:0/3172166897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59fc108980 0x7f59fc10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 --2- 172.21.15.100:0/3172166897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc103c80 0x7f59fc104090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 --2- 172.21.15.100:0/3172166897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc102a40 0x7f59fc103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 -- 172.21.15.100:0/3172166897 >> 172.21.15.100:0/3172166897 conn(0x7f59fc0fdc30 msgr2=0x7f59fc1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 -- 172.21.15.100:0/3172166897 shutdown_connections 2024-04-30T23:11:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.800+0000 7f5a01067640 1 -- 172.21.15.100:0/3172166897 wait complete. 2024-04-30T23:11:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 Processor -- start 2024-04-30T23:11:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 -- start start 2024-04-30T23:11:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 0x7f59fc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59fc108980 0x7f59fc1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc10e560 con 0x7f59fc102a40 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc10e3e0 con 0x7f59fc108980 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.801+0000 7f5a01067640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc10e6e0 con 0x7f59fc103c80 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54136/0 (socket says 172.21.15.100:54136) 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 -- 172.21.15.100:0/2141659284 learned_addr learned my addr 172.21.15.100:0/2141659284 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59f3fff640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 0x7f59fc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 -- 172.21.15.100:0/2141659284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 msgr2=0x7f59fc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 0x7f59fc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 -- 172.21.15.100:0/2141659284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59fc108980 msgr2=0x7f59fc1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59fc108980 0x7f59fc1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 -- 172.21.15.100:0/2141659284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc1a1df0 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59f3fff640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 0x7f59fc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59fad9d640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005d00 tx=0x7f59ec00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec017070 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc1a20e0 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59ec009c30 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00f620 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.802+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc1a25e0 con 0x7f59fc102a40 2024-04-30T23:11:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.803+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc1a2840 con 0x7f59fc102a40 2024-04-30T23:11:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.805+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f59ec01a070 con 0x7f59fc102a40 2024-04-30T23:11:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.805+0000 7f59f8d99640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 0x7f59e80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.805+0000 7f59f3fff640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 0x7f59e80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.805+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f59ec0d01a0 con 0x7f59fc102a40 2024-04-30T23:11:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.806+0000 7f59f3fff640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 0x7f59e80a60c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59e4005f70 tx=0x7f59e4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:24.809+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f59ec009de0 con 0x7f59fc102a40 2024-04-30T23:11:25.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.030+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f59fc1a2a10 con 0x7f59fc102a40 2024-04-30T23:11:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:24 smithi104 ceph-mon[32987]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-30T23:11:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:24 smithi104 ceph-mon[32987]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:25.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-30T23:11:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:24 smithi183 ceph-mon[33560]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-30T23:11:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:24 smithi183 ceph-mon[33560]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:25.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-30T23:11:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:24 smithi100 ceph-mon[29745]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-30T23:11:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3822626025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-30T23:11:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:24 smithi100 ceph-mon[29745]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:25.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-30T23:11:25.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.682+0000 7f59f8d99640 1 -- 172.21.15.100:0/2141659284 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f59ec09c940 con 0x7f59fc102a40 2024-04-30T23:11:25.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.684+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 msgr2=0x7f59e80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:25.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.684+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 0x7f59e80a60c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59e4005f70 tx=0x7f59e4031400 comp rx=0 tx=0).stop 2024-04-30T23:11:25.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.684+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 msgr2=0x7f59fc19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:25.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.684+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005d00 tx=0x7f59ec00dde0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.684+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 shutdown_connections 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f59e80a3bb0 0x7f59e80a60c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59fc108980 0x7f59fc1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59fc103c80 0x7f59fc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 --2- 172.21.15.100:0/2141659284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59fc102a40 0x7f59fc19a2b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 >> 172.21.15.100:0/2141659284 conn(0x7f59fc0fdc30 msgr2=0x7f59fc109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 shutdown_connections 2024-04-30T23:11:25.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.685+0000 7f5a01067640 1 -- 172.21.15.100:0/2141659284 wait complete. 2024-04-30T23:11:25.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-30T23:11:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.818+0000 7f68db72d640 1 -- 172.21.15.100:0/1697776680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d4102280 msgr2=0x7f68d410bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.818+0000 7f68db72d640 1 --2- 172.21.15.100:0/1697776680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d4102280 0x7f68d410bce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009ca0 tx=0x7f68cc02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.818+0000 7f68db72d640 1 -- 172.21.15.100:0/1697776680 shutdown_connections 2024-04-30T23:11:25.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.818+0000 7f68db72d640 1 --2- 172.21.15.100:0/1697776680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d4102280 0x7f68d410bce0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 --2- 172.21.15.100:0/1697776680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4101780 0x7f68d4101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 --2- 172.21.15.100:0/1697776680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d41050d0 0x7f68d41054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- 172.21.15.100:0/1697776680 >> 172.21.15.100:0/1697776680 conn(0x7f68d40fd380 msgr2=0x7f68d40ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- 172.21.15.100:0/1697776680 shutdown_connections 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- 172.21.15.100:0/1697776680 wait complete. 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 Processor -- start 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- start start 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 0x7f68d419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4102280 0x7f68d419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410f660 con 0x7f68d41050d0 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410f4e0 con 0x7f68d4101780 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.819+0000 7f68db72d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410f7e0 con 0x7f68d4102280 2024-04-30T23:11:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54162/0 (socket says 172.21.15.100:54162) 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 -- 172.21.15.100:0/2232948903 learned_addr learned my addr 172.21.15.100:0/2232948903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d94c9640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 0x7f68d419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d8cc8640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4102280 0x7f68d419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 -- 172.21.15.100:0/2232948903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4102280 msgr2=0x7f68d419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4102280 0x7f68d419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 -- 172.21.15.100:0/2232948903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 msgr2=0x7f68d419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 0x7f68d419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 -- 172.21.15.100:0/2232948903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d41a1d20 con 0x7f68d41050d0 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d94c9640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 0x7f68d419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:11:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68d9cca640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0097b0 tx=0x7f68cc031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc003bf0 con 0x7f68d41050d0 2024-04-30T23:11:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68cc003d90 con 0x7f68d41050d0 2024-04-30T23:11:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d41a1fb0 con 0x7f68d41050d0 2024-04-30T23:11:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc02fc30 con 0x7f68d41050d0 2024-04-30T23:11:25.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.820+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d41a2410 con 0x7f68d41050d0 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.821+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d4069320 con 0x7f68d41050d0 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.823+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f68cc004040 con 0x7f68d41050d0 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.823+0000 7f68ca7fc640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 0x7f68c00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.823+0000 7f68d94c9640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 0x7f68c00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.823+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f68cc0f1e30 con 0x7f68d41050d0 2024-04-30T23:11:25.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.824+0000 7f68d94c9640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 0x7f68c00a60c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68d4069c30 tx=0x7f68d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:25.827+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f68cc0be5d0 con 0x7f68d41050d0 2024-04-30T23:11:26.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.045+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f68d410aac0 con 0x7f68d41050d0 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-30T23:11:26.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-30T23:11:26.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-30T23:11:26.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-30T23:11:26.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-30T23:11:26.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-30T23:11:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-30T23:11:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-30T23:11:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3888811825' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-30T23:11:26.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-30T23:11:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.689+0000 7f68ca7fc640 1 -- 172.21.15.100:0/2232948903 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f68d410aac0 con 0x7f68d41050d0 2024-04-30T23:11:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 msgr2=0x7f68c00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 0x7f68c00a60c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68d4069c30 tx=0x7f68d0005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:26.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 msgr2=0x7f68d41a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0097b0 tx=0x7f68cc031840 comp rx=0 tx=0).stop 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 shutdown_connections 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68c00a3bb0 0x7f68c00a60c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d41050d0 0x7f68d41a16b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68d4102280 0x7f68d419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 --2- 172.21.15.100:0/2232948903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68d4101780 0x7f68d419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 >> 172.21.15.100:0/2232948903 conn(0x7f68d40fd380 msgr2=0x7f68d4107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.692+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 shutdown_connections 2024-04-30T23:11:26.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.693+0000 7f68db72d640 1 -- 172.21.15.100:0/2232948903 wait complete. 2024-04-30T23:11:26.709 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-04-30T23:11:26.709 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-30T23:11:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 -- 172.21.15.100:0/2840432821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 msgr2=0x7f51e810ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 --2- 172.21.15.100:0/2840432821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e810ad80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009ca0 tx=0x7f51e002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 -- 172.21.15.100:0/2840432821 shutdown_connections 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 --2- 172.21.15.100:0/2840432821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e810ad80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 --2- 172.21.15.100:0/2840432821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8103c60 0x7f51e8104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 --2- 172.21.15.100:0/2840432821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8102a20 0x7f51e8103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.825+0000 7f51efc96640 1 -- 172.21.15.100:0/2840432821 >> 172.21.15.100:0/2840432821 conn(0x7f51e80fdc10 msgr2=0x7f51e81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- 172.21.15.100:0/2840432821 shutdown_connections 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- 172.21.15.100:0/2840432821 wait complete. 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 Processor -- start 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- start start 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 0x7f51e806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8103c60 0x7f51e819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51e810e530 con 0x7f51e8108960 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f51e810e3b0 con 0x7f51e8102a20 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51efc96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51e810e6b0 con 0x7f51e8103c60 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51ee233640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51ee233640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54186/0 (socket says 172.21.15.100:54186) 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51ee233640 1 -- 172.21.15.100:0/1279502738 learned_addr learned my addr 172.21.15.100:0/1279502738 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.826+0000 7f51eda32640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 0x7f51e806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ed231640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8103c60 0x7f51e819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 -- 172.21.15.100:0/1279502738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8103c60 msgr2=0x7f51e819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8103c60 0x7f51e819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 -- 172.21.15.100:0/1279502738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 msgr2=0x7f51e806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 0x7f51e806a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 -- 172.21.15.100:0/1279502738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e81a2050 con 0x7f51e8108960 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51eda32640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 0x7f51e806a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:11:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51ee233640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097b0 tx=0x7f51e0031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0003bf0 con 0x7f51e8108960 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e0003d90 con 0x7f51e8108960 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e81a22e0 con 0x7f51e8108960 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e002fc30 con 0x7f51e8108960 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.827+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81a2830 con 0x7f51e8108960 2024-04-30T23:11:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.828+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8107770 con 0x7f51e8108960 2024-04-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.829+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f51e0004040 con 0x7f51e8108960 2024-04-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.830+0000 7f51deffd640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 0x7f51d40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.830+0000 7f51eda32640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 0x7f51d40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.830+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f51e00f1e30 con 0x7f51e8108960 2024-04-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.831+0000 7f51eda32640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 0x7f51d40a60c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:26.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:26.834+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f51e00be5d0 con 0x7f51e8108960 2024-04-30T23:11:27.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.045+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f51e802dd40 con 0x7f51d40a3bb0 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:active 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-30T23:11:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-30T23:11:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-30T23:11:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:active 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-30T23:11:27.050 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2141659284' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] up:active 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-30T23:11:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-30T23:11:27.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.074+0000 7f51deffd640 1 -- 172.21.15.100:0/1279502738 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f51e802dd40 con 0x7f51d40a3bb0 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 msgr2=0x7f51d40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 0x7f51d40a60c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e400b410 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 msgr2=0x7f51e81a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51e00097b0 tx=0x7f51e0031840 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 shutdown_connections 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f51d40a3bb0 0x7f51d40a60c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51e8108960 0x7f51e81a1830 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e8103c60 0x7f51e819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 --2- 172.21.15.100:0/1279502738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e8102a20 0x7f51e806a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 >> 172.21.15.100:0/1279502738 conn(0x7f51e80fdc10 msgr2=0x7f51e8104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 shutdown_connections 2024-04-30T23:11:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.076+0000 7f51efc96640 1 -- 172.21.15.100:0/1279502738 wait complete. 2024-04-30T23:11:27.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- 172.21.15.100:0/296182565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 msgr2=0x7f002c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- 172.21.15.100:0/296182565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c106bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0028009ca0 tx=0x7f002802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- 172.21.15.100:0/296182565 shutdown_connections 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- 172.21.15.100:0/296182565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c109a50 0x7f002c10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- 172.21.15.100:0/296182565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c1070f0 0x7f002c109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- 172.21.15.100:0/296182565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c106bb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- 172.21.15.100:0/296182565 >> 172.21.15.100:0/296182565 conn(0x7f002c0fd380 msgr2=0x7f002c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- 172.21.15.100:0/296182565 shutdown_connections 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- 172.21.15.100:0/296182565 wait complete. 2024-04-30T23:11:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 Processor -- start 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- start start 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 0x7f002c19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c109a50 0x7f002c1a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10f6c0 con 0x7f002c101f40 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.203+0000 7f00340a7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10f540 con 0x7f002c109a50 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f00340a7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10f840 con 0x7f002c1070f0 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54204/0 (socket says 172.21.15.100:54204) 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 -- 172.21.15.100:0/3602081188 learned_addr learned my addr 172.21.15.100:0/3602081188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0032644640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c109a50 0x7f002c1a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031642640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 0x7f002c19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 -- 172.21.15.100:0/3602081188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 msgr2=0x7f002c19a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 0x7f002c19a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 -- 172.21.15.100:0/3602081188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c109a50 msgr2=0x7f002c1a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c109a50 0x7f002c1a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 -- 172.21.15.100:0/3602081188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c1a1e00 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031642640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 0x7f002c19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0031e43640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f002802ade0 tx=0x7f0028003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002802f380 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00280317c0 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002802fc60 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c1a2090 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.204+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1a2590 con 0x7f002c101f40 2024-04-30T23:11:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.205+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c0feea0 con 0x7f002c101f40 2024-04-30T23:11:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.207+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f0028004040 con 0x7f002c101f40 2024-04-30T23:11:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.207+0000 7f0022ffd640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 0x7f00180a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.208+0000 7f0031642640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 0x7f00180a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.208+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f00280f1e10 con 0x7f002c101f40 2024-04-30T23:11:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.208+0000 7f0031642640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 0x7f00180a6260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c19b360 tx=0x7f001c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.212+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f00280be550 con 0x7f002c101f40 2024-04-30T23:11:27.322 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:11:27.049+0000 7f3c6650a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-30T23:11:27.322 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:11:27.049+0000 7f3c6650a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-30T23:11:27.322 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:11:27.049+0000 7f3c6650a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-30T23:11:27.322 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:11:27.049+0000 7f3c6650a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-30T23:11:27.322 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:11:27.049+0000 7f3c6650a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-30T23:11:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.414+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f002c063020 con 0x7f00180a3d50 2024-04-30T23:11:27.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.438+0000 7f0022ffd640 1 -- 172.21.15.100:0/3602081188 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f002c063020 con 0x7f00180a3d50 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 msgr2=0x7f00180a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 0x7f00180a6260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c19b360 tx=0x7f001c005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 msgr2=0x7f002c19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f002802ade0 tx=0x7f0028003ba0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 shutdown_connections 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f00180a3d50 0x7f00180a6260 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f002c109a50 0x7f002c1a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f002c1070f0 0x7f002c19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 --2- 172.21.15.100:0/3602081188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101f40 0x7f002c19a2c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 >> 172.21.15.100:0/3602081188 conn(0x7f002c0fd380 msgr2=0x7f002c105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 shutdown_connections 2024-04-30T23:11:27.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.440+0000 7f00340a7640 1 -- 172.21.15.100:0/3602081188 wait complete. 2024-04-30T23:11:27.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/1262509168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4103c60 msgr2=0x7fe8c4104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/1262509168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4103c60 0x7fe8c4104070 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009900 tx=0x7fe8b402a410 comp rx=0 tx=0).stop 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/1262509168 shutdown_connections 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/1262509168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4108960 0x7fe8c410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/1262509168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4103c60 0x7fe8c4104070 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/1262509168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 0x7fe8c4103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/1262509168 >> 172.21.15.100:0/1262509168 conn(0x7fe8c40fdc10 msgr2=0x7fe8c41000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/1262509168 shutdown_connections 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.564+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/1262509168 wait complete. 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 Processor -- start 2024-04-30T23:11:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 -- start start 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 0x7fe8c41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4103c60 0x7fe8c41999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c410e540 con 0x7fe8c4108960 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c410e3c0 con 0x7fe8c4103c60 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8cb7a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c410e6c0 con 0x7fe8c4102a20 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54226/0 (socket says 172.21.15.100:54226) 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 -- 172.21.15.100:0/2468774457 learned_addr learned my addr 172.21.15.100:0/2468774457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c8d40640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4103c60 0x7fe8c41999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9541640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 0x7fe8c41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 -- 172.21.15.100:0/2468774457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 msgr2=0x7fe8c41994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 0x7fe8c41994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 -- 172.21.15.100:0/2468774457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4103c60 msgr2=0x7fe8c41999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4103c60 0x7fe8c41999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.565+0000 7fe8c9d42640 1 -- 172.21.15.100:0/2468774457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c41a0fe0 con 0x7fe8c4108960 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8c9d42640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009f20 tx=0x7fe8bc00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc003970 con 0x7fe8c4108960 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8bc004020 con 0x7fe8c4108960 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c4069f30 con 0x7fe8c4108960 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0177f0 con 0x7fe8c4108960 2024-04-30T23:11:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.566+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c406a480 con 0x7fe8c4108960 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.567+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c406c400 con 0x7fe8c4108960 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.568+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe8bc017ba0 con 0x7fe8c4108960 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.568+0000 7fe8ba7fc640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 0x7fe8b00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.569+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fe8bc0d2d50 con 0x7fe8c4108960 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.569+0000 7fe8c9541640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 0x7fe8b00a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.569+0000 7fe8c9541640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 0x7fe8b00a6140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4103620 tx=0x7fe8c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.572+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe8bc09f4f0 con 0x7fe8c4108960 2024-04-30T23:11:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.782+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe8c4107530 con 0x7fe8b00a3c30 2024-04-30T23:11:27.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.787+0000 7fe8ba7fc640 1 -- 172.21.15.100:0/2468774457 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe8c4107530 con 0x7fe8b00a3c30 2024-04-30T23:11:27.787 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_0/b38883d1-fdd0-44b9-ac51-3b915654acff 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 msgr2=0x7fe8b00a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 0x7fe8b00a6140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4103620 tx=0x7fe8c0005f90 comp rx=0 tx=0).stop 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 msgr2=0x7fe8c41a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009f20 tx=0x7fe8bc00b690 comp rx=0 tx=0).stop 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 shutdown_connections 2024-04-30T23:11:27.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe8b00a3c30 0x7fe8b00a6140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c4108960 0x7fe8c41a0970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4103c60 0x7fe8c41999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 --2- 172.21.15.100:0/2468774457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8c4102a20 0x7fe8c41994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 >> 172.21.15.100:0/2468774457 conn(0x7fe8c40fdc10 msgr2=0x7fe8c4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 shutdown_connections 2024-04-30T23:11:27.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.789+0000 7fe8cb7a5640 1 -- 172.21.15.100:0/2468774457 wait complete. 2024-04-30T23:11:27.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-30T23:11:27.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:active 2024-04-30T23:11:27.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-30T23:11:27.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-30T23:11:27.799 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:active 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: Cluster is now healthy 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-30T23:11:27.800 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:27 smithi100 ceph-mon[29745]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-30T23:11:27.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-30T23:11:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.922+0000 7fa94a12d640 1 -- 172.21.15.100:0/2725962698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944102a30 msgr2=0x7fa944103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.922+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2725962698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944102a30 0x7fa944103730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa934009900 tx=0x7fa93402a400 comp rx=0 tx=0).stop 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 -- 172.21.15.100:0/2725962698 shutdown_connections 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2725962698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 0x7fa94410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2725962698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944103c70 0x7fa944104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2725962698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944102a30 0x7fa944103730 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 -- 172.21.15.100:0/2725962698 >> 172.21.15.100:0/2725962698 conn(0x7fa9440fdc40 msgr2=0x7fa9441000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 -- 172.21.15.100:0/2725962698 shutdown_connections 2024-04-30T23:11:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 -- 172.21.15.100:0/2725962698 wait complete. 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.923+0000 7fa94a12d640 1 Processor -- start 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 -- start start 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944102a30 0x7fa94419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 0x7fa9441a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410f690 con 0x7fa944103c70 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410f510 con 0x7fa944102a30 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa94a12d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410f810 con 0x7fa944108970 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa942ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa942ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54234/0 (socket says 172.21.15.100:54234) 2024-04-30T23:11:27.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa942ffd640 1 -- 172.21.15.100:0/2534675220 learned_addr learned my addr 172.21.15.100:0/2534675220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa943fff640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 0x7fa9441a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.924+0000 7fa9437fe640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944102a30 0x7fa94419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 -- 172.21.15.100:0/2534675220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 msgr2=0x7fa9441a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 0x7fa9441a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 -- 172.21.15.100:0/2534675220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944102a30 msgr2=0x7fa94419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944102a30 0x7fa94419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 -- 172.21.15.100:0/2534675220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9441a1e30 con 0x7fa944103c70 2024-04-30T23:11:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.925+0000 7fa942ffd640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa93800b4a0 tx=0x7fa93800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.926+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938014070 con 0x7fa944103c70 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.926+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa938010ac0 con 0x7fa944103c70 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.926+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938017c30 con 0x7fa944103c70 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.926+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9441a2120 con 0x7fa944103c70 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.926+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9441a26a0 con 0x7fa944103c70 2024-04-30T23:11:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.928+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa944107780 con 0x7fa944103c70 2024-04-30T23:11:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.929+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa938017070 con 0x7fa944103c70 2024-04-30T23:11:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.930+0000 7fa940ff9640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 0x7fa92c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.930+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa9380cfc90 con 0x7fa944103c70 2024-04-30T23:11:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.930+0000 7fa9437fe640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 0x7fa92c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.931+0000 7fa9437fe640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 0x7fa92c0a61d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa934005ab0 tx=0x7fa934031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:27.934+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa93809bd90 con 0x7fa944103c70 2024-04-30T23:11:28.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-30T23:11:28.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:active 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:active 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: Cluster is now healthy 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-30T23:11:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:27 smithi104 ceph-mon[32987]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-30T23:11:28.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2232948903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-30T23:11:28.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] up:active 2024-04-30T23:11:28.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] up:active 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: Cluster is now healthy 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-30T23:11:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:27 smithi183 ceph-mon[33560]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-30T23:11:28.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.138+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa944063020 con 0x7fa92c0a3cc0 2024-04-30T23:11:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.165+0000 7fa940ff9640 1 -- 172.21.15.100:0/2534675220 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa944063020 con 0x7fa92c0a3cc0 2024-04-30T23:11:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.167+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 msgr2=0x7fa92c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.167+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 0x7fa92c0a61d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa934005ab0 tx=0x7fa934031400 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.167+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 msgr2=0x7fa94419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.167+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa93800b4a0 tx=0x7fa93800b960 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 shutdown_connections 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa92c0a3cc0 0x7fa92c0a61d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa944108970 0x7fa9441a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa944103c70 0x7fa94419a8a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 --2- 172.21.15.100:0/2534675220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa944102a30 0x7fa94419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 >> 172.21.15.100:0/2534675220 conn(0x7fa9440fdc40 msgr2=0x7fa944104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 shutdown_connections 2024-04-30T23:11:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.168+0000 7fa94a12d640 1 -- 172.21.15.100:0/2534675220 wait complete. 2024-04-30T23:11:28.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.290+0000 7fa27d629640 1 -- 172.21.15.100:0/2967916010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278109a60 msgr2=0x7fa27810be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.290+0000 7fa27d629640 1 --2- 172.21.15.100:0/2967916010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278109a60 0x7fa27810be80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa270009900 tx=0x7fa27002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 -- 172.21.15.100:0/2967916010 shutdown_connections 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 --2- 172.21.15.100:0/2967916010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278109a60 0x7fa27810be80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 --2- 172.21.15.100:0/2967916010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278104d60 0x7fa278105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 --2- 172.21.15.100:0/2967916010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278103b20 0x7fa278104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 -- 172.21.15.100:0/2967916010 >> 172.21.15.100:0/2967916010 conn(0x7fa2780fed10 msgr2=0x7fa2781011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 -- 172.21.15.100:0/2967916010 shutdown_connections 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 -- 172.21.15.100:0/2967916010 wait complete. 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 Processor -- start 2024-04-30T23:11:28.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.291+0000 7fa27d629640 1 -- start start 2024-04-30T23:11:28.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278104d60 0x7fa27819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278109a60 0x7fa2781a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810f6a0 con 0x7fa278103b20 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810f520 con 0x7fa278104d60 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810f820 con 0x7fa278109a60 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54260/0 (socket says 172.21.15.100:54260) 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 -- 172.21.15.100:0/4212130629 learned_addr learned my addr 172.21.15.100:0/4212130629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa2767fc640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278104d60 0x7fa27819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa2777fe640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278109a60 0x7fa2781a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 -- 172.21.15.100:0/4212130629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278109a60 msgr2=0x7fa2781a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278109a60 0x7fa2781a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 -- 172.21.15.100:0/4212130629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278104d60 msgr2=0x7fa27819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278104d60 0x7fa27819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 -- 172.21.15.100:0/4212130629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2781a1db0 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa276ffd640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa26800eb90 tx=0x7fa26800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268003970 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2781a20a0 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa268004030 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2680196e0 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.292+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2781a2670 con 0x7fa278103b20 2024-04-30T23:11:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.294+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa278108870 con 0x7fa278103b20 2024-04-30T23:11:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.295+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa268003b10 con 0x7fa278103b20 2024-04-30T23:11:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.296+0000 7fa25ffff640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 0x7fa2600a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.296+0000 7fa2767fc640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 0x7fa2600a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.296+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa2680d1130 con 0x7fa278103b20 2024-04-30T23:11:28.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.296+0000 7fa2767fc640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 0x7fa2600a6150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa27819b310 tx=0x7fa26c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.300+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa2680183e0 con 0x7fa278103b20 2024-04-30T23:11:28.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.504+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa278063020 con 0x7fa2600a3c40 2024-04-30T23:11:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.509+0000 7fa25ffff640 1 -- 172.21.15.100:0/4212130629 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa278063020 con 0x7fa2600a3c40 2024-04-30T23:11:28.509 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_1/50f7f738-5072-42da-817a-1f139b16aaf8 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 msgr2=0x7fa2600a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 0x7fa2600a6150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa27819b310 tx=0x7fa26c009110 comp rx=0 tx=0).stop 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 msgr2=0x7fa27819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa26800eb90 tx=0x7fa26800ef90 comp rx=0 tx=0).stop 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 shutdown_connections 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2600a3c40 0x7fa2600a6150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa278109a60 0x7fa2781a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa278104d60 0x7fa27819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 --2- 172.21.15.100:0/4212130629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa278103b20 0x7fa27819a270 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 >> 172.21.15.100:0/4212130629 conn(0x7fa2780fed10 msgr2=0x7fa278105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 shutdown_connections 2024-04-30T23:11:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.511+0000 7fa27d629640 1 -- 172.21.15.100:0/4212130629 wait complete. 2024-04-30T23:11:28.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:11:28.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- 172.21.15.100:0/3172018912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 msgr2=0x7fb614103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/3172018912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb614103700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb610009900 tx=0x7fb61002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- 172.21.15.100:0/3172018912 shutdown_connections 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/3172018912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 0x7fb61410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/3172018912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 0x7fb614104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/3172018912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb614103700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- 172.21.15.100:0/3172018912 >> 172.21.15.100:0/3172018912 conn(0x7fb6140fdc10 msgr2=0x7fb6141000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- 172.21.15.100:0/3172018912 shutdown_connections 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- 172.21.15.100:0/3172018912 wait complete. 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 Processor -- start 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.631+0000 7fb61b8e0640 1 -- start start 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 0x7fb61419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 0x7fb6141a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410f5f0 con 0x7fb614102a00 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410f470 con 0x7fb614108940 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410f770 con 0x7fb614103c40 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54288/0 (socket says 172.21.15.100:54288) 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 -- 172.21.15.100:0/4269363838 learned_addr learned my addr 172.21.15.100:0/4269363838 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb619e7d640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 0x7fb6141a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb618e7b640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 0x7fb61419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 -- 172.21.15.100:0/4269363838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 msgr2=0x7fb61419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 0x7fb61419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 -- 172.21.15.100:0/4269363838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 msgr2=0x7fb6141a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 0x7fb6141a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 -- 172.21.15.100:0/4269363838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6141a1ce0 con 0x7fb614102a00 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61967c640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb610006010 tx=0x7fb610004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61003f030 con 0x7fb614102a00 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb610003aa0 con 0x7fb614102a00 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6141a1f70 con 0x7fb614102a00 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.632+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610035070 con 0x7fb614102a00 2024-04-30T23:11:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.633+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6141a2370 con 0x7fb614102a00 2024-04-30T23:11:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.633+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb614107750 con 0x7fb614102a00 2024-04-30T23:11:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.635+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb610042030 con 0x7fb614102a00 2024-04-30T23:11:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.635+0000 7fb60a7fc640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 0x7fb6000a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.635+0000 7fb618e7b640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 0x7fb6000a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.635+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb6100f0c20 con 0x7fb614102a00 2024-04-30T23:11:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.636+0000 7fb618e7b640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 0x7fb6000a6150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb604005e10 tx=0x7fb604005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.640+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6100bd260 con 0x7fb614102a00 2024-04-30T23:11:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: pgmap v305: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-30T23:11:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:active 2024-04-30T23:11:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-30T23:11:28.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-30T23:11:28.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:28 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:11:28.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.859+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb61402ddd0 con 0x7fb614102a00 2024-04-30T23:11:28.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.860+0000 7fb60a7fc640 1 -- 172.21.15.100:0/4269363838 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7fb6100bcb60 con 0x7fb614102a00 2024-04-30T23:11:28.859 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:28.859 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:11:28.860 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 msgr2=0x7fb6000a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 0x7fb6000a6150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb604005e10 tx=0x7fb604005da0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 msgr2=0x7fb61419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb610006010 tx=0x7fb610004270 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 shutdown_connections 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3c40 0x7fb6000a6150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108940 0x7fb6141a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c40 0x7fb61419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 --2- 172.21.15.100:0/4269363838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a00 0x7fb61419a250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 >> 172.21.15.100:0/4269363838 conn(0x7fb6140fdc10 msgr2=0x7fb614104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 shutdown_connections 2024-04-30T23:11:28.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.862+0000 7fb61b8e0640 1 -- 172.21.15.100:0/4269363838 wait complete. 2024-04-30T23:11:28.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:11:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 -- 172.21.15.100:0/310082038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac108980 msgr2=0x7f12ac10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 --2- 172.21.15.100:0/310082038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac108980 0x7f12ac10ada0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ca0 tx=0x7f12a402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 -- 172.21.15.100:0/310082038 shutdown_connections 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 --2- 172.21.15.100:0/310082038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac108980 0x7f12ac10ada0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 --2- 172.21.15.100:0/310082038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac103c80 0x7f12ac104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 --2- 172.21.15.100:0/310082038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac102a40 0x7f12ac103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 -- 172.21.15.100:0/310082038 >> 172.21.15.100:0/310082038 conn(0x7f12ac0fdc30 msgr2=0x7f12ac1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 -- 172.21.15.100:0/310082038 shutdown_connections 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.985+0000 7f12b334d640 1 -- 172.21.15.100:0/310082038 wait complete. 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 Processor -- start 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 -- start start 2024-04-30T23:11:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac102a40 0x7f12ac0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 0x7f12ac1a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e550 con 0x7f12ac103c80 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e3d0 con 0x7f12ac102a40 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b334d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e6d0 con 0x7f12ac108980 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54300/0 (socket says 172.21.15.100:54300) 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 -- 172.21.15.100:0/1543336150 learned_addr learned my addr 172.21.15.100:0/1543336150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b10e9640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac102a40 0x7f12ac0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b18ea640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 0x7f12ac1a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 -- 172.21.15.100:0/1543336150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 msgr2=0x7f12ac1a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 0x7f12ac1a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 -- 172.21.15.100:0/1543336150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac102a40 msgr2=0x7f12ac0758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac102a40 0x7f12ac0758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 -- 172.21.15.100:0/1543336150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac1a1d10 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b18ea640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 0x7f12ac1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12b08e8640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f129c00e9f0 tx=0x7f129c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.986+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c00cd80 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.987+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f129c0108e0 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.987+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c018980 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.987+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a1fa0 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.987+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a2490 con 0x7f12ac103c80 2024-04-30T23:11:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.987+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac107790 con 0x7f12ac103c80 2024-04-30T23:11:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.989+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f129c010430 con 0x7f12ac103c80 2024-04-30T23:11:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.989+0000 7f12a27fc640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 0x7f12980a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.990+0000 7f12b10e9640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 0x7f12980a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.990+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f129c0d1000 con 0x7f12ac103c80 2024-04-30T23:11:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.990+0000 7f12b10e9640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 0x7f12980a6150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f12ac103640 tx=0x7f12a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:28.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:28.993+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f129c09d640 con 0x7f12ac103c80 2024-04-30T23:11:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: pgmap v305: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-30T23:11:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:active 2024-04-30T23:11:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-30T23:11:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-30T23:11:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:28 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: pgmap v305: 129 pgs: 129 active+clean; 582 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] up:active 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-30T23:11:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:28 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:11:29.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.173+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12ac02dde0 con 0x7f12ac103c80 2024-04-30T23:11:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.174+0000 7f12a27fc640 1 -- 172.21.15.100:0/1543336150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f129c09cf40 con 0x7f12ac103c80 2024-04-30T23:11:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:29.174 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 msgr2=0x7f12980a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 0x7f12980a6150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f12ac103640 tx=0x7f12a800b390 comp rx=0 tx=0).stop 2024-04-30T23:11:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 msgr2=0x7f12ac19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f129c00e9f0 tx=0x7f129c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 shutdown_connections 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f12980a3c40 0x7f12980a6150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12ac108980 0x7f12ac1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12ac103c80 0x7f12ac19ef80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 --2- 172.21.15.100:0/1543336150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12ac102a40 0x7f12ac0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 >> 172.21.15.100:0/1543336150 conn(0x7f12ac0fdc30 msgr2=0x7f12ac104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 shutdown_connections 2024-04-30T23:11:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.176+0000 7f12b334d640 1 -- 172.21.15.100:0/1543336150 wait complete. 2024-04-30T23:11:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T23:11:29.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 -- 172.21.15.100:0/2883578039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c103c40 msgr2=0x7fc26c104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 --2- 172.21.15.100:0/2883578039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c103c40 0x7fc26c104050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc268009900 tx=0x7fc26802a410 comp rx=0 tx=0).stop 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 -- 172.21.15.100:0/2883578039 shutdown_connections 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 --2- 172.21.15.100:0/2883578039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 0x7fc26c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 --2- 172.21.15.100:0/2883578039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c103c40 0x7fc26c104050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 --2- 172.21.15.100:0/2883578039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c102a00 0x7fc26c103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 -- 172.21.15.100:0/2883578039 >> 172.21.15.100:0/2883578039 conn(0x7fc26c0fdc10 msgr2=0x7fc26c1000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 -- 172.21.15.100:0/2883578039 shutdown_connections 2024-04-30T23:11:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 -- 172.21.15.100:0/2883578039 wait complete. 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.296+0000 7fc274219640 1 Processor -- start 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 -- start start 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c103c40 0x7fc26c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 0x7fc26c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c10e530 con 0x7fc26c102a00 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c10e3b0 con 0x7fc26c103c40 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c10e6b0 con 0x7fc26c108940 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54316/0 (socket says 172.21.15.100:54316) 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 -- 172.21.15.100:0/4174450165 learned_addr learned my addr 172.21.15.100:0/4174450165 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc2717b4640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c103c40 0x7fc26c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc2727b6640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 0x7fc26c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 -- 172.21.15.100:0/4174450165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 msgr2=0x7fc26c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 0x7fc26c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 -- 172.21.15.100:0/4174450165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c103c40 msgr2=0x7fc26c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c103c40 0x7fc26c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 -- 172.21.15.100:0/4174450165 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c1a0c80 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc271fb5640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00e9f0 tx=0x7fc25c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00ccc0 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c1a0f70 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc25c0035f0 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.297+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00ce60 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.298+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c1a13d0 con 0x7fc26c102a00 2024-04-30T23:11:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.298+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26c06afe0 con 0x7fc26c102a00 2024-04-30T23:11:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.300+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fc25c003aa0 con 0x7fc26c102a00 2024-04-30T23:11:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.300+0000 7fc262ffd640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 0x7fc2580a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.301+0000 7fc2717b4640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 0x7fc2580a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.301+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc25c0d0b20 con 0x7fc26c102a00 2024-04-30T23:11:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.301+0000 7fc2717b4640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 0x7fc2580a6150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc268009230 tx=0x7fc268031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.304+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc25c09d160 con 0x7fc26c102a00 2024-04-30T23:11:29.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.477+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc26c063020 con 0x7fc2580a3c40 2024-04-30T23:11:29.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.487+0000 7fc262ffd640 1 -- 172.21.15.100:0/4174450165 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340271 (secure 0 0 0) 0x7fc26c063020 con 0x7fc2580a3c40 2024-04-30T23:11:29.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:29.493 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:11:29.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 msgr2=0x7fc2580a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 0x7fc2580a6150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc268009230 tx=0x7fc268031400 comp rx=0 tx=0).stop 2024-04-30T23:11:29.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 msgr2=0x7fc26c199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00e9f0 tx=0x7fc25c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 shutdown_connections 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2580a3c40 0x7fc2580a6150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc26c108940 0x7fc26c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc26c103c40 0x7fc26c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 --2- 172.21.15.100:0/4174450165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc26c102a00 0x7fc26c199140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 >> 172.21.15.100:0/4174450165 conn(0x7fc26c0fdc10 msgr2=0x7fc26c104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 shutdown_connections 2024-04-30T23:11:29.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.491+0000 7fc274219640 1 -- 172.21.15.100:0/4174450165 wait complete. 2024-04-30T23:11:29.501 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-30T23:11:27.584869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595904,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":133,"num_read_kb":116,"num_write":282,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383380,"kb_used_data":13412,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558444,"statfs":{"total":1151940427776,"available":1151547846656,"internally_reserved":0,"allocated":13733888,"data_stored":7509878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1037,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003929"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347727+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:11:07.347727+0000","last_peered":"2024-04-30T23:11:07.347727+0000","last_clean":"2024-04-30T23:11:07.347727+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:11:07.347727+0000","last_undegraded":"2024-04-30T23:11:07.347727+0000","last_fullsized":"2024-04-30T23:11:07.347727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114185+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:11:06.114185+0000","last_peered":"2024-04-30T23:11:06.114185+0000","last_clean":"2024-04-30T23:11:06.114185+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:11:06.114185+0000","last_undegraded":"2024-04-30T23:11:06.114185+0000","last_fullsized":"2024-04-30T23:11:06.114185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113945+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:11:06.113945+0000","last_peered":"2024-04-30T23:11:06.113945+0000","last_clean":"2024-04-30T23:11:06.113945+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:11:06.113945+0000","last_undegraded":"2024-04-30T23:11:06.113945+0000","last_fullsized":"2024-04-30T23:11:06.113945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175542+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:11:07.175542+0000","last_peered":"2024-04-30T23:11:07.175542+0000","last_clean":"2024-04-30T23:11:07.175542+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:11:07.175542+0000","last_undegraded":"2024-04-30T23:11:07.175542+0000","last_fullsized":"2024-04-30T23:11:07.175542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347080+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:11:07.347080+0000","last_peered":"2024-04-30T23:11:07.347080+0000","last_clean":"2024-04-30T23:11:07.347080+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:11:07.347080+0000","last_undegraded":"2024-04-30T23:11:07.347080+0000","last_fullsized":"2024-04-30T23:11:07.347080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347771+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:11:07.347771+0000","last_peered":"2024-04-30T23:11:07.347771+0000","last_clean":"2024-04-30T23:11:07.347771+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:11:07.347771+0000","last_undegraded":"2024-04-30T23:11:07.347771+0000","last_fullsized":"2024-04-30T23:11:07.347771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933926+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:11:05.933926+0000","last_peered":"2024-04-30T23:11:05.933926+0000","last_clean":"2024-04-30T23:11:05.933926+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:11:05.933926+0000","last_undegraded":"2024-04-30T23:11:05.933926+0000","last_fullsized":"2024-04-30T23:11:05.933926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347129+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:11:07.347129+0000","last_peered":"2024-04-30T23:11:07.347129+0000","last_clean":"2024-04-30T23:11:07.347129+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:11:07.347129+0000","last_undegraded":"2024-04-30T23:11:07.347129+0000","last_fullsized":"2024-04-30T23:11:07.347129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348278+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:11:07.348278+0000","last_peered":"2024-04-30T23:11:07.348278+0000","last_clean":"2024-04-30T23:11:07.348278+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:11:07.348278+0000","last_undegraded":"2024-04-30T23:11:07.348278+0000","last_fullsized":"2024-04-30T23:11:07.348278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348481+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:11:07.348481+0000","last_peered":"2024-04-30T23:11:07.348481+0000","last_clean":"2024-04-30T23:11:07.348481+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:11:07.348481+0000","last_undegraded":"2024-04-30T23:11:07.348481+0000","last_fullsized":"2024-04-30T23:11:07.348481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934381+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:11:05.934381+0000","last_peered":"2024-04-30T23:11:05.934381+0000","last_clean":"2024-04-30T23:11:05.934381+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:11:05.934381+0000","last_undegraded":"2024-04-30T23:11:05.934381+0000","last_fullsized":"2024-04-30T23:11:05.934381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175473+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:11:07.175473+0000","last_peered":"2024-04-30T23:11:07.175473+0000","last_clean":"2024-04-30T23:11:07.175473+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:11:07.175473+0000","last_undegraded":"2024-04-30T23:11:07.175473+0000","last_fullsized":"2024-04-30T23:11:07.175473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519944+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:11:06.519944+0000","last_peered":"2024-04-30T23:11:06.519944+0000","last_clean":"2024-04-30T23:11:06.519944+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:11:06.519944+0000","last_undegraded":"2024-04-30T23:11:06.519944+0000","last_fullsized":"2024-04-30T23:11:06.519944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113728+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:11:06.113728+0000","last_peered":"2024-04-30T23:11:06.113728+0000","last_clean":"2024-04-30T23:11:06.113728+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:11:06.113728+0000","last_undegraded":"2024-04-30T23:11:06.113728+0000","last_fullsized":"2024-04-30T23:11:06.113728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113722+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:11:06.113722+0000","last_peered":"2024-04-30T23:11:06.113722+0000","last_clean":"2024-04-30T23:11:06.113722+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:11:06.113722+0000","last_undegraded":"2024-04-30T23:11:06.113722+0000","last_fullsized":"2024-04-30T23:11:06.113722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347046+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:11:07.347046+0000","last_peered":"2024-04-30T23:11:07.347046+0000","last_clean":"2024-04-30T23:11:07.347046+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:11:07.347046+0000","last_undegraded":"2024-04-30T23:11:07.347046+0000","last_fullsized":"2024-04-30T23:11:07.347046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347399+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:11:07.347399+0000","last_peered":"2024-04-30T23:11:07.347399+0000","last_clean":"2024-04-30T23:11:07.347399+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:11:07.347399+0000","last_undegraded":"2024-04-30T23:11:07.347399+0000","last_fullsized":"2024-04-30T23:11:07.347399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933944+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:11:05.933944+0000","last_peered":"2024-04-30T23:11:05.933944+0000","last_clean":"2024-04-30T23:11:05.933944+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:11:05.933944+0000","last_undegraded":"2024-04-30T23:11:05.933944+0000","last_fullsized":"2024-04-30T23:11:05.933944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936511+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:11:05.936511+0000","last_peered":"2024-04-30T23:11:05.936511+0000","last_clean":"2024-04-30T23:11:05.936511+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:11:05.936511+0000","last_undegraded":"2024-04-30T23:11:05.936511+0000","last_fullsized":"2024-04-30T23:11:05.936511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936148+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:11:05.936148+0000","last_peered":"2024-04-30T23:11:05.936148+0000","last_clean":"2024-04-30T23:11:05.936148+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:11:05.936148+0000","last_undegraded":"2024-04-30T23:11:05.936148+0000","last_fullsized":"2024-04-30T23:11:05.936148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934149+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:11:05.934149+0000","last_peered":"2024-04-30T23:11:05.934149+0000","last_clean":"2024-04-30T23:11:05.934149+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:11:05.934149+0000","last_undegraded":"2024-04-30T23:11:05.934149+0000","last_fullsized":"2024-04-30T23:11:05.934149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347444+0000","last_change":"2024-04-30T23:11:00.903613+0000","last_active":"2024-04-30T23:11:07.347444+0000","last_peered":"2024-04-30T23:11:07.347444+0000","last_clean":"2024-04-30T23:11:07.347444+0000","last_became_active":"2024-04-30T23:11:00.903278+0000","last_became_peered":"2024-04-30T23:11:00.903278+0000","last_unstale":"2024-04-30T23:11:07.347444+0000","last_undegraded":"2024-04-30T23:11:07.347444+0000","last_fullsized":"2024-04-30T23:11:07.347444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:40:56.938331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175129+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:11:07.175129+0000","last_peered":"2024-04-30T23:11:07.175129+0000","last_clean":"2024-04-30T23:11:07.175129+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:07.175129+0000","last_undegraded":"2024-04-30T23:11:07.175129+0000","last_fullsized":"2024-04-30T23:11:07.175129+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347768+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:11:07.347768+0000","last_peered":"2024-04-30T23:11:07.347768+0000","last_clean":"2024-04-30T23:11:07.347768+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:11:07.347768+0000","last_undegraded":"2024-04-30T23:11:07.347768+0000","last_fullsized":"2024-04-30T23:11:07.347768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114222+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:11:06.114222+0000","last_peered":"2024-04-30T23:11:06.114222+0000","last_clean":"2024-04-30T23:11:06.114222+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:11:06.114222+0000","last_undegraded":"2024-04-30T23:11:06.114222+0000","last_fullsized":"2024-04-30T23:11:06.114222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175073+0000","last_change":"2024-04-30T23:11:04.936272+0000","last_active":"2024-04-30T23:11:07.175073+0000","last_peered":"2024-04-30T23:11:07.175073+0000","last_clean":"2024-04-30T23:11:07.175073+0000","last_became_active":"2024-04-30T23:11:04.935738+0000","last_became_peered":"2024-04-30T23:11:04.935738+0000","last_unstale":"2024-04-30T23:11:07.175073+0000","last_undegraded":"2024-04-30T23:11:07.175073+0000","last_fullsized":"2024-04-30T23:11:07.175073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:53:47.792943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'11","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.915276+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:11:26.915276+0000","last_peered":"2024-04-30T23:11:26.915276+0000","last_clean":"2024-04-30T23:11:26.915276+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:11:26.915276+0000","last_undegraded":"2024-04-30T23:11:26.915276+0000","last_fullsized":"2024-04-30T23:11:26.915276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347597+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:11:07.347597+0000","last_peered":"2024-04-30T23:11:07.347597+0000","last_clean":"2024-04-30T23:11:07.347597+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:11:07.347597+0000","last_undegraded":"2024-04-30T23:11:07.347597+0000","last_fullsized":"2024-04-30T23:11:07.347597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175080+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:11:07.175080+0000","last_peered":"2024-04-30T23:11:07.175080+0000","last_clean":"2024-04-30T23:11:07.175080+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:11:07.175080+0000","last_undegraded":"2024-04-30T23:11:07.175080+0000","last_fullsized":"2024-04-30T23:11:07.175080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.914812+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:11:26.914812+0000","last_peered":"2024-04-30T23:11:26.914812+0000","last_clean":"2024-04-30T23:11:26.914812+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:11:26.914812+0000","last_undegraded":"2024-04-30T23:11:26.914812+0000","last_fullsized":"2024-04-30T23:11:26.914812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290828+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:11:06.290828+0000","last_peered":"2024-04-30T23:11:06.290828+0000","last_clean":"2024-04-30T23:11:06.290828+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:11:06.290828+0000","last_undegraded":"2024-04-30T23:11:06.290828+0000","last_fullsized":"2024-04-30T23:11:06.290828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936422+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:11:05.936422+0000","last_peered":"2024-04-30T23:11:05.936422+0000","last_clean":"2024-04-30T23:11:05.936422+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:11:05.936422+0000","last_undegraded":"2024-04-30T23:11:05.936422+0000","last_fullsized":"2024-04-30T23:11:05.936422+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290376+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:11:06.290376+0000","last_peered":"2024-04-30T23:11:06.290376+0000","last_clean":"2024-04-30T23:11:06.290376+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:11:06.290376+0000","last_undegraded":"2024-04-30T23:11:06.290376+0000","last_fullsized":"2024-04-30T23:11:06.290376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347444+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:11:07.347444+0000","last_peered":"2024-04-30T23:11:07.347444+0000","last_clean":"2024-04-30T23:11:07.347444+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:11:07.347444+0000","last_undegraded":"2024-04-30T23:11:07.347444+0000","last_fullsized":"2024-04-30T23:11:07.347444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936091+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:11:05.936091+0000","last_peered":"2024-04-30T23:11:05.936091+0000","last_clean":"2024-04-30T23:11:05.936091+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:11:05.936091+0000","last_undegraded":"2024-04-30T23:11:05.936091+0000","last_fullsized":"2024-04-30T23:11:05.936091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347719+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:11:07.347719+0000","last_peered":"2024-04-30T23:11:07.347719+0000","last_clean":"2024-04-30T23:11:07.347719+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:11:07.347719+0000","last_undegraded":"2024-04-30T23:11:07.347719+0000","last_fullsized":"2024-04-30T23:11:07.347719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290489+0000","last_change":"2024-04-30T23:11:00.903401+0000","last_active":"2024-04-30T23:11:06.290489+0000","last_peered":"2024-04-30T23:11:06.290489+0000","last_clean":"2024-04-30T23:11:06.290489+0000","last_became_active":"2024-04-30T23:11:00.903043+0000","last_became_peered":"2024-04-30T23:11:00.903043+0000","last_unstale":"2024-04-30T23:11:06.290489+0000","last_undegraded":"2024-04-30T23:11:06.290489+0000","last_fullsized":"2024-04-30T23:11:06.290489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:29:33.839258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347404+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:11:07.347404+0000","last_peered":"2024-04-30T23:11:07.347404+0000","last_clean":"2024-04-30T23:11:07.347404+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:11:07.347404+0000","last_undegraded":"2024-04-30T23:11:07.347404+0000","last_fullsized":"2024-04-30T23:11:07.347404+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519716+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:11:06.519716+0000","last_peered":"2024-04-30T23:11:06.519716+0000","last_clean":"2024-04-30T23:11:06.519716+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:11:06.519716+0000","last_undegraded":"2024-04-30T23:11:06.519716+0000","last_fullsized":"2024-04-30T23:11:06.519716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347017+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:11:07.347017+0000","last_peered":"2024-04-30T23:11:07.347017+0000","last_clean":"2024-04-30T23:11:07.347017+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:11:07.347017+0000","last_undegraded":"2024-04-30T23:11:07.347017+0000","last_fullsized":"2024-04-30T23:11:07.347017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114239+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:11:06.114239+0000","last_peered":"2024-04-30T23:11:06.114239+0000","last_clean":"2024-04-30T23:11:06.114239+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:11:06.114239+0000","last_undegraded":"2024-04-30T23:11:06.114239+0000","last_fullsized":"2024-04-30T23:11:06.114239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290328+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:11:06.290328+0000","last_peered":"2024-04-30T23:11:06.290328+0000","last_clean":"2024-04-30T23:11:06.290328+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:11:06.290328+0000","last_undegraded":"2024-04-30T23:11:06.290328+0000","last_fullsized":"2024-04-30T23:11:06.290328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933291+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:11:05.933291+0000","last_peered":"2024-04-30T23:11:05.933291+0000","last_clean":"2024-04-30T23:11:05.933291+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:11:05.933291+0000","last_undegraded":"2024-04-30T23:11:05.933291+0000","last_fullsized":"2024-04-30T23:11:05.933291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347167+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:11:07.347167+0000","last_peered":"2024-04-30T23:11:07.347167+0000","last_clean":"2024-04-30T23:11:07.347167+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:11:07.347167+0000","last_undegraded":"2024-04-30T23:11:07.347167+0000","last_fullsized":"2024-04-30T23:11:07.347167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.685307+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:11:24.685307+0000","last_peered":"2024-04-30T23:11:24.685307+0000","last_clean":"2024-04-30T23:11:24.685307+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:11:24.685307+0000","last_undegraded":"2024-04-30T23:11:24.685307+0000","last_fullsized":"2024-04-30T23:11:24.685307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348291+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:11:07.348291+0000","last_peered":"2024-04-30T23:11:07.348291+0000","last_clean":"2024-04-30T23:11:07.348291+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:11:07.348291+0000","last_undegraded":"2024-04-30T23:11:07.348291+0000","last_fullsized":"2024-04-30T23:11:07.348291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933460+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:11:05.933460+0000","last_peered":"2024-04-30T23:11:05.933460+0000","last_clean":"2024-04-30T23:11:05.933460+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:11:05.933460+0000","last_undegraded":"2024-04-30T23:11:05.933460+0000","last_fullsized":"2024-04-30T23:11:05.933460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.686063+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:11:24.686063+0000","last_peered":"2024-04-30T23:11:24.686063+0000","last_clean":"2024-04-30T23:11:24.686063+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:11:24.686063+0000","last_undegraded":"2024-04-30T23:11:24.686063+0000","last_fullsized":"2024-04-30T23:11:24.686063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114325+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:11:06.114325+0000","last_peered":"2024-04-30T23:11:06.114325+0000","last_clean":"2024-04-30T23:11:06.114325+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:11:06.114325+0000","last_undegraded":"2024-04-30T23:11:06.114325+0000","last_fullsized":"2024-04-30T23:11:06.114325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175345+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:11:07.175345+0000","last_peered":"2024-04-30T23:11:07.175345+0000","last_clean":"2024-04-30T23:11:07.175345+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:11:07.175345+0000","last_undegraded":"2024-04-30T23:11:07.175345+0000","last_fullsized":"2024-04-30T23:11:07.175345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290643+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:11:06.290643+0000","last_peered":"2024-04-30T23:11:06.290643+0000","last_clean":"2024-04-30T23:11:06.290643+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:11:06.290643+0000","last_undegraded":"2024-04-30T23:11:06.290643+0000","last_fullsized":"2024-04-30T23:11:06.290643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347820+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:11:07.347820+0000","last_peered":"2024-04-30T23:11:07.347820+0000","last_clean":"2024-04-30T23:11:07.347820+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:11:07.347820+0000","last_undegraded":"2024-04-30T23:11:07.347820+0000","last_fullsized":"2024-04-30T23:11:07.347820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933458+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:11:05.933458+0000","last_peered":"2024-04-30T23:11:05.933458+0000","last_clean":"2024-04-30T23:11:05.933458+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:11:05.933458+0000","last_undegraded":"2024-04-30T23:11:05.933458+0000","last_fullsized":"2024-04-30T23:11:05.933458+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.685046+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:11:24.685046+0000","last_peered":"2024-04-30T23:11:24.685046+0000","last_clean":"2024-04-30T23:11:24.685046+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:11:24.685046+0000","last_undegraded":"2024-04-30T23:11:24.685046+0000","last_fullsized":"2024-04-30T23:11:24.685046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347942+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:11:07.347942+0000","last_peered":"2024-04-30T23:11:07.347942+0000","last_clean":"2024-04-30T23:11:07.347942+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:11:07.347942+0000","last_undegraded":"2024-04-30T23:11:07.347942+0000","last_fullsized":"2024-04-30T23:11:07.347942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.291040+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:11:06.291040+0000","last_peered":"2024-04-30T23:11:06.291040+0000","last_clean":"2024-04-30T23:11:06.291040+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:11:06.291040+0000","last_undegraded":"2024-04-30T23:11:06.291040+0000","last_fullsized":"2024-04-30T23:11:06.291040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.684500+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:11:24.684500+0000","last_peered":"2024-04-30T23:11:24.684500+0000","last_clean":"2024-04-30T23:11:24.684500+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:11:24.684500+0000","last_undegraded":"2024-04-30T23:11:24.684500+0000","last_fullsized":"2024-04-30T23:11:24.684500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519777+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:11:06.519777+0000","last_peered":"2024-04-30T23:11:06.519777+0000","last_clean":"2024-04-30T23:11:06.519777+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:11:06.519777+0000","last_undegraded":"2024-04-30T23:11:06.519777+0000","last_fullsized":"2024-04-30T23:11:06.519777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347073+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:11:07.347073+0000","last_peered":"2024-04-30T23:11:07.347073+0000","last_clean":"2024-04-30T23:11:07.347073+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:11:07.347073+0000","last_undegraded":"2024-04-30T23:11:07.347073+0000","last_fullsized":"2024-04-30T23:11:07.347073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290335+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:11:06.290335+0000","last_peered":"2024-04-30T23:11:06.290335+0000","last_clean":"2024-04-30T23:11:06.290335+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:11:06.290335+0000","last_undegraded":"2024-04-30T23:11:06.290335+0000","last_fullsized":"2024-04-30T23:11:06.290335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934631+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:11:05.934631+0000","last_peered":"2024-04-30T23:11:05.934631+0000","last_clean":"2024-04-30T23:11:05.934631+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:11:05.934631+0000","last_undegraded":"2024-04-30T23:11:05.934631+0000","last_fullsized":"2024-04-30T23:11:05.934631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934076+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:11:05.934076+0000","last_peered":"2024-04-30T23:11:05.934076+0000","last_clean":"2024-04-30T23:11:05.934076+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:11:05.934076+0000","last_undegraded":"2024-04-30T23:11:05.934076+0000","last_fullsized":"2024-04-30T23:11:05.934076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175199+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:11:07.175199+0000","last_peered":"2024-04-30T23:11:07.175199+0000","last_clean":"2024-04-30T23:11:07.175199+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:11:07.175199+0000","last_undegraded":"2024-04-30T23:11:07.175199+0000","last_fullsized":"2024-04-30T23:11:07.175199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934048+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:11:05.934048+0000","last_peered":"2024-04-30T23:11:05.934048+0000","last_clean":"2024-04-30T23:11:05.934048+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:11:05.934048+0000","last_undegraded":"2024-04-30T23:11:05.934048+0000","last_fullsized":"2024-04-30T23:11:05.934048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520094+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:11:06.520094+0000","last_peered":"2024-04-30T23:11:06.520094+0000","last_clean":"2024-04-30T23:11:06.520094+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:11:06.520094+0000","last_undegraded":"2024-04-30T23:11:06.520094+0000","last_fullsized":"2024-04-30T23:11:06.520094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.904644+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:11:26.904644+0000","last_peered":"2024-04-30T23:11:26.904644+0000","last_clean":"2024-04-30T23:11:26.904644+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:11:26.904644+0000","last_undegraded":"2024-04-30T23:11:26.904644+0000","last_fullsized":"2024-04-30T23:11:26.904644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290206+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:11:06.290206+0000","last_peered":"2024-04-30T23:11:06.290206+0000","last_clean":"2024-04-30T23:11:06.290206+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:11:06.290206+0000","last_undegraded":"2024-04-30T23:11:06.290206+0000","last_fullsized":"2024-04-30T23:11:06.290206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290296+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:11:06.290296+0000","last_peered":"2024-04-30T23:11:06.290296+0000","last_clean":"2024-04-30T23:11:06.290296+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:11:06.290296+0000","last_undegraded":"2024-04-30T23:11:06.290296+0000","last_fullsized":"2024-04-30T23:11:06.290296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.695689+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:11:26.695689+0000","last_peered":"2024-04-30T23:11:26.695689+0000","last_clean":"2024-04-30T23:11:26.695689+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:11:26.695689+0000","last_undegraded":"2024-04-30T23:11:26.695689+0000","last_fullsized":"2024-04-30T23:11:26.695689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347222+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:11:07.347222+0000","last_peered":"2024-04-30T23:11:07.347222+0000","last_clean":"2024-04-30T23:11:07.347222+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:11:07.347222+0000","last_undegraded":"2024-04-30T23:11:07.347222+0000","last_fullsized":"2024-04-30T23:11:07.347222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347354+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:11:07.347354+0000","last_peered":"2024-04-30T23:11:07.347354+0000","last_clean":"2024-04-30T23:11:07.347354+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:11:07.347354+0000","last_undegraded":"2024-04-30T23:11:07.347354+0000","last_fullsized":"2024-04-30T23:11:07.347354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933617+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:11:05.933617+0000","last_peered":"2024-04-30T23:11:05.933617+0000","last_clean":"2024-04-30T23:11:05.933617+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:11:05.933617+0000","last_undegraded":"2024-04-30T23:11:05.933617+0000","last_fullsized":"2024-04-30T23:11:05.933617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348202+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:11:07.348202+0000","last_peered":"2024-04-30T23:11:07.348202+0000","last_clean":"2024-04-30T23:11:07.348202+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:11:07.348202+0000","last_undegraded":"2024-04-30T23:11:07.348202+0000","last_fullsized":"2024-04-30T23:11:07.348202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520174+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:11:06.520174+0000","last_peered":"2024-04-30T23:11:06.520174+0000","last_clean":"2024-04-30T23:11:06.520174+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:11:06.520174+0000","last_undegraded":"2024-04-30T23:11:06.520174+0000","last_fullsized":"2024-04-30T23:11:06.520174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934248+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:11:05.934248+0000","last_peered":"2024-04-30T23:11:05.934248+0000","last_clean":"2024-04-30T23:11:05.934248+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:11:05.934248+0000","last_undegraded":"2024-04-30T23:11:05.934248+0000","last_fullsized":"2024-04-30T23:11:05.934248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348277+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:11:07.348277+0000","last_peered":"2024-04-30T23:11:07.348277+0000","last_clean":"2024-04-30T23:11:07.348277+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:11:07.348277+0000","last_undegraded":"2024-04-30T23:11:07.348277+0000","last_fullsized":"2024-04-30T23:11:07.348277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520060+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:11:06.520060+0000","last_peered":"2024-04-30T23:11:06.520060+0000","last_clean":"2024-04-30T23:11:06.520060+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:11:06.520060+0000","last_undegraded":"2024-04-30T23:11:06.520060+0000","last_fullsized":"2024-04-30T23:11:06.520060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290451+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:11:06.290451+0000","last_peered":"2024-04-30T23:11:06.290451+0000","last_clean":"2024-04-30T23:11:06.290451+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:11:06.290451+0000","last_undegraded":"2024-04-30T23:11:06.290451+0000","last_fullsized":"2024-04-30T23:11:06.290451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519636+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:11:06.519636+0000","last_peered":"2024-04-30T23:11:06.519636+0000","last_clean":"2024-04-30T23:11:06.519636+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:11:06.519636+0000","last_undegraded":"2024-04-30T23:11:06.519636+0000","last_fullsized":"2024-04-30T23:11:06.519636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934205+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:11:05.934205+0000","last_peered":"2024-04-30T23:11:05.934205+0000","last_clean":"2024-04-30T23:11:05.934205+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:11:05.934205+0000","last_undegraded":"2024-04-30T23:11:05.934205+0000","last_fullsized":"2024-04-30T23:11:05.934205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347219+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:11:07.347219+0000","last_peered":"2024-04-30T23:11:07.347219+0000","last_clean":"2024-04-30T23:11:07.347219+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:11:07.347219+0000","last_undegraded":"2024-04-30T23:11:07.347219+0000","last_fullsized":"2024-04-30T23:11:07.347219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175123+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:11:07.175123+0000","last_peered":"2024-04-30T23:11:07.175123+0000","last_clean":"2024-04-30T23:11:07.175123+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:11:07.175123+0000","last_undegraded":"2024-04-30T23:11:07.175123+0000","last_fullsized":"2024-04-30T23:11:07.175123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933926+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:11:05.933926+0000","last_peered":"2024-04-30T23:11:05.933926+0000","last_clean":"2024-04-30T23:11:05.933926+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:11:05.933926+0000","last_undegraded":"2024-04-30T23:11:05.933926+0000","last_fullsized":"2024-04-30T23:11:05.933926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290884+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:11:06.290884+0000","last_peered":"2024-04-30T23:11:06.290884+0000","last_clean":"2024-04-30T23:11:06.290884+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:11:06.290884+0000","last_undegraded":"2024-04-30T23:11:06.290884+0000","last_fullsized":"2024-04-30T23:11:06.290884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519584+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:11:06.519584+0000","last_peered":"2024-04-30T23:11:06.519584+0000","last_clean":"2024-04-30T23:11:06.519584+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:11:06.519584+0000","last_undegraded":"2024-04-30T23:11:06.519584+0000","last_fullsized":"2024-04-30T23:11:06.519584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:25.700674+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:11:25.700674+0000","last_peered":"2024-04-30T23:11:25.700674+0000","last_clean":"2024-04-30T23:11:25.700674+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:11:25.700674+0000","last_undegraded":"2024-04-30T23:11:25.700674+0000","last_fullsized":"2024-04-30T23:11:25.700674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347004+0000","last_change":"2024-04-30T23:11:04.927963+0000","last_active":"2024-04-30T23:11:07.347004+0000","last_peered":"2024-04-30T23:11:07.347004+0000","last_clean":"2024-04-30T23:11:07.347004+0000","last_became_active":"2024-04-30T23:11:04.926056+0000","last_became_peered":"2024-04-30T23:11:04.926056+0000","last_unstale":"2024-04-30T23:11:07.347004+0000","last_undegraded":"2024-04-30T23:11:07.347004+0000","last_fullsized":"2024-04-30T23:11:07.347004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:00:23.290883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.904125+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:11:26.904125+0000","last_peered":"2024-04-30T23:11:26.904125+0000","last_clean":"2024-04-30T23:11:26.904125+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:11:26.904125+0000","last_undegraded":"2024-04-30T23:11:26.904125+0000","last_fullsized":"2024-04-30T23:11:26.904125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520278+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:11:06.520278+0000","last_peered":"2024-04-30T23:11:06.520278+0000","last_clean":"2024-04-30T23:11:06.520278+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:11:06.520278+0000","last_undegraded":"2024-04-30T23:11:06.520278+0000","last_fullsized":"2024-04-30T23:11:06.520278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347113+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:11:07.347113+0000","last_peered":"2024-04-30T23:11:07.347113+0000","last_clean":"2024-04-30T23:11:07.347113+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:11:07.347113+0000","last_undegraded":"2024-04-30T23:11:07.347113+0000","last_fullsized":"2024-04-30T23:11:07.347113+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933989+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:11:05.933989+0000","last_peered":"2024-04-30T23:11:05.933989+0000","last_clean":"2024-04-30T23:11:05.933989+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:11:05.933989+0000","last_undegraded":"2024-04-30T23:11:05.933989+0000","last_fullsized":"2024-04-30T23:11:05.933989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347527+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:11:07.347527+0000","last_peered":"2024-04-30T23:11:07.347527+0000","last_clean":"2024-04-30T23:11:07.347527+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:11:07.347527+0000","last_undegraded":"2024-04-30T23:11:07.347527+0000","last_fullsized":"2024-04-30T23:11:07.347527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935810+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:11:05.935810+0000","last_peered":"2024-04-30T23:11:05.935810+0000","last_clean":"2024-04-30T23:11:05.935810+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:11:05.935810+0000","last_undegraded":"2024-04-30T23:11:05.935810+0000","last_fullsized":"2024-04-30T23:11:05.935810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175739+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:11:07.175739+0000","last_peered":"2024-04-30T23:11:07.175739+0000","last_clean":"2024-04-30T23:11:07.175739+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:11:07.175739+0000","last_undegraded":"2024-04-30T23:11:07.175739+0000","last_fullsized":"2024-04-30T23:11:07.175739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114284+0000","last_change":"2024-04-30T23:11:00.906300+0000","last_active":"2024-04-30T23:11:06.114284+0000","last_peered":"2024-04-30T23:11:06.114284+0000","last_clean":"2024-04-30T23:11:06.114284+0000","last_became_active":"2024-04-30T23:11:00.906023+0000","last_became_peered":"2024-04-30T23:11:00.906023+0000","last_unstale":"2024-04-30T23:11:06.114284+0000","last_undegraded":"2024-04-30T23:11:06.114284+0000","last_fullsized":"2024-04-30T23:11:06.114284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:27:34.379088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175668+0000","last_change":"2024-04-30T23:11:04.928164+0000","last_active":"2024-04-30T23:11:07.175668+0000","last_peered":"2024-04-30T23:11:07.175668+0000","last_clean":"2024-04-30T23:11:07.175668+0000","last_became_active":"2024-04-30T23:11:04.927643+0000","last_became_peered":"2024-04-30T23:11:04.927643+0000","last_unstale":"2024-04-30T23:11:07.175668+0000","last_undegraded":"2024-04-30T23:11:07.175668+0000","last_fullsized":"2024-04-30T23:11:07.175668+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:28:14.731552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.684827+0000","last_change":"2024-04-30T23:10:59.894525+0000","last_active":"2024-04-30T23:11:24.684827+0000","last_peered":"2024-04-30T23:11:24.684827+0000","last_clean":"2024-04-30T23:11:24.684827+0000","last_became_active":"2024-04-30T23:10:59.894274+0000","last_became_peered":"2024-04-30T23:10:59.894274+0000","last_unstale":"2024-04-30T23:11:24.684827+0000","last_undegraded":"2024-04-30T23:11:24.684827+0000","last_fullsized":"2024-04-30T23:11:24.684827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:33.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346946+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:11:07.346946+0000","last_peered":"2024-04-30T23:11:07.346946+0000","last_clean":"2024-04-30T23:11:07.346946+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:11:07.346946+0000","last_undegraded":"2024-04-30T23:11:07.346946+0000","last_fullsized":"2024-04-30T23:11:07.346946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934066+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:11:05.934066+0000","last_peered":"2024-04-30T23:11:05.934066+0000","last_clean":"2024-04-30T23:11:05.934066+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:11:05.934066+0000","last_undegraded":"2024-04-30T23:11:05.934066+0000","last_fullsized":"2024-04-30T23:11:05.934066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347124+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:11:07.347124+0000","last_peered":"2024-04-30T23:11:07.347124+0000","last_clean":"2024-04-30T23:11:07.347124+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:11:07.347124+0000","last_undegraded":"2024-04-30T23:11:07.347124+0000","last_fullsized":"2024-04-30T23:11:07.347124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346751+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:11:07.346751+0000","last_peered":"2024-04-30T23:11:07.346751+0000","last_clean":"2024-04-30T23:11:07.346751+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:11:07.346751+0000","last_undegraded":"2024-04-30T23:11:07.346751+0000","last_fullsized":"2024-04-30T23:11:07.346751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175278+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:11:07.175278+0000","last_peered":"2024-04-30T23:11:07.175278+0000","last_clean":"2024-04-30T23:11:07.175278+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:11:07.175278+0000","last_undegraded":"2024-04-30T23:11:07.175278+0000","last_fullsized":"2024-04-30T23:11:07.175278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935832+0000","last_change":"2024-04-30T23:10:59.897945+0000","last_active":"2024-04-30T23:11:05.935832+0000","last_peered":"2024-04-30T23:11:05.935832+0000","last_clean":"2024-04-30T23:11:05.935832+0000","last_became_active":"2024-04-30T23:10:59.897554+0000","last_became_peered":"2024-04-30T23:10:59.897554+0000","last_unstale":"2024-04-30T23:11:05.935832+0000","last_undegraded":"2024-04-30T23:11:05.935832+0000","last_fullsized":"2024-04-30T23:11:05.935832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:39.593177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347321+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:11:07.347321+0000","last_peered":"2024-04-30T23:11:07.347321+0000","last_clean":"2024-04-30T23:11:07.347321+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:11:07.347321+0000","last_undegraded":"2024-04-30T23:11:07.347321+0000","last_fullsized":"2024-04-30T23:11:07.347321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175524+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:11:07.175524+0000","last_peered":"2024-04-30T23:11:07.175524+0000","last_clean":"2024-04-30T23:11:07.175524+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:07.175524+0000","last_undegraded":"2024-04-30T23:11:07.175524+0000","last_fullsized":"2024-04-30T23:11:07.175524+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.687069+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:11:24.687069+0000","last_peered":"2024-04-30T23:11:24.687069+0000","last_clean":"2024-04-30T23:11:24.687069+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:11:24.687069+0000","last_undegraded":"2024-04-30T23:11:24.687069+0000","last_fullsized":"2024-04-30T23:11:24.687069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934325+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:11:05.934325+0000","last_peered":"2024-04-30T23:11:05.934325+0000","last_clean":"2024-04-30T23:11:05.934325+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:11:05.934325+0000","last_undegraded":"2024-04-30T23:11:05.934325+0000","last_fullsized":"2024-04-30T23:11:05.934325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347170+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:11:07.347170+0000","last_peered":"2024-04-30T23:11:07.347170+0000","last_clean":"2024-04-30T23:11:07.347170+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:11:07.347170+0000","last_undegraded":"2024-04-30T23:11:07.347170+0000","last_fullsized":"2024-04-30T23:11:07.347170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936434+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:11:05.936434+0000","last_peered":"2024-04-30T23:11:05.936434+0000","last_clean":"2024-04-30T23:11:05.936434+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:11:05.936434+0000","last_undegraded":"2024-04-30T23:11:05.936434+0000","last_fullsized":"2024-04-30T23:11:05.936434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934466+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:11:05.934466+0000","last_peered":"2024-04-30T23:11:05.934466+0000","last_clean":"2024-04-30T23:11:05.934466+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:11:05.934466+0000","last_undegraded":"2024-04-30T23:11:05.934466+0000","last_fullsized":"2024-04-30T23:11:05.934466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113872+0000","last_change":"2024-04-30T23:11:04.925427+0000","last_active":"2024-04-30T23:11:06.113872+0000","last_peered":"2024-04-30T23:11:06.113872+0000","last_clean":"2024-04-30T23:11:06.113872+0000","last_became_active":"2024-04-30T23:11:04.924996+0000","last_became_peered":"2024-04-30T23:11:04.924996+0000","last_unstale":"2024-04-30T23:11:06.113872+0000","last_undegraded":"2024-04-30T23:11:06.113872+0000","last_fullsized":"2024-04-30T23:11:06.113872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:56:44.902872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290794+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:11:06.290794+0000","last_peered":"2024-04-30T23:11:06.290794+0000","last_clean":"2024-04-30T23:11:06.290794+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:11:06.290794+0000","last_undegraded":"2024-04-30T23:11:06.290794+0000","last_fullsized":"2024-04-30T23:11:06.290794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934114+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:11:05.934114+0000","last_peered":"2024-04-30T23:11:05.934114+0000","last_clean":"2024-04-30T23:11:05.934114+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:11:05.934114+0000","last_undegraded":"2024-04-30T23:11:05.934114+0000","last_fullsized":"2024-04-30T23:11:05.934114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290157+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:11:06.290157+0000","last_peered":"2024-04-30T23:11:06.290157+0000","last_clean":"2024-04-30T23:11:06.290157+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:11:06.290157+0000","last_undegraded":"2024-04-30T23:11:06.290157+0000","last_fullsized":"2024-04-30T23:11:06.290157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519985+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:11:06.519985+0000","last_peered":"2024-04-30T23:11:06.519985+0000","last_clean":"2024-04-30T23:11:06.519985+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:11:06.519985+0000","last_undegraded":"2024-04-30T23:11:06.519985+0000","last_fullsized":"2024-04-30T23:11:06.519985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934587+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:11:05.934587+0000","last_peered":"2024-04-30T23:11:05.934587+0000","last_clean":"2024-04-30T23:11:05.934587+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:11:05.934587+0000","last_undegraded":"2024-04-30T23:11:05.934587+0000","last_fullsized":"2024-04-30T23:11:05.934587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346823+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:11:07.346823+0000","last_peered":"2024-04-30T23:11:07.346823+0000","last_clean":"2024-04-30T23:11:07.346823+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:11:07.346823+0000","last_undegraded":"2024-04-30T23:11:07.346823+0000","last_fullsized":"2024-04-30T23:11:07.346823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936011+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:11:05.936011+0000","last_peered":"2024-04-30T23:11:05.936011+0000","last_clean":"2024-04-30T23:11:05.936011+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:11:05.936011+0000","last_undegraded":"2024-04-30T23:11:05.936011+0000","last_fullsized":"2024-04-30T23:11:05.936011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935805+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:11:05.935805+0000","last_peered":"2024-04-30T23:11:05.935805+0000","last_clean":"2024-04-30T23:11:05.935805+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:11:05.935805+0000","last_undegraded":"2024-04-30T23:11:05.935805+0000","last_fullsized":"2024-04-30T23:11:05.935805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113923+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:11:06.113923+0000","last_peered":"2024-04-30T23:11:06.113923+0000","last_clean":"2024-04-30T23:11:06.113923+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:11:06.113923+0000","last_undegraded":"2024-04-30T23:11:06.113923+0000","last_fullsized":"2024-04-30T23:11:06.113923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520224+0000","last_change":"2024-04-30T23:11:00.900008+0000","last_active":"2024-04-30T23:11:06.520224+0000","last_peered":"2024-04-30T23:11:06.520224+0000","last_clean":"2024-04-30T23:11:06.520224+0000","last_became_active":"2024-04-30T23:11:00.899665+0000","last_became_peered":"2024-04-30T23:11:00.899665+0000","last_unstale":"2024-04-30T23:11:06.520224+0000","last_undegraded":"2024-04-30T23:11:06.520224+0000","last_fullsized":"2024-04-30T23:11:06.520224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:24:34.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347731+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:11:07.347731+0000","last_peered":"2024-04-30T23:11:07.347731+0000","last_clean":"2024-04-30T23:11:07.347731+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:11:07.347731+0000","last_undegraded":"2024-04-30T23:11:07.347731+0000","last_fullsized":"2024-04-30T23:11:07.347731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936710+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:11:05.936710+0000","last_peered":"2024-04-30T23:11:05.936710+0000","last_clean":"2024-04-30T23:11:05.936710+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:11:05.936710+0000","last_undegraded":"2024-04-30T23:11:05.936710+0000","last_fullsized":"2024-04-30T23:11:05.936710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347637+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:11:07.347637+0000","last_peered":"2024-04-30T23:11:07.347637+0000","last_clean":"2024-04-30T23:11:07.347637+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:11:07.347637+0000","last_undegraded":"2024-04-30T23:11:07.347637+0000","last_fullsized":"2024-04-30T23:11:07.347637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290424+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:11:06.290424+0000","last_peered":"2024-04-30T23:11:06.290424+0000","last_clean":"2024-04-30T23:11:06.290424+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:11:06.290424+0000","last_undegraded":"2024-04-30T23:11:06.290424+0000","last_fullsized":"2024-04-30T23:11:06.290424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347245+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:11:07.347245+0000","last_peered":"2024-04-30T23:11:07.347245+0000","last_clean":"2024-04-30T23:11:07.347245+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:11:07.347245+0000","last_undegraded":"2024-04-30T23:11:07.347245+0000","last_fullsized":"2024-04-30T23:11:07.347245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347513+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:11:07.347513+0000","last_peered":"2024-04-30T23:11:07.347513+0000","last_clean":"2024-04-30T23:11:07.347513+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:11:07.347513+0000","last_undegraded":"2024-04-30T23:11:07.347513+0000","last_fullsized":"2024-04-30T23:11:07.347513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520009+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:11:06.520009+0000","last_peered":"2024-04-30T23:11:06.520009+0000","last_clean":"2024-04-30T23:11:06.520009+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:11:06.520009+0000","last_undegraded":"2024-04-30T23:11:06.520009+0000","last_fullsized":"2024-04-30T23:11:06.520009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347228+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:11:07.347228+0000","last_peered":"2024-04-30T23:11:07.347228+0000","last_clean":"2024-04-30T23:11:07.347228+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:11:07.347228+0000","last_undegraded":"2024-04-30T23:11:07.347228+0000","last_fullsized":"2024-04-30T23:11:07.347228+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5536,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":101,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":19889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1071995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808860,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":987136,"data_stored":477411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":477567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1068401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495660,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":476829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":478307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":999424,"data_stored":480705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":476933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":987136,"data_stored":476851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32732,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712420,"statfs":{"total":95995035648,"available":95961518080,"internally_reserved":0,"allocated":1589248,"data_stored":1067379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:11:29.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T23:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 -- 172.21.15.100:0/2150550795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 msgr2=0x7f2960109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 --2- 172.21.15.100:0/2150550795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f2960109370 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f295002a410 comp rx=0 tx=0).stop 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 -- 172.21.15.100:0/2150550795 shutdown_connections 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 --2- 172.21.15.100:0/2150550795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601098b0 0x7f296010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 --2- 172.21.15.100:0/2150550795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f2960109370 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 --2- 172.21.15.100:0/2150550795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601045f0 0x7f2960106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 -- 172.21.15.100:0/2150550795 >> 172.21.15.100:0/2150550795 conn(0x7f29600fdc10 msgr2=0x7f29601000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 -- 172.21.15.100:0/2150550795 shutdown_connections 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 -- 172.21.15.100:0/2150550795 wait complete. 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.651+0000 7f2965f1f640 1 Processor -- start 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 -- start start 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601045f0 0x7f296019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601098b0 0x7f29601a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f296010f630 con 0x7f2960106f50 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f296010f4b0 con 0x7f29601098b0 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f296010f7b0 con 0x7f29601045f0 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54342/0 (socket says 172.21.15.100:54342) 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 -- 172.21.15.100:0/136413750 learned_addr learned my addr 172.21.15.100:0/136413750 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295f7fe640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601045f0 0x7f296019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295ffff640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601098b0 0x7f29601a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 -- 172.21.15.100:0/136413750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601045f0 msgr2=0x7f296019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601045f0 0x7f296019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 -- 172.21.15.100:0/136413750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601098b0 msgr2=0x7f29601a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601098b0 0x7f29601a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 -- 172.21.15.100:0/136413750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29601a1da0 con 0x7f2960106f50 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295effd640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f2950004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f030 con 0x7f2960106f50 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2950003cb0 con 0x7f2960106f50 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.652+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29601a2030 con 0x7f2960106f50 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.653+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2950035070 con 0x7f2960106f50 2024-04-30T23:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.653+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29601a2520 con 0x7f2960106f50 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.654+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29600ff730 con 0x7f2960106f50 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.656+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2950042030 con 0x7f2960106f50 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.656+0000 7f295cff9640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 0x7f294c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.656+0000 7f295f7fe640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 0x7f294c0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.656+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f29500f1580 con 0x7f2960106f50 2024-04-30T23:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.657+0000 7f295f7fe640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 0x7f294c0a6150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2948005d00 tx=0x7f2948005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:29.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.660+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29500bdbc0 con 0x7f2960106f50 2024-04-30T23:11:29.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:29 smithi100 ceph-mon[29745]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:29 smithi100 ceph-mon[29745]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:29 smithi100 ceph-mon[29745]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:29.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4269363838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:29.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1543336150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:29.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.837+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2960063020 con 0x7f294c0a3c40 2024-04-30T23:11:29.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.846+0000 7f295cff9640 1 -- 172.21.15.100:0/136413750 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340346 (secure 0 0 0) 0x7f2960063020 con 0x7f294c0a3c40 2024-04-30T23:11:29.850 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:29.852 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 msgr2=0x7f294c0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 0x7f294c0a6150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2948005d00 tx=0x7f2948005c50 comp rx=0 tx=0).stop 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 msgr2=0x7f296019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f2950004340 comp rx=0 tx=0).stop 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 shutdown_connections 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f294c0a3c40 0x7f294c0a6150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29601098b0 0x7f29601a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2960106f50 0x7f296019a7a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 --2- 172.21.15.100:0/136413750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29601045f0 0x7f296019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:29.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 >> 172.21.15.100:0/136413750 conn(0x7f29600fdc10 msgr2=0x7f2960105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:29.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 shutdown_connections 2024-04-30T23:11:29.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:29.850+0000 7f2965f1f640 1 -- 172.21.15.100:0/136413750 wait complete. 2024-04-30T23:11:29.861 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-04-30T23:11:29.585409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599447,"num_objects":74,"num_object_clones":0,"num_object_copies":223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":157,"num_read_kb":135,"num_write":337,"num_write_kb":2995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383464,"kb_used_data":13508,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558360,"statfs":{"total":1151940427776,"available":1151547760640,"internally_reserved":0,"allocated":13832192,"data_stored":7530900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4580,"num_objects":50,"num_object_clones":0,"num_object_copies":151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":31,"num_read_kb":26,"num_write":109,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003893"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347727+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:11:07.347727+0000","last_peered":"2024-04-30T23:11:07.347727+0000","last_clean":"2024-04-30T23:11:07.347727+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:11:07.347727+0000","last_undegraded":"2024-04-30T23:11:07.347727+0000","last_fullsized":"2024-04-30T23:11:07.347727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114185+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:11:06.114185+0000","last_peered":"2024-04-30T23:11:06.114185+0000","last_clean":"2024-04-30T23:11:06.114185+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:11:06.114185+0000","last_undegraded":"2024-04-30T23:11:06.114185+0000","last_fullsized":"2024-04-30T23:11:06.114185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113945+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:11:06.113945+0000","last_peered":"2024-04-30T23:11:06.113945+0000","last_clean":"2024-04-30T23:11:06.113945+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:11:06.113945+0000","last_undegraded":"2024-04-30T23:11:06.113945+0000","last_fullsized":"2024-04-30T23:11:06.113945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175542+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:11:07.175542+0000","last_peered":"2024-04-30T23:11:07.175542+0000","last_clean":"2024-04-30T23:11:07.175542+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:11:07.175542+0000","last_undegraded":"2024-04-30T23:11:07.175542+0000","last_fullsized":"2024-04-30T23:11:07.175542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347080+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:11:07.347080+0000","last_peered":"2024-04-30T23:11:07.347080+0000","last_clean":"2024-04-30T23:11:07.347080+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:11:07.347080+0000","last_undegraded":"2024-04-30T23:11:07.347080+0000","last_fullsized":"2024-04-30T23:11:07.347080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347771+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:11:07.347771+0000","last_peered":"2024-04-30T23:11:07.347771+0000","last_clean":"2024-04-30T23:11:07.347771+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:11:07.347771+0000","last_undegraded":"2024-04-30T23:11:07.347771+0000","last_fullsized":"2024-04-30T23:11:07.347771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933926+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:11:05.933926+0000","last_peered":"2024-04-30T23:11:05.933926+0000","last_clean":"2024-04-30T23:11:05.933926+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:11:05.933926+0000","last_undegraded":"2024-04-30T23:11:05.933926+0000","last_fullsized":"2024-04-30T23:11:05.933926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347129+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:11:07.347129+0000","last_peered":"2024-04-30T23:11:07.347129+0000","last_clean":"2024-04-30T23:11:07.347129+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:11:07.347129+0000","last_undegraded":"2024-04-30T23:11:07.347129+0000","last_fullsized":"2024-04-30T23:11:07.347129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348278+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:11:07.348278+0000","last_peered":"2024-04-30T23:11:07.348278+0000","last_clean":"2024-04-30T23:11:07.348278+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:11:07.348278+0000","last_undegraded":"2024-04-30T23:11:07.348278+0000","last_fullsized":"2024-04-30T23:11:07.348278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348481+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:11:07.348481+0000","last_peered":"2024-04-30T23:11:07.348481+0000","last_clean":"2024-04-30T23:11:07.348481+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:11:07.348481+0000","last_undegraded":"2024-04-30T23:11:07.348481+0000","last_fullsized":"2024-04-30T23:11:07.348481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934381+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:11:05.934381+0000","last_peered":"2024-04-30T23:11:05.934381+0000","last_clean":"2024-04-30T23:11:05.934381+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:11:05.934381+0000","last_undegraded":"2024-04-30T23:11:05.934381+0000","last_fullsized":"2024-04-30T23:11:05.934381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175473+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:11:07.175473+0000","last_peered":"2024-04-30T23:11:07.175473+0000","last_clean":"2024-04-30T23:11:07.175473+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:11:07.175473+0000","last_undegraded":"2024-04-30T23:11:07.175473+0000","last_fullsized":"2024-04-30T23:11:07.175473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519944+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:11:06.519944+0000","last_peered":"2024-04-30T23:11:06.519944+0000","last_clean":"2024-04-30T23:11:06.519944+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:11:06.519944+0000","last_undegraded":"2024-04-30T23:11:06.519944+0000","last_fullsized":"2024-04-30T23:11:06.519944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113728+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:11:06.113728+0000","last_peered":"2024-04-30T23:11:06.113728+0000","last_clean":"2024-04-30T23:11:06.113728+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:11:06.113728+0000","last_undegraded":"2024-04-30T23:11:06.113728+0000","last_fullsized":"2024-04-30T23:11:06.113728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113722+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:11:06.113722+0000","last_peered":"2024-04-30T23:11:06.113722+0000","last_clean":"2024-04-30T23:11:06.113722+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:11:06.113722+0000","last_undegraded":"2024-04-30T23:11:06.113722+0000","last_fullsized":"2024-04-30T23:11:06.113722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347046+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:11:07.347046+0000","last_peered":"2024-04-30T23:11:07.347046+0000","last_clean":"2024-04-30T23:11:07.347046+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:11:07.347046+0000","last_undegraded":"2024-04-30T23:11:07.347046+0000","last_fullsized":"2024-04-30T23:11:07.347046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347399+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:11:07.347399+0000","last_peered":"2024-04-30T23:11:07.347399+0000","last_clean":"2024-04-30T23:11:07.347399+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:11:07.347399+0000","last_undegraded":"2024-04-30T23:11:07.347399+0000","last_fullsized":"2024-04-30T23:11:07.347399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933944+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:11:05.933944+0000","last_peered":"2024-04-30T23:11:05.933944+0000","last_clean":"2024-04-30T23:11:05.933944+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:11:05.933944+0000","last_undegraded":"2024-04-30T23:11:05.933944+0000","last_fullsized":"2024-04-30T23:11:05.933944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936511+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:11:05.936511+0000","last_peered":"2024-04-30T23:11:05.936511+0000","last_clean":"2024-04-30T23:11:05.936511+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:11:05.936511+0000","last_undegraded":"2024-04-30T23:11:05.936511+0000","last_fullsized":"2024-04-30T23:11:05.936511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936148+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:11:05.936148+0000","last_peered":"2024-04-30T23:11:05.936148+0000","last_clean":"2024-04-30T23:11:05.936148+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:11:05.936148+0000","last_undegraded":"2024-04-30T23:11:05.936148+0000","last_fullsized":"2024-04-30T23:11:05.936148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.913902+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:11:26.913902+0000","last_peered":"2024-04-30T23:11:26.913902+0000","last_clean":"2024-04-30T23:11:26.913902+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:11:26.913902+0000","last_undegraded":"2024-04-30T23:11:26.913902+0000","last_fullsized":"2024-04-30T23:11:26.913902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347444+0000","last_change":"2024-04-30T23:11:00.903613+0000","last_active":"2024-04-30T23:11:07.347444+0000","last_peered":"2024-04-30T23:11:07.347444+0000","last_clean":"2024-04-30T23:11:07.347444+0000","last_became_active":"2024-04-30T23:11:00.903278+0000","last_became_peered":"2024-04-30T23:11:00.903278+0000","last_unstale":"2024-04-30T23:11:07.347444+0000","last_undegraded":"2024-04-30T23:11:07.347444+0000","last_fullsized":"2024-04-30T23:11:07.347444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:40:56.938331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175129+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:11:07.175129+0000","last_peered":"2024-04-30T23:11:07.175129+0000","last_clean":"2024-04-30T23:11:07.175129+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:07.175129+0000","last_undegraded":"2024-04-30T23:11:07.175129+0000","last_fullsized":"2024-04-30T23:11:07.175129+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347768+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:11:07.347768+0000","last_peered":"2024-04-30T23:11:07.347768+0000","last_clean":"2024-04-30T23:11:07.347768+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:11:07.347768+0000","last_undegraded":"2024-04-30T23:11:07.347768+0000","last_fullsized":"2024-04-30T23:11:07.347768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114222+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:11:06.114222+0000","last_peered":"2024-04-30T23:11:06.114222+0000","last_clean":"2024-04-30T23:11:06.114222+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:11:06.114222+0000","last_undegraded":"2024-04-30T23:11:06.114222+0000","last_fullsized":"2024-04-30T23:11:06.114222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175073+0000","last_change":"2024-04-30T23:11:04.936272+0000","last_active":"2024-04-30T23:11:07.175073+0000","last_peered":"2024-04-30T23:11:07.175073+0000","last_clean":"2024-04-30T23:11:07.175073+0000","last_became_active":"2024-04-30T23:11:04.935738+0000","last_became_peered":"2024-04-30T23:11:04.935738+0000","last_unstale":"2024-04-30T23:11:07.175073+0000","last_undegraded":"2024-04-30T23:11:07.175073+0000","last_fullsized":"2024-04-30T23:11:07.175073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:53:47.792943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'11","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.915276+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:11:26.915276+0000","last_peered":"2024-04-30T23:11:26.915276+0000","last_clean":"2024-04-30T23:11:26.915276+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:11:26.915276+0000","last_undegraded":"2024-04-30T23:11:26.915276+0000","last_fullsized":"2024-04-30T23:11:26.915276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347597+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:11:07.347597+0000","last_peered":"2024-04-30T23:11:07.347597+0000","last_clean":"2024-04-30T23:11:07.347597+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:11:07.347597+0000","last_undegraded":"2024-04-30T23:11:07.347597+0000","last_fullsized":"2024-04-30T23:11:07.347597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175080+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:11:07.175080+0000","last_peered":"2024-04-30T23:11:07.175080+0000","last_clean":"2024-04-30T23:11:07.175080+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:11:07.175080+0000","last_undegraded":"2024-04-30T23:11:07.175080+0000","last_fullsized":"2024-04-30T23:11:07.175080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.914812+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:11:26.914812+0000","last_peered":"2024-04-30T23:11:26.914812+0000","last_clean":"2024-04-30T23:11:26.914812+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:11:26.914812+0000","last_undegraded":"2024-04-30T23:11:26.914812+0000","last_fullsized":"2024-04-30T23:11:26.914812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290828+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:11:06.290828+0000","last_peered":"2024-04-30T23:11:06.290828+0000","last_clean":"2024-04-30T23:11:06.290828+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:11:06.290828+0000","last_undegraded":"2024-04-30T23:11:06.290828+0000","last_fullsized":"2024-04-30T23:11:06.290828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936422+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:11:05.936422+0000","last_peered":"2024-04-30T23:11:05.936422+0000","last_clean":"2024-04-30T23:11:05.936422+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:11:05.936422+0000","last_undegraded":"2024-04-30T23:11:05.936422+0000","last_fullsized":"2024-04-30T23:11:05.936422+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:27.910592+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:11:27.910592+0000","last_peered":"2024-04-30T23:11:27.910592+0000","last_clean":"2024-04-30T23:11:27.910592+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:11:27.910592+0000","last_undegraded":"2024-04-30T23:11:27.910592+0000","last_fullsized":"2024-04-30T23:11:27.910592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347444+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:11:07.347444+0000","last_peered":"2024-04-30T23:11:07.347444+0000","last_clean":"2024-04-30T23:11:07.347444+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:11:07.347444+0000","last_undegraded":"2024-04-30T23:11:07.347444+0000","last_fullsized":"2024-04-30T23:11:07.347444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936091+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:11:05.936091+0000","last_peered":"2024-04-30T23:11:05.936091+0000","last_clean":"2024-04-30T23:11:05.936091+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:11:05.936091+0000","last_undegraded":"2024-04-30T23:11:05.936091+0000","last_fullsized":"2024-04-30T23:11:05.936091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347719+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:11:07.347719+0000","last_peered":"2024-04-30T23:11:07.347719+0000","last_clean":"2024-04-30T23:11:07.347719+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:11:07.347719+0000","last_undegraded":"2024-04-30T23:11:07.347719+0000","last_fullsized":"2024-04-30T23:11:07.347719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290489+0000","last_change":"2024-04-30T23:11:00.903401+0000","last_active":"2024-04-30T23:11:06.290489+0000","last_peered":"2024-04-30T23:11:06.290489+0000","last_clean":"2024-04-30T23:11:06.290489+0000","last_became_active":"2024-04-30T23:11:00.903043+0000","last_became_peered":"2024-04-30T23:11:00.903043+0000","last_unstale":"2024-04-30T23:11:06.290489+0000","last_undegraded":"2024-04-30T23:11:06.290489+0000","last_fullsized":"2024-04-30T23:11:06.290489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:29:33.839258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347404+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:11:07.347404+0000","last_peered":"2024-04-30T23:11:07.347404+0000","last_clean":"2024-04-30T23:11:07.347404+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:11:07.347404+0000","last_undegraded":"2024-04-30T23:11:07.347404+0000","last_fullsized":"2024-04-30T23:11:07.347404+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519716+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:11:06.519716+0000","last_peered":"2024-04-30T23:11:06.519716+0000","last_clean":"2024-04-30T23:11:06.519716+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:11:06.519716+0000","last_undegraded":"2024-04-30T23:11:06.519716+0000","last_fullsized":"2024-04-30T23:11:06.519716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347017+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:11:07.347017+0000","last_peered":"2024-04-30T23:11:07.347017+0000","last_clean":"2024-04-30T23:11:07.347017+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:11:07.347017+0000","last_undegraded":"2024-04-30T23:11:07.347017+0000","last_fullsized":"2024-04-30T23:11:07.347017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114239+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:11:06.114239+0000","last_peered":"2024-04-30T23:11:06.114239+0000","last_clean":"2024-04-30T23:11:06.114239+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:11:06.114239+0000","last_undegraded":"2024-04-30T23:11:06.114239+0000","last_fullsized":"2024-04-30T23:11:06.114239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.912492+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:11:26.912492+0000","last_peered":"2024-04-30T23:11:26.912492+0000","last_clean":"2024-04-30T23:11:26.912492+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:11:26.912492+0000","last_undegraded":"2024-04-30T23:11:26.912492+0000","last_fullsized":"2024-04-30T23:11:26.912492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933291+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:11:05.933291+0000","last_peered":"2024-04-30T23:11:05.933291+0000","last_clean":"2024-04-30T23:11:05.933291+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:11:05.933291+0000","last_undegraded":"2024-04-30T23:11:05.933291+0000","last_fullsized":"2024-04-30T23:11:05.933291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347167+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:11:07.347167+0000","last_peered":"2024-04-30T23:11:07.347167+0000","last_clean":"2024-04-30T23:11:07.347167+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:11:07.347167+0000","last_undegraded":"2024-04-30T23:11:07.347167+0000","last_fullsized":"2024-04-30T23:11:07.347167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.685307+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:11:24.685307+0000","last_peered":"2024-04-30T23:11:24.685307+0000","last_clean":"2024-04-30T23:11:24.685307+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:11:24.685307+0000","last_undegraded":"2024-04-30T23:11:24.685307+0000","last_fullsized":"2024-04-30T23:11:24.685307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348291+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:11:07.348291+0000","last_peered":"2024-04-30T23:11:07.348291+0000","last_clean":"2024-04-30T23:11:07.348291+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:11:07.348291+0000","last_undegraded":"2024-04-30T23:11:07.348291+0000","last_fullsized":"2024-04-30T23:11:07.348291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933460+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:11:05.933460+0000","last_peered":"2024-04-30T23:11:05.933460+0000","last_clean":"2024-04-30T23:11:05.933460+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:11:05.933460+0000","last_undegraded":"2024-04-30T23:11:05.933460+0000","last_fullsized":"2024-04-30T23:11:05.933460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.686063+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:11:24.686063+0000","last_peered":"2024-04-30T23:11:24.686063+0000","last_clean":"2024-04-30T23:11:24.686063+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:11:24.686063+0000","last_undegraded":"2024-04-30T23:11:24.686063+0000","last_fullsized":"2024-04-30T23:11:24.686063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114325+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:11:06.114325+0000","last_peered":"2024-04-30T23:11:06.114325+0000","last_clean":"2024-04-30T23:11:06.114325+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:11:06.114325+0000","last_undegraded":"2024-04-30T23:11:06.114325+0000","last_fullsized":"2024-04-30T23:11:06.114325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175345+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:11:07.175345+0000","last_peered":"2024-04-30T23:11:07.175345+0000","last_clean":"2024-04-30T23:11:07.175345+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:11:07.175345+0000","last_undegraded":"2024-04-30T23:11:07.175345+0000","last_fullsized":"2024-04-30T23:11:07.175345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.707933+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:11:26.707933+0000","last_peered":"2024-04-30T23:11:26.707933+0000","last_clean":"2024-04-30T23:11:26.707933+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:11:26.707933+0000","last_undegraded":"2024-04-30T23:11:26.707933+0000","last_fullsized":"2024-04-30T23:11:26.707933+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347820+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:11:07.347820+0000","last_peered":"2024-04-30T23:11:07.347820+0000","last_clean":"2024-04-30T23:11:07.347820+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:11:07.347820+0000","last_undegraded":"2024-04-30T23:11:07.347820+0000","last_fullsized":"2024-04-30T23:11:07.347820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933458+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:11:05.933458+0000","last_peered":"2024-04-30T23:11:05.933458+0000","last_clean":"2024-04-30T23:11:05.933458+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:11:05.933458+0000","last_undegraded":"2024-04-30T23:11:05.933458+0000","last_fullsized":"2024-04-30T23:11:05.933458+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.685046+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:11:24.685046+0000","last_peered":"2024-04-30T23:11:24.685046+0000","last_clean":"2024-04-30T23:11:24.685046+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:11:24.685046+0000","last_undegraded":"2024-04-30T23:11:24.685046+0000","last_fullsized":"2024-04-30T23:11:24.685046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347942+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:11:07.347942+0000","last_peered":"2024-04-30T23:11:07.347942+0000","last_clean":"2024-04-30T23:11:07.347942+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:11:07.347942+0000","last_undegraded":"2024-04-30T23:11:07.347942+0000","last_fullsized":"2024-04-30T23:11:07.347942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.291040+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:11:06.291040+0000","last_peered":"2024-04-30T23:11:06.291040+0000","last_clean":"2024-04-30T23:11:06.291040+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:11:06.291040+0000","last_undegraded":"2024-04-30T23:11:06.291040+0000","last_fullsized":"2024-04-30T23:11:06.291040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.684500+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:11:24.684500+0000","last_peered":"2024-04-30T23:11:24.684500+0000","last_clean":"2024-04-30T23:11:24.684500+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:11:24.684500+0000","last_undegraded":"2024-04-30T23:11:24.684500+0000","last_fullsized":"2024-04-30T23:11:24.684500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519777+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:11:06.519777+0000","last_peered":"2024-04-30T23:11:06.519777+0000","last_clean":"2024-04-30T23:11:06.519777+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:11:06.519777+0000","last_undegraded":"2024-04-30T23:11:06.519777+0000","last_fullsized":"2024-04-30T23:11:06.519777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347073+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:11:07.347073+0000","last_peered":"2024-04-30T23:11:07.347073+0000","last_clean":"2024-04-30T23:11:07.347073+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:11:07.347073+0000","last_undegraded":"2024-04-30T23:11:07.347073+0000","last_fullsized":"2024-04-30T23:11:07.347073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.914427+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:11:26.914427+0000","last_peered":"2024-04-30T23:11:26.914427+0000","last_clean":"2024-04-30T23:11:26.914427+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:11:26.914427+0000","last_undegraded":"2024-04-30T23:11:26.914427+0000","last_fullsized":"2024-04-30T23:11:26.914427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934631+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:11:05.934631+0000","last_peered":"2024-04-30T23:11:05.934631+0000","last_clean":"2024-04-30T23:11:05.934631+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:11:05.934631+0000","last_undegraded":"2024-04-30T23:11:05.934631+0000","last_fullsized":"2024-04-30T23:11:05.934631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934076+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:11:05.934076+0000","last_peered":"2024-04-30T23:11:05.934076+0000","last_clean":"2024-04-30T23:11:05.934076+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:11:05.934076+0000","last_undegraded":"2024-04-30T23:11:05.934076+0000","last_fullsized":"2024-04-30T23:11:05.934076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:27.911068+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:11:27.911068+0000","last_peered":"2024-04-30T23:11:27.911068+0000","last_clean":"2024-04-30T23:11:27.911068+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:11:27.911068+0000","last_undegraded":"2024-04-30T23:11:27.911068+0000","last_fullsized":"2024-04-30T23:11:27.911068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934048+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:11:05.934048+0000","last_peered":"2024-04-30T23:11:05.934048+0000","last_clean":"2024-04-30T23:11:05.934048+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:11:05.934048+0000","last_undegraded":"2024-04-30T23:11:05.934048+0000","last_fullsized":"2024-04-30T23:11:05.934048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520094+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:11:06.520094+0000","last_peered":"2024-04-30T23:11:06.520094+0000","last_clean":"2024-04-30T23:11:06.520094+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:11:06.520094+0000","last_undegraded":"2024-04-30T23:11:06.520094+0000","last_fullsized":"2024-04-30T23:11:06.520094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.904644+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:11:26.904644+0000","last_peered":"2024-04-30T23:11:26.904644+0000","last_clean":"2024-04-30T23:11:26.904644+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:11:26.904644+0000","last_undegraded":"2024-04-30T23:11:26.904644+0000","last_fullsized":"2024-04-30T23:11:26.904644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290206+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:11:06.290206+0000","last_peered":"2024-04-30T23:11:06.290206+0000","last_clean":"2024-04-30T23:11:06.290206+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:11:06.290206+0000","last_undegraded":"2024-04-30T23:11:06.290206+0000","last_fullsized":"2024-04-30T23:11:06.290206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290296+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:11:06.290296+0000","last_peered":"2024-04-30T23:11:06.290296+0000","last_clean":"2024-04-30T23:11:06.290296+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:11:06.290296+0000","last_undegraded":"2024-04-30T23:11:06.290296+0000","last_fullsized":"2024-04-30T23:11:06.290296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.695689+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:11:26.695689+0000","last_peered":"2024-04-30T23:11:26.695689+0000","last_clean":"2024-04-30T23:11:26.695689+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:11:26.695689+0000","last_undegraded":"2024-04-30T23:11:26.695689+0000","last_fullsized":"2024-04-30T23:11:26.695689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347222+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:11:07.347222+0000","last_peered":"2024-04-30T23:11:07.347222+0000","last_clean":"2024-04-30T23:11:07.347222+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:11:07.347222+0000","last_undegraded":"2024-04-30T23:11:07.347222+0000","last_fullsized":"2024-04-30T23:11:07.347222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347354+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:11:07.347354+0000","last_peered":"2024-04-30T23:11:07.347354+0000","last_clean":"2024-04-30T23:11:07.347354+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:11:07.347354+0000","last_undegraded":"2024-04-30T23:11:07.347354+0000","last_fullsized":"2024-04-30T23:11:07.347354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933650+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:11:05.933650+0000","last_peered":"2024-04-30T23:11:05.933650+0000","last_clean":"2024-04-30T23:11:05.933650+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:11:05.933650+0000","last_undegraded":"2024-04-30T23:11:05.933650+0000","last_fullsized":"2024-04-30T23:11:05.933650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348202+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:11:07.348202+0000","last_peered":"2024-04-30T23:11:07.348202+0000","last_clean":"2024-04-30T23:11:07.348202+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:11:07.348202+0000","last_undegraded":"2024-04-30T23:11:07.348202+0000","last_fullsized":"2024-04-30T23:11:07.348202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520174+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:11:06.520174+0000","last_peered":"2024-04-30T23:11:06.520174+0000","last_clean":"2024-04-30T23:11:06.520174+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:11:06.520174+0000","last_undegraded":"2024-04-30T23:11:06.520174+0000","last_fullsized":"2024-04-30T23:11:06.520174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934248+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:11:05.934248+0000","last_peered":"2024-04-30T23:11:05.934248+0000","last_clean":"2024-04-30T23:11:05.934248+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:11:05.934248+0000","last_undegraded":"2024-04-30T23:11:05.934248+0000","last_fullsized":"2024-04-30T23:11:05.934248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.348277+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:11:07.348277+0000","last_peered":"2024-04-30T23:11:07.348277+0000","last_clean":"2024-04-30T23:11:07.348277+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:11:07.348277+0000","last_undegraded":"2024-04-30T23:11:07.348277+0000","last_fullsized":"2024-04-30T23:11:07.348277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520060+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:11:06.520060+0000","last_peered":"2024-04-30T23:11:06.520060+0000","last_clean":"2024-04-30T23:11:06.520060+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:11:06.520060+0000","last_undegraded":"2024-04-30T23:11:06.520060+0000","last_fullsized":"2024-04-30T23:11:06.520060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290451+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:11:06.290451+0000","last_peered":"2024-04-30T23:11:06.290451+0000","last_clean":"2024-04-30T23:11:06.290451+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:11:06.290451+0000","last_undegraded":"2024-04-30T23:11:06.290451+0000","last_fullsized":"2024-04-30T23:11:06.290451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519636+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:11:06.519636+0000","last_peered":"2024-04-30T23:11:06.519636+0000","last_clean":"2024-04-30T23:11:06.519636+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:11:06.519636+0000","last_undegraded":"2024-04-30T23:11:06.519636+0000","last_fullsized":"2024-04-30T23:11:06.519636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934205+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:11:05.934205+0000","last_peered":"2024-04-30T23:11:05.934205+0000","last_clean":"2024-04-30T23:11:05.934205+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:11:05.934205+0000","last_undegraded":"2024-04-30T23:11:05.934205+0000","last_fullsized":"2024-04-30T23:11:05.934205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347219+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:11:07.347219+0000","last_peered":"2024-04-30T23:11:07.347219+0000","last_clean":"2024-04-30T23:11:07.347219+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:11:07.347219+0000","last_undegraded":"2024-04-30T23:11:07.347219+0000","last_fullsized":"2024-04-30T23:11:07.347219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.912449+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:11:26.912449+0000","last_peered":"2024-04-30T23:11:26.912449+0000","last_clean":"2024-04-30T23:11:26.912449+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:11:26.912449+0000","last_undegraded":"2024-04-30T23:11:26.912449+0000","last_fullsized":"2024-04-30T23:11:26.912449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.933926+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:11:05.933926+0000","last_peered":"2024-04-30T23:11:05.933926+0000","last_clean":"2024-04-30T23:11:05.933926+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:11:05.933926+0000","last_undegraded":"2024-04-30T23:11:05.933926+0000","last_fullsized":"2024-04-30T23:11:05.933926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290884+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:11:06.290884+0000","last_peered":"2024-04-30T23:11:06.290884+0000","last_clean":"2024-04-30T23:11:06.290884+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:11:06.290884+0000","last_undegraded":"2024-04-30T23:11:06.290884+0000","last_fullsized":"2024-04-30T23:11:06.290884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519584+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:11:06.519584+0000","last_peered":"2024-04-30T23:11:06.519584+0000","last_clean":"2024-04-30T23:11:06.519584+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:11:06.519584+0000","last_undegraded":"2024-04-30T23:11:06.519584+0000","last_fullsized":"2024-04-30T23:11:06.519584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:25.700674+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:11:25.700674+0000","last_peered":"2024-04-30T23:11:25.700674+0000","last_clean":"2024-04-30T23:11:25.700674+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:11:25.700674+0000","last_undegraded":"2024-04-30T23:11:25.700674+0000","last_fullsized":"2024-04-30T23:11:25.700674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347004+0000","last_change":"2024-04-30T23:11:04.927963+0000","last_active":"2024-04-30T23:11:07.347004+0000","last_peered":"2024-04-30T23:11:07.347004+0000","last_clean":"2024-04-30T23:11:07.347004+0000","last_became_active":"2024-04-30T23:11:04.926056+0000","last_became_peered":"2024-04-30T23:11:04.926056+0000","last_unstale":"2024-04-30T23:11:07.347004+0000","last_undegraded":"2024-04-30T23:11:07.347004+0000","last_fullsized":"2024-04-30T23:11:07.347004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:00:23.290883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.904125+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:11:26.904125+0000","last_peered":"2024-04-30T23:11:26.904125+0000","last_clean":"2024-04-30T23:11:26.904125+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:11:26.904125+0000","last_undegraded":"2024-04-30T23:11:26.904125+0000","last_fullsized":"2024-04-30T23:11:26.904125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520278+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:11:06.520278+0000","last_peered":"2024-04-30T23:11:06.520278+0000","last_clean":"2024-04-30T23:11:06.520278+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:11:06.520278+0000","last_undegraded":"2024-04-30T23:11:06.520278+0000","last_fullsized":"2024-04-30T23:11:06.520278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347113+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:11:07.347113+0000","last_peered":"2024-04-30T23:11:07.347113+0000","last_clean":"2024-04-30T23:11:07.347113+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:11:07.347113+0000","last_undegraded":"2024-04-30T23:11:07.347113+0000","last_fullsized":"2024-04-30T23:11:07.347113+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.708303+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:11:26.708303+0000","last_peered":"2024-04-30T23:11:26.708303+0000","last_clean":"2024-04-30T23:11:26.708303+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:11:26.708303+0000","last_undegraded":"2024-04-30T23:11:26.708303+0000","last_fullsized":"2024-04-30T23:11:26.708303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347527+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:11:07.347527+0000","last_peered":"2024-04-30T23:11:07.347527+0000","last_clean":"2024-04-30T23:11:07.347527+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:11:07.347527+0000","last_undegraded":"2024-04-30T23:11:07.347527+0000","last_fullsized":"2024-04-30T23:11:07.347527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935810+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:11:05.935810+0000","last_peered":"2024-04-30T23:11:05.935810+0000","last_clean":"2024-04-30T23:11:05.935810+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:11:05.935810+0000","last_undegraded":"2024-04-30T23:11:05.935810+0000","last_fullsized":"2024-04-30T23:11:05.935810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.914295+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:11:26.914295+0000","last_peered":"2024-04-30T23:11:26.914295+0000","last_clean":"2024-04-30T23:11:26.914295+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:11:26.914295+0000","last_undegraded":"2024-04-30T23:11:26.914295+0000","last_fullsized":"2024-04-30T23:11:26.914295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.114284+0000","last_change":"2024-04-30T23:11:00.906300+0000","last_active":"2024-04-30T23:11:06.114284+0000","last_peered":"2024-04-30T23:11:06.114284+0000","last_clean":"2024-04-30T23:11:06.114284+0000","last_became_active":"2024-04-30T23:11:00.906023+0000","last_became_peered":"2024-04-30T23:11:00.906023+0000","last_unstale":"2024-04-30T23:11:06.114284+0000","last_undegraded":"2024-04-30T23:11:06.114284+0000","last_fullsized":"2024-04-30T23:11:06.114284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:27:34.379088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175668+0000","last_change":"2024-04-30T23:11:04.928164+0000","last_active":"2024-04-30T23:11:07.175668+0000","last_peered":"2024-04-30T23:11:07.175668+0000","last_clean":"2024-04-30T23:11:07.175668+0000","last_became_active":"2024-04-30T23:11:04.927643+0000","last_became_peered":"2024-04-30T23:11:04.927643+0000","last_unstale":"2024-04-30T23:11:07.175668+0000","last_undegraded":"2024-04-30T23:11:07.175668+0000","last_fullsized":"2024-04-30T23:11:07.175668+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:28:14.731552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.684827+0000","last_change":"2024-04-30T23:10:59.894525+0000","last_active":"2024-04-30T23:11:24.684827+0000","last_peered":"2024-04-30T23:11:24.684827+0000","last_clean":"2024-04-30T23:11:24.684827+0000","last_became_active":"2024-04-30T23:10:59.894274+0000","last_became_peered":"2024-04-30T23:10:59.894274+0000","last_unstale":"2024-04-30T23:11:24.684827+0000","last_undegraded":"2024-04-30T23:11:24.684827+0000","last_fullsized":"2024-04-30T23:11:24.684827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:33.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346946+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:11:07.346946+0000","last_peered":"2024-04-30T23:11:07.346946+0000","last_clean":"2024-04-30T23:11:07.346946+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:11:07.346946+0000","last_undegraded":"2024-04-30T23:11:07.346946+0000","last_fullsized":"2024-04-30T23:11:07.346946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934066+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:11:05.934066+0000","last_peered":"2024-04-30T23:11:05.934066+0000","last_clean":"2024-04-30T23:11:05.934066+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:11:05.934066+0000","last_undegraded":"2024-04-30T23:11:05.934066+0000","last_fullsized":"2024-04-30T23:11:05.934066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347124+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:11:07.347124+0000","last_peered":"2024-04-30T23:11:07.347124+0000","last_clean":"2024-04-30T23:11:07.347124+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:11:07.347124+0000","last_undegraded":"2024-04-30T23:11:07.347124+0000","last_fullsized":"2024-04-30T23:11:07.347124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346751+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:11:07.346751+0000","last_peered":"2024-04-30T23:11:07.346751+0000","last_clean":"2024-04-30T23:11:07.346751+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:11:07.346751+0000","last_undegraded":"2024-04-30T23:11:07.346751+0000","last_fullsized":"2024-04-30T23:11:07.346751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175364+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:11:07.175364+0000","last_peered":"2024-04-30T23:11:07.175364+0000","last_clean":"2024-04-30T23:11:07.175364+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:11:07.175364+0000","last_undegraded":"2024-04-30T23:11:07.175364+0000","last_fullsized":"2024-04-30T23:11:07.175364+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935832+0000","last_change":"2024-04-30T23:10:59.897945+0000","last_active":"2024-04-30T23:11:05.935832+0000","last_peered":"2024-04-30T23:11:05.935832+0000","last_clean":"2024-04-30T23:11:05.935832+0000","last_became_active":"2024-04-30T23:10:59.897554+0000","last_became_peered":"2024-04-30T23:10:59.897554+0000","last_unstale":"2024-04-30T23:11:05.935832+0000","last_undegraded":"2024-04-30T23:11:05.935832+0000","last_fullsized":"2024-04-30T23:11:05.935832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:39.593177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347321+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:11:07.347321+0000","last_peered":"2024-04-30T23:11:07.347321+0000","last_clean":"2024-04-30T23:11:07.347321+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:11:07.347321+0000","last_undegraded":"2024-04-30T23:11:07.347321+0000","last_fullsized":"2024-04-30T23:11:07.347321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.175524+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:11:07.175524+0000","last_peered":"2024-04-30T23:11:07.175524+0000","last_clean":"2024-04-30T23:11:07.175524+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:07.175524+0000","last_undegraded":"2024-04-30T23:11:07.175524+0000","last_fullsized":"2024-04-30T23:11:07.175524+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:24.687069+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:11:24.687069+0000","last_peered":"2024-04-30T23:11:24.687069+0000","last_clean":"2024-04-30T23:11:24.687069+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:11:24.687069+0000","last_undegraded":"2024-04-30T23:11:24.687069+0000","last_fullsized":"2024-04-30T23:11:24.687069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934325+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:11:05.934325+0000","last_peered":"2024-04-30T23:11:05.934325+0000","last_clean":"2024-04-30T23:11:05.934325+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:11:05.934325+0000","last_undegraded":"2024-04-30T23:11:05.934325+0000","last_fullsized":"2024-04-30T23:11:05.934325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347170+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:11:07.347170+0000","last_peered":"2024-04-30T23:11:07.347170+0000","last_clean":"2024-04-30T23:11:07.347170+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:11:07.347170+0000","last_undegraded":"2024-04-30T23:11:07.347170+0000","last_fullsized":"2024-04-30T23:11:07.347170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936434+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:11:05.936434+0000","last_peered":"2024-04-30T23:11:05.936434+0000","last_clean":"2024-04-30T23:11:05.936434+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:11:05.936434+0000","last_undegraded":"2024-04-30T23:11:05.936434+0000","last_fullsized":"2024-04-30T23:11:05.936434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934466+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:11:05.934466+0000","last_peered":"2024-04-30T23:11:05.934466+0000","last_clean":"2024-04-30T23:11:05.934466+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:11:05.934466+0000","last_undegraded":"2024-04-30T23:11:05.934466+0000","last_fullsized":"2024-04-30T23:11:05.934466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113872+0000","last_change":"2024-04-30T23:11:04.925427+0000","last_active":"2024-04-30T23:11:06.113872+0000","last_peered":"2024-04-30T23:11:06.113872+0000","last_clean":"2024-04-30T23:11:06.113872+0000","last_became_active":"2024-04-30T23:11:04.924996+0000","last_became_peered":"2024-04-30T23:11:04.924996+0000","last_unstale":"2024-04-30T23:11:06.113872+0000","last_undegraded":"2024-04-30T23:11:06.113872+0000","last_fullsized":"2024-04-30T23:11:06.113872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:56:44.902872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:26.905338+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:11:26.905338+0000","last_peered":"2024-04-30T23:11:26.905338+0000","last_clean":"2024-04-30T23:11:26.905338+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:11:26.905338+0000","last_undegraded":"2024-04-30T23:11:26.905338+0000","last_fullsized":"2024-04-30T23:11:26.905338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934114+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:11:05.934114+0000","last_peered":"2024-04-30T23:11:05.934114+0000","last_clean":"2024-04-30T23:11:05.934114+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:11:05.934114+0000","last_undegraded":"2024-04-30T23:11:05.934114+0000","last_fullsized":"2024-04-30T23:11:05.934114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290157+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:11:06.290157+0000","last_peered":"2024-04-30T23:11:06.290157+0000","last_clean":"2024-04-30T23:11:06.290157+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:11:06.290157+0000","last_undegraded":"2024-04-30T23:11:06.290157+0000","last_fullsized":"2024-04-30T23:11:06.290157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.519985+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:11:06.519985+0000","last_peered":"2024-04-30T23:11:06.519985+0000","last_clean":"2024-04-30T23:11:06.519985+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:11:06.519985+0000","last_undegraded":"2024-04-30T23:11:06.519985+0000","last_fullsized":"2024-04-30T23:11:06.519985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.934587+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:11:05.934587+0000","last_peered":"2024-04-30T23:11:05.934587+0000","last_clean":"2024-04-30T23:11:05.934587+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:11:05.934587+0000","last_undegraded":"2024-04-30T23:11:05.934587+0000","last_fullsized":"2024-04-30T23:11:05.934587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.346823+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:11:07.346823+0000","last_peered":"2024-04-30T23:11:07.346823+0000","last_clean":"2024-04-30T23:11:07.346823+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:11:07.346823+0000","last_undegraded":"2024-04-30T23:11:07.346823+0000","last_fullsized":"2024-04-30T23:11:07.346823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936011+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:11:05.936011+0000","last_peered":"2024-04-30T23:11:05.936011+0000","last_clean":"2024-04-30T23:11:05.936011+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:11:05.936011+0000","last_undegraded":"2024-04-30T23:11:05.936011+0000","last_fullsized":"2024-04-30T23:11:05.936011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.935805+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:11:05.935805+0000","last_peered":"2024-04-30T23:11:05.935805+0000","last_clean":"2024-04-30T23:11:05.935805+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:11:05.935805+0000","last_undegraded":"2024-04-30T23:11:05.935805+0000","last_fullsized":"2024-04-30T23:11:05.935805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.113923+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:11:06.113923+0000","last_peered":"2024-04-30T23:11:06.113923+0000","last_clean":"2024-04-30T23:11:06.113923+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:11:06.113923+0000","last_undegraded":"2024-04-30T23:11:06.113923+0000","last_fullsized":"2024-04-30T23:11:06.113923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520224+0000","last_change":"2024-04-30T23:11:00.900008+0000","last_active":"2024-04-30T23:11:06.520224+0000","last_peered":"2024-04-30T23:11:06.520224+0000","last_clean":"2024-04-30T23:11:06.520224+0000","last_became_active":"2024-04-30T23:11:00.899665+0000","last_became_peered":"2024-04-30T23:11:00.899665+0000","last_unstale":"2024-04-30T23:11:06.520224+0000","last_undegraded":"2024-04-30T23:11:06.520224+0000","last_fullsized":"2024-04-30T23:11:06.520224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:24:34.890750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347731+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:11:07.347731+0000","last_peered":"2024-04-30T23:11:07.347731+0000","last_clean":"2024-04-30T23:11:07.347731+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:11:07.347731+0000","last_undegraded":"2024-04-30T23:11:07.347731+0000","last_fullsized":"2024-04-30T23:11:07.347731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:05.936710+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:11:05.936710+0000","last_peered":"2024-04-30T23:11:05.936710+0000","last_clean":"2024-04-30T23:11:05.936710+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:11:05.936710+0000","last_undegraded":"2024-04-30T23:11:05.936710+0000","last_fullsized":"2024-04-30T23:11:05.936710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347637+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:11:07.347637+0000","last_peered":"2024-04-30T23:11:07.347637+0000","last_clean":"2024-04-30T23:11:07.347637+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:11:07.347637+0000","last_undegraded":"2024-04-30T23:11:07.347637+0000","last_fullsized":"2024-04-30T23:11:07.347637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.290424+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:11:06.290424+0000","last_peered":"2024-04-30T23:11:06.290424+0000","last_clean":"2024-04-30T23:11:06.290424+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:11:06.290424+0000","last_undegraded":"2024-04-30T23:11:06.290424+0000","last_fullsized":"2024-04-30T23:11:06.290424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347245+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:11:07.347245+0000","last_peered":"2024-04-30T23:11:07.347245+0000","last_clean":"2024-04-30T23:11:07.347245+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:11:07.347245+0000","last_undegraded":"2024-04-30T23:11:07.347245+0000","last_fullsized":"2024-04-30T23:11:07.347245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347513+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:11:07.347513+0000","last_peered":"2024-04-30T23:11:07.347513+0000","last_clean":"2024-04-30T23:11:07.347513+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:11:07.347513+0000","last_undegraded":"2024-04-30T23:11:07.347513+0000","last_fullsized":"2024-04-30T23:11:07.347513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:06.520009+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:11:06.520009+0000","last_peered":"2024-04-30T23:11:06.520009+0000","last_clean":"2024-04-30T23:11:06.520009+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:11:06.520009+0000","last_undegraded":"2024-04-30T23:11:06.520009+0000","last_fullsized":"2024-04-30T23:11:06.520009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-30T23:11:07.347228+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:11:07.347228+0000","last_peered":"2024-04-30T23:11:07.347228+0000","last_clean":"2024-04-30T23:11:07.347228+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:11:07.347228+0000","last_undegraded":"2024-04-30T23:11:07.347228+0000","last_fullsized":"2024-04-30T23:11:07.347228+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8962,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":31,"num_read_kb":26,"num_write":155,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":24527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":476829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1071995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1028096,"data_stored":486143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":477567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1068401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495660,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":476829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":478307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":999424,"data_stored":480705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":476933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1007616,"data_stored":482016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1626112,"data_stored":1074504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:11:29.867 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T23:11:29.867 INFO:tasks.cephadm:Setting up client nodes... 2024-04-30T23:11:29.868 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-30T23:11:30.045 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: 2024-04-30T23:11:29.643+0000 7f1ae5f84700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: 2024-04-30T23:11:29.643+0000 7f1ae5f84700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-mon[32987]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-mon[32987]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-mon[32987]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4269363838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1543336150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:29 smithi183 ceph-mon[33560]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:29 smithi183 ceph-mon[33560]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:29 smithi183 ceph-mon[33560]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:11:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4269363838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:11:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1543336150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:30.140 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:30.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:30 smithi100 ceph-mon[29745]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:30.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:30 smithi100 ceph-mon[29745]: pgmap v306: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-04-30T23:11:31.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:30 smithi104 ceph-mon[32987]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:31.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:30 smithi104 ceph-mon[32987]: pgmap v306: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-04-30T23:11:31.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:30 smithi183 ceph-mon[33560]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:31.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:30 smithi183 ceph-mon[33560]: pgmap v306: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-04-30T23:11:31.870 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:31 smithi100 ceph-mon[29745]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:31.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/198515571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 msgr2=0x7f4e4810b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/198515571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e4810b4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000b0a0 tx=0x7f4e4000b3b0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/198515571 shutdown_connections 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/198515571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e4810b4c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/198515571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 0x7f4e48103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/198515571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e48104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/198515571 >> 172.21.15.100:0/198515571 conn(0x7f4e480fe7a0 msgr2=0x7f4e48100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/198515571 shutdown_connections 2024-04-30T23:11:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.995+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/198515571 wait complete. 2024-04-30T23:11:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 Processor -- start 2024-04-30T23:11:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 -- start start 2024-04-30T23:11:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 0x7f4e48076380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e4819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810ebb0 con 0x7f4e48104c10 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810ea30 con 0x7f4e48104270 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4e2f0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810ed30 con 0x7f4e48103140 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54362/0 (socket says 172.21.15.100:54362) 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 -- 172.21.15.100:0/923703106 learned_addr learned my addr 172.21.15.100:0/923703106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e47fff700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 0x7f4e48076380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e477fe700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e4819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 -- 172.21.15.100:0/923703106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 msgr2=0x7f4e48076380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 0x7f4e48076380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 -- 172.21.15.100:0/923703106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 msgr2=0x7f4e4819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e4819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e4c88d700 1 -- 172.21.15.100:0/923703106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e481a2320 con 0x7f4e48104c10 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.996+0000 7f4e477fe700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e4819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e4c88d700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e400062a0 tx=0x7f4e40004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40021070 con 0x7f4e48104c10 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e481a25b0 con 0x7f4e48104c10 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e40007c80 con 0x7f4e48104c10 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40004850 con 0x7f4e48104c10 2024-04-30T23:11:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.997+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481a2af0 con 0x7f4e48104c10 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.998+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e480511d0 con 0x7f4e48104c10 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:31.999+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f4e40003a00 con 0x7f4e48104c10 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.000+0000 7f4e457fa700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 0x7f4e300a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.000+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f4e4000f020 con 0x7f4e48104c10 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.000+0000 7f4e47fff700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 0x7f4e300a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.000+0000 7f4e47fff700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 0x7f4e300a61e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e48104170 tx=0x7f4e3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:32.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.004+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e4002a020 con 0x7f4e48104c10 2024-04-30T23:11:32.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:31 smithi104 ceph-mon[32987]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:32.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:31 smithi183 ceph-mon[33560]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:11:32.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.284+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4e4802e550 con 0x7f4e48104c10 2024-04-30T23:11:32.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.288+0000 7f4e457fa700 1 -- 172.21.15.100:0/923703106 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f4e4009e890 con 0x7f4e48104c10 2024-04-30T23:11:32.288 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-04-30T23:11:32.288 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCkejFmmRYRERAAOclspRZdg/W3FEIdxrBJ1Q== 2024-04-30T23:11:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 msgr2=0x7f4e300a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 0x7f4e300a61e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e48104170 tx=0x7f4e3800b410 comp rx=0 tx=0).stop 2024-04-30T23:11:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 msgr2=0x7f4e481a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e400062a0 tx=0x7f4e40004e40 comp rx=0 tx=0).stop 2024-04-30T23:11:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 shutdown_connections 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4e300a3cd0 0x7f4e300a61e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e48104c10 0x7f4e481a1af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e48103140 0x7f4e48076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 --2- 172.21.15.100:0/923703106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e48104270 0x7f4e4819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.291+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 >> 172.21.15.100:0/923703106 conn(0x7f4e480fe7a0 msgr2=0x7f4e481074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.292+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 shutdown_connections 2024-04-30T23:11:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:32.292+0000 7f4e4e2f0700 1 -- 172.21.15.100:0/923703106 wait complete. 2024-04-30T23:11:33.037 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:32 smithi100 ceph-mon[29745]: pgmap v307: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.5 KiB/s wr, 20 op/s 2024-04-30T23:11:33.037 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:32 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-30T23:11:33.037 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:32 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-30T23:11:33.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:32 smithi104 ceph-mon[32987]: pgmap v307: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.5 KiB/s wr, 20 op/s 2024-04-30T23:11:33.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:32 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-30T23:11:33.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:32 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-30T23:11:33.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:32 smithi183 ceph-mon[33560]: pgmap v307: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.5 KiB/s wr, 20 op/s 2024-04-30T23:11:33.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:32 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-30T23:11:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:32 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/923703106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-30T23:11:33.064 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:11:33.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-30T23:11:33.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-30T23:11:33.100 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-30T23:11:33.101 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-30T23:11:33.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-30T23:11:33.375 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:34.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:34 smithi100 ceph-mon[29745]: pgmap v308: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-04-30T23:11:35.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:34 smithi104 ceph-mon[32987]: pgmap v308: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-04-30T23:11:35.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:34 smithi183 ceph-mon[33560]: pgmap v308: 129 pgs: 129 active+clean; 629 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-04-30T23:11:35.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 -- 172.21.15.100:0/113470658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 msgr2=0x7fc28c1048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 --2- 172.21.15.100:0/113470658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c1048f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0099c0 tx=0x7fc27c009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 -- 172.21.15.100:0/113470658 shutdown_connections 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 --2- 172.21.15.100:0/113470658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 0x7fc28c1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 --2- 172.21.15.100:0/113470658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c1048f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 --2- 172.21.15.100:0/113470658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 -- 172.21.15.100:0/113470658 >> 172.21.15.100:0/113470658 conn(0x7fc28c0ffdb0 msgr2=0x7fc28c102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 -- 172.21.15.100:0/113470658 shutdown_connections 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.251+0000 7fc2914c3700 1 -- 172.21.15.100:0/113470658 wait complete. 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 Processor -- start 2024-04-30T23:11:35.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 -- start start 2024-04-30T23:11:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 0x7fc28c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c114390 con 0x7fc28c1044e0 2024-04-30T23:11:35.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c114210 con 0x7fc28c108e10 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc2914c3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c114510 con 0x7fc28c109760 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc28affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc28affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33620/0 (socket says 172.21.15.100:33620) 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.252+0000 7fc28affd700 1 -- 172.21.15.100:0/1703808455 learned_addr learned my addr 172.21.15.100:0/1703808455 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28a7fc700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28b7fe700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 0x7fc28c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 -- 172.21.15.100:0/1703808455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 msgr2=0x7fc28c19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 0x7fc28c19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 -- 172.21.15.100:0/1703808455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 msgr2=0x7fc28c19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 -- 172.21.15.100:0/1703808455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c19fc50 con 0x7fc28c1044e0 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28a7fc700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc28affd700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006010 tx=0x7fc27c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:35.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c026070 con 0x7fc28c1044e0 2024-04-30T23:11:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c19fee0 con 0x7fc28c1044e0 2024-04-30T23:11:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc27c00f460 con 0x7fc28c1044e0 2024-04-30T23:11:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c009e60 con 0x7fc28c1044e0 2024-04-30T23:11:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.253+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1a03c0 con 0x7fc28c1044e0 2024-04-30T23:11:35.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.254+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c0511d0 con 0x7fc28c1044e0 2024-04-30T23:11:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.256+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fc27c029070 con 0x7fc28c1044e0 2024-04-30T23:11:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.256+0000 7fc273fff700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 0x7fc2740a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.256+0000 7fc28a7fc700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 0x7fc2740a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.256+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc27c0d13f0 con 0x7fc28c1044e0 2024-04-30T23:11:35.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.257+0000 7fc28a7fc700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 0x7fc2740a61e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc28c103430 tx=0x7fc280009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:35.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.260+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc27c030080 con 0x7fc28c1044e0 2024-04-30T23:11:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.514+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc28c02e550 con 0x7fc28c1044e0 2024-04-30T23:11:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.519+0000 7fc273fff700 1 -- 172.21.15.100:0/1703808455 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+265005 (secure 0 0 0) 0x7fc27c013070 con 0x7fc28c1044e0 2024-04-30T23:11:35.522 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 msgr2=0x7fc2740a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 0x7fc2740a61e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc28c103430 tx=0x7fc280009260 comp rx=0 tx=0).stop 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 msgr2=0x7fc28c19ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006010 tx=0x7fc27c0045e0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 shutdown_connections 2024-04-30T23:11:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2740a3cd0 0x7fc2740a61e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc28c109760 0x7fc28c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc28c1044e0 0x7fc28c19ad80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 --2- 172.21.15.100:0/1703808455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc28c108e10 0x7fc28c19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.523+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 >> 172.21.15.100:0/1703808455 conn(0x7fc28c0ffdb0 msgr2=0x7fc28c10a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.524+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 shutdown_connections 2024-04-30T23:11:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:35.524+0000 7fc2914c3700 1 -- 172.21.15.100:0/1703808455 wait complete. 2024-04-30T23:11:35.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:35 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1703808455' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-30T23:11:36.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:35 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1703808455' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-30T23:11:36.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:35 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1703808455' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-30T23:11:36.321 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":3346272580},{"type":"v1","addr":"172.21.15.100:6801","nonce":3346272580}]},"active_addr":"172.21.15.100:6801/3346272580","active_change":"2024-04-30T23:03:55.489741+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.100:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":176264207}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3696440809}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":474760944}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1701025406}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1905593214}]}]} 2024-04-30T23:11:36.326 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-30T23:11:36.326 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-30T23:11:36.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-30T23:11:36.568 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:36.993 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:36 smithi100 ceph-mon[29745]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 KiB/s wr, 24 op/s 2024-04-30T23:11:37.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:36 smithi104 ceph-mon[32987]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 KiB/s wr, 24 op/s 2024-04-30T23:11:37.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:36 smithi183 ceph-mon[33560]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 KiB/s wr, 24 op/s 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 -- 172.21.15.100:0/3422158801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 msgr2=0x7f0e4c1110e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 --2- 172.21.15.100:0/3422158801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c1110e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0099c0 tx=0x7f0e3c009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 -- 172.21.15.100:0/3422158801 shutdown_connections 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 --2- 172.21.15.100:0/3422158801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c1110e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 --2- 172.21.15.100:0/3422158801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 0x7f0e4c104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 --2- 172.21.15.100:0/3422158801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 -- 172.21.15.100:0/3422158801 >> 172.21.15.100:0/3422158801 conn(0x7f0e4c0fff50 msgr2=0x7f0e4c102370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 -- 172.21.15.100:0/3422158801 shutdown_connections 2024-04-30T23:11:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.290+0000 7f0e51479700 1 -- 172.21.15.100:0/3422158801 wait complete. 2024-04-30T23:11:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 Processor -- start 2024-04-30T23:11:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 -- start start 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 0x7f0e4c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c114420 con 0x7f0e4c109780 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1142a0 con 0x7f0e4c104500 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.291+0000 7f0e51479700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1145a0 con 0x7f0e4c108e30 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33630/0 (socket says 172.21.15.100:33630) 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 -- 172.21.15.100:0/3294394010 learned_addr learned my addr 172.21.15.100:0/3294394010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4affd700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 0x7f0e4c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4a7fc700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 -- 172.21.15.100:0/3294394010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 msgr2=0x7f0e4c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 -- 172.21.15.100:0/3294394010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 msgr2=0x7f0e4c19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 0x7f0e4c19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 -- 172.21.15.100:0/3294394010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c19fc00 con 0x7f0e4c109780 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4a7fc700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e4b7fe700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0059d0 tx=0x7f0e3c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c027070 con 0x7f0e4c109780 2024-04-30T23:11:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c19fe90 con 0x7f0e4c109780 2024-04-30T23:11:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e3c003fe0 con 0x7f0e4c109780 2024-04-30T23:11:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c022c00 con 0x7f0e4c109780 2024-04-30T23:11:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.292+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c1a0370 con 0x7f0e4c109780 2024-04-30T23:11:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.293+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4c0511d0 con 0x7f0e4c109780 2024-04-30T23:11:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.294+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0e3c02a070 con 0x7f0e4c109780 2024-04-30T23:11:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.295+0000 7f0e33fff700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 0x7f0e340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.295+0000 7f0e4affd700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 0x7f0e340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.295+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f0e3c0d1f80 con 0x7f0e4c109780 2024-04-30T23:11:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.296+0000 7f0e4affd700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 0x7f0e340a61e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009550 tx=0x7f0e440091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.299+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0e3c031080 con 0x7f0e4c109780 2024-04-30T23:11:38.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.497+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e4c02e550 con 0x7f0e4c109780 2024-04-30T23:11:38.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.499+0000 7f0e33fff700 1 -- 172.21.15.100:0/3294394010 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f0e3c013070 con 0x7f0e4c109780 2024-04-30T23:11:38.499 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 msgr2=0x7f0e340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 0x7f0e340a61e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009550 tx=0x7f0e440091b0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 msgr2=0x7f0e4c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0059d0 tx=0x7f0e3c0057c0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 shutdown_connections 2024-04-30T23:11:38.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0e340a3cd0 0x7f0e340a61e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e4c109780 0x7f0e4c19f560 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4c104500 0x7f0e4c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 --2- 172.21.15.100:0/3294394010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e4c108e30 0x7f0e4c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 >> 172.21.15.100:0/3294394010 conn(0x7f0e4c0fff50 msgr2=0x7f0e4c1085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 shutdown_connections 2024-04-30T23:11:38.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:38.501+0000 7f0e51479700 1 -- 172.21.15.100:0/3294394010 wait complete. 2024-04-30T23:11:38.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:38 smithi100 ceph-mon[29745]: pgmap v310: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 24 op/s 2024-04-30T23:11:38.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:38 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3294394010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:39.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:38 smithi104 ceph-mon[32987]: pgmap v310: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 24 op/s 2024-04-30T23:11:39.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:38 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3294394010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:39.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:38 smithi183 ceph-mon[33560]: pgmap v310: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 KiB/s wr, 24 op/s 2024-04-30T23:11:39.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:38 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3294394010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:39.246 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-30T23:11:39.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-30T23:11:39.486 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:41.039 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:40 smithi100 ceph-mon[29745]: pgmap v311: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2024-04-30T23:11:41.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:40 smithi104 ceph-mon[32987]: pgmap v311: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2024-04-30T23:11:41.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:40 smithi183 ceph-mon[33560]: pgmap v311: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 -- 172.21.15.100:0/954515251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538108650 msgr2=0x7f353810ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 --2- 172.21.15.100:0/954515251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538108650 0x7f353810ffb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f35280099c0 tx=0x7f3528009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 -- 172.21.15.100:0/954515251 shutdown_connections 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 --2- 172.21.15.100:0/954515251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538108650 0x7f353810ffb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 --2- 172.21.15.100:0/954515251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35381033d0 0x7f35381037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 --2- 172.21.15.100:0/954515251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f3538108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 -- 172.21.15.100:0/954515251 >> 172.21.15.100:0/954515251 conn(0x7f35380fecd0 msgr2=0x7f35381010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 -- 172.21.15.100:0/954515251 shutdown_connections 2024-04-30T23:11:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.284+0000 7f353ccb7700 1 -- 172.21.15.100:0/954515251 wait complete. 2024-04-30T23:11:41.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 Processor -- start 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 -- start start 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f353819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 0x7f353819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113280 con 0x7f35381033d0 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113100 con 0x7f3538108650 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353ccb7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113400 con 0x7f3538107d00 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33648/0 (socket says 172.21.15.100:33648) 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 -- 172.21.15.100:0/3135904805 learned_addr learned my addr 172.21.15.100:0/3135904805 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f3535d9b700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f353819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f3536d9d700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 0x7f353819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:41.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 -- 172.21.15.100:0/3135904805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 msgr2=0x7f353819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f353819c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 -- 172.21.15.100:0/3135904805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 msgr2=0x7f353819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 0x7f353819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f353659c700 1 -- 172.21.15.100:0/3135904805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35381a6e60 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f3536d9d700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 0x7f353819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.285+0000 7f3535d9b700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f353819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f353659c700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3530007f10 tx=0x7f353000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530003a00 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35381a7150 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3530003ba0 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530015660 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.286+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35381a76e0 con 0x7f35381033d0 2024-04-30T23:11:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.287+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35380511d0 con 0x7f35381033d0 2024-04-30T23:11:41.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.288+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3530004000 con 0x7f35381033d0 2024-04-30T23:11:41.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.289+0000 7f352f7fe700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 0x7f35240a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:41.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.289+0000 7f3535d9b700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 0x7f35240a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:41.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.289+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f35300d0870 con 0x7f35381033d0 2024-04-30T23:11:41.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.289+0000 7f3535d9b700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 0x7f35240a61e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3520005fd0 tx=0x7f352000a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:41.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.293+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3530010070 con 0x7f35381033d0 2024-04-30T23:11:41.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.492+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f353806bb10 con 0x7f35381033d0 2024-04-30T23:11:41.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.494+0000 7f352f7fe700 1 -- 172.21.15.100:0/3135904805 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24147 (secure 0 0 0) 0x7f353009ceb0 con 0x7f35381033d0 2024-04-30T23:11:41.494 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:11:41.494 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":89,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:05.270308+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 msgr2=0x7f35240a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 0x7f35240a61e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3520005fd0 tx=0x7f352000a5e0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 msgr2=0x7f353819bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3530007f10 tx=0x7f353000d3b0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 shutdown_connections 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35240a3cd0 0x7f35240a61e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3538108650 0x7f353819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35381033d0 0x7f353819bba0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 --2- 172.21.15.100:0/3135904805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3538107d00 0x7f353819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:41.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 >> 172.21.15.100:0/3135904805 conn(0x7f35380fecd0 msgr2=0x7f3538107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:41.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 shutdown_connections 2024-04-30T23:11:41.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:41.496+0000 7f353ccb7700 1 -- 172.21.15.100:0/3135904805 wait complete. 2024-04-30T23:11:41.859 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:41 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3135904805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:42.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:41 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3135904805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:42.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:41 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3135904805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:11:42.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-30T23:11:42.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-30T23:11:42.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-30T23:11:42.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-30T23:11:42.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-30T23:11:42.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-30T23:11:42.269 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-30T23:11:42.269 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-30T23:11:42.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-30T23:11:42.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-30T23:11:42.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-30T23:11:42.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-30T23:11:42.901 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:42.923 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:42.926 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:42 smithi104 ceph-mon[32987]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-30T23:11:43.046 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:42 smithi100 ceph-mon[29745]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-30T23:11:43.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:42 smithi183 ceph-mon[33560]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-30T23:11:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.553 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:43.986 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:45.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:44 smithi104 ceph-mon[32987]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-04-30T23:11:45.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:44 smithi183 ceph-mon[33560]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-04-30T23:11:45.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:44 smithi100 ceph-mon[29745]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-04-30T23:11:46.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:46 smithi100 ceph-mon[29745]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-30T23:11:47.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:46 smithi104 ceph-mon[32987]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-30T23:11:47.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:46 smithi183 ceph-mon[33560]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-30T23:11:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:11:49.013 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:48 smithi100 ceph-mon[29745]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-30T23:11:49.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:48 smithi104 ceph-mon[32987]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-30T23:11:49.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:48 smithi183 ceph-mon[33560]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-30T23:11:50.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:50 smithi100 ceph-mon[29745]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-30T23:11:51.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:50 smithi104 ceph-mon[32987]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-30T23:11:51.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:50 smithi183 ceph-mon[33560]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-30T23:11:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- 172.21.15.100:0/1293324843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c108e10 msgr2=0x7f0d0c109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/1293324843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c108e10 0x7f0d0c109220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0099c0 tx=0x7f0cfc009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- 172.21.15.100:0/1293324843 shutdown_connections 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/1293324843 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c109760 0x7f0d0c1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/1293324843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d0c1044e0 0x7f0d0c1048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/1293324843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c108e10 0x7f0d0c109220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- 172.21.15.100:0/1293324843 >> 172.21.15.100:0/1293324843 conn(0x7f0d0c0ffdb0 msgr2=0x7f0d0c102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- 172.21.15.100:0/1293324843 shutdown_connections 2024-04-30T23:11:51.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- 172.21.15.100:0/1293324843 wait complete. 2024-04-30T23:11:51.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 Processor -- start 2024-04-30T23:11:51.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.345+0000 7f0d12c5b700 1 -- start start 2024-04-30T23:11:51.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d0c1044e0 0x7f0d0c076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:51.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c108e10 0x7f0d0c077020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:51.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 0x7f0d0c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c114370 con 0x7f0d0c109760 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c1141f0 con 0x7f0d0c108e10 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d12c5b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c1144f0 con 0x7f0d0c1044e0 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 0x7f0d0c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 0x7f0d0c077560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35974/0 (socket says 172.21.15.100:35974) 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 -- 172.21.15.100:0/4170951078 learned_addr learned my addr 172.21.15.100:0/4170951078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d109f7700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d0c1044e0 0x7f0d0c076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d03fff700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c108e10 0x7f0d0c077020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 -- 172.21.15.100:0/4170951078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d0c1044e0 msgr2=0x7f0d0c076ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d0c1044e0 0x7f0d0c076ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 -- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c108e10 msgr2=0x7f0d0c077020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c108e10 0x7f0d0c077020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c1a91a0 con 0x7f0d0c109760 2024-04-30T23:11:51.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d03fff700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c108e10 0x7f0d0c077020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d111f8700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 0x7f0d0c077560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c970 tx=0x7f0d0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.346+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0400ce60 con 0x7f0d0c109760 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.347+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d04004830 con 0x7f0d0c109760 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.347+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c1a9490 con 0x7f0d0c109760 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.347+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040054c0 con 0x7f0d0c109760 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.347+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c1a9980 con 0x7f0d0c109760 2024-04-30T23:11:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.348+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d0c063da0 con 0x7f0d0c109760 2024-04-30T23:11:51.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.349+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0d040049e0 con 0x7f0d0c109760 2024-04-30T23:11:51.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.349+0000 7f0d01ffb700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cf40a3cd0 0x7f0cf40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:51.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f0d040d0690 con 0x7f0d0c109760 2024-04-30T23:11:51.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d109f7700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cf40a3cd0 0x7f0cf40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:51.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d01ffb700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] conn(0x7f0cf40ae9e0 0x7f0cf40b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d04012ec0 con 0x7f0cf40ae9e0 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f0d040d0ae0 con 0x7f0d0c109760 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d109f7700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cf40a3cd0 0x7f0cf40a61e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009550 tx=0x7f0d080091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.350+0000 7f0d03fff700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] conn(0x7f0cf40ae9e0 0x7f0cf40b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.351+0000 7f0d03fff700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] conn(0x7f0cf40ae9e0 0x7f0cf40b0e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:51.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.352+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== osd.1 v2:172.21.15.104:6800/742044421 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d04012ec0 con 0x7f0cf40ae9e0 2024-04-30T23:11:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.368+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 --> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d0c0641a0 con 0x7f0cf40ae9e0 2024-04-30T23:11:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.368+0000 7f0d01ffb700 1 -- 172.21.15.100:0/4170951078 <== osd.1 v2:172.21.15.104:6800/742044421 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d0c0641a0 con 0x7f0cf40ae9e0 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] conn(0x7f0cf40ae9e0 msgr2=0x7f0cf40b0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] conn(0x7f0cf40ae9e0 0x7f0cf40b0e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cf40a3cd0 msgr2=0x7f0cf40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cf40a3cd0 0x7f0cf40a61e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009550 tx=0x7f0d080091b0 comp rx=0 tx=0).stop 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 msgr2=0x7f0d0c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 --2- 172.21.15.100:0/4170951078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c109760 0x7f0d0c077560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c970 tx=0x7f0d0400cc80 comp rx=0 tx=0).stop 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d111f8700 1 -- 172.21.15.100:0/4170951078 reap_dead start 2024-04-30T23:11:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 shutdown_connections 2024-04-30T23:11:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 >> 172.21.15.100:0/4170951078 conn(0x7f0d0c0ffdb0 msgr2=0x7f0d0c10a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 shutdown_connections 2024-04-30T23:11:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.369+0000 7f0d12c5b700 1 -- 172.21.15.100:0/4170951078 wait complete. 2024-04-30T23:11:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 -- 172.21.15.100:0/3645039410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad81041c0 msgr2=0x7f8ad810ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 --2- 172.21.15.100:0/3645039410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad81041c0 0x7f8ad810ff80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000b0a0 tx=0x7f8ad000b3b0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 -- 172.21.15.100:0/3645039410 shutdown_connections 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 --2- 172.21.15.100:0/3645039410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad81041c0 0x7f8ad810ff80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 --2- 172.21.15.100:0/3645039410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ad8108110 0x7f8ad8108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 --2- 172.21.15.100:0/3645039410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad8103870 0x7f8ad8103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 -- 172.21.15.100:0/3645039410 >> 172.21.15.100:0/3645039410 conn(0x7f8ad80fe430 msgr2=0x7f8ad8100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 -- 172.21.15.100:0/3645039410 shutdown_connections 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 -- 172.21.15.100:0/3645039410 wait complete. 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.029+0000 7f8add947700 1 Processor -- start 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 -- start start 2024-04-30T23:11:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad8103870 0x7f8ad81a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ad81041c0 0x7f8ad81a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 0x7f8ad819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad81132c0 con 0x7f8ad8108110 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8113140 con 0x7f8ad8103870 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8add947700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8113440 con 0x7f8ad81041c0 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 0x7f8ad819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 0x7f8ad819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35998/0 (socket says 172.21.15.100:35998) 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 -- 172.21.15.100:0/3258605784 learned_addr learned my addr 172.21.15.100:0/3258605784 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad6ffd700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad8103870 0x7f8ad81a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad67fc700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ad81041c0 0x7f8ad81a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 -- 172.21.15.100:0/3258605784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ad81041c0 msgr2=0x7f8ad81a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ad81041c0 0x7f8ad81a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 -- 172.21.15.100:0/3258605784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad8103870 msgr2=0x7f8ad81a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad8103870 0x7f8ad81a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad819b140 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.030+0000 7f8ad77fe700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 0x7f8ad819aa90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000b780 tx=0x7f8ad0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.031+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0021070 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.031+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad819b3d0 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.031+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ad0007e30 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.031+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0004700 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.031+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad81a7700 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.032+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ad8063e60 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.033+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8ad0007980 con 0x7f8ad8108110 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8adc945700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ac00a3cd0 0x7f8ac00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8ad6ffd700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ac00a3cd0 0x7f8ac00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f8ad000f020 con 0x7f8ad8108110 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8adc945700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] conn(0x7f8ac00ae9e0 0x7f8ac00b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ad0029e70 con 0x7f8ac00ae9e0 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f8ad00d2410 con 0x7f8ad8108110 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8ad67fc700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] conn(0x7f8ac00ae9e0 0x7f8ac00b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8ad6ffd700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ac00a3cd0 0x7f8ac00a61e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ad819bbd0 tx=0x7f8ac8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.034+0000 7f8ad67fc700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] conn(0x7f8ac00ae9e0 0x7f8ac00b0e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.035+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== osd.0 v2:172.21.15.100:6802/815126249 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ad0029e70 con 0x7f8ac00ae9e0 2024-04-30T23:11:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.052+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 --> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ad8064260 con 0x7f8ac00ae9e0 2024-04-30T23:11:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.052+0000 7f8adc945700 1 -- 172.21.15.100:0/3258605784 <== osd.0 v2:172.21.15.100:6802/815126249 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ad8064260 con 0x7f8ac00ae9e0 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] conn(0x7f8ac00ae9e0 msgr2=0x7f8ac00b0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] conn(0x7f8ac00ae9e0 0x7f8ac00b0e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ac00a3cd0 msgr2=0x7f8ac00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ac00a3cd0 0x7f8ac00a61e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ad819bbd0 tx=0x7f8ac8009260 comp rx=0 tx=0).stop 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 msgr2=0x7f8ad819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 --2- 172.21.15.100:0/3258605784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad8108110 0x7f8ad819aa90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000b780 tx=0x7f8ad0004d00 comp rx=0 tx=0).stop 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8ad77fe700 1 -- 172.21.15.100:0/3258605784 reap_dead start 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 shutdown_connections 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 >> 172.21.15.100:0/3258605784 conn(0x7f8ad80fe430 msgr2=0x7f8ad81029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 shutdown_connections 2024-04-30T23:11:52.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:52.053+0000 7f8add947700 1 -- 172.21.15.100:0/3258605784 wait complete. 2024-04-30T23:11:52.756 INFO:teuthology.orchestra.run.smithi100.stdout:34359738447 2024-04-30T23:11:52.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-30T23:11:53.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:52 smithi104 ceph-mon[32987]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:11:53.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:52 smithi183 ceph-mon[33560]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:11:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:52 smithi100 ceph-mon[29745]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/701362268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc010e7e0 msgr2=0x7f6dc0110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/701362268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc010e7e0 0x7f6dc0110cc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6db800b0a0 tx=0x7f6db800b3b0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/701362268 shutdown_connections 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/701362268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc010e7e0 0x7f6dc0110cc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/701362268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc0105370 0x7f6dc0105780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/701362268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc0105cc0 0x7f6dc010e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.625+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/701362268 >> 172.21.15.100:0/701362268 conn(0x7f6dc00fecd0 msgr2=0x7f6dc01010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.626+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/701362268 shutdown_connections 2024-04-30T23:11:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.626+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/701362268 wait complete. 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.626+0000 7f6dc6cb7700 1 Processor -- start 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.626+0000 7f6dc6cb7700 1 -- start start 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 0x7f6dc01a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc0105cc0 0x7f6dc01a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc010e7e0 0x7f6dc019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc01143b0 con 0x7f6dc0105370 2024-04-30T23:11:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 0x7f6dc01a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 0x7f6dc01a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50662/0 (socket says 172.21.15.100:50662) 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 -- 172.21.15.100:0/1952287551 learned_addr learned my addr 172.21.15.100:0/1952287551 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0114230 con 0x7f6dc010e7e0 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0114530 con 0x7f6dc0105cc0 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dbffff700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc0105cc0 0x7f6dc01a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc5254700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc010e7e0 0x7f6dc019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 -- 172.21.15.100:0/1952287551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc0105cc0 msgr2=0x7f6dc01a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc0105cc0 0x7f6dc01a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 -- 172.21.15.100:0/1952287551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc010e7e0 msgr2=0x7f6dc019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc010e7e0 0x7f6dc019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.627+0000 7f6dc4a53700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc019b260 con 0x7f6dc0105370 2024-04-30T23:11:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dc4a53700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 0x7f6dc01a09a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6db400b530 tx=0x7f6db400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4015020 con 0x7f6dc0105370 2024-04-30T23:11:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db4011ce0 con 0x7f6dc0105370 2024-04-30T23:11:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc019b550 con 0x7f6dc0105370 2024-04-30T23:11:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4010dd0 con 0x7f6dc0105370 2024-04-30T23:11:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.628+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01a7750 con 0x7f6dc0105370 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.629+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dc0063e60 con 0x7f6dc0105370 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.630+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6db4018020 con 0x7f6dc0105370 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbdffb700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6db00a3d50 0x7f6db00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbffff700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6db00a3d50 0x7f6db00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f6db40d0410 con 0x7f6dc0105370 2024-04-30T23:11:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbdffb700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] conn(0x7f6db00aea60 0x7f6db00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6db4018ec0 con 0x7f6db00aea60 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6db40d0860 con 0x7f6dc0105370 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dc5254700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] conn(0x7f6db00aea60 0x7f6db00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.631+0000 7f6dbffff700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6db00a3d50 0x7f6db00a6260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6dc019c260 tx=0x7f6dac0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.632+0000 7f6dc5254700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] conn(0x7f6db00aea60 0x7f6db00b0ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.632+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== osd.9 v2:172.21.15.100:6826/3455336884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6db4018ec0 con 0x7f6db00aea60 2024-04-30T23:11:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.648+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 --> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dc0064260 con 0x7f6db00aea60 2024-04-30T23:11:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dbdffb700 1 -- 172.21.15.100:0/1952287551 <== osd.9 v2:172.21.15.100:6826/3455336884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6dc0064260 con 0x7f6db00aea60 2024-04-30T23:11:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] conn(0x7f6db00aea60 msgr2=0x7f6db00b0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] conn(0x7f6db00aea60 0x7f6db00b0ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6db00a3d50 msgr2=0x7f6db00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6db00a3d50 0x7f6db00a6260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6dc019c260 tx=0x7f6dac0073d0 comp rx=0 tx=0).stop 2024-04-30T23:11:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 msgr2=0x7f6dc01a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 --2- 172.21.15.100:0/1952287551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc0105370 0x7f6dc01a09a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6db400b530 tx=0x7f6db400b840 comp rx=0 tx=0).stop 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc5254700 1 -- 172.21.15.100:0/1952287551 reap_dead start 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 shutdown_connections 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.649+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 >> 172.21.15.100:0/1952287551 conn(0x7f6dc00fecd0 msgr2=0x7f6dc00ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.650+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 shutdown_connections 2024-04-30T23:11:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:53.650+0000 7f6dc6cb7700 1 -- 172.21.15.100:0/1952287551 wait complete. 2024-04-30T23:11:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 -- 172.21.15.100:0/4001046160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac1033f0 msgr2=0x7fabac103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/4001046160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac1033f0 0x7fabac103800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0099c0 tx=0x7fab9c009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 -- 172.21.15.100:0/4001046160 shutdown_connections 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/4001046160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabac108670 0x7fabac10ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/4001046160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac1033f0 0x7fabac103800 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/4001046160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabac107d20 0x7fabac108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 -- 172.21.15.100:0/4001046160 >> 172.21.15.100:0/4001046160 conn(0x7fabac0fee40 msgr2=0x7fabac101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 -- 172.21.15.100:0/4001046160 shutdown_connections 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.916+0000 7fabb0ad5700 1 -- 172.21.15.100:0/4001046160 wait complete. 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 Processor -- start 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 -- start start 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabac1033f0 0x7fabac19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 0x7fabac19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabac108670 0x7fabac19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1132a0 con 0x7fabac107d20 2024-04-30T23:11:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabac113120 con 0x7fabac108670 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.917+0000 7fabb0ad5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabac113420 con 0x7fabac1033f0 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 0x7fabac19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 0x7fabac19c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35982/0 (socket says 172.21.15.100:35982) 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 -- 172.21.15.100:0/2208818249 learned_addr learned my addr 172.21.15.100:0/2208818249 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fabaa59c700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabac1033f0 0x7fabac19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fabaad9d700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabac108670 0x7fabac19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 -- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabac1033f0 msgr2=0x7fabac19bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabac1033f0 0x7fabac19bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 -- 172.21.15.100:0/2208818249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabac108670 msgr2=0x7fabac19c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabac108670 0x7fabac19c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac1a6ef0 con 0x7fabac107d20 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7faba9d9b700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 0x7fabac19c1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faba000c9e0 tx=0x7faba000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0007aa0 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac1a71e0 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faba0007c40 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.918+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0018660 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.919+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1a7770 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.919+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabac063da0 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.921+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7faba0018800 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.921+0000 7fab9b7fe700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fab940a3cd0 0x7fab940a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fabaa59c700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fab940a3cd0 0x7fab940a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7faba00d0d30 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fab9b7fe700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] conn(0x7fab940ae9e0 0x7fab940b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faba0004e50 con 0x7fab940ae9e0 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7faba00d1180 con 0x7fabac107d20 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fabaa59c700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fab940a3cd0 0x7fab940a61e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009990 tx=0x7fab9c0036e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.922+0000 7fabaad9d700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] conn(0x7fab940ae9e0 0x7fab940b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.923+0000 7fabaad9d700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] conn(0x7fab940ae9e0 0x7fab940b0e70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.924+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== osd.5 v2:172.21.15.183:6808/4049435736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faba0004e50 con 0x7fab940ae9e0 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.940+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 --> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fabac0641a0 con 0x7fab940ae9e0 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fab9b7fe700 1 -- 172.21.15.100:0/2208818249 <== osd.5 v2:172.21.15.183:6808/4049435736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fabac0641a0 con 0x7fab940ae9e0 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] conn(0x7fab940ae9e0 msgr2=0x7fab940b0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] conn(0x7fab940ae9e0 0x7fab940b0e70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fab940a3cd0 msgr2=0x7fab940a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fab940a3cd0 0x7fab940a61e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009990 tx=0x7fab9c0036e0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 msgr2=0x7fabac19c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 --2- 172.21.15.100:0/2208818249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabac107d20 0x7fabac19c1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faba000c9e0 tx=0x7faba000ccf0 comp rx=0 tx=0).stop 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabaad9d700 1 -- 172.21.15.100:0/2208818249 reap_dead start 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 shutdown_connections 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 >> 172.21.15.100:0/2208818249 conn(0x7fabac0fee40 msgr2=0x7fabac101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 shutdown_connections 2024-04-30T23:11:54.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:51.941+0000 7fabb0ad5700 1 -- 172.21.15.100:0/2208818249 wait complete. 2024-04-30T23:11:55.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:54 smithi104 ceph-mon[32987]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-30T23:11:55.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:54 smithi183 ceph-mon[33560]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-30T23:11:55.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:54 smithi100 ceph-mon[29745]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-30T23:11:55.610 INFO:teuthology.orchestra.run.smithi100.stdout:163208757301 2024-04-30T23:11:55.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-30T23:11:56.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 -- 172.21.15.100:0/2227113794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a41033f0 msgr2=0x7ff7a4103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 --2- 172.21.15.100:0/2227113794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a41033f0 0x7ff7a4103800 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7940099c0 tx=0x7ff794009cd0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 -- 172.21.15.100:0/2227113794 shutdown_connections 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 --2- 172.21.15.100:0/2227113794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7a4108670 0x7ff7a410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 --2- 172.21.15.100:0/2227113794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a41033f0 0x7ff7a4103800 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 --2- 172.21.15.100:0/2227113794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7a4107d20 0x7ff7a4108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.004+0000 7ff7aa189700 1 -- 172.21.15.100:0/2227113794 >> 172.21.15.100:0/2227113794 conn(0x7ff7a40fee40 msgr2=0x7ff7a4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.005+0000 7ff7aa189700 1 -- 172.21.15.100:0/2227113794 shutdown_connections 2024-04-30T23:11:56.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.005+0000 7ff7aa189700 1 -- 172.21.15.100:0/2227113794 wait complete. 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.005+0000 7ff7aa189700 1 Processor -- start 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.005+0000 7ff7aa189700 1 -- start start 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7a41033f0 0x7ff7a419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7a4107d20 0x7ff7a419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 0x7ff7a4199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a41132c0 con 0x7ff7a4108670 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4113140 con 0x7ff7a4107d20 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7aa189700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4113440 con 0x7ff7a41033f0 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 0x7ff7a4199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 0x7ff7a4199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50680/0 (socket says 172.21.15.100:50680) 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 -- 172.21.15.100:0/744620477 learned_addr learned my addr 172.21.15.100:0/744620477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a37fe700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7a41033f0 0x7ff7a419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff79affd700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7a4107d20 0x7ff7a419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 -- 172.21.15.100:0/744620477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7a41033f0 msgr2=0x7ff7a419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7a41033f0 0x7ff7a419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 -- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7a4107d20 msgr2=0x7ff7a419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7a4107d20 0x7ff7a419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a419a0a0 con 0x7ff7a4108670 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.006+0000 7ff7a3fff700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 0x7ff7a4199a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007ee0 tx=0x7ff79c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004bb0 con 0x7ff7a4108670 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a419a390 con 0x7ff7a4108670 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff79c004d50 con 0x7ff7a4108670 2024-04-30T23:11:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c005920 con 0x7ff7a4108670 2024-04-30T23:11:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a41a66d0 con 0x7ff7a4108670 2024-04-30T23:11:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.007+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7a4063e60 con 0x7ff7a4108670 2024-04-30T23:11:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.009+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff79c01a020 con 0x7ff7a4108670 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.009+0000 7ff7a17fa700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7900a3cd0 0x7ff7900a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a37fe700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7900a3cd0 0x7ff7900a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7ff79c0d08c0 con 0x7ff7a4108670 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a17fa700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] conn(0x7ff7900aee00 0x7ff7900b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff79c01de50 con 0x7ff7900aee00 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff79c0d0d10 con 0x7ff7a4108670 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff7a37fe700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7900a3cd0 0x7ff7900a61e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7a419aba0 tx=0x7ff794000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.010+0000 7ff79affd700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] conn(0x7ff7900aee00 0x7ff7900b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:11:56.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.011+0000 7ff79affd700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] conn(0x7ff7900aee00 0x7ff7900b12f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:11:56.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.012+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== osd.4 v2:172.21.15.104:6808/369610864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff79c01de50 con 0x7ff7900aee00 2024-04-30T23:11:56.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.030+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 --> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7a40642e0 con 0x7ff7900aee00 2024-04-30T23:11:56.030 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-30T23:11:56.030 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-30T23:11:56.030 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-30T23:11:56.030 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-04-30T23:11:56.030 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-30T23:11:56.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]: dispatch 2024-04-30T23:11:56.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:56.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-04-30T23:11:56.031 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:56.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.030+0000 7ff7a17fa700 1 -- 172.21.15.100:0/744620477 <== osd.4 v2:172.21.15.104:6808/369610864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff7a40642e0 con 0x7ff7900aee00 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] conn(0x7ff7900aee00 msgr2=0x7ff7900b12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] conn(0x7ff7900aee00 0x7ff7900b12f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7900a3cd0 msgr2=0x7ff7900a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7900a3cd0 0x7ff7900a61e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7a419aba0 tx=0x7ff794000bc0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 msgr2=0x7ff7a4199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 --2- 172.21.15.100:0/744620477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a4108670 0x7ff7a4199a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007ee0 tx=0x7ff79c00d3b0 comp rx=0 tx=0).stop 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7a3fff700 1 -- 172.21.15.100:0/744620477 reap_dead start 2024-04-30T23:11:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 shutdown_connections 2024-04-30T23:11:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 >> 172.21.15.100:0/744620477 conn(0x7ff7a40fee40 msgr2=0x7ff7a4107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:11:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 shutdown_connections 2024-04-30T23:11:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:11:56.031+0000 7ff7aa189700 1 -- 172.21.15.100:0/744620477 wait complete. 2024-04-30T23:11:56.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-04-30T23:11:56.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:56.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-04-30T23:11:56.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-30T23:11:57.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:56 smithi104 ceph-mon[32987]: osdmap e90: 12 total, 12 up, 12 in 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]': finished 2024-04-30T23:11:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-04-30T23:11:57.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:56 smithi183 ceph-mon[33560]: osdmap e90: 12 total, 12 up, 12 in 2024-04-30T23:11:57.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:11:57.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-30T23:11:57.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-30T23:11:57.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 10]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-30T23:11:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:56 smithi100 ceph-mon[29745]: osdmap e90: 12 total, 12 up, 12 in 2024-04-30T23:11:57.126 INFO:teuthology.orchestra.run.smithi100.stdout:141733920829 2024-04-30T23:11:57.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-30T23:11:57.807 INFO:teuthology.orchestra.run.smithi100.stdout:287762808866 2024-04-30T23:11:57.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-30T23:11:58.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:57 smithi104 ceph-mon[32987]: osdmap e91: 12 total, 12 up, 12 in 2024-04-30T23:11:58.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:57 smithi104 ceph-mon[32987]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-30T23:11:58.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:57 smithi183 ceph-mon[33560]: osdmap e91: 12 total, 12 up, 12 in 2024-04-30T23:11:58.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:57 smithi183 ceph-mon[33560]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-30T23:11:58.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:57 smithi100 ceph-mon[29745]: osdmap e91: 12 total, 12 up, 12 in 2024-04-30T23:11:58.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:57 smithi100 ceph-mon[29745]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-30T23:11:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:11:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:11:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:11:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:11:59.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:11:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 -- 172.21.15.100:0/1106230513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625810e7e0 msgr2=0x7f6258110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 --2- 172.21.15.100:0/1106230513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625810e7e0 0x7f6258110cc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f625000b0a0 tx=0x7f625000b3b0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 -- 172.21.15.100:0/1106230513 shutdown_connections 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 --2- 172.21.15.100:0/1106230513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625810e7e0 0x7f6258110cc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 --2- 172.21.15.100:0/1106230513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6258105370 0x7f6258105780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 --2- 172.21.15.100:0/1106230513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6258105cc0 0x7f625810e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 -- 172.21.15.100:0/1106230513 >> 172.21.15.100:0/1106230513 conn(0x7f62580fecd0 msgr2=0x7f62581010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 -- 172.21.15.100:0/1106230513 shutdown_connections 2024-04-30T23:12:00.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.709+0000 7f625eece700 1 -- 172.21.15.100:0/1106230513 wait complete. 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 Processor -- start 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 -- start start 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 0x7f62581a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6258105cc0 0x7f62581a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f625810e7e0 0x7f625819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6258114340 con 0x7f6258105370 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f62581141c0 con 0x7f625810e7e0 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625eece700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62581144c0 con 0x7f6258105cc0 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625cc6a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 0x7f62581a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625cc6a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 0x7f62581a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50692/0 (socket says 172.21.15.100:50692) 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625d46b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f625810e7e0 0x7f625819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f625cc6a700 1 -- 172.21.15.100:0/852323366 learned_addr learned my addr 172.21.15.100:0/852323366 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:00.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.710+0000 7f6257fff700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6258105cc0 0x7f62581a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 -- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6258105cc0 msgr2=0x7f62581a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6258105cc0 0x7f62581a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 -- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 msgr2=0x7f62581a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 0x7f62581a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625819b0f0 con 0x7f625810e7e0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625cc6a700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6258105370 0x7f62581a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625d46b700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f625810e7e0 0x7f625819aa40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f625000d010 tx=0x7f6250004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250021070 con 0x7f625810e7e0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6250007e30 con 0x7f625810e7e0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625819b380 con 0x7f625810e7e0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500046a0 con 0x7f625810e7e0 2024-04-30T23:12:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.711+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62581a76b0 con 0x7f625810e7e0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.712+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6258063e60 con 0x7f625810e7e0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.713+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6250003d00 con 0x7f625810e7e0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f6255ffb700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62480a3cd0 0x7f62480a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f625cc6a700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62480a3cd0 0x7f62480a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f625000f020 con 0x7f625810e7e0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f6255ffb700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] conn(0x7f62480aee00 0x7f62480b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f625001fe80 con 0x7f62480aee00 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f62500d2340 con 0x7f625810e7e0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.714+0000 7f625cc6a700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62480a3cd0 0x7f62480a61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f625819bb80 tx=0x7f624c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.715+0000 7f6257fff700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] conn(0x7f62480aee00 0x7f62480b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:00.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.715+0000 7f6257fff700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] conn(0x7f62480aee00 0x7f62480b12f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:00.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.716+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== osd.2 v2:172.21.15.183:6800/3395265285 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f625001fe80 con 0x7f62480aee00 2024-04-30T23:12:00.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.732+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 --> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62580642e0 con 0x7f62480aee00 2024-04-30T23:12:00.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:00 smithi100 ceph-mon[29745]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:12:00.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:00.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:00.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:00.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:00 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:00.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.732+0000 7f6255ffb700 1 -- 172.21.15.100:0/852323366 <== osd.2 v2:172.21.15.183:6800/3395265285 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f62580642e0 con 0x7f62480aee00 2024-04-30T23:12:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.732+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] conn(0x7f62480aee00 msgr2=0x7f62480b12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.732+0000 7f625eece700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] conn(0x7f62480aee00 0x7f62480b12f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62480a3cd0 msgr2=0x7f62480a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62480a3cd0 0x7f62480a61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f625819bb80 tx=0x7f624c009260 comp rx=0 tx=0).stop 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f625810e7e0 msgr2=0x7f625819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 --2- 172.21.15.100:0/852323366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f625810e7e0 0x7f625819aa40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f625000d010 tx=0x7f6250004d00 comp rx=0 tx=0).stop 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625d46b700 1 -- 172.21.15.100:0/852323366 reap_dead start 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 shutdown_connections 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 >> 172.21.15.100:0/852323366 conn(0x7f62580fecd0 msgr2=0x7f6258100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 shutdown_connections 2024-04-30T23:12:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:00.733+0000 7f625eece700 1 -- 172.21.15.100:0/852323366 wait complete. 2024-04-30T23:12:01.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:00 smithi104 ceph-mon[32987]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:12:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:00 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:00 smithi183 ceph-mon[33560]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:12:01.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:00 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.893+0000 7ff63147f700 1 -- 172.21.15.100:0/1629394741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 msgr2=0x7ff62c102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.893+0000 7ff63147f700 1 --2- 172.21.15.100:0/1629394741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c102e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6200099c0 tx=0x7ff620009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 -- 172.21.15.100:0/1629394741 shutdown_connections 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 --2- 172.21.15.100:0/1629394741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c109760 0x7ff62c1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 --2- 172.21.15.100:0/1629394741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c102e00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 --2- 172.21.15.100:0/1629394741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff62c108e10 0x7ff62c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 -- 172.21.15.100:0/1629394741 >> 172.21.15.100:0/1629394741 conn(0x7ff62c0fe430 msgr2=0x7ff62c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 -- 172.21.15.100:0/1629394741 shutdown_connections 2024-04-30T23:12:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 -- 172.21.15.100:0/1629394741 wait complete. 2024-04-30T23:12:01.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 Processor -- start 2024-04-30T23:12:01.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.894+0000 7ff63147f700 1 -- start start 2024-04-30T23:12:01.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c103940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c108e10 0x7ff62c103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff62c109760 0x7ff62c1043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114390 con 0x7ff62c1029f0 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114210 con 0x7ff62c108e10 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff63147f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114510 con 0x7ff62c109760 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c103940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c103940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50714/0 (socket says 172.21.15.100:50714) 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 -- 172.21.15.100:0/3699181862 learned_addr learned my addr 172.21.15.100:0/3699181862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62a7fc700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c108e10 0x7ff62c103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62b7fe700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff62c109760 0x7ff62c1043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 -- 172.21.15.100:0/3699181862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff62c109760 msgr2=0x7ff62c1043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff62c109760 0x7ff62c1043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 -- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c108e10 msgr2=0x7ff62c103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c108e10 0x7ff62c103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62affd700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c1a90e0 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.895+0000 7ff62a7fc700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff62c108e10 0x7ff62c103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff62affd700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c103940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6200098e0 tx=0x7ff6200057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620027070 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff620003f20 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62c1a9370 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620022da0 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.896+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62c1a9820 con 0x7ff62c1029f0 2024-04-30T23:12:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.897+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff62c063de0 con 0x7ff62c1029f0 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.898+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff62002a070 con 0x7ff62c1029f0 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff613fff700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6140a3d50 0x7ff6140a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7ff6200d2300 con 0x7ff62c1029f0 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff62a7fc700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6140a3d50 0x7ff6140a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff613fff700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] conn(0x7ff6140aee80 0x7ff6140b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6140b1a40 con 0x7ff6140aee80 2024-04-30T23:12:01.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7ff6200d2750 con 0x7ff62c1029f0 2024-04-30T23:12:01.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff62b7fe700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] conn(0x7ff6140aee80 0x7ff6140b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:01.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.899+0000 7ff62a7fc700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6140a3d50 0x7ff6140a6260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff62c108840 tx=0x7ff61c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:01.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.900+0000 7ff62b7fe700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] conn(0x7ff6140aee80 0x7ff6140b1370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:01.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.901+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== osd.7 v2:172.21.15.104:6816/1321206568 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6140b1a40 con 0x7ff6140aee80 2024-04-30T23:12:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.918+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 --> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff62c0641e0 con 0x7ff6140aee80 2024-04-30T23:12:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff613fff700 1 -- 172.21.15.100:0/3699181862 <== osd.7 v2:172.21.15.104:6816/1321206568 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff62c0641e0 con 0x7ff6140aee80 2024-04-30T23:12:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] conn(0x7ff6140aee80 msgr2=0x7ff6140b1370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] conn(0x7ff6140aee80 0x7ff6140b1370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6140a3d50 msgr2=0x7ff6140a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6140a3d50 0x7ff6140a6260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff62c108840 tx=0x7ff61c0073d0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 msgr2=0x7ff62c103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 --2- 172.21.15.100:0/3699181862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff62c1029f0 0x7ff62c103940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6200098e0 tx=0x7ff6200057c0 comp rx=0 tx=0).stop 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff62b7fe700 1 -- 172.21.15.100:0/3699181862 reap_dead start 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 shutdown_connections 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 >> 172.21.15.100:0/3699181862 conn(0x7ff62c0fe430 msgr2=0x7ff62c100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 shutdown_connections 2024-04-30T23:12:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:01.919+0000 7ff63147f700 1 -- 172.21.15.100:0/3699181862 wait complete. 2024-04-30T23:12:02.256 INFO:teuthology.orchestra.run.smithi100.stdout:55834574923 2024-04-30T23:12:02.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-30T23:12:02.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:02 smithi100 ceph-mon[29745]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 383 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:03.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:02 smithi104 ceph-mon[32987]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 383 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:03.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:02 smithi183 ceph-mon[33560]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 383 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:03.349 INFO:teuthology.orchestra.run.smithi100.stdout:77309411400 2024-04-30T23:12:03.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-30T23:12:04.502 INFO:teuthology.orchestra.run.smithi100.stdout:219043332142 2024-04-30T23:12:04.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-30T23:12:04.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:04 smithi100 ceph-mon[29745]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:05.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:04 smithi104 ceph-mon[32987]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:05.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:04 smithi183 ceph-mon[33560]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:05.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 -- 172.21.15.100:0/1689747820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 msgr2=0x7f65781037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 --2- 172.21.15.100:0/1689747820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f65781037e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f65740099c0 tx=0x7f6574009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 -- 172.21.15.100:0/1689747820 shutdown_connections 2024-04-30T23:12:05.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 --2- 172.21.15.100:0/1689747820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6578108650 0x7f657810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 --2- 172.21.15.100:0/1689747820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f65781037e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 --2- 172.21.15.100:0/1689747820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578107d00 0x7f6578108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 -- 172.21.15.100:0/1689747820 >> 172.21.15.100:0/1689747820 conn(0x7f65780fecd0 msgr2=0x7f65781010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 -- 172.21.15.100:0/1689747820 shutdown_connections 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.171+0000 7f6580253700 1 -- 172.21.15.100:0/1689747820 wait complete. 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 Processor -- start 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 -- start start 2024-04-30T23:12:05.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f657819f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6578107d00 0x7f657819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578108650 0x7f6578199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65781132f0 con 0x7f65781033d0 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6578113170 con 0x7f6578107d00 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f6580253700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6578113470 con 0x7f6578108650 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f657dfef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f657819f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f657dfef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f657819f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56884/0 (socket says 172.21.15.100:56884) 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f657dfef700 1 -- 172.21.15.100:0/4280207270 learned_addr learned my addr 172.21.15.100:0/4280207270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f657d7ee700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6578107d00 0x7f657819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.172+0000 7f657e7f0700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578108650 0x7f6578199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 -- 172.21.15.100:0/4280207270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578108650 msgr2=0x7f6578199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578108650 0x7f6578199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 -- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6578107d00 msgr2=0x7f657819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6578107d00 0x7f657819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657819a120 con 0x7f65781033d0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657e7f0700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6578108650 0x7f6578199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f657dfef700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f657819f850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f657400b580 tx=0x7f65740047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574027070 con 0x7f65781033d0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657819a3b0 con 0x7f65781033d0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6574003f20 con 0x7f65781033d0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574022d70 con 0x7f65781033d0 2024-04-30T23:12:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.173+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657819a890 con 0x7f65781033d0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.174+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6578063e60 con 0x7f65781033d0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.175+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6574022500 con 0x7f65781033d0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f656effd700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65640a3cd0 0x7f65640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f657d7ee700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65640a3cd0 0x7f65640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f65740d1b90 con 0x7f65781033d0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f656effd700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] conn(0x7f65640aecd0 0x7f65640b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f657400b0b0 con 0x7f65640aecd0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.176+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f65740d1fe0 con 0x7f65781033d0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.177+0000 7f657d7ee700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65640a3cd0 0x7f65640a61e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65781062f0 tx=0x7f6568009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.177+0000 7f657e7f0700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] conn(0x7f65640aecd0 0x7f65640b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.177+0000 7f657e7f0700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] conn(0x7f65640aecd0 0x7f65640b11c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.178+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== osd.10 v2:172.21.15.104:6824/452844074 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f657400b0b0 con 0x7f65640aecd0 2024-04-30T23:12:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.194+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 --> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65780642e0 con 0x7f65640aecd0 2024-04-30T23:12:05.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.194+0000 7f656effd700 1 -- 172.21.15.100:0/4280207270 <== osd.10 v2:172.21.15.104:6824/452844074 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f65780642e0 con 0x7f65640aecd0 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] conn(0x7f65640aecd0 msgr2=0x7f65640b11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] conn(0x7f65640aecd0 0x7f65640b11c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65640a3cd0 msgr2=0x7f65640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65640a3cd0 0x7f65640a61e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65781062f0 tx=0x7f6568009190 comp rx=0 tx=0).stop 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 msgr2=0x7f657819f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 --2- 172.21.15.100:0/4280207270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65781033d0 0x7f657819f850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f657400b580 tx=0x7f65740047b0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f657e7f0700 1 -- 172.21.15.100:0/4280207270 reap_dead start 2024-04-30T23:12:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 shutdown_connections 2024-04-30T23:12:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 >> 172.21.15.100:0/4280207270 conn(0x7f65780fecd0 msgr2=0x7f6578101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 shutdown_connections 2024-04-30T23:12:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.195+0000 7f6580253700 1 -- 172.21.15.100:0/4280207270 wait complete. 2024-04-30T23:12:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 -- 172.21.15.100:0/824073276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8103b70 msgr2=0x7f9ab8103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 --2- 172.21.15.100:0/824073276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8103b70 0x7f9ab8103f80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80099c0 tx=0x7f9aa8009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 -- 172.21.15.100:0/824073276 shutdown_connections 2024-04-30T23:12:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 --2- 172.21.15.100:0/824073276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ab8108660 0x7f9ab810ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 --2- 172.21.15.100:0/824073276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8103b70 0x7f9ab8103f80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 --2- 172.21.15.100:0/824073276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ab8107d10 0x7f9ab8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 -- 172.21.15.100:0/824073276 >> 172.21.15.100:0/824073276 conn(0x7f9ab80fe600 msgr2=0x7f9ab8100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 -- 172.21.15.100:0/824073276 shutdown_connections 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.052+0000 7f9abd500700 1 -- 172.21.15.100:0/824073276 wait complete. 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.053+0000 7f9abd500700 1 Processor -- start 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.053+0000 7f9abd500700 1 -- start start 2024-04-30T23:12:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ab8103b70 0x7f9ab819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ab8107d10 0x7f9ab819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 0x7f9ab81a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8113290 con 0x7f9ab8108660 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8113110 con 0x7f9ab8107d10 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8113410 con 0x7f9ab8103b70 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 0x7f9ab81a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 0x7f9ab81a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56862/0 (socket says 172.21.15.100:56862) 2024-04-30T23:12:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 -- 172.21.15.100:0/3582525264 learned_addr learned my addr 172.21.15.100:0/3582525264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab6ffd700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ab8103b70 0x7f9ab819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9aae7fc700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ab8107d10 0x7f9ab819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 -- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ab8103b70 msgr2=0x7f9ab819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ab8103b70 0x7f9ab819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 -- 172.21.15.100:0/3582525264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ab8107d10 msgr2=0x7f9ab819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ab8107d10 0x7f9ab819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab819c890 con 0x7f9ab8108660 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab77fe700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 0x7f9ab81a6bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007d70 tx=0x7f9ab000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0016020 con 0x7f9ab8108660 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ab000ad40 con 0x7f9ab8108660 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.054+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab81a7150 con 0x7f9ab8108660 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.055+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00115e0 con 0x7f9ab8108660 2024-04-30T23:12:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.055+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81a7640 con 0x7f9ab8108660 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.055+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ab8063de0 con 0x7f9ab8108660 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.057+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f9ab0019020 con 0x7f9ab8108660 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab4ff9700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9aa40a3cd0 0x7f9aa40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab6ffd700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9aa40a3cd0 0x7f9aa40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f9ab00d0c60 con 0x7f9ab8108660 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab4ff9700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] conn(0x7f9aa40aee00 0x7f9aa40b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ab0022e50 con 0x7f9aa40aee00 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.058+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9ab00d10b0 con 0x7f9ab8108660 2024-04-30T23:12:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.059+0000 7f9ab6ffd700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9aa40a3cd0 0x7f9aa40a61e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009990 tx=0x7f9aa80036e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.059+0000 7f9aae7fc700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] conn(0x7f9aa40aee00 0x7f9aa40b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.059+0000 7f9aae7fc700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] conn(0x7f9aa40aee00 0x7f9aa40b12f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.060+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== osd.11 v2:172.21.15.183:6824/964206536 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ab0022e50 con 0x7f9aa40aee00 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.076+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 --> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ab80641e0 con 0x7f9aa40aee00 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9ab4ff9700 1 -- 172.21.15.100:0/3582525264 <== osd.11 v2:172.21.15.183:6824/964206536 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ab80641e0 con 0x7f9aa40aee00 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] conn(0x7f9aa40aee00 msgr2=0x7f9aa40b12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] conn(0x7f9aa40aee00 0x7f9aa40b12f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9aa40a3cd0 msgr2=0x7f9aa40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9aa40a3cd0 0x7f9aa40a61e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009990 tx=0x7f9aa80036e0 comp rx=0 tx=0).stop 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 msgr2=0x7f9ab81a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 --2- 172.21.15.100:0/3582525264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8108660 0x7f9ab81a6bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007d70 tx=0x7f9ab000a340 comp rx=0 tx=0).stop 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9ab77fe700 1 -- 172.21.15.100:0/3582525264 reap_dead start 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 shutdown_connections 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.077+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 >> 172.21.15.100:0/3582525264 conn(0x7f9ab80fe600 msgr2=0x7f9ab81070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.078+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 shutdown_connections 2024-04-30T23:12:05.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:05.078+0000 7f9abd500700 1 -- 172.21.15.100:0/3582525264 wait complete. 2024-04-30T23:12:06.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- 172.21.15.100:0/2991233579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24107d30 msgr2=0x7f5e24108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 --2- 172.21.15.100:0/2991233579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24107d30 0x7f5e24108140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e140099c0 tx=0x7f5e14009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- 172.21.15.100:0/2991233579 shutdown_connections 2024-04-30T23:12:06.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 --2- 172.21.15.100:0/2991233579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e24108680 0x7f5e2410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 --2- 172.21.15.100:0/2991233579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e24103450 0x7f5e24103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 --2- 172.21.15.100:0/2991233579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24107d30 0x7f5e24108140 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- 172.21.15.100:0/2991233579 >> 172.21.15.100:0/2991233579 conn(0x7f5e24078d60 msgr2=0x7f5e240791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- 172.21.15.100:0/2991233579 shutdown_connections 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- 172.21.15.100:0/2991233579 wait complete. 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 Processor -- start 2024-04-30T23:12:06.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.352+0000 7f5e2c590700 1 -- start start 2024-04-30T23:12:06.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 0x7f5e24100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e24107d30 0x7f5e24100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e24108680 0x7f5e24101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24113380 con 0x7f5e24103450 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24113200 con 0x7f5e24108680 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2c590700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24113500 con 0x7f5e24107d30 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 0x7f5e24100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 0x7f5e24100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56900/0 (socket says 172.21.15.100:56900) 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 -- 172.21.15.100:0/4100059173 learned_addr learned my addr 172.21.15.100:0/4100059173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e29b2b700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e24107d30 0x7f5e24100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2ab2d700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e24108680 0x7f5e24101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 -- 172.21.15.100:0/4100059173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e24107d30 msgr2=0x7f5e24100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e24107d30 0x7f5e24100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 -- 172.21.15.100:0/4100059173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e24108680 msgr2=0x7f5e24101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e24108680 0x7f5e24101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e241a92c0 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.353+0000 7f5e2a32c700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 0x7f5e24100600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000b530 tx=0x7f5e2000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.354+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20015020 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.354+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e20011ce0 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.354+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e241a95b0 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.354+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20010d20 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.354+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e241a9b10 con 0x7f5e24103450 2024-04-30T23:12:06.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.355+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e24063de0 con 0x7f5e24103450 2024-04-30T23:12:06.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.356+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5e20018020 con 0x7f5e24103450 2024-04-30T23:12:06.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.357+0000 7f5e1b7fe700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5e100a3d50 0x7f5e100a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.357+0000 7f5e29b2b700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5e100a3d50 0x7f5e100a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.357+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f5e200d0690 con 0x7f5e24103450 2024-04-30T23:12:06.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e1b7fe700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] conn(0x7f5e100aee80 0x7f5e100b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e100b1a40 con 0x7f5e100aee80 2024-04-30T23:12:06.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f5e200d0ae0 con 0x7f5e24103450 2024-04-30T23:12:06.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e2ab2d700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] conn(0x7f5e100aee80 0x7f5e100b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e29b2b700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5e100a3d50 0x7f5e100a6260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e1401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.358+0000 7f5e2ab2d700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] conn(0x7f5e100aee80 0x7f5e100b1370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.359+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== osd.3 v2:172.21.15.100:6810/2399310688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e100b1a40 con 0x7f5e100aee80 2024-04-30T23:12:06.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.376+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 --> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e240641e0 con 0x7f5e100aee80 2024-04-30T23:12:06.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.376+0000 7f5e1b7fe700 1 -- 172.21.15.100:0/4100059173 <== osd.3 v2:172.21.15.100:6810/2399310688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e240641e0 con 0x7f5e100aee80 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] conn(0x7f5e100aee80 msgr2=0x7f5e100b1370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] conn(0x7f5e100aee80 0x7f5e100b1370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5e100a3d50 msgr2=0x7f5e100a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5e100a3d50 0x7f5e100a6260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e1401a040 comp rx=0 tx=0).stop 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 msgr2=0x7f5e24100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 --2- 172.21.15.100:0/4100059173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e24103450 0x7f5e24100600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000b530 tx=0x7f5e2000b8f0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2ab2d700 1 -- 172.21.15.100:0/4100059173 reap_dead start 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 shutdown_connections 2024-04-30T23:12:06.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 >> 172.21.15.100:0/4100059173 conn(0x7f5e24078d60 msgr2=0x7f5e24075d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:06.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 shutdown_connections 2024-04-30T23:12:06.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.377+0000 7f5e2c590700 1 -- 172.21.15.100:0/4100059173 wait complete. 2024-04-30T23:12:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2490427447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 msgr2=0x7f0a58107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2490427447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a58107f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0099c0 tx=0x7f0a4c009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2490427447 shutdown_connections 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2490427447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 0x7f0a5810fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2490427447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a58103200 0x7f0a58103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2490427447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a58107f40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2490427447 >> 172.21.15.100:0/2490427447 conn(0x7f0a58078a10 msgr2=0x7f0a58078e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2490427447 shutdown_connections 2024-04-30T23:12:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.688+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2490427447 wait complete. 2024-04-30T23:12:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.689+0000 7f0a5d79d700 1 Processor -- start 2024-04-30T23:12:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.689+0000 7f0a5d79d700 1 -- start start 2024-04-30T23:12:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a58103200 0x7f0a5819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a5819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 0x7f0a5819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58113090 con 0x7f0a58107b30 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58112f10 con 0x7f0a58108480 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58113210 con 0x7f0a58103200 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a5819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a5819bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56918/0 (socket says 172.21.15.100:56918) 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 -- 172.21.15.100:0/2634904608 learned_addr learned my addr 172.21.15.100:0/2634904608 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a57fff700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a58103200 0x7f0a5819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5cf9c700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 0x7f0a5819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 -- 172.21.15.100:0/2634904608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a58103200 msgr2=0x7f0a5819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a58103200 0x7f0a5819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 -- 172.21.15.100:0/2634904608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 msgr2=0x7f0a5819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 0x7f0a5819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a581a6d80 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5cf9c700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a58108480 0x7f0a5819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a577fe700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a5819bf50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0045e0 tx=0x7f0a4c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c026070 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c00f460 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.690+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a581a7010 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.691+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c009e60 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.691+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a581a7460 con 0x7f0a58107b30 2024-04-30T23:12:06.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.691+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a58063dd0 con 0x7f0a58107b30 2024-04-30T23:12:06.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.693+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0a4c029070 con 0x7f0a58107b30 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.693+0000 7f0a557fa700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a400a3cd0 0x7f0a400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a57fff700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a400a3cd0 0x7f0a400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f0a4c0d18e0 con 0x7f0a58107b30 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a557fa700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] conn(0x7f0a400aecd0 0x7f0a400b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a4c026e70 con 0x7f0a400aecd0 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c0d1d30 con 0x7f0a58107b30 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a5cf9c700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] conn(0x7f0a400aecd0 0x7f0a400b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a57fff700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a400a3cd0 0x7f0a400a61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009c60 tx=0x7f0a48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.694+0000 7f0a5cf9c700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] conn(0x7f0a400aecd0 0x7f0a400b11c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:06.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.695+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== osd.6 v2:172.21.15.100:6818/652878635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a4c026e70 con 0x7f0a400aecd0 2024-04-30T23:12:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.711+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 --> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a58064200 con 0x7f0a400aecd0 2024-04-30T23:12:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a557fa700 1 -- 172.21.15.100:0/2634904608 <== osd.6 v2:172.21.15.100:6818/652878635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0a58064200 con 0x7f0a400aecd0 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] conn(0x7f0a400aecd0 msgr2=0x7f0a400b11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] conn(0x7f0a400aecd0 0x7f0a400b11c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a400a3cd0 msgr2=0x7f0a400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a400a3cd0 0x7f0a400a61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009c60 tx=0x7f0a48009260 comp rx=0 tx=0).stop 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 msgr2=0x7f0a5819bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 --2- 172.21.15.100:0/2634904608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58107b30 0x7f0a5819bf50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0045e0 tx=0x7f0a4c004610 comp rx=0 tx=0).stop 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5cf9c700 1 -- 172.21.15.100:0/2634904608 reap_dead start 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 shutdown_connections 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 >> 172.21.15.100:0/2634904608 conn(0x7f0a58078a10 msgr2=0x7f0a58100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 shutdown_connections 2024-04-30T23:12:06.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:06.712+0000 7f0a5d79d700 1 -- 172.21.15.100:0/2634904608 wait complete. 2024-04-30T23:12:07.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:06 smithi104 ceph-mon[32987]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:07.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:06 smithi183 ceph-mon[33560]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:07.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:06 smithi100 ceph-mon[29745]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:309237645344 2024-04-30T23:12:07.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-30T23:12:07.479 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:07.501 INFO:teuthology.orchestra.run.smithi100.stdout:343597383705 2024-04-30T23:12:07.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-30T23:12:08.768 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:08 smithi100 ceph-mon[29745]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:08.797 INFO:teuthology.orchestra.run.smithi100.stdout:197568495669 2024-04-30T23:12:08.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-30T23:12:09.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:08 smithi104 ceph-mon[32987]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:08 smithi183 ceph-mon[33560]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:10.157 INFO:teuthology.orchestra.run.smithi100.stdout:107374182468 2024-04-30T23:12:10.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-30T23:12:10.353 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:10.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 -- 172.21.15.100:0/3209883154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c108670 msgr2=0x7fe34c10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 --2- 172.21.15.100:0/3209883154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c108670 0x7fe34c10ffd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe34400b0d0 tx=0x7fe34400b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 -- 172.21.15.100:0/3209883154 shutdown_connections 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 --2- 172.21.15.100:0/3209883154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c108670 0x7fe34c10ffd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 --2- 172.21.15.100:0/3209883154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe34c1033f0 0x7fe34c103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 --2- 172.21.15.100:0/3209883154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 0x7fe34c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 -- 172.21.15.100:0/3209883154 >> 172.21.15.100:0/3209883154 conn(0x7fe34c0fee40 msgr2=0x7fe34c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 -- 172.21.15.100:0/3209883154 shutdown_connections 2024-04-30T23:12:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.366+0000 7fe353551700 1 -- 172.21.15.100:0/3209883154 wait complete. 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.367+0000 7fe353551700 1 Processor -- start 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.367+0000 7fe353551700 1 -- start start 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 0x7fe34c0ff320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 0x7fe34c0ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe34c108670 0x7fe34c0ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1132a0 con 0x7fe34c1033f0 2024-04-30T23:12:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c113120 con 0x7fe34c107d20 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe3512ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 0x7fe34c0ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe353551700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c113420 con 0x7fe34c108670 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe3512ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 0x7fe34c0ff320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56936/0 (socket says 172.21.15.100:56936) 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe3512ed700 1 -- 172.21.15.100:0/3167368546 learned_addr learned my addr 172.21.15.100:0/3167368546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 0x7fe34c0ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe351aee700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe34c108670 0x7fe34c0ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 -- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe34c108670 msgr2=0x7fe34c0ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe34c108670 0x7fe34c0ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 -- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 msgr2=0x7fe34c0ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 0x7fe34c0ff320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.368+0000 7fe350aec700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c1a90c0 con 0x7fe34c107d20 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe3512ed700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe34c1033f0 0x7fe34c0ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe350aec700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 0x7fe34c0ff860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0769c0 tx=0x7fe33c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c017070 con 0x7fe34c107d20 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe33c009de0 con 0x7fe34c107d20 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c010df0 con 0x7fe34c107d20 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c1a93b0 con 0x7fe34c107d20 2024-04-30T23:12:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.369+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c1a98a0 con 0x7fe34c107d20 2024-04-30T23:12:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.370+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe34c101730 con 0x7fe34c107d20 2024-04-30T23:12:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.372+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe33c01a070 con 0x7fe34c107d20 2024-04-30T23:12:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.373+0000 7fe3427fc700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3380a3cd0 0x7fe3380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.373+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fe33c0d0580 con 0x7fe34c107d20 2024-04-30T23:12:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.373+0000 7fe3427fc700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] conn(0x7fe3380aee00 0x7fe3380b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.373+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3380b19c0 con 0x7fe3380aee00 2024-04-30T23:12:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.373+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== mon.2 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe33c0d09d0 con 0x7fe34c107d20 2024-04-30T23:12:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.374+0000 7fe3512ed700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3380a3cd0 0x7fe3380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.374+0000 7fe351aee700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] conn(0x7fe3380aee00 0x7fe3380b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:10.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.374+0000 7fe3512ed700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3380a3cd0 0x7fe3380a61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe348005d90 tx=0x7fe348005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:10.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.375+0000 7fe351aee700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] conn(0x7fe3380aee00 0x7fe3380b12f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:10.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.376+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== osd.8 v2:172.21.15.183:6816/2582979705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3380b19c0 con 0x7fe3380aee00 2024-04-30T23:12:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.396+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 --> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe34c1048a0 con 0x7fe3380aee00 2024-04-30T23:12:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.396+0000 7fe3427fc700 1 -- 172.21.15.100:0/3167368546 <== osd.8 v2:172.21.15.183:6816/2582979705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe34c1048a0 con 0x7fe3380aee00 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.396+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] conn(0x7fe3380aee00 msgr2=0x7fe3380b12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.396+0000 7fe353551700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] conn(0x7fe3380aee00 0x7fe3380b12f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3380a3cd0 msgr2=0x7fe3380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe3380a3cd0 0x7fe3380a61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe348005d90 tx=0x7fe348005d20 comp rx=0 tx=0).stop 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 msgr2=0x7fe34c0ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 --2- 172.21.15.100:0/3167368546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe34c107d20 0x7fe34c0ff860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0769c0 tx=0x7fe33c00dc30 comp rx=0 tx=0).stop 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe351aee700 1 -- 172.21.15.100:0/3167368546 reap_dead start 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 shutdown_connections 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 >> 172.21.15.100:0/3167368546 conn(0x7fe34c0fee40 msgr2=0x7fe34c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 shutdown_connections 2024-04-30T23:12:10.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:10.397+0000 7fe353551700 1 -- 172.21.15.100:0/3167368546 wait complete. 2024-04-30T23:12:11.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:10 smithi104 ceph-mon[32987]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:11.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:10 smithi183 ceph-mon[33560]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:11.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:10 smithi100 ceph-mon[29745]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:13.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:12 smithi104 ceph-mon[32987]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:13.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:12 smithi183 ceph-mon[33560]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:13.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:12 smithi100 ceph-mon[29745]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:12:13.616 INFO:teuthology.orchestra.run.smithi100.stdout:253403070507 2024-04-30T23:12:13.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-30T23:12:15.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:14 smithi104 ceph-mon[32987]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:14 smithi183 ceph-mon[33560]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:15.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:14 smithi100 ceph-mon[29745]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:16.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 -- 172.21.15.100:0/2078779819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 msgr2=0x7f098c10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:16.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 --2- 172.21.15.100:0/2078779819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c10ffd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f098400b0d0 tx=0x7f098400b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 -- 172.21.15.100:0/2078779819 shutdown_connections 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 --2- 172.21.15.100:0/2078779819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c10ffd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 --2- 172.21.15.100:0/2078779819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c1033f0 0x7f098c103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 --2- 172.21.15.100:0/2078779819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c107d20 0x7f098c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 -- 172.21.15.100:0/2078779819 >> 172.21.15.100:0/2078779819 conn(0x7f098c0fee40 msgr2=0x7f098c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 -- 172.21.15.100:0/2078779819 shutdown_connections 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.240+0000 7f09913d0700 1 -- 172.21.15.100:0/2078779819 wait complete. 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 Processor -- start 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 -- start start 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c1033f0 0x7f098c19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c107d20 0x7f098c19c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f098c1132a0 con 0x7f098c108670 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f098c113120 con 0x7f098c1033f0 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f09913d0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f098c113420 con 0x7f098c107d20 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36324/0 (socket says 172.21.15.100:36324) 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.241+0000 7f098b7fe700 1 -- 172.21.15.100:0/2855194075 learned_addr learned my addr 172.21.15.100:0/2855194075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098affd700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c1033f0 0x7f098c19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098a7fc700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c107d20 0x7f098c19c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 -- 172.21.15.100:0/2855194075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c107d20 msgr2=0x7f098c19c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c107d20 0x7f098c19c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 -- 172.21.15.100:0/2855194075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c1033f0 msgr2=0x7f098c19bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c1033f0 0x7f098c19bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 -- 172.21.15.100:0/2855194075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c1a6ed0 con 0x7f098c108670 2024-04-30T23:12:16.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f098b7fe700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0984009850 tx=0x7f0984007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:16.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098401f070 con 0x7f098c108670 2024-04-30T23:12:16.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098c1a7160 con 0x7f098c108670 2024-04-30T23:12:16.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0984004c50 con 0x7f098c108670 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098401b690 con 0x7f098c108670 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.242+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c1a7610 con 0x7f098c108670 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.243+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098c0511d0 con 0x7f098c108670 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.245+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0984022070 con 0x7f098c108670 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.245+0000 7f0973fff700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 0x7f09740a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.245+0000 7f098affd700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 0x7f09740a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.245+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f098400f020 con 0x7f098c108670 2024-04-30T23:12:16.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.246+0000 7f098affd700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 0x7f09740a61e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f097c005950 tx=0x7f097c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:16.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.249+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0984029020 con 0x7f098c108670 2024-04-30T23:12:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.449+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f098c02e550 con 0x7f098c108670 2024-04-30T23:12:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.450+0000 7f0973fff700 1 -- 172.21.15.100:0/2855194075 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f098409e300 con 0x7f098c108670 2024-04-30T23:12:16.450 INFO:teuthology.orchestra.run.smithi100.stdout:287762808871 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 msgr2=0x7f09740a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 0x7f09740a61e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f097c005950 tx=0x7f097c00a300 comp rx=0 tx=0).stop 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 msgr2=0x7f098c19c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0984009850 tx=0x7f0984007a20 comp rx=0 tx=0).stop 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 shutdown_connections 2024-04-30T23:12:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09740a3cd0 0x7f09740a61e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f098c108670 0x7f098c19c620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f098c1033f0 0x7f098c19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 --2- 172.21.15.100:0/2855194075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f098c107d20 0x7f098c19c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 >> 172.21.15.100:0/2855194075 conn(0x7f098c0fee40 msgr2=0x7f098c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 shutdown_connections 2024-04-30T23:12:16.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:16.452+0000 7f09913d0700 1 -- 172.21.15.100:0/2855194075 wait complete. 2024-04-30T23:12:16.987 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:16 smithi100 ceph-mon[29745]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:16.987 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2855194075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-30T23:12:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:16 smithi104 ceph-mon[32987]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2855194075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-30T23:12:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:16 smithi183 ceph-mon[33560]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2855194075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-30T23:12:17.523 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 -- 172.21.15.100:0/355884974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 msgr2=0x7fecf410ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 --2- 172.21.15.100:0/355884974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410ac50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fece8009990 tx=0x7fece8009ca0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 -- 172.21.15.100:0/355884974 shutdown_connections 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 --2- 172.21.15.100:0/355884974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf410b190 0x7fecf41197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 --2- 172.21.15.100:0/355884974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf4111ae0 0x7fecf4111ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 --2- 172.21.15.100:0/355884974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410ac50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 -- 172.21.15.100:0/355884974 >> 172.21.15.100:0/355884974 conn(0x7fecf406f3e0 msgr2=0x7fecf406f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 -- 172.21.15.100:0/355884974 shutdown_connections 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.523+0000 7fecf92f9700 1 -- 172.21.15.100:0/355884974 wait complete. 2024-04-30T23:12:17.524 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 Processor -- start 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 -- start start 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf410b190 0x7fecf410cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf4111ae0 0x7fecf410d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecf411cb70 con 0x7fecf410a840 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fecf411c9f0 con 0x7fecf4111ae0 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf92f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fecf411ccf0 con 0x7fecf410b190 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36352/0 (socket says 172.21.15.100:36352) 2024-04-30T23:12:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.524+0000 7fecf2ffd700 1 -- 172.21.15.100:0/1906080302 learned_addr learned my addr 172.21.15.100:0/1906080302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf37fe700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf4111ae0 0x7fecf410d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf27fc700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf410b190 0x7fecf410cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 -- 172.21.15.100:0/1906080302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf410b190 msgr2=0x7fecf410cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf410b190 0x7fecf410cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 -- 172.21.15.100:0/1906080302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf4111ae0 msgr2=0x7fecf410d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf4111ae0 0x7fecf410d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 -- 172.21.15.100:0/1906080302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf41b1840 con 0x7fecf410a840 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf2ffd700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fece400e970 tx=0x7fece400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4004220 con 0x7fecf410a840 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.525+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41b1b30 con 0x7fecf410a840 2024-04-30T23:12:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.526+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41b2090 con 0x7fecf410a840 2024-04-30T23:12:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.526+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece40043c0 con 0x7fecf410a840 2024-04-30T23:12:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.526+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4003ce0 con 0x7fecf410a840 2024-04-30T23:12:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.527+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf40511d0 con 0x7fecf410a840 2024-04-30T23:12:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.528+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fece400c7e0 con 0x7fecf410a840 2024-04-30T23:12:17.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.529+0000 7fecdbfff700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 0x7fecdc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.530+0000 7fecf27fc700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 0x7fecdc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.530+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fece40d09f0 con 0x7fecf410a840 2024-04-30T23:12:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.530+0000 7fecf27fc700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 0x7fecdc0a6260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fece800b2e0 tx=0x7fece8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:17.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.535+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fece409cf30 con 0x7fecf410a840 2024-04-30T23:12:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 -- 172.21.15.100:0/508232116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44109210 msgr2=0x7fcb44109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 --2- 172.21.15.100:0/508232116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44109210 0x7fcb44109620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009990 tx=0x7fcb34009ca0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 -- 172.21.15.100:0/508232116 shutdown_connections 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 --2- 172.21.15.100:0/508232116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb441030e0 0x7fcb44111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 --2- 172.21.15.100:0/508232116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44109210 0x7fcb44109620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 --2- 172.21.15.100:0/508232116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb44102790 0x7fcb44102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 -- 172.21.15.100:0/508232116 >> 172.21.15.100:0/508232116 conn(0x7fcb440fe600 msgr2=0x7fcb44100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 -- 172.21.15.100:0/508232116 shutdown_connections 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.416+0000 7fcb490f8700 1 -- 172.21.15.100:0/508232116 wait complete. 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.417+0000 7fcb490f8700 1 Processor -- start 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.417+0000 7fcb490f8700 1 -- start start 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb441030e0 0x7fcb4419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 0x7fcb4419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb441144f0 con 0x7fcb44102790 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44114370 con 0x7fcb44109210 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb490f8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44114670 con 0x7fcb441030e0 2024-04-30T23:12:17.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36340/0 (socket says 172.21.15.100:36340) 2024-04-30T23:12:17.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 -- 172.21.15.100:0/4256348868 learned_addr learned my addr 172.21.15.100:0/4256348868 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:17.668 INFO:teuthology.orchestra.run.smithi100.stdout:34359738452 2024-04-30T23:12:17.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb4259c700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb441030e0 0x7fcb4419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb4359e700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 0x7fcb4419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 -- 172.21.15.100:0/4256348868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb441030e0 msgr2=0x7fcb4419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb441030e0 0x7fcb4419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 -- 172.21.15.100:0/4256348868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 msgr2=0x7fcb4419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 0x7fcb4419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 -- 172.21.15.100:0/4256348868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4419fcc0 con 0x7fcb44102790 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb4359e700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 0x7fcb4419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.418+0000 7fcb42d9d700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400b5c0 tx=0x7fcb340047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.419+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34027070 con 0x7fcb44102790 2024-04-30T23:12:17.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.419+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4419ff50 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.419+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb34003f20 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.419+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34022c50 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.419+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb441a0480 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.420+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4410c7b0 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.421+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fcb3402a070 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.422+0000 7fcb2bfff700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 0x7fcb2c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.422+0000 7fcb4259c700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 0x7fcb2c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.422+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fcb340d1a60 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.422+0000 7fcb4259c700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 0x7fcb2c0a61e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005ea0 tx=0x7fcb38005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.427+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcb34013070 con 0x7fcb44102790 2024-04-30T23:12:17.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.653+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcb4419c200 con 0x7fcb44102790 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.653+0000 7fcb2bfff700 1 -- 172.21.15.100:0/4256348868 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb3409e030 con 0x7fcb44102790 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 msgr2=0x7fcb2c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 0x7fcb2c0a61e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005ea0 tx=0x7fcb38005e30 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 msgr2=0x7fcb4419aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400b5c0 tx=0x7fcb340047b0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 shutdown_connections 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcb2c0a3cd0 0x7fcb2c0a61e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb44109210 0x7fcb4419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb44102790 0x7fcb4419aea0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 --2- 172.21.15.100:0/4256348868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb441030e0 0x7fcb4419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 >> 172.21.15.100:0/4256348868 conn(0x7fcb440fe600 msgr2=0x7fcb4410a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:17.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 shutdown_connections 2024-04-30T23:12:17.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.656+0000 7fcb490f8700 1 -- 172.21.15.100:0/4256348868 wait complete. 2024-04-30T23:12:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.762+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fecf402e550 con 0x7fecf410a840 2024-04-30T23:12:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.762+0000 7fecdbfff700 1 -- 172.21.15.100:0/1906080302 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fece409c830 con 0x7fecf410a840 2024-04-30T23:12:17.762 INFO:teuthology.orchestra.run.smithi100.stdout:141733920833 2024-04-30T23:12:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 msgr2=0x7fecdc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 0x7fecdc0a6260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fece800b2e0 tx=0x7fece8005960 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 msgr2=0x7fecf410c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fece400e970 tx=0x7fece400ec80 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 shutdown_connections 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fecdc0a3d50 0x7fecdc0a6260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fecf4111ae0 0x7fecf410d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf410a840 0x7fecf410c590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 --2- 172.21.15.100:0/1906080302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecf410b190 0x7fecf410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 >> 172.21.15.100:0/1906080302 conn(0x7fecf406f3e0 msgr2=0x7fecf4110420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.764+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 shutdown_connections 2024-04-30T23:12:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:17.765+0000 7fecf92f9700 1 -- 172.21.15.100:0/1906080302 wait complete. 2024-04-30T23:12:18.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:17 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4256348868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-30T23:12:18.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:17 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4256348868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-30T23:12:18.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:17 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4256348868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-30T23:12:19.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:18 smithi104 ceph-mon[32987]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:12:19.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:18 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1906080302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-30T23:12:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:18 smithi183 ceph-mon[33560]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:12:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:18 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1906080302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-30T23:12:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:18 smithi100 ceph-mon[29745]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:12:19.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:18 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1906080302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-30T23:12:19.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808866 got 287762808871 for osd.9 2024-04-30T23:12:19.454 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:19.658 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:20.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738452 for osd.0 2024-04-30T23:12:20.109 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:20.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:20 smithi100 ceph-mon[29745]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-30T23:12:21.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:20 smithi104 ceph-mon[32987]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-30T23:12:21.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:20 smithi183 ceph-mon[33560]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-30T23:12:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:21.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920829 got 141733920833 for osd.4 2024-04-30T23:12:21.535 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:21.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 -- 172.21.15.100:0/3936715133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 msgr2=0x7fc82810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:21.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 --2- 172.21.15.100:0/3936715133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc82810f7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc82000b0a0 tx=0x7fc82000b3b0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 -- 172.21.15.100:0/3936715133 shutdown_connections 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 --2- 172.21.15.100:0/3936715133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc82810f7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 --2- 172.21.15.100:0/3936715133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc828108900 0x7fc828108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 --2- 172.21.15.100:0/3936715133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8281028d0 0x7fc828102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 -- 172.21.15.100:0/3936715133 >> 172.21.15.100:0/3936715133 conn(0x7fc8280fe600 msgr2=0x7fc828100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 -- 172.21.15.100:0/3936715133 shutdown_connections 2024-04-30T23:12:21.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.738+0000 7fc82da9e700 1 -- 172.21.15.100:0/3936715133 wait complete. 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 Processor -- start 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 -- start start 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8281028d0 0x7fc828110ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc828108900 0x7fc828111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114400 con 0x7fc828103220 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114280 con 0x7fc8281028d0 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc82da9e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114580 con 0x7fc828108900 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc826ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:21.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc826ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36374/0 (socket says 172.21.15.100:36374) 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.739+0000 7fc826ffd700 1 -- 172.21.15.100:0/2038643677 learned_addr learned my addr 172.21.15.100:0/2038643677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc8277fe700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8281028d0 0x7fc828110ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc827fff700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc828108900 0x7fc828111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 -- 172.21.15.100:0/2038643677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc828108900 msgr2=0x7fc828111940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc828108900 0x7fc828111940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 -- 172.21.15.100:0/2038643677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8281028d0 msgr2=0x7fc828110ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8281028d0 0x7fc828110ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 -- 172.21.15.100:0/2038643677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8281a90f0 con 0x7fc828103220 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc826ffd700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00d980 tx=0x7fc81c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c017070 con 0x7fc828103220 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8281a93e0 con 0x7fc828103220 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81c009de0 con 0x7fc828103220 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00f3c0 con 0x7fc828103220 2024-04-30T23:12:21.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.740+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a9920 con 0x7fc828103220 2024-04-30T23:12:21.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.741+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8280511d0 con 0x7fc828103220 2024-04-30T23:12:21.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.744+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fc81c009930 con 0x7fc828103220 2024-04-30T23:12:21.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.744+0000 7fc824ff9700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 0x7fc8100a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:21.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.744+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fc81c0d0320 con 0x7fc828103220 2024-04-30T23:12:21.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.744+0000 7fc8277fe700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 0x7fc8100a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.745+0000 7fc8277fe700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 0x7fc8100a61e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc828103a10 tx=0x7fc818009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:21.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.748+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc81c09c900 con 0x7fc828103220 2024-04-30T23:12:21.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.960+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc82802e550 con 0x7fc828103220 2024-04-30T23:12:21.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.961+0000 7fc824ff9700 1 -- 172.21.15.100:0/2038643677 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc81c09c200 con 0x7fc828103220 2024-04-30T23:12:21.962 INFO:teuthology.orchestra.run.smithi100.stdout:55834574929 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 msgr2=0x7fc8100a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 0x7fc8100a61e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc828103a10 tx=0x7fc818009260 comp rx=0 tx=0).stop 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 msgr2=0x7fc828111400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00d980 tx=0x7fc81c00dc90 comp rx=0 tx=0).stop 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 shutdown_connections 2024-04-30T23:12:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8100a3cd0 0x7fc8100a61e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc828108900 0x7fc828111940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8281028d0 0x7fc828110ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 --2- 172.21.15.100:0/2038643677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc828103220 0x7fc828111400 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 >> 172.21.15.100:0/2038643677 conn(0x7fc8280fe600 msgr2=0x7fc828106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 shutdown_connections 2024-04-30T23:12:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:21.963+0000 7fc82da9e700 1 -- 172.21.15.100:0/2038643677 wait complete. 2024-04-30T23:12:22.652 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574929 for osd.1 2024-04-30T23:12:22.652 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:22.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:22 smithi100 ceph-mon[29745]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-30T23:12:22.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:22 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2038643677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-30T23:12:23.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:22 smithi104 ceph-mon[32987]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-30T23:12:23.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:22 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2038643677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-30T23:12:23.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:22 smithi183 ceph-mon[33560]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-30T23:12:23.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:22 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2038643677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-30T23:12:24.985 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:24 smithi100 ceph-mon[29745]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:24 smithi104 ceph-mon[32987]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:24 smithi183 ceph-mon[33560]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:26.318 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:26.979 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:26 smithi100 ceph-mon[29745]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:27.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:26 smithi104 ceph-mon[32987]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:27.050 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:26 smithi183 ceph-mon[33560]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.092+0000 7f99ce53b700 1 -- 172.21.15.100:0/4055487689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 msgr2=0x7f99c810ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.092+0000 7f99ce53b700 1 --2- 172.21.15.100:0/4055487689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c810ffd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99c000b0d0 tx=0x7f99c000b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 -- 172.21.15.100:0/4055487689 shutdown_connections 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 --2- 172.21.15.100:0/4055487689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c810ffd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 --2- 172.21.15.100:0/4055487689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c81033f0 0x7f99c8103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 --2- 172.21.15.100:0/4055487689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c8107d20 0x7f99c8108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 -- 172.21.15.100:0/4055487689 >> 172.21.15.100:0/4055487689 conn(0x7f99c80fee40 msgr2=0x7f99c8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 -- 172.21.15.100:0/4055487689 shutdown_connections 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 -- 172.21.15.100:0/4055487689 wait complete. 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 Processor -- start 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.093+0000 7f99ce53b700 1 -- start start 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 0x7f99c8199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c8107d20 0x7f99c8199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81132c0 con 0x7f99c8108670 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8113140 con 0x7f99c8107d20 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ce53b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8113440 con 0x7f99c81033f0 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47886/0 (socket says 172.21.15.100:47886) 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 -- 172.21.15.100:0/3517620620 learned_addr learned my addr 172.21.15.100:0/3517620620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99c7fff700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 0x7f99c8199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stdout:309237645348 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99c77fe700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c8107d20 0x7f99c8199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 -- 172.21.15.100:0/3517620620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 msgr2=0x7f99c8199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 0x7f99c8199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 -- 172.21.15.100:0/3517620620 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c8107d20 msgr2=0x7f99c8199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c8107d20 0x7f99c8199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 -- 172.21.15.100:0/3517620620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c81a9070 con 0x7f99c8108670 2024-04-30T23:12:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99c7fff700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 0x7f99c8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.094+0000 7f99ccad8700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009850 tx=0x7f99c0007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.095+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c001f070 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.095+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81a9300 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.095+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c0005520 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.095+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c81a97b0 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.095+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c001b870 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.096+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b4005330 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.097+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f99c0022070 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.098+0000 7f99c57fa700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 0x7f99b00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.098+0000 7f99c7fff700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 0x7f99b00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.098+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f99c000f020 con 0x7f99c8108670 2024-04-30T23:12:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.098+0000 7f99c7fff700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 0x7f99b00a6260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005950 tx=0x7f99b80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.103+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f99c0029020 con 0x7f99c8108670 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.307+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f99b40058f0 con 0x7f99c8108670 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.307+0000 7f99c57fa700 1 -- 172.21.15.100:0/3517620620 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f99c009ded0 con 0x7f99c8108670 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.309+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 msgr2=0x7f99b00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.309+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 0x7f99b00a6260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005950 tx=0x7f99b80058e0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.309+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 msgr2=0x7f99c819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.309+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009850 tx=0x7f99c0007ad0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 shutdown_connections 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f99b00a3d50 0x7f99b00a6260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99c8108670 0x7f99c819a3f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c81033f0 0x7f99c8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 --2- 172.21.15.100:0/3517620620 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99c8107d20 0x7f99c8199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 >> 172.21.15.100:0/3517620620 conn(0x7f99c80fee40 msgr2=0x7f99c8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 shutdown_connections 2024-04-30T23:12:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:27.310+0000 7f99ce53b700 1 -- 172.21.15.100:0/3517620620 wait complete. 2024-04-30T23:12:27.997 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:27 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3517620620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-30T23:12:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:27 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3517620620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-30T23:12:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:27 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3517620620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-30T23:12:29.021 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:28 smithi100 ceph-mon[29745]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:29.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:28 smithi104 ceph-mon[32987]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:28 smithi183 ceph-mon[33560]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:29.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 -- 172.21.15.100:0/3858417549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 msgr2=0x7fca50104910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 --2- 172.21.15.100:0/3858417549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca50104910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00b0d0 tx=0x7fca4c00b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 -- 172.21.15.100:0/3858417549 shutdown_connections 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 --2- 172.21.15.100:0/3858417549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 0x7fca501110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 --2- 172.21.15.100:0/3858417549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca50104910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 --2- 172.21.15.100:0/3858417549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca50109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 -- 172.21.15.100:0/3858417549 >> 172.21.15.100:0/3858417549 conn(0x7fca500fff50 msgr2=0x7fca50102370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 -- 172.21.15.100:0/3858417549 shutdown_connections 2024-04-30T23:12:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.527+0000 7fca56b7b700 1 -- 172.21.15.100:0/3858417549 wait complete. 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 Processor -- start 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 -- start start 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca5019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 0x7fca5019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca50114430 con 0x7fca50104500 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fca501142b0 con 0x7fca50108e30 2024-04-30T23:12:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca56b7b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca501145b0 con 0x7fca50109780 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca54917700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca54917700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47896/0 (socket says 172.21.15.100:47896) 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.528+0000 7fca54917700 1 -- 172.21.15.100:0/4264640866 learned_addr learned my addr 172.21.15.100:0/4264640866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca47fff700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca5019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca55118700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 0x7fca5019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 -- 172.21.15.100:0/4264640866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 msgr2=0x7fca5019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 0x7fca5019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 -- 172.21.15.100:0/4264640866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 msgr2=0x7fca5019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca5019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 -- 172.21.15.100:0/4264640866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5019fc70 con 0x7fca50104500 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca47fff700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca5019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca54917700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00d010 tx=0x7fca4c007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c01f070 con 0x7fca50104500 2024-04-30T23:12:29.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca4c003c00 con 0x7fca50104500 2024-04-30T23:12:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5019ff00 con 0x7fca50104500 2024-04-30T23:12:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.529+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c01b6a0 con 0x7fca50104500 2024-04-30T23:12:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.530+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501a03e0 con 0x7fca50104500 2024-04-30T23:12:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.531+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca500511d0 con 0x7fca50104500 2024-04-30T23:12:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.533+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fca4c022070 con 0x7fca50104500 2024-04-30T23:12:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.533+0000 7fca45ffb700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 0x7fca380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.533+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fca4c00f020 con 0x7fca50104500 2024-04-30T23:12:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.533+0000 7fca47fff700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 0x7fca380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.534+0000 7fca47fff700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 0x7fca380a61e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca40005950 tx=0x7fca400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.537+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca4c029020 con 0x7fca50104500 2024-04-30T23:12:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 -- 172.21.15.100:0/824856399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7420105390 msgr2=0x7f74201057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 --2- 172.21.15.100:0/824856399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7420105390 0x7f74201057a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7414009990 tx=0x7f7414009ca0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 -- 172.21.15.100:0/824856399 shutdown_connections 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 --2- 172.21.15.100:0/824856399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f742010e800 0x7f7420110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 --2- 172.21.15.100:0/824856399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7420105390 0x7f74201057a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 --2- 172.21.15.100:0/824856399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 0x7f742010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 -- 172.21.15.100:0/824856399 >> 172.21.15.100:0/824856399 conn(0x7f74200fee40 msgr2=0x7f7420101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 -- 172.21.15.100:0/824856399 shutdown_connections 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.731+0000 7f7426e35700 1 -- 172.21.15.100:0/824856399 wait complete. 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 Processor -- start 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 -- start start 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7420105390 0x7f7420103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 0x7f74201035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74201143d0 con 0x7f742010e800 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7420114250 con 0x7f7420105390 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7426e35700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7420114550 con 0x7f7420105ce0 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f74253d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f74253d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47906/0 (socket says 172.21.15.100:47906) 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f74253d2700 1 -- 172.21.15.100:0/2905552408 learned_addr learned my addr 172.21.15.100:0/2905552408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f7424bd1700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7420105390 0x7f7420103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.732+0000 7f741ffff700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 0x7f74201035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 -- 172.21.15.100:0/2905552408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 msgr2=0x7f74201035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 0x7f74201035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 -- 172.21.15.100:0/2905552408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7420105390 msgr2=0x7f7420103080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7420105390 0x7f7420103080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 -- 172.21.15.100:0/2905552408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74201a9120 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f74253d2700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f741800ef30 tx=0x7f741800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74180092e0 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74201a93b0 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7418004bb0 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418004020 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.733+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74201a98f0 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.734+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74200511d0 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.738+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f741801b030 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.739+0000 7f741dffb700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 0x7f74100a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.739+0000 7f7424bd1700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 0x7f74100a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.739+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f74180d0d70 con 0x7f742010e800 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.739+0000 7f7424bd1700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 0x7f74100a61e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f741400b2e0 tx=0x7f7414005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.742+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7418022020 con 0x7f742010e800 2024-04-30T23:12:29.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.747+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fca5002e550 con 0x7fca50104500 2024-04-30T23:12:29.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.747+0000 7fca45ffb700 1 -- 172.21.15.100:0/4264640866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca4c09e570 con 0x7fca50104500 2024-04-30T23:12:29.748 INFO:teuthology.orchestra.run.smithi100.stdout:77309411405 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 msgr2=0x7fca380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 0x7fca380a61e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca40005950 tx=0x7fca400058e0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 msgr2=0x7fca5019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00d010 tx=0x7fca4c007ad0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 shutdown_connections 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fca380a3cd0 0x7fca380a61e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca50109780 0x7fca5019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50104500 0x7fca5019ada0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 --2- 172.21.15.100:0/4264640866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca50108e30 0x7fca5019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 >> 172.21.15.100:0/4264640866 conn(0x7fca500fff50 msgr2=0x7fca5010a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.749+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 shutdown_connections 2024-04-30T23:12:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.750+0000 7fca56b7b700 1 -- 172.21.15.100:0/4264640866 wait complete. 2024-04-30T23:12:29.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.946+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f742002e550 con 0x7f742010e800 2024-04-30T23:12:29.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.947+0000 7f741dffb700 1 -- 172.21.15.100:0/2905552408 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7418010040 con 0x7f742010e800 2024-04-30T23:12:29.948 INFO:teuthology.orchestra.run.smithi100.stdout:163208757309 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 msgr2=0x7f74100a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 0x7f74100a61e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f741400b2e0 tx=0x7f7414005960 comp rx=0 tx=0).stop 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 msgr2=0x7f7420103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f741800ef30 tx=0x7f741800c3a0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 shutdown_connections 2024-04-30T23:12:29.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f74100a3cd0 0x7f74100a61e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f742010e800 0x7f7420103b00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7420105390 0x7f7420103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 --2- 172.21.15.100:0/2905552408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7420105ce0 0x7f74201035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 >> 172.21.15.100:0/2905552408 conn(0x7f74200fee40 msgr2=0x7f7420100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 shutdown_connections 2024-04-30T23:12:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:29.949+0000 7f7426e35700 1 -- 172.21.15.100:0/2905552408 wait complete. 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 -- 172.21.15.100:0/57371144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105480 msgr2=0x7f9910105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 --2- 172.21.15.100:0/57371144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105480 0x7f9910105890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f990c009990 tx=0x7f990c009ca0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 -- 172.21.15.100:0/57371144 shutdown_connections 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 --2- 172.21.15.100:0/57371144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f991010e860 0x7f9910110d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 --2- 172.21.15.100:0/57371144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105480 0x7f9910105890 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 --2- 172.21.15.100:0/57371144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9910105dd0 0x7f991010e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 -- 172.21.15.100:0/57371144 >> 172.21.15.100:0/57371144 conn(0x7f9910078d10 msgr2=0x7f9910079150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:30.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 -- 172.21.15.100:0/57371144 shutdown_connections 2024-04-30T23:12:30.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 -- 172.21.15.100:0/57371144 wait complete. 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.744+0000 7f9917a81700 1 Processor -- start 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 -- start start 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9910105480 0x7f991019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 0x7f991019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:30.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9910114380 con 0x7f9910105dd0 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9910114200 con 0x7f991010e860 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f9917a81700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9910114500 con 0x7f9910105480 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47944/0 (socket says 172.21.15.100:47944) 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 -- 172.21.15.100:0/2557147133 learned_addr learned my addr 172.21.15.100:0/2557147133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991581d700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9910105480 0x7f991019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991601e700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 0x7f991019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 -- 172.21.15.100:0/2557147133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9910105480 msgr2=0x7f991019ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9910105480 0x7f991019ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 -- 172.21.15.100:0/2557147133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 msgr2=0x7f991019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 0x7f991019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991501c700 1 -- 172.21.15.100:0/2557147133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991019fbb0 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.745+0000 7f991601e700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 0x7f991019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f991501c700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f990000c9b0 tx=0x7f990000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900007b00 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991019fea0 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99101a7870 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9900007ca0 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.746+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900018660 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.747+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f4005330 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.748+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f9900018800 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.749+0000 7f9906ffd700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 0x7f98fc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.749+0000 7f991581d700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 0x7f98fc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.749+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f99000d0a70 con 0x7f9910105dd0 2024-04-30T23:12:30.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.750+0000 7f991581d700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 0x7f98fc0a61e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f990c00b5c0 tx=0x7f990c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:30.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.757+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9900014030 con 0x7f9910105dd0 2024-04-30T23:12:30.876 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:30 smithi100 ceph-mon[29745]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:30.876 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4264640866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-30T23:12:30.876 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2905552408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-30T23:12:30.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.966+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f98f40058f0 con 0x7f9910105dd0 2024-04-30T23:12:30.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.966+0000 7f9906ffd700 1 -- 172.21.15.100:0/2557147133 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f99000a1e20 con 0x7f9910105dd0 2024-04-30T23:12:30.968 INFO:teuthology.orchestra.run.smithi100.stdout:343597383710 2024-04-30T23:12:30.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.968+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 msgr2=0x7f98fc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.968+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 0x7f98fc0a61e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f990c00b5c0 tx=0x7f990c005960 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.968+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 msgr2=0x7f991019b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.968+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f990000c9b0 tx=0x7f990000ccc0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 shutdown_connections 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f98fc0a3cd0 0x7f98fc0a61e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f991010e860 0x7f991019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9910105480 0x7f991019ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 --2- 172.21.15.100:0/2557147133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9910105dd0 0x7f991019b330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 >> 172.21.15.100:0/2557147133 conn(0x7f9910078d10 msgr2=0x7f99100fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 shutdown_connections 2024-04-30T23:12:30.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.969+0000 7f9917a81700 1 -- 172.21.15.100:0/2557147133 wait complete. 2024-04-30T23:12:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:30 smithi104 ceph-mon[32987]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4264640866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-30T23:12:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2905552408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-30T23:12:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:30 smithi183 ceph-mon[33560]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4264640866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-30T23:12:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2905552408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-30T23:12:31.290 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645344 got 309237645348 for osd.10 2024-04-30T23:12:31.290 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:31.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1606199977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-30T23:12:31.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2557147133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-30T23:12:32.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411405 for osd.2 2024-04-30T23:12:32.017 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1606199977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-30T23:12:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2557147133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-30T23:12:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1606199977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-30T23:12:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2557147133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-30T23:12:32.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 -- 172.21.15.100:0/198388742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc108670 msgr2=0x7fb1cc10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:32.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 --2- 172.21.15.100:0/198388742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc108670 0x7fb1cc10ffd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400b0d0 tx=0x7fb1c400b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 -- 172.21.15.100:0/198388742 shutdown_connections 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 --2- 172.21.15.100:0/198388742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc108670 0x7fb1cc10ffd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 --2- 172.21.15.100:0/198388742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 --2- 172.21.15.100:0/198388742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 -- 172.21.15.100:0/198388742 >> 172.21.15.100:0/198388742 conn(0x7fb1cc0fee40 msgr2=0x7fb1cc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 -- 172.21.15.100:0/198388742 shutdown_connections 2024-04-30T23:12:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.330+0000 7fb1d3089700 1 -- 172.21.15.100:0/198388742 wait complete. 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 Processor -- start 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 -- start start 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc108670 0x7fb1cc199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc113320 con 0x7fb1cc1033f0 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc1131a0 con 0x7fb1cc107d20 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.331+0000 7fb1d3089700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc1134a0 con 0x7fb1cc108670 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47962/0 (socket says 172.21.15.100:47962) 2024-04-30T23:12:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 -- 172.21.15.100:0/1686086890 learned_addr learned my addr 172.21.15.100:0/1686086890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d1626700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc108670 0x7fb1cc199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1cbfff700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 -- 172.21.15.100:0/1686086890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc108670 msgr2=0x7fb1cc199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc108670 0x7fb1cc199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 -- 172.21.15.100:0/1686086890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 msgr2=0x7fb1cc19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 -- 172.21.15.100:0/1686086890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc19a100 con 0x7fb1cc1033f0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1cbfff700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d0e25700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b530 tx=0x7fb1c000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0015020 con 0x7fb1cc1033f0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1c0011ce0 con 0x7fb1cc1033f0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc19a3f0 con 0x7fb1cc1033f0 2024-04-30T23:12:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.332+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0010e40 con 0x7fb1cc1033f0 2024-04-30T23:12:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.333+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc19a8e0 con 0x7fb1cc1033f0 2024-04-30T23:12:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.334+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc0511d0 con 0x7fb1cc1033f0 2024-04-30T23:12:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.335+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb1c0018020 con 0x7fb1cc1033f0 2024-04-30T23:12:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.336+0000 7fb1c9ffb700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 0x7fb1bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.336+0000 7fb1cbfff700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 0x7fb1bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.336+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fb1c00d0050 con 0x7fb1cc1033f0 2024-04-30T23:12:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.337+0000 7fb1cbfff700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 0x7fb1bc0a61e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8005fd0 tx=0x7fb1b8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.341+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1c001f020 con 0x7fb1cc1033f0 2024-04-30T23:12:32.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.553+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb1cc10b100 con 0x7fb1cc1033f0 2024-04-30T23:12:32.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.554+0000 7fb1c9ffb700 1 -- 172.21.15.100:0/1686086890 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb1c009c6a0 con 0x7fb1cc1033f0 2024-04-30T23:12:32.555 INFO:teuthology.orchestra.run.smithi100.stdout:197568495674 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 msgr2=0x7fb1bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 0x7fb1bc0a61e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8005fd0 tx=0x7fb1b8005e30 comp rx=0 tx=0).stop 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 msgr2=0x7fb1cc19f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b530 tx=0x7fb1c000b840 comp rx=0 tx=0).stop 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 shutdown_connections 2024-04-30T23:12:32.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb1bc0a3cd0 0x7fb1bc0a61e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1cc108670 0x7fb1cc199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1cc1033f0 0x7fb1cc19f8a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 --2- 172.21.15.100:0/1686086890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1cc107d20 0x7fb1cc19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 >> 172.21.15.100:0/1686086890 conn(0x7fb1cc0fee40 msgr2=0x7fb1cc107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 shutdown_connections 2024-04-30T23:12:32.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:32.556+0000 7fb1d3089700 1 -- 172.21.15.100:0/1686086890 wait complete. 2024-04-30T23:12:32.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:32 smithi100 ceph-mon[29745]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:32.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:32 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1686086890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-30T23:12:33.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:32 smithi104 ceph-mon[32987]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:33.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:32 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1686086890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-30T23:12:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:32 smithi183 ceph-mon[33560]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:32 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1686086890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-30T23:12:33.083 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383705 got 343597383710 for osd.11 2024-04-30T23:12:33.084 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:33.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495669 got 197568495674 for osd.6 2024-04-30T23:12:33.862 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 -- 172.21.15.100:0/3928481207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264109760 msgr2=0x7f02641110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 --2- 172.21.15.100:0/3928481207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264109760 0x7f02641110c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f025c00b0d0 tx=0x7f025c00b3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 -- 172.21.15.100:0/3928481207 shutdown_connections 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 --2- 172.21.15.100:0/3928481207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264109760 0x7f02641110c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 --2- 172.21.15.100:0/3928481207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 0x7f02641048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 --2- 172.21.15.100:0/3928481207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264108e10 0x7f0264109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 -- 172.21.15.100:0/3928481207 >> 172.21.15.100:0/3928481207 conn(0x7f02640ffdb0 msgr2=0x7f0264102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 -- 172.21.15.100:0/3928481207 shutdown_connections 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.623+0000 7f026887d700 1 -- 172.21.15.100:0/3928481207 wait complete. 2024-04-30T23:12:34.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 Processor -- start 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 -- start start 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 0x7f02641a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264109760 0x7f026419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0264114390 con 0x7f0264108e10 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0264114210 con 0x7f02641044e0 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.624+0000 7f026887d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0264114510 con 0x7f0264109760 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47928/0 (socket says 172.21.15.100:47928) 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 -- 172.21.15.100:0/1606199977 learned_addr learned my addr 172.21.15.100:0/1606199977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0262d9d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264109760 0x7f026419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f026259c700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 0x7f02641a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:34.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 -- 172.21.15.100:0/1606199977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264109760 msgr2=0x7f026419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264109760 0x7f026419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 -- 172.21.15.100:0/1606199977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 msgr2=0x7f02641a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 0x7f02641a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 -- 172.21.15.100:0/1606199977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026419b1b0 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f0261d9b700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f025800d980 tx=0x7f025800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258017070 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026419b4a0 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.625+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641a7740 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.626+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258010460 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.626+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025800de60 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.627+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0244005330 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.628+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0258009b40 con 0x7f0264108e10 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.629+0000 7f02537fe700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 0x7f024c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:34.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.629+0000 7f026259c700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 0x7f024c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.629+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f02580d0320 con 0x7f0264108e10 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.629+0000 7f026259c700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 0x7f024c0a61e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0254005950 tx=0x7f02540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.633+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f025809c860 con 0x7f0264108e10 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.861+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f02440058f0 con 0x7f0264108e10 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.861+0000 7f02537fe700 1 -- 172.21.15.100:0/1606199977 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f025809c160 con 0x7f0264108e10 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stdout:107374182472 2024-04-30T23:12:34.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 msgr2=0x7f024c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 0x7f024c0a61e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0254005950 tx=0x7f02540058e0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 msgr2=0x7f02641a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f025800d980 tx=0x7f025800dd40 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 shutdown_connections 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f024c0a3cd0 0x7f024c0a61e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0264109760 0x7f026419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02641044e0 0x7f02641a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 --2- 172.21.15.100:0/1606199977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264108e10 0x7f02641a0df0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.863+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 >> 172.21.15.100:0/1606199977 conn(0x7f02640ffdb0 msgr2=0x7f0264108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.864+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 shutdown_connections 2024-04-30T23:12:34.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:30.864+0000 7f026887d700 1 -- 172.21.15.100:0/1606199977 wait complete. 2024-04-30T23:12:34.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182472 for osd.3 2024-04-30T23:12:34.689 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:35.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:34 smithi104 ceph-mon[32987]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:35.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:34 smithi183 ceph-mon[33560]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:35.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:34 smithi100 ceph-mon[29745]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:35.143 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757301 got 163208757309 for osd.5 2024-04-30T23:12:35.144 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 -- 172.21.15.100:0/3458209207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01033f0 msgr2=0x7fb6c0103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3458209207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01033f0 0x7fb6c0103800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00099c0 tx=0x7fb6b0009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 -- 172.21.15.100:0/3458209207 shutdown_connections 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3458209207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c0108670 0x7fb6c010ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3458209207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01033f0 0x7fb6c0103800 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3458209207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 0x7fb6c0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 -- 172.21.15.100:0/3458209207 >> 172.21.15.100:0/3458209207 conn(0x7fb6c00fee60 msgr2=0x7fb6c0101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 -- 172.21.15.100:0/3458209207 shutdown_connections 2024-04-30T23:12:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.865+0000 7fb6c530b700 1 -- 172.21.15.100:0/3458209207 wait complete. 2024-04-30T23:12:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 Processor -- start 2024-04-30T23:12:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 -- start start 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 0x7fb6c019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 0x7fb6c019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c01143f0 con 0x7fb6c0108670 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0114270 con 0x7fb6c01033f0 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.866+0000 7fb6c530b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0114570 con 0x7fb6c0107d20 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50182/0 (socket says 172.21.15.100:50182) 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 -- 172.21.15.100:0/3028198978 learned_addr learned my addr 172.21.15.100:0/3028198978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6beffd700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 0x7fb6c019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6be7fc700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 0x7fb6c019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 -- 172.21.15.100:0/3028198978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 msgr2=0x7fb6c019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 0x7fb6c019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 -- 172.21.15.100:0/3028198978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 msgr2=0x7fb6c019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 0x7fb6c019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 -- 172.21.15.100:0/3028198978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c019fc30 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6beffd700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 0x7fb6c019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6bf7fe700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800ef30 tx=0x7fb6b800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80092e0 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c019fec0 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6b8004bb0 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8004280 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.867+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01a7840 con 0x7fb6c0108670 2024-04-30T23:12:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.868+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c00511d0 con 0x7fb6c0108670 2024-04-30T23:12:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.870+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb6b801b030 con 0x7fb6c0108670 2024-04-30T23:12:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.870+0000 7fb6a7fff700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 0x7fb6a80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.870+0000 7fb6beffd700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 0x7fb6a80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.870+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fb6b80d0f00 con 0x7fb6c0108670 2024-04-30T23:12:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.871+0000 7fb6beffd700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 0x7fb6a80a61e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0003760 tx=0x7fb6b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:36.874+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6b8022020 con 0x7fb6c0108670 2024-04-30T23:12:36.937 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:36 smithi100 ceph-mon[29745]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:37.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:36 smithi104 ceph-mon[32987]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:37.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:36 smithi183 ceph-mon[33560]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 -- 172.21.15.100:0/1373124553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 msgr2=0x7f40e4109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 --2- 172.21.15.100:0/1373124553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4109220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f40d80099c0 tx=0x7f40d8009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 -- 172.21.15.100:0/1373124553 shutdown_connections 2024-04-30T23:12:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 --2- 172.21.15.100:0/1373124553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 0x7f40e41110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 --2- 172.21.15.100:0/1373124553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 0x7f40e41048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 --2- 172.21.15.100:0/1373124553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4109220 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 -- 172.21.15.100:0/1373124553 >> 172.21.15.100:0/1373124553 conn(0x7f40e40ffdb0 msgr2=0x7f40e4102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 -- 172.21.15.100:0/1373124553 shutdown_connections 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 -- 172.21.15.100:0/1373124553 wait complete. 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.051+0000 7f40e9a50700 1 Processor -- start 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 -- start start 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 0x7f40e4076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 0x7f40e4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41143e0 con 0x7f40e4108e10 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4114260 con 0x7f40e4109760 2024-04-30T23:12:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e9a50700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4114560 con 0x7f40e41044e0 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50190/0 (socket says 172.21.15.100:50190) 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 -- 172.21.15.100:0/2038812713 learned_addr learned my addr 172.21.15.100:0/2038812713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e2ffd700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 0x7f40e4076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e37fe700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 0x7f40e4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 -- 172.21.15.100:0/2038812713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 msgr2=0x7f40e4076ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 0x7f40e4076ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 -- 172.21.15.100:0/2038812713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 msgr2=0x7f40e4077560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 0x7f40e4077560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.052+0000 7f40e27fc700 1 -- 172.21.15.100:0/2038812713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e41a91f0 con 0x7f40e4108e10 2024-04-30T23:12:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e27fc700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006010 tx=0x7f40d80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8027070 con 0x7f40e4108e10 2024-04-30T23:12:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d8003f20 con 0x7f40e4108e10 2024-04-30T23:12:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e41a9480 con 0x7f40e4108e10 2024-04-30T23:12:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8022c60 con 0x7f40e4108e10 2024-04-30T23:12:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.053+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41a9930 con 0x7f40e4108e10 2024-04-30T23:12:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.054+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e40511d0 con 0x7f40e4108e10 2024-04-30T23:12:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.056+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f40d802a070 con 0x7f40e4108e10 2024-04-30T23:12:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.056+0000 7f40e8a4e700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 0x7f40cc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.056+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f40d8022e00 con 0x7f40e4108e10 2024-04-30T23:12:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.056+0000 7f40e2ffd700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 0x7f40cc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.057+0000 7f40e2ffd700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 0x7f40cc0a6260 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009a10 tx=0x7f40d4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.060+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f40d8013070 con 0x7f40e4108e10 2024-04-30T23:12:37.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.086+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb6c002e550 con 0x7fb6c0108670 2024-04-30T23:12:37.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.087+0000 7fb6a7fff700 1 -- 172.21.15.100:0/3028198978 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6b8010040 con 0x7fb6c0108670 2024-04-30T23:12:37.087 INFO:teuthology.orchestra.run.smithi100.stdout:219043332148 2024-04-30T23:12:37.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 msgr2=0x7fb6a80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 0x7fb6a80a61e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0003760 tx=0x7fb6b001a040 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 msgr2=0x7fb6c019f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800ef30 tx=0x7fb6b800c450 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 shutdown_connections 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6a80a3cd0 0x7fb6a80a61e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0108670 0x7fb6c019f590 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6c01033f0 0x7fb6c019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 --2- 172.21.15.100:0/3028198978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c0107d20 0x7fb6c019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.089+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 >> 172.21.15.100:0/3028198978 conn(0x7fb6c00fee60 msgr2=0x7fb6c01070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.090+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 shutdown_connections 2024-04-30T23:12:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.090+0000 7fb6c530b700 1 -- 172.21.15.100:0/3028198978 wait complete. 2024-04-30T23:12:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.271+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f40e402e550 con 0x7f40e4108e10 2024-04-30T23:12:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.272+0000 7f40e8a4e700 1 -- 172.21.15.100:0/2038812713 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40d809e120 con 0x7f40e4108e10 2024-04-30T23:12:37.272 INFO:teuthology.orchestra.run.smithi100.stdout:253403070512 2024-04-30T23:12:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 msgr2=0x7f40cc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 0x7f40cc0a6260 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009a10 tx=0x7f40d4009190 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 msgr2=0x7f40e4077020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006010 tx=0x7f40d80047b0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 shutdown_connections 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40cc0a3d50 0x7f40cc0a6260 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40e4109760 0x7f40e4077560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e41044e0 0x7f40e4076ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 --2- 172.21.15.100:0/2038812713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40e4108e10 0x7f40e4077020 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 >> 172.21.15.100:0/2038812713 conn(0x7f40e40ffdb0 msgr2=0x7f40e410a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 shutdown_connections 2024-04-30T23:12:37.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:37.274+0000 7f40e9a50700 1 -- 172.21.15.100:0/2038812713 wait complete. 2024-04-30T23:12:37.914 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332142 got 219043332148 for osd.7 2024-04-30T23:12:37.914 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:38.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:37 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3028198978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-30T23:12:38.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:37 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2038812713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-30T23:12:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:37 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3028198978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-30T23:12:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:37 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2038812713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-30T23:12:38.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:37 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3028198978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-30T23:12:38.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:37 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2038812713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-30T23:12:38.538 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070507 got 253403070512 for osd.8 2024-04-30T23:12:38.538 DEBUG:teuthology.parallel:result is None 2024-04-30T23:12:38.538 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-30T23:12:38.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-30T23:12:38.803 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:38.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:38 smithi100 ceph-mon[29745]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:38.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:38.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:38 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:38 smithi104 ceph-mon[32987]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:38 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:38 smithi183 ceph-mon[33560]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:38 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:39.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:39 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:12:39.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:39 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:12:39.966 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:39 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:40.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:39 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:12:40.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:39 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:12:40.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:39 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:40.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:12:40.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:12:40.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 -- 172.21.15.100:0/736583430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc108e10 msgr2=0x7fc4bc109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/736583430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc108e10 0x7fc4bc109220 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00099c0 tx=0x7fc4b0009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 -- 172.21.15.100:0/736583430 shutdown_connections 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/736583430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc109760 0x7fc4bc1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/736583430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc1048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/736583430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc108e10 0x7fc4bc109220 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 -- 172.21.15.100:0/736583430 >> 172.21.15.100:0/736583430 conn(0x7fc4bc0ffdb0 msgr2=0x7fc4bc102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 -- 172.21.15.100:0/736583430 shutdown_connections 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.566+0000 7fc4c29ba700 1 -- 172.21.15.100:0/736583430 wait complete. 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 Processor -- start 2024-04-30T23:12:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 -- start start 2024-04-30T23:12:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 0x7fc4bc19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc1143e0 con 0x7fc4bc109760 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc114260 con 0x7fc4bc108e10 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c29ba700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc114560 con 0x7fc4bc1044e0 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.567+0000 7fc4c0f57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50208/0 (socket says 172.21.15.100:50208) 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 -- 172.21.15.100:0/1319828145 learned_addr learned my addr 172.21.15.100:0/1319828145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4bbfff700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4bb7fe700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 0x7fc4bc19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 -- 172.21.15.100:0/1319828145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 msgr2=0x7fc4bc19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc19add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 -- 172.21.15.100:0/1319828145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 msgr2=0x7fc4bc19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 0x7fc4bc19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 -- 172.21.15.100:0/1319828145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc19fca0 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4bbfff700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4bb7fe700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 0x7fc4bc19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c0f57700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b970 tx=0x7fc4b400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4019070 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4b4014440 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc19ff90 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400ce60 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.568+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc1a78b0 con 0x7fc4bc109760 2024-04-30T23:12:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.569+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc0511d0 con 0x7fc4bc109760 2024-04-30T23:12:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.570+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fc4b401c070 con 0x7fc4bc109760 2024-04-30T23:12:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.571+0000 7fc4b97fa700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 0x7fc4a40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.571+0000 7fc4bbfff700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 0x7fc4a40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.571+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fc4b40d00d0 con 0x7fc4bc109760 2024-04-30T23:12:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.572+0000 7fc4bbfff700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 0x7fc4a40a61e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005950 tx=0x7fc4ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.577+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc4b409c720 con 0x7fc4bc109760 2024-04-30T23:12:40.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.770+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4bc19c130 con 0x7fc4a40a3cd0 2024-04-30T23:12:40.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.779+0000 7fc4b97fa700 1 -- 172.21.15.100:0/1319828145 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340404 (secure 0 0 0) 0x7fc4bc19c130 con 0x7fc4a40a3cd0 2024-04-30T23:12:40.785 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:40.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 msgr2=0x7fc4a40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 0x7fc4a40a61e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005950 tx=0x7fc4ac0058e0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 msgr2=0x7fc4bc19f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b970 tx=0x7fc4b400bd30 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 shutdown_connections 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4a40a3cd0 0x7fc4a40a61e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4bc109760 0x7fc4bc19f600 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4bc1044e0 0x7fc4bc19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 --2- 172.21.15.100:0/1319828145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4bc108e10 0x7fc4bc19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 >> 172.21.15.100:0/1319828145 conn(0x7fc4bc0ffdb0 msgr2=0x7fc4bc10a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 shutdown_connections 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:40.783+0000 7fc4c29ba700 1 -- 172.21.15.100:0/1319828145 wait complete. 2024-04-30T23:12:40.788 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:12:41.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:40 smithi104 ceph-mon[32987]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:40 smithi183 ceph-mon[33560]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:41.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:40 smithi100 ceph-mon[29745]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:41.479 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-30T23:12:39.608127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660530,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":862,"num_read_kb":552,"num_write":427,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388416,"kb_used_data":14240,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553408,"statfs":{"total":1151940427776,"available":1151542689792,"internally_reserved":0,"allocated":14581760,"data_stored":7961816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004059"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782900+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:11:56.782900+0000","last_peered":"2024-04-30T23:11:56.782900+0000","last_clean":"2024-04-30T23:11:56.782900+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:11:56.782900+0000","last_undegraded":"2024-04-30T23:11:56.782900+0000","last_fullsized":"2024-04-30T23:11:56.782900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783427+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:11:56.783427+0000","last_peered":"2024-04-30T23:11:56.783427+0000","last_clean":"2024-04-30T23:11:56.783427+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:11:56.783427+0000","last_undegraded":"2024-04-30T23:11:56.783427+0000","last_fullsized":"2024-04-30T23:11:56.783427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784038+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:11:56.784038+0000","last_peered":"2024-04-30T23:11:56.784038+0000","last_clean":"2024-04-30T23:11:56.784038+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:11:56.784038+0000","last_undegraded":"2024-04-30T23:11:56.784038+0000","last_fullsized":"2024-04-30T23:11:56.784038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779686+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:11:56.779686+0000","last_peered":"2024-04-30T23:11:56.779686+0000","last_clean":"2024-04-30T23:11:56.779686+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:11:56.779686+0000","last_undegraded":"2024-04-30T23:11:56.779686+0000","last_fullsized":"2024-04-30T23:11:56.779686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784127+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:11:56.784127+0000","last_peered":"2024-04-30T23:11:56.784127+0000","last_clean":"2024-04-30T23:11:56.784127+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:11:56.784127+0000","last_undegraded":"2024-04-30T23:11:56.784127+0000","last_fullsized":"2024-04-30T23:11:56.784127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955592+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:11:56.955592+0000","last_peered":"2024-04-30T23:11:56.955592+0000","last_clean":"2024-04-30T23:11:56.955592+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:11:56.955592+0000","last_undegraded":"2024-04-30T23:11:56.955592+0000","last_fullsized":"2024-04-30T23:11:56.955592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974263+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:11:56.974263+0000","last_peered":"2024-04-30T23:11:56.974263+0000","last_clean":"2024-04-30T23:11:56.974263+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:11:56.974263+0000","last_undegraded":"2024-04-30T23:11:56.974263+0000","last_fullsized":"2024-04-30T23:11:56.974263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783859+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:11:56.783859+0000","last_peered":"2024-04-30T23:11:56.783859+0000","last_clean":"2024-04-30T23:11:56.783859+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:11:56.783859+0000","last_undegraded":"2024-04-30T23:11:56.783859+0000","last_fullsized":"2024-04-30T23:11:56.783859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123909+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:11:57.123909+0000","last_peered":"2024-04-30T23:11:57.123909+0000","last_clean":"2024-04-30T23:11:57.123909+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:11:57.123909+0000","last_undegraded":"2024-04-30T23:11:57.123909+0000","last_fullsized":"2024-04-30T23:11:57.123909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955728+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:11:56.955728+0000","last_peered":"2024-04-30T23:11:56.955728+0000","last_clean":"2024-04-30T23:11:56.955728+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:11:56.955728+0000","last_undegraded":"2024-04-30T23:11:56.955728+0000","last_fullsized":"2024-04-30T23:11:56.955728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974444+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:11:56.974444+0000","last_peered":"2024-04-30T23:11:56.974444+0000","last_clean":"2024-04-30T23:11:56.974444+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:11:56.974444+0000","last_undegraded":"2024-04-30T23:11:56.974444+0000","last_fullsized":"2024-04-30T23:11:56.974444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779552+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:11:56.779552+0000","last_peered":"2024-04-30T23:11:56.779552+0000","last_clean":"2024-04-30T23:11:56.779552+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:11:56.779552+0000","last_undegraded":"2024-04-30T23:11:56.779552+0000","last_fullsized":"2024-04-30T23:11:56.779552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783004+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:11:56.783004+0000","last_peered":"2024-04-30T23:11:56.783004+0000","last_clean":"2024-04-30T23:11:56.783004+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:11:56.783004+0000","last_undegraded":"2024-04-30T23:11:56.783004+0000","last_fullsized":"2024-04-30T23:11:56.783004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782228+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:11:56.782228+0000","last_peered":"2024-04-30T23:11:56.782228+0000","last_clean":"2024-04-30T23:11:56.782228+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:11:56.782228+0000","last_undegraded":"2024-04-30T23:11:56.782228+0000","last_fullsized":"2024-04-30T23:11:56.782228+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783814+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:11:56.783814+0000","last_peered":"2024-04-30T23:11:56.783814+0000","last_clean":"2024-04-30T23:11:56.783814+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:11:56.783814+0000","last_undegraded":"2024-04-30T23:11:56.783814+0000","last_fullsized":"2024-04-30T23:11:56.783814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123453+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:11:57.123453+0000","last_peered":"2024-04-30T23:11:57.123453+0000","last_clean":"2024-04-30T23:11:57.123453+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:11:57.123453+0000","last_undegraded":"2024-04-30T23:11:57.123453+0000","last_fullsized":"2024-04-30T23:11:57.123453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782670+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:11:56.782670+0000","last_peered":"2024-04-30T23:11:56.782670+0000","last_clean":"2024-04-30T23:11:56.782670+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:11:56.782670+0000","last_undegraded":"2024-04-30T23:11:56.782670+0000","last_fullsized":"2024-04-30T23:11:56.782670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780732+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:11:56.780732+0000","last_peered":"2024-04-30T23:11:56.780732+0000","last_clean":"2024-04-30T23:11:56.780732+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:11:56.780732+0000","last_undegraded":"2024-04-30T23:11:56.780732+0000","last_fullsized":"2024-04-30T23:11:56.780732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779589+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:11:56.779589+0000","last_peered":"2024-04-30T23:11:56.779589+0000","last_clean":"2024-04-30T23:11:56.779589+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:11:56.779589+0000","last_undegraded":"2024-04-30T23:11:56.779589+0000","last_fullsized":"2024-04-30T23:11:56.779589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779228+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:11:56.779228+0000","last_peered":"2024-04-30T23:11:56.779228+0000","last_clean":"2024-04-30T23:11:56.779228+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:11:56.779228+0000","last_undegraded":"2024-04-30T23:11:56.779228+0000","last_fullsized":"2024-04-30T23:11:56.779228+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:37.028423+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:12:37.028423+0000","last_peered":"2024-04-30T23:12:37.028423+0000","last_clean":"2024-04-30T23:12:37.028423+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:12:37.028423+0000","last_undegraded":"2024-04-30T23:12:37.028423+0000","last_fullsized":"2024-04-30T23:12:37.028423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.962242+0000","last_change":"2024-04-30T23:11:56.961809+0000","last_active":"2024-04-30T23:11:56.962242+0000","last_peered":"2024-04-30T23:11:56.962242+0000","last_clean":"2024-04-30T23:11:56.962242+0000","last_became_active":"2024-04-30T23:11:56.961461+0000","last_became_peered":"2024-04-30T23:11:56.961461+0000","last_unstale":"2024-04-30T23:11:56.962242+0000","last_undegraded":"2024-04-30T23:11:56.962242+0000","last_fullsized":"2024-04-30T23:11:56.962242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:41:28.814142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778931+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:11:56.778931+0000","last_peered":"2024-04-30T23:11:56.778931+0000","last_clean":"2024-04-30T23:11:56.778931+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:56.778931+0000","last_undegraded":"2024-04-30T23:11:56.778931+0000","last_fullsized":"2024-04-30T23:11:56.778931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786661+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:11:56.786661+0000","last_peered":"2024-04-30T23:11:56.786661+0000","last_clean":"2024-04-30T23:11:56.786661+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:11:56.786661+0000","last_undegraded":"2024-04-30T23:11:56.786661+0000","last_fullsized":"2024-04-30T23:11:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784186+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:11:56.784186+0000","last_peered":"2024-04-30T23:11:56.784186+0000","last_clean":"2024-04-30T23:11:56.784186+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:11:56.784186+0000","last_undegraded":"2024-04-30T23:11:56.784186+0000","last_fullsized":"2024-04-30T23:11:56.784186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.961194+0000","last_change":"2024-04-30T23:11:56.961194+0000","last_active":"2024-04-30T23:11:56.961194+0000","last_peered":"2024-04-30T23:11:56.961194+0000","last_clean":"2024-04-30T23:11:56.961194+0000","last_became_active":"2024-04-30T23:11:56.960793+0000","last_became_peered":"2024-04-30T23:11:56.960793+0000","last_unstale":"2024-04-30T23:11:56.961194+0000","last_undegraded":"2024-04-30T23:11:56.961194+0000","last_fullsized":"2024-04-30T23:11:56.961194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:44:07.845730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784581+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:11:56.784581+0000","last_peered":"2024-04-30T23:11:56.784581+0000","last_clean":"2024-04-30T23:11:56.784581+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:11:56.784581+0000","last_undegraded":"2024-04-30T23:11:56.784581+0000","last_fullsized":"2024-04-30T23:11:56.784581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123730+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:11:57.123730+0000","last_peered":"2024-04-30T23:11:57.123730+0000","last_clean":"2024-04-30T23:11:57.123730+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:11:57.123730+0000","last_undegraded":"2024-04-30T23:11:57.123730+0000","last_fullsized":"2024-04-30T23:11:57.123730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778994+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:11:56.778994+0000","last_peered":"2024-04-30T23:11:56.778994+0000","last_clean":"2024-04-30T23:11:56.778994+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:11:56.778994+0000","last_undegraded":"2024-04-30T23:11:56.778994+0000","last_fullsized":"2024-04-30T23:11:56.778994+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784441+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:11:56.784441+0000","last_peered":"2024-04-30T23:11:56.784441+0000","last_clean":"2024-04-30T23:11:56.784441+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:11:56.784441+0000","last_undegraded":"2024-04-30T23:11:56.784441+0000","last_fullsized":"2024-04-30T23:11:56.784441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959462+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:11:56.959462+0000","last_peered":"2024-04-30T23:11:56.959462+0000","last_clean":"2024-04-30T23:11:56.959462+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:11:56.959462+0000","last_undegraded":"2024-04-30T23:11:56.959462+0000","last_fullsized":"2024-04-30T23:11:56.959462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779321+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:11:56.779321+0000","last_peered":"2024-04-30T23:11:56.779321+0000","last_clean":"2024-04-30T23:11:56.779321+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:11:56.779321+0000","last_undegraded":"2024-04-30T23:11:56.779321+0000","last_fullsized":"2024-04-30T23:11:56.779321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:37.021539+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:12:37.021539+0000","last_peered":"2024-04-30T23:12:37.021539+0000","last_clean":"2024-04-30T23:12:37.021539+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:12:37.021539+0000","last_undegraded":"2024-04-30T23:12:37.021539+0000","last_fullsized":"2024-04-30T23:12:37.021539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784192+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:11:56.784192+0000","last_peered":"2024-04-30T23:11:56.784192+0000","last_clean":"2024-04-30T23:11:56.784192+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:11:56.784192+0000","last_undegraded":"2024-04-30T23:11:56.784192+0000","last_fullsized":"2024-04-30T23:11:56.784192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779012+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:11:56.779012+0000","last_peered":"2024-04-30T23:11:56.779012+0000","last_clean":"2024-04-30T23:11:56.779012+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:11:56.779012+0000","last_undegraded":"2024-04-30T23:11:56.779012+0000","last_fullsized":"2024-04-30T23:11:56.779012+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.956272+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:11:56.956272+0000","last_peered":"2024-04-30T23:11:56.956272+0000","last_clean":"2024-04-30T23:11:56.956272+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:11:56.956272+0000","last_undegraded":"2024-04-30T23:11:56.956272+0000","last_fullsized":"2024-04-30T23:11:56.956272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786946+0000","last_change":"2024-04-30T23:11:56.786296+0000","last_active":"2024-04-30T23:11:56.786946+0000","last_peered":"2024-04-30T23:11:56.786946+0000","last_clean":"2024-04-30T23:11:56.786946+0000","last_became_active":"2024-04-30T23:11:56.785834+0000","last_became_peered":"2024-04-30T23:11:56.785834+0000","last_unstale":"2024-04-30T23:11:56.786946+0000","last_undegraded":"2024-04-30T23:11:56.786946+0000","last_fullsized":"2024-04-30T23:11:56.786946+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:33.908301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782539+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:11:56.782539+0000","last_peered":"2024-04-30T23:11:56.782539+0000","last_clean":"2024-04-30T23:11:56.782539+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:11:56.782539+0000","last_undegraded":"2024-04-30T23:11:56.782539+0000","last_fullsized":"2024-04-30T23:11:56.782539+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784802+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:11:56.784802+0000","last_peered":"2024-04-30T23:11:56.784802+0000","last_clean":"2024-04-30T23:11:56.784802+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:11:56.784802+0000","last_undegraded":"2024-04-30T23:11:56.784802+0000","last_fullsized":"2024-04-30T23:11:56.784802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783764+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:11:56.783764+0000","last_peered":"2024-04-30T23:11:56.783764+0000","last_clean":"2024-04-30T23:11:56.783764+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:11:56.783764+0000","last_undegraded":"2024-04-30T23:11:56.783764+0000","last_fullsized":"2024-04-30T23:11:56.783764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783310+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:11:56.783310+0000","last_peered":"2024-04-30T23:11:56.783310+0000","last_clean":"2024-04-30T23:11:56.783310+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:11:56.783310+0000","last_undegraded":"2024-04-30T23:11:56.783310+0000","last_fullsized":"2024-04-30T23:11:56.783310+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960272+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:11:56.960272+0000","last_peered":"2024-04-30T23:11:56.960272+0000","last_clean":"2024-04-30T23:11:56.960272+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:11:56.960272+0000","last_undegraded":"2024-04-30T23:11:56.960272+0000","last_fullsized":"2024-04-30T23:11:56.960272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781215+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:11:56.781215+0000","last_peered":"2024-04-30T23:11:56.781215+0000","last_clean":"2024-04-30T23:11:56.781215+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:11:56.781215+0000","last_undegraded":"2024-04-30T23:11:56.781215+0000","last_fullsized":"2024-04-30T23:11:56.781215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784167+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:11:56.784167+0000","last_peered":"2024-04-30T23:11:56.784167+0000","last_clean":"2024-04-30T23:11:56.784167+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:11:56.784167+0000","last_undegraded":"2024-04-30T23:11:56.784167+0000","last_fullsized":"2024-04-30T23:11:56.784167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:34.015725+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:12:34.015725+0000","last_peered":"2024-04-30T23:12:34.015725+0000","last_clean":"2024-04-30T23:12:34.015725+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:12:34.015725+0000","last_undegraded":"2024-04-30T23:12:34.015725+0000","last_fullsized":"2024-04-30T23:12:34.015725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123604+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:11:57.123604+0000","last_peered":"2024-04-30T23:11:57.123604+0000","last_clean":"2024-04-30T23:11:57.123604+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:11:57.123604+0000","last_undegraded":"2024-04-30T23:11:57.123604+0000","last_fullsized":"2024-04-30T23:11:57.123604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780807+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:11:56.780807+0000","last_peered":"2024-04-30T23:11:56.780807+0000","last_clean":"2024-04-30T23:11:56.780807+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:11:56.780807+0000","last_undegraded":"2024-04-30T23:11:56.780807+0000","last_fullsized":"2024-04-30T23:11:56.780807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.975125+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:11:56.975125+0000","last_peered":"2024-04-30T23:11:56.975125+0000","last_clean":"2024-04-30T23:11:56.975125+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:11:56.975125+0000","last_undegraded":"2024-04-30T23:11:56.975125+0000","last_fullsized":"2024-04-30T23:11:56.975125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784317+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:11:56.784317+0000","last_peered":"2024-04-30T23:11:56.784317+0000","last_clean":"2024-04-30T23:11:56.784317+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:11:56.784317+0000","last_undegraded":"2024-04-30T23:11:56.784317+0000","last_fullsized":"2024-04-30T23:11:56.784317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779686+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:11:56.779686+0000","last_peered":"2024-04-30T23:11:56.779686+0000","last_clean":"2024-04-30T23:11:56.779686+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:11:56.779686+0000","last_undegraded":"2024-04-30T23:11:56.779686+0000","last_fullsized":"2024-04-30T23:11:56.779686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960738+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:11:56.960738+0000","last_peered":"2024-04-30T23:11:56.960738+0000","last_clean":"2024-04-30T23:11:56.960738+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:11:56.960738+0000","last_undegraded":"2024-04-30T23:11:56.960738+0000","last_fullsized":"2024-04-30T23:11:56.960738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123522+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:11:57.123522+0000","last_peered":"2024-04-30T23:11:57.123522+0000","last_clean":"2024-04-30T23:11:57.123522+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:11:57.123522+0000","last_undegraded":"2024-04-30T23:11:57.123522+0000","last_fullsized":"2024-04-30T23:11:57.123522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781181+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:11:56.781181+0000","last_peered":"2024-04-30T23:11:56.781181+0000","last_clean":"2024-04-30T23:11:56.781181+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:11:56.781181+0000","last_undegraded":"2024-04-30T23:11:56.781181+0000","last_fullsized":"2024-04-30T23:11:56.781181+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":207,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:34.025041+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:12:34.025041+0000","last_peered":"2024-04-30T23:12:34.025041+0000","last_clean":"2024-04-30T23:12:34.025041+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:12:34.025041+0000","last_undegraded":"2024-04-30T23:12:34.025041+0000","last_fullsized":"2024-04-30T23:12:34.025041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62333,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784384+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:11:56.784384+0000","last_peered":"2024-04-30T23:11:56.784384+0000","last_clean":"2024-04-30T23:11:56.784384+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:11:56.784384+0000","last_undegraded":"2024-04-30T23:11:56.784384+0000","last_fullsized":"2024-04-30T23:11:56.784384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.961010+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:11:56.961010+0000","last_peered":"2024-04-30T23:11:56.961010+0000","last_clean":"2024-04-30T23:11:56.961010+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:11:56.961010+0000","last_undegraded":"2024-04-30T23:11:56.961010+0000","last_fullsized":"2024-04-30T23:11:56.961010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779800+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:11:56.779800+0000","last_peered":"2024-04-30T23:11:56.779800+0000","last_clean":"2024-04-30T23:11:56.779800+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:11:56.779800+0000","last_undegraded":"2024-04-30T23:11:56.779800+0000","last_fullsized":"2024-04-30T23:11:56.779800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.785156+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:11:56.785156+0000","last_peered":"2024-04-30T23:11:56.785156+0000","last_clean":"2024-04-30T23:11:56.785156+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:11:56.785156+0000","last_undegraded":"2024-04-30T23:11:56.785156+0000","last_fullsized":"2024-04-30T23:11:56.785156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781810+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:11:56.781810+0000","last_peered":"2024-04-30T23:11:56.781810+0000","last_clean":"2024-04-30T23:11:56.781810+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:11:56.781810+0000","last_undegraded":"2024-04-30T23:11:56.781810+0000","last_fullsized":"2024-04-30T23:11:56.781810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960426+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:11:56.960426+0000","last_peered":"2024-04-30T23:11:56.960426+0000","last_clean":"2024-04-30T23:11:56.960426+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:11:56.960426+0000","last_undegraded":"2024-04-30T23:11:56.960426+0000","last_fullsized":"2024-04-30T23:11:56.960426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974305+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:11:56.974305+0000","last_peered":"2024-04-30T23:11:56.974305+0000","last_clean":"2024-04-30T23:11:56.974305+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:11:56.974305+0000","last_undegraded":"2024-04-30T23:11:56.974305+0000","last_fullsized":"2024-04-30T23:11:56.974305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780962+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:11:56.780962+0000","last_peered":"2024-04-30T23:11:56.780962+0000","last_clean":"2024-04-30T23:11:56.780962+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:11:56.780962+0000","last_undegraded":"2024-04-30T23:11:56.780962+0000","last_fullsized":"2024-04-30T23:11:56.780962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:38.018274+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:12:38.018274+0000","last_peered":"2024-04-30T23:12:38.018274+0000","last_clean":"2024-04-30T23:12:38.018274+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:12:38.018274+0000","last_undegraded":"2024-04-30T23:12:38.018274+0000","last_fullsized":"2024-04-30T23:12:38.018274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974808+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:11:56.974808+0000","last_peered":"2024-04-30T23:11:56.974808+0000","last_clean":"2024-04-30T23:11:56.974808+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:11:56.974808+0000","last_undegraded":"2024-04-30T23:11:56.974808+0000","last_fullsized":"2024-04-30T23:11:56.974808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783026+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:11:56.783026+0000","last_peered":"2024-04-30T23:11:56.783026+0000","last_clean":"2024-04-30T23:11:56.783026+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:11:56.783026+0000","last_undegraded":"2024-04-30T23:11:56.783026+0000","last_fullsized":"2024-04-30T23:11:56.783026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783924+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:11:56.783924+0000","last_peered":"2024-04-30T23:11:56.783924+0000","last_clean":"2024-04-30T23:11:56.783924+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:11:56.783924+0000","last_undegraded":"2024-04-30T23:11:56.783924+0000","last_fullsized":"2024-04-30T23:11:56.783924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959062+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:11:56.959062+0000","last_peered":"2024-04-30T23:11:56.959062+0000","last_clean":"2024-04-30T23:11:56.959062+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:11:56.959062+0000","last_undegraded":"2024-04-30T23:11:56.959062+0000","last_fullsized":"2024-04-30T23:11:56.959062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959699+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:11:56.959699+0000","last_peered":"2024-04-30T23:11:56.959699+0000","last_clean":"2024-04-30T23:11:56.959699+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:11:56.959699+0000","last_undegraded":"2024-04-30T23:11:56.959699+0000","last_fullsized":"2024-04-30T23:11:56.959699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784453+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:11:56.784453+0000","last_peered":"2024-04-30T23:11:56.784453+0000","last_clean":"2024-04-30T23:11:56.784453+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:11:56.784453+0000","last_undegraded":"2024-04-30T23:11:56.784453+0000","last_fullsized":"2024-04-30T23:11:56.784453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782117+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:11:56.782117+0000","last_peered":"2024-04-30T23:11:56.782117+0000","last_clean":"2024-04-30T23:11:56.782117+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:11:56.782117+0000","last_undegraded":"2024-04-30T23:11:56.782117+0000","last_fullsized":"2024-04-30T23:11:56.782117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784102+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:11:56.784102+0000","last_peered":"2024-04-30T23:11:56.784102+0000","last_clean":"2024-04-30T23:11:56.784102+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:11:56.784102+0000","last_undegraded":"2024-04-30T23:11:56.784102+0000","last_fullsized":"2024-04-30T23:11:56.784102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781086+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:11:56.781086+0000","last_peered":"2024-04-30T23:11:56.781086+0000","last_clean":"2024-04-30T23:11:56.781086+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:11:56.781086+0000","last_undegraded":"2024-04-30T23:11:56.781086+0000","last_fullsized":"2024-04-30T23:11:56.781086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955712+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:11:56.955712+0000","last_peered":"2024-04-30T23:11:56.955712+0000","last_clean":"2024-04-30T23:11:56.955712+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:11:56.955712+0000","last_undegraded":"2024-04-30T23:11:56.955712+0000","last_fullsized":"2024-04-30T23:11:56.955712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783997+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:11:56.783997+0000","last_peered":"2024-04-30T23:11:56.783997+0000","last_clean":"2024-04-30T23:11:56.783997+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:11:56.783997+0000","last_undegraded":"2024-04-30T23:11:56.783997+0000","last_fullsized":"2024-04-30T23:11:56.783997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:34.024832+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:12:34.024832+0000","last_peered":"2024-04-30T23:12:34.024832+0000","last_clean":"2024-04-30T23:12:34.024832+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:12:34.024832+0000","last_undegraded":"2024-04-30T23:12:34.024832+0000","last_fullsized":"2024-04-30T23:12:34.024832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955739+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:11:56.955739+0000","last_peered":"2024-04-30T23:11:56.955739+0000","last_clean":"2024-04-30T23:11:56.955739+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:11:56.955739+0000","last_undegraded":"2024-04-30T23:11:56.955739+0000","last_fullsized":"2024-04-30T23:11:56.955739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783093+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:11:56.783093+0000","last_peered":"2024-04-30T23:11:56.783093+0000","last_clean":"2024-04-30T23:11:56.783093+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:11:56.783093+0000","last_undegraded":"2024-04-30T23:11:56.783093+0000","last_fullsized":"2024-04-30T23:11:56.783093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959008+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:11:56.959008+0000","last_peered":"2024-04-30T23:11:56.959008+0000","last_clean":"2024-04-30T23:11:56.959008+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:11:56.959008+0000","last_undegraded":"2024-04-30T23:11:56.959008+0000","last_fullsized":"2024-04-30T23:11:56.959008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:34.010879+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:12:34.010879+0000","last_peered":"2024-04-30T23:12:34.010879+0000","last_clean":"2024-04-30T23:12:34.010879+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:12:34.010879+0000","last_undegraded":"2024-04-30T23:12:34.010879+0000","last_fullsized":"2024-04-30T23:12:34.010879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974995+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:11:56.974995+0000","last_peered":"2024-04-30T23:11:56.974995+0000","last_clean":"2024-04-30T23:11:56.974995+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:11:56.974995+0000","last_undegraded":"2024-04-30T23:11:56.974995+0000","last_fullsized":"2024-04-30T23:11:56.974995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784427+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:11:56.784427+0000","last_peered":"2024-04-30T23:11:56.784427+0000","last_clean":"2024-04-30T23:11:56.784427+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:11:56.784427+0000","last_undegraded":"2024-04-30T23:11:56.784427+0000","last_fullsized":"2024-04-30T23:11:56.784427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779558+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:11:56.779558+0000","last_peered":"2024-04-30T23:11:56.779558+0000","last_clean":"2024-04-30T23:11:56.779558+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:11:56.779558+0000","last_undegraded":"2024-04-30T23:11:56.779558+0000","last_fullsized":"2024-04-30T23:11:56.779558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974691+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:11:56.974691+0000","last_peered":"2024-04-30T23:11:56.974691+0000","last_clean":"2024-04-30T23:11:56.974691+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:11:56.974691+0000","last_undegraded":"2024-04-30T23:11:56.974691+0000","last_fullsized":"2024-04-30T23:11:56.974691+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960926+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:11:56.960926+0000","last_peered":"2024-04-30T23:11:56.960926+0000","last_clean":"2024-04-30T23:11:56.960926+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:11:56.960926+0000","last_undegraded":"2024-04-30T23:11:56.960926+0000","last_fullsized":"2024-04-30T23:11:56.960926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784564+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:11:56.784564+0000","last_peered":"2024-04-30T23:11:56.784564+0000","last_clean":"2024-04-30T23:11:56.784564+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:11:56.784564+0000","last_undegraded":"2024-04-30T23:11:56.784564+0000","last_fullsized":"2024-04-30T23:11:56.784564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974759+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:11:56.974759+0000","last_peered":"2024-04-30T23:11:56.974759+0000","last_clean":"2024-04-30T23:11:56.974759+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:11:56.974759+0000","last_undegraded":"2024-04-30T23:11:56.974759+0000","last_fullsized":"2024-04-30T23:11:56.974759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.976706+0000","last_change":"2024-04-30T23:11:56.976706+0000","last_active":"2024-04-30T23:11:56.976706+0000","last_peered":"2024-04-30T23:11:56.976706+0000","last_clean":"2024-04-30T23:11:56.976706+0000","last_became_active":"2024-04-30T23:11:56.976251+0000","last_became_peered":"2024-04-30T23:11:56.976251+0000","last_unstale":"2024-04-30T23:11:56.976706+0000","last_undegraded":"2024-04-30T23:11:56.976706+0000","last_fullsized":"2024-04-30T23:11:56.976706+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:12.294435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784474+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:11:56.784474+0000","last_peered":"2024-04-30T23:11:56.784474+0000","last_clean":"2024-04-30T23:11:56.784474+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:11:56.784474+0000","last_undegraded":"2024-04-30T23:11:56.784474+0000","last_fullsized":"2024-04-30T23:11:56.784474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784181+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:11:56.784181+0000","last_peered":"2024-04-30T23:11:56.784181+0000","last_clean":"2024-04-30T23:11:56.784181+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:11:56.784181+0000","last_undegraded":"2024-04-30T23:11:56.784181+0000","last_fullsized":"2024-04-30T23:11:56.784181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783646+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:11:56.783646+0000","last_peered":"2024-04-30T23:11:56.783646+0000","last_clean":"2024-04-30T23:11:56.783646+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:11:56.783646+0000","last_undegraded":"2024-04-30T23:11:56.783646+0000","last_fullsized":"2024-04-30T23:11:56.783646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781002+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:11:56.781002+0000","last_peered":"2024-04-30T23:11:56.781002+0000","last_clean":"2024-04-30T23:11:56.781002+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:11:56.781002+0000","last_undegraded":"2024-04-30T23:11:56.781002+0000","last_fullsized":"2024-04-30T23:11:56.781002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786064+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:11:56.786064+0000","last_peered":"2024-04-30T23:11:56.786064+0000","last_clean":"2024-04-30T23:11:56.786064+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:11:56.786064+0000","last_undegraded":"2024-04-30T23:11:56.786064+0000","last_fullsized":"2024-04-30T23:11:56.786064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778793+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:11:56.778793+0000","last_peered":"2024-04-30T23:11:56.778793+0000","last_clean":"2024-04-30T23:11:56.778793+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:11:56.778793+0000","last_undegraded":"2024-04-30T23:11:56.778793+0000","last_fullsized":"2024-04-30T23:11:56.778793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779465+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:11:56.779465+0000","last_peered":"2024-04-30T23:11:56.779465+0000","last_clean":"2024-04-30T23:11:56.779465+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:11:56.779465+0000","last_undegraded":"2024-04-30T23:11:56.779465+0000","last_fullsized":"2024-04-30T23:11:56.779465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.787447+0000","last_change":"2024-04-30T23:11:56.787447+0000","last_active":"2024-04-30T23:11:56.787447+0000","last_peered":"2024-04-30T23:11:56.787447+0000","last_clean":"2024-04-30T23:11:56.787447+0000","last_became_active":"2024-04-30T23:11:56.786482+0000","last_became_peered":"2024-04-30T23:11:56.786482+0000","last_unstale":"2024-04-30T23:11:56.787447+0000","last_undegraded":"2024-04-30T23:11:56.787447+0000","last_fullsized":"2024-04-30T23:11:56.787447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:40.441920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.962145+0000","last_change":"2024-04-30T23:11:56.962145+0000","last_active":"2024-04-30T23:11:56.962145+0000","last_peered":"2024-04-30T23:11:56.962145+0000","last_clean":"2024-04-30T23:11:56.962145+0000","last_became_active":"2024-04-30T23:11:56.961737+0000","last_became_peered":"2024-04-30T23:11:56.961737+0000","last_unstale":"2024-04-30T23:11:56.962145+0000","last_undegraded":"2024-04-30T23:11:56.962145+0000","last_fullsized":"2024-04-30T23:11:56.962145+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:27:04.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.124531+0000","last_change":"2024-04-30T23:10:59.894525+0000","last_active":"2024-04-30T23:11:57.124531+0000","last_peered":"2024-04-30T23:11:57.124531+0000","last_clean":"2024-04-30T23:11:57.124531+0000","last_became_active":"2024-04-30T23:10:59.894274+0000","last_became_peered":"2024-04-30T23:10:59.894274+0000","last_unstale":"2024-04-30T23:11:57.124531+0000","last_undegraded":"2024-04-30T23:11:57.124531+0000","last_fullsized":"2024-04-30T23:11:57.124531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:33.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783934+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:11:56.783934+0000","last_peered":"2024-04-30T23:11:56.783934+0000","last_clean":"2024-04-30T23:11:56.783934+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:11:56.783934+0000","last_undegraded":"2024-04-30T23:11:56.783934+0000","last_fullsized":"2024-04-30T23:11:56.783934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781086+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:11:56.781086+0000","last_peered":"2024-04-30T23:11:56.781086+0000","last_clean":"2024-04-30T23:11:56.781086+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:11:56.781086+0000","last_undegraded":"2024-04-30T23:11:56.781086+0000","last_fullsized":"2024-04-30T23:11:56.781086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784276+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:11:56.784276+0000","last_peered":"2024-04-30T23:11:56.784276+0000","last_clean":"2024-04-30T23:11:56.784276+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:11:56.784276+0000","last_undegraded":"2024-04-30T23:11:56.784276+0000","last_fullsized":"2024-04-30T23:11:56.784276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781639+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:11:56.781639+0000","last_peered":"2024-04-30T23:11:56.781639+0000","last_clean":"2024-04-30T23:11:56.781639+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:11:56.781639+0000","last_undegraded":"2024-04-30T23:11:56.781639+0000","last_fullsized":"2024-04-30T23:11:56.781639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779169+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:11:56.779169+0000","last_peered":"2024-04-30T23:11:56.779169+0000","last_clean":"2024-04-30T23:11:56.779169+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:11:56.779169+0000","last_undegraded":"2024-04-30T23:11:56.779169+0000","last_fullsized":"2024-04-30T23:11:56.779169+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.132978+0000","last_change":"2024-04-30T23:11:57.132504+0000","last_active":"2024-04-30T23:11:57.132978+0000","last_peered":"2024-04-30T23:11:57.132978+0000","last_clean":"2024-04-30T23:11:57.132978+0000","last_became_active":"2024-04-30T23:11:57.125899+0000","last_became_peered":"2024-04-30T23:11:57.125899+0000","last_unstale":"2024-04-30T23:11:57.132978+0000","last_undegraded":"2024-04-30T23:11:57.132978+0000","last_fullsized":"2024-04-30T23:11:57.132978+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:16.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784904+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:11:56.784904+0000","last_peered":"2024-04-30T23:11:56.784904+0000","last_clean":"2024-04-30T23:11:56.784904+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:11:56.784904+0000","last_undegraded":"2024-04-30T23:11:56.784904+0000","last_fullsized":"2024-04-30T23:11:56.784904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779170+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:11:56.779170+0000","last_peered":"2024-04-30T23:11:56.779170+0000","last_clean":"2024-04-30T23:11:56.779170+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:56.779170+0000","last_undegraded":"2024-04-30T23:11:56.779170+0000","last_fullsized":"2024-04-30T23:11:56.779170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784092+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:11:56.784092+0000","last_peered":"2024-04-30T23:11:56.784092+0000","last_clean":"2024-04-30T23:11:56.784092+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:11:56.784092+0000","last_undegraded":"2024-04-30T23:11:56.784092+0000","last_fullsized":"2024-04-30T23:11:56.784092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974263+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:11:56.974263+0000","last_peered":"2024-04-30T23:11:56.974263+0000","last_clean":"2024-04-30T23:11:56.974263+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:11:56.974263+0000","last_undegraded":"2024-04-30T23:11:56.974263+0000","last_fullsized":"2024-04-30T23:11:56.974263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.124512+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:11:57.124512+0000","last_peered":"2024-04-30T23:11:57.124512+0000","last_clean":"2024-04-30T23:11:57.124512+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:11:57.124512+0000","last_undegraded":"2024-04-30T23:11:57.124512+0000","last_fullsized":"2024-04-30T23:11:57.124512+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:34.016436+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:12:34.016436+0000","last_peered":"2024-04-30T23:12:34.016436+0000","last_clean":"2024-04-30T23:12:34.016436+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:12:34.016436+0000","last_undegraded":"2024-04-30T23:12:34.016436+0000","last_fullsized":"2024-04-30T23:12:34.016436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974349+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:11:56.974349+0000","last_peered":"2024-04-30T23:11:56.974349+0000","last_clean":"2024-04-30T23:11:56.974349+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:11:56.974349+0000","last_undegraded":"2024-04-30T23:11:56.974349+0000","last_fullsized":"2024-04-30T23:11:56.974349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.125302+0000","last_change":"2024-04-30T23:11:57.125302+0000","last_active":"2024-04-30T23:11:57.125302+0000","last_peered":"2024-04-30T23:11:57.125302+0000","last_clean":"2024-04-30T23:11:57.125302+0000","last_became_active":"2024-04-30T23:11:57.124777+0000","last_became_peered":"2024-04-30T23:11:57.124777+0000","last_unstale":"2024-04-30T23:11:57.125302+0000","last_undegraded":"2024-04-30T23:11:57.125302+0000","last_fullsized":"2024-04-30T23:11:57.125302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:57:20.020845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960608+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:11:56.960608+0000","last_peered":"2024-04-30T23:11:56.960608+0000","last_clean":"2024-04-30T23:11:56.960608+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:11:56.960608+0000","last_undegraded":"2024-04-30T23:11:56.960608+0000","last_fullsized":"2024-04-30T23:11:56.960608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974309+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:11:56.974309+0000","last_peered":"2024-04-30T23:11:56.974309+0000","last_clean":"2024-04-30T23:11:56.974309+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:11:56.974309+0000","last_undegraded":"2024-04-30T23:11:56.974309+0000","last_fullsized":"2024-04-30T23:11:56.974309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959992+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:11:56.959992+0000","last_peered":"2024-04-30T23:11:56.959992+0000","last_clean":"2024-04-30T23:11:56.959992+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:11:56.959992+0000","last_undegraded":"2024-04-30T23:11:56.959992+0000","last_fullsized":"2024-04-30T23:11:56.959992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783136+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:11:56.783136+0000","last_peered":"2024-04-30T23:11:56.783136+0000","last_clean":"2024-04-30T23:11:56.783136+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:11:56.783136+0000","last_undegraded":"2024-04-30T23:11:56.783136+0000","last_fullsized":"2024-04-30T23:11:56.783136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974399+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:11:56.974399+0000","last_peered":"2024-04-30T23:11:56.974399+0000","last_clean":"2024-04-30T23:11:56.974399+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:11:56.974399+0000","last_undegraded":"2024-04-30T23:11:56.974399+0000","last_fullsized":"2024-04-30T23:11:56.974399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781666+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:11:56.781666+0000","last_peered":"2024-04-30T23:11:56.781666+0000","last_clean":"2024-04-30T23:11:56.781666+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:11:56.781666+0000","last_undegraded":"2024-04-30T23:11:56.781666+0000","last_fullsized":"2024-04-30T23:11:56.781666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779217+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:11:56.779217+0000","last_peered":"2024-04-30T23:11:56.779217+0000","last_clean":"2024-04-30T23:11:56.779217+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:11:56.779217+0000","last_undegraded":"2024-04-30T23:11:56.779217+0000","last_fullsized":"2024-04-30T23:11:56.779217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778931+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:11:56.778931+0000","last_peered":"2024-04-30T23:11:56.778931+0000","last_clean":"2024-04-30T23:11:56.778931+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:11:56.778931+0000","last_undegraded":"2024-04-30T23:11:56.778931+0000","last_fullsized":"2024-04-30T23:11:56.778931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784954+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:11:56.784954+0000","last_peered":"2024-04-30T23:11:56.784954+0000","last_clean":"2024-04-30T23:11:56.784954+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:11:56.784954+0000","last_undegraded":"2024-04-30T23:11:56.784954+0000","last_fullsized":"2024-04-30T23:11:56.784954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.787962+0000","last_change":"2024-04-30T23:11:56.787962+0000","last_active":"2024-04-30T23:11:56.787962+0000","last_peered":"2024-04-30T23:11:56.787962+0000","last_clean":"2024-04-30T23:11:56.787962+0000","last_became_active":"2024-04-30T23:11:56.787540+0000","last_became_peered":"2024-04-30T23:11:56.787540+0000","last_unstale":"2024-04-30T23:11:56.787962+0000","last_undegraded":"2024-04-30T23:11:56.787962+0000","last_fullsized":"2024-04-30T23:11:56.787962+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:57:43.364201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782131+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:11:56.782131+0000","last_peered":"2024-04-30T23:11:56.782131+0000","last_clean":"2024-04-30T23:11:56.782131+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:11:56.782131+0000","last_undegraded":"2024-04-30T23:11:56.782131+0000","last_fullsized":"2024-04-30T23:11:56.782131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779520+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:11:56.779520+0000","last_peered":"2024-04-30T23:11:56.779520+0000","last_clean":"2024-04-30T23:11:56.779520+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:11:56.779520+0000","last_undegraded":"2024-04-30T23:11:56.779520+0000","last_fullsized":"2024-04-30T23:11:56.779520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786233+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:11:56.786233+0000","last_peered":"2024-04-30T23:11:56.786233+0000","last_clean":"2024-04-30T23:11:56.786233+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:11:56.786233+0000","last_undegraded":"2024-04-30T23:11:56.786233+0000","last_fullsized":"2024-04-30T23:11:56.786233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959190+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:11:56.959190+0000","last_peered":"2024-04-30T23:11:56.959190+0000","last_clean":"2024-04-30T23:11:56.959190+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:11:56.959190+0000","last_undegraded":"2024-04-30T23:11:56.959190+0000","last_fullsized":"2024-04-30T23:11:56.959190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784379+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:11:56.784379+0000","last_peered":"2024-04-30T23:11:56.784379+0000","last_clean":"2024-04-30T23:11:56.784379+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:11:56.784379+0000","last_undegraded":"2024-04-30T23:11:56.784379+0000","last_fullsized":"2024-04-30T23:11:56.784379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123498+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:11:57.123498+0000","last_peered":"2024-04-30T23:11:57.123498+0000","last_clean":"2024-04-30T23:11:57.123498+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:11:57.123498+0000","last_undegraded":"2024-04-30T23:11:57.123498+0000","last_fullsized":"2024-04-30T23:11:57.123498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783139+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:11:56.783139+0000","last_peered":"2024-04-30T23:11:56.783139+0000","last_clean":"2024-04-30T23:11:56.783139+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:11:56.783139+0000","last_undegraded":"2024-04-30T23:11:56.783139+0000","last_fullsized":"2024-04-30T23:11:56.783139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781993+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:11:56.781993+0000","last_peered":"2024-04-30T23:11:56.781993+0000","last_clean":"2024-04-30T23:11:56.781993+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:11:56.781993+0000","last_undegraded":"2024-04-30T23:11:56.781993+0000","last_fullsized":"2024-04-30T23:11:56.781993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69928,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":736,"num_read_kb":443,"num_write":244,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383712,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":501359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1728512,"data_stored":1150508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":504994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":501276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1650688,"data_stored":1098164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":496402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":559765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":498249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":560767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":500867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1093355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:12:41.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-30T23:12:41.723 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:42.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:41 smithi104 ceph-mon[32987]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:42.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:41 smithi183 ceph-mon[33560]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:42.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:41 smithi100 ceph-mon[29745]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:42.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:42 smithi100 ceph-mon[29745]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:42 smithi104 ceph-mon[32987]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:42 smithi183 ceph-mon[33560]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:43.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 -- 172.21.15.100:0/1854820098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0108e20 msgr2=0x7f48e0109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/1854820098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0108e20 0x7f48e0109230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48c80099c0 tx=0x7f48c8009cd0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 -- 172.21.15.100:0/1854820098 shutdown_connections 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/1854820098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e0109770 0x7f48e01110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/1854820098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e01044f0 0x7f48e0104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/1854820098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0108e20 0x7f48e0109230 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 -- 172.21.15.100:0/1854820098 >> 172.21.15.100:0/1854820098 conn(0x7f48e00ffe00 msgr2=0x7f48e0102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 -- 172.21.15.100:0/1854820098 shutdown_connections 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.425+0000 7f48e5a0a700 1 -- 172.21.15.100:0/1854820098 wait complete. 2024-04-30T23:12:43.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.426+0000 7f48e5a0a700 1 Processor -- start 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.426+0000 7f48e5a0a700 1 -- start start 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.426+0000 7f48e5a0a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e01044f0 0x7f48e019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e0108e20 0x7f48e019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48e01143a0 con 0x7f48e0109770 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0114220 con 0x7f48e0108e20 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0114520 con 0x7f48e01044f0 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50232/0 (socket says 172.21.15.100:50232) 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 -- 172.21.15.100:0/2688440077 learned_addr learned my addr 172.21.15.100:0/2688440077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48deffd700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e01044f0 0x7f48e019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:43.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48d67fc700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e0108e20 0x7f48e019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 -- 172.21.15.100:0/2688440077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e01044f0 msgr2=0x7f48e019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e01044f0 0x7f48e019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 -- 172.21.15.100:0/2688440077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e0108e20 msgr2=0x7f48e019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e0108e20 0x7f48e019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 -- 172.21.15.100:0/2688440077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e019fb90 con 0x7f48e0109770 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48df7fe700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48d800ada0 tx=0x7f48d800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8017020 con 0x7f48e0109770 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e019fe80 con 0x7f48e0109770 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48d800ce30 con 0x7f48e0109770 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8005350 con 0x7f48e0109770 2024-04-30T23:12:43.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.427+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e01a03e0 con 0x7f48e0109770 2024-04-30T23:12:43.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.428+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e00511d0 con 0x7f48e0109770 2024-04-30T23:12:43.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.430+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f48d800c980 con 0x7f48e0109770 2024-04-30T23:12:43.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.430+0000 7f48e4a08700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 0x7f48cc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:43.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.431+0000 7f48deffd700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 0x7f48cc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:43.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.431+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f48d80d0510 con 0x7f48e0109770 2024-04-30T23:12:43.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.431+0000 7f48deffd700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 0x7f48cc0a61e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ac50 tx=0x7f48d000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:43.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.434+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f48d8021020 con 0x7f48e0109770 2024-04-30T23:12:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.629+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48e0063b10 con 0x7f48cc0a3cd0 2024-04-30T23:12:43.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.638+0000 7f48e4a08700 1 -- 172.21.15.100:0/2688440077 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340404 (secure 0 0 0) 0x7f48e0063b10 con 0x7f48cc0a3cd0 2024-04-30T23:12:43.643 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:43.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 msgr2=0x7f48cc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:43.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 0x7f48cc0a61e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ac50 tx=0x7f48d000a380 comp rx=0 tx=0).stop 2024-04-30T23:12:43.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 msgr2=0x7f48e019f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:43.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48d800ada0 tx=0x7f48d800c330 comp rx=0 tx=0).stop 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 shutdown_connections 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48cc0a3cd0 0x7f48cc0a61e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48e0109770 0x7f48e019f5a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e01044f0 0x7f48e019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 --2- 172.21.15.100:0/2688440077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e0108e20 0x7f48e019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 >> 172.21.15.100:0/2688440077 conn(0x7f48e00ffe00 msgr2=0x7f48e010a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 shutdown_connections 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:43.641+0000 7f48e5a0a700 1 -- 172.21.15.100:0/2688440077 wait complete. 2024-04-30T23:12:43.646 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:12:44.445 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-04-30T23:12:43.609338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660530,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":902,"num_read_kb":572,"num_write":427,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388416,"kb_used_data":14240,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553408,"statfs":{"total":1151940427776,"available":1151542689792,"internally_reserved":0,"allocated":14581760,"data_stored":7961816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004187"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782900+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:11:56.782900+0000","last_peered":"2024-04-30T23:11:56.782900+0000","last_clean":"2024-04-30T23:11:56.782900+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:11:56.782900+0000","last_undegraded":"2024-04-30T23:11:56.782900+0000","last_fullsized":"2024-04-30T23:11:56.782900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783427+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:11:56.783427+0000","last_peered":"2024-04-30T23:11:56.783427+0000","last_clean":"2024-04-30T23:11:56.783427+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:11:56.783427+0000","last_undegraded":"2024-04-30T23:11:56.783427+0000","last_fullsized":"2024-04-30T23:11:56.783427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784038+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:11:56.784038+0000","last_peered":"2024-04-30T23:11:56.784038+0000","last_clean":"2024-04-30T23:11:56.784038+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:11:56.784038+0000","last_undegraded":"2024-04-30T23:11:56.784038+0000","last_fullsized":"2024-04-30T23:11:56.784038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779686+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:11:56.779686+0000","last_peered":"2024-04-30T23:11:56.779686+0000","last_clean":"2024-04-30T23:11:56.779686+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:11:56.779686+0000","last_undegraded":"2024-04-30T23:11:56.779686+0000","last_fullsized":"2024-04-30T23:11:56.779686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784127+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:11:56.784127+0000","last_peered":"2024-04-30T23:11:56.784127+0000","last_clean":"2024-04-30T23:11:56.784127+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:11:56.784127+0000","last_undegraded":"2024-04-30T23:11:56.784127+0000","last_fullsized":"2024-04-30T23:11:56.784127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955592+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:11:56.955592+0000","last_peered":"2024-04-30T23:11:56.955592+0000","last_clean":"2024-04-30T23:11:56.955592+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:11:56.955592+0000","last_undegraded":"2024-04-30T23:11:56.955592+0000","last_fullsized":"2024-04-30T23:11:56.955592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974263+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:11:56.974263+0000","last_peered":"2024-04-30T23:11:56.974263+0000","last_clean":"2024-04-30T23:11:56.974263+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:11:56.974263+0000","last_undegraded":"2024-04-30T23:11:56.974263+0000","last_fullsized":"2024-04-30T23:11:56.974263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783859+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:11:56.783859+0000","last_peered":"2024-04-30T23:11:56.783859+0000","last_clean":"2024-04-30T23:11:56.783859+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:11:56.783859+0000","last_undegraded":"2024-04-30T23:11:56.783859+0000","last_fullsized":"2024-04-30T23:11:56.783859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123909+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:11:57.123909+0000","last_peered":"2024-04-30T23:11:57.123909+0000","last_clean":"2024-04-30T23:11:57.123909+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:11:57.123909+0000","last_undegraded":"2024-04-30T23:11:57.123909+0000","last_fullsized":"2024-04-30T23:11:57.123909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955728+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:11:56.955728+0000","last_peered":"2024-04-30T23:11:56.955728+0000","last_clean":"2024-04-30T23:11:56.955728+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:11:56.955728+0000","last_undegraded":"2024-04-30T23:11:56.955728+0000","last_fullsized":"2024-04-30T23:11:56.955728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974444+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:11:56.974444+0000","last_peered":"2024-04-30T23:11:56.974444+0000","last_clean":"2024-04-30T23:11:56.974444+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:11:56.974444+0000","last_undegraded":"2024-04-30T23:11:56.974444+0000","last_fullsized":"2024-04-30T23:11:56.974444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779552+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:11:56.779552+0000","last_peered":"2024-04-30T23:11:56.779552+0000","last_clean":"2024-04-30T23:11:56.779552+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:11:56.779552+0000","last_undegraded":"2024-04-30T23:11:56.779552+0000","last_fullsized":"2024-04-30T23:11:56.779552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783004+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:11:56.783004+0000","last_peered":"2024-04-30T23:11:56.783004+0000","last_clean":"2024-04-30T23:11:56.783004+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:11:56.783004+0000","last_undegraded":"2024-04-30T23:11:56.783004+0000","last_fullsized":"2024-04-30T23:11:56.783004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782228+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:11:56.782228+0000","last_peered":"2024-04-30T23:11:56.782228+0000","last_clean":"2024-04-30T23:11:56.782228+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:11:56.782228+0000","last_undegraded":"2024-04-30T23:11:56.782228+0000","last_fullsized":"2024-04-30T23:11:56.782228+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783814+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:11:56.783814+0000","last_peered":"2024-04-30T23:11:56.783814+0000","last_clean":"2024-04-30T23:11:56.783814+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:11:56.783814+0000","last_undegraded":"2024-04-30T23:11:56.783814+0000","last_fullsized":"2024-04-30T23:11:56.783814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123453+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:11:57.123453+0000","last_peered":"2024-04-30T23:11:57.123453+0000","last_clean":"2024-04-30T23:11:57.123453+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:11:57.123453+0000","last_undegraded":"2024-04-30T23:11:57.123453+0000","last_fullsized":"2024-04-30T23:11:57.123453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782670+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:11:56.782670+0000","last_peered":"2024-04-30T23:11:56.782670+0000","last_clean":"2024-04-30T23:11:56.782670+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:11:56.782670+0000","last_undegraded":"2024-04-30T23:11:56.782670+0000","last_fullsized":"2024-04-30T23:11:56.782670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780732+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:11:56.780732+0000","last_peered":"2024-04-30T23:11:56.780732+0000","last_clean":"2024-04-30T23:11:56.780732+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:11:56.780732+0000","last_undegraded":"2024-04-30T23:11:56.780732+0000","last_fullsized":"2024-04-30T23:11:56.780732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779589+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:11:56.779589+0000","last_peered":"2024-04-30T23:11:56.779589+0000","last_clean":"2024-04-30T23:11:56.779589+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:11:56.779589+0000","last_undegraded":"2024-04-30T23:11:56.779589+0000","last_fullsized":"2024-04-30T23:11:56.779589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779228+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:11:56.779228+0000","last_peered":"2024-04-30T23:11:56.779228+0000","last_clean":"2024-04-30T23:11:56.779228+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:11:56.779228+0000","last_undegraded":"2024-04-30T23:11:56.779228+0000","last_fullsized":"2024-04-30T23:11:56.779228+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:37.028423+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:12:37.028423+0000","last_peered":"2024-04-30T23:12:37.028423+0000","last_clean":"2024-04-30T23:12:37.028423+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:12:37.028423+0000","last_undegraded":"2024-04-30T23:12:37.028423+0000","last_fullsized":"2024-04-30T23:12:37.028423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.962242+0000","last_change":"2024-04-30T23:11:56.961809+0000","last_active":"2024-04-30T23:11:56.962242+0000","last_peered":"2024-04-30T23:11:56.962242+0000","last_clean":"2024-04-30T23:11:56.962242+0000","last_became_active":"2024-04-30T23:11:56.961461+0000","last_became_peered":"2024-04-30T23:11:56.961461+0000","last_unstale":"2024-04-30T23:11:56.962242+0000","last_undegraded":"2024-04-30T23:11:56.962242+0000","last_fullsized":"2024-04-30T23:11:56.962242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:41:28.814142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778931+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:11:56.778931+0000","last_peered":"2024-04-30T23:11:56.778931+0000","last_clean":"2024-04-30T23:11:56.778931+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:56.778931+0000","last_undegraded":"2024-04-30T23:11:56.778931+0000","last_fullsized":"2024-04-30T23:11:56.778931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786661+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:11:56.786661+0000","last_peered":"2024-04-30T23:11:56.786661+0000","last_clean":"2024-04-30T23:11:56.786661+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:11:56.786661+0000","last_undegraded":"2024-04-30T23:11:56.786661+0000","last_fullsized":"2024-04-30T23:11:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784186+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:11:56.784186+0000","last_peered":"2024-04-30T23:11:56.784186+0000","last_clean":"2024-04-30T23:11:56.784186+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:11:56.784186+0000","last_undegraded":"2024-04-30T23:11:56.784186+0000","last_fullsized":"2024-04-30T23:11:56.784186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.961194+0000","last_change":"2024-04-30T23:11:56.961194+0000","last_active":"2024-04-30T23:11:56.961194+0000","last_peered":"2024-04-30T23:11:56.961194+0000","last_clean":"2024-04-30T23:11:56.961194+0000","last_became_active":"2024-04-30T23:11:56.960793+0000","last_became_peered":"2024-04-30T23:11:56.960793+0000","last_unstale":"2024-04-30T23:11:56.961194+0000","last_undegraded":"2024-04-30T23:11:56.961194+0000","last_fullsized":"2024-04-30T23:11:56.961194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:44:07.845730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784581+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:11:56.784581+0000","last_peered":"2024-04-30T23:11:56.784581+0000","last_clean":"2024-04-30T23:11:56.784581+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:11:56.784581+0000","last_undegraded":"2024-04-30T23:11:56.784581+0000","last_fullsized":"2024-04-30T23:11:56.784581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123730+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:11:57.123730+0000","last_peered":"2024-04-30T23:11:57.123730+0000","last_clean":"2024-04-30T23:11:57.123730+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:11:57.123730+0000","last_undegraded":"2024-04-30T23:11:57.123730+0000","last_fullsized":"2024-04-30T23:11:57.123730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778994+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:11:56.778994+0000","last_peered":"2024-04-30T23:11:56.778994+0000","last_clean":"2024-04-30T23:11:56.778994+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:11:56.778994+0000","last_undegraded":"2024-04-30T23:11:56.778994+0000","last_fullsized":"2024-04-30T23:11:56.778994+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784441+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:11:56.784441+0000","last_peered":"2024-04-30T23:11:56.784441+0000","last_clean":"2024-04-30T23:11:56.784441+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:11:56.784441+0000","last_undegraded":"2024-04-30T23:11:56.784441+0000","last_fullsized":"2024-04-30T23:11:56.784441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959462+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:11:56.959462+0000","last_peered":"2024-04-30T23:11:56.959462+0000","last_clean":"2024-04-30T23:11:56.959462+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:11:56.959462+0000","last_undegraded":"2024-04-30T23:11:56.959462+0000","last_fullsized":"2024-04-30T23:11:56.959462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779321+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:11:56.779321+0000","last_peered":"2024-04-30T23:11:56.779321+0000","last_clean":"2024-04-30T23:11:56.779321+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:11:56.779321+0000","last_undegraded":"2024-04-30T23:11:56.779321+0000","last_fullsized":"2024-04-30T23:11:56.779321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":113,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:42.029178+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:12:42.029178+0000","last_peered":"2024-04-30T23:12:42.029178+0000","last_clean":"2024-04-30T23:12:42.029178+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:12:42.029178+0000","last_undegraded":"2024-04-30T23:12:42.029178+0000","last_fullsized":"2024-04-30T23:12:42.029178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784192+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:11:56.784192+0000","last_peered":"2024-04-30T23:11:56.784192+0000","last_clean":"2024-04-30T23:11:56.784192+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:11:56.784192+0000","last_undegraded":"2024-04-30T23:11:56.784192+0000","last_fullsized":"2024-04-30T23:11:56.784192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779012+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:11:56.779012+0000","last_peered":"2024-04-30T23:11:56.779012+0000","last_clean":"2024-04-30T23:11:56.779012+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:11:56.779012+0000","last_undegraded":"2024-04-30T23:11:56.779012+0000","last_fullsized":"2024-04-30T23:11:56.779012+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.956272+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:11:56.956272+0000","last_peered":"2024-04-30T23:11:56.956272+0000","last_clean":"2024-04-30T23:11:56.956272+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:11:56.956272+0000","last_undegraded":"2024-04-30T23:11:56.956272+0000","last_fullsized":"2024-04-30T23:11:56.956272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786946+0000","last_change":"2024-04-30T23:11:56.786296+0000","last_active":"2024-04-30T23:11:56.786946+0000","last_peered":"2024-04-30T23:11:56.786946+0000","last_clean":"2024-04-30T23:11:56.786946+0000","last_became_active":"2024-04-30T23:11:56.785834+0000","last_became_peered":"2024-04-30T23:11:56.785834+0000","last_unstale":"2024-04-30T23:11:56.786946+0000","last_undegraded":"2024-04-30T23:11:56.786946+0000","last_fullsized":"2024-04-30T23:11:56.786946+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:33.908301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782539+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:11:56.782539+0000","last_peered":"2024-04-30T23:11:56.782539+0000","last_clean":"2024-04-30T23:11:56.782539+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:11:56.782539+0000","last_undegraded":"2024-04-30T23:11:56.782539+0000","last_fullsized":"2024-04-30T23:11:56.782539+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784802+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:11:56.784802+0000","last_peered":"2024-04-30T23:11:56.784802+0000","last_clean":"2024-04-30T23:11:56.784802+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:11:56.784802+0000","last_undegraded":"2024-04-30T23:11:56.784802+0000","last_fullsized":"2024-04-30T23:11:56.784802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783764+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:11:56.783764+0000","last_peered":"2024-04-30T23:11:56.783764+0000","last_clean":"2024-04-30T23:11:56.783764+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:11:56.783764+0000","last_undegraded":"2024-04-30T23:11:56.783764+0000","last_fullsized":"2024-04-30T23:11:56.783764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783310+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:11:56.783310+0000","last_peered":"2024-04-30T23:11:56.783310+0000","last_clean":"2024-04-30T23:11:56.783310+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:11:56.783310+0000","last_undegraded":"2024-04-30T23:11:56.783310+0000","last_fullsized":"2024-04-30T23:11:56.783310+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960272+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:11:56.960272+0000","last_peered":"2024-04-30T23:11:56.960272+0000","last_clean":"2024-04-30T23:11:56.960272+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:11:56.960272+0000","last_undegraded":"2024-04-30T23:11:56.960272+0000","last_fullsized":"2024-04-30T23:11:56.960272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781215+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:11:56.781215+0000","last_peered":"2024-04-30T23:11:56.781215+0000","last_clean":"2024-04-30T23:11:56.781215+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:11:56.781215+0000","last_undegraded":"2024-04-30T23:11:56.781215+0000","last_fullsized":"2024-04-30T23:11:56.781215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784167+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:11:56.784167+0000","last_peered":"2024-04-30T23:11:56.784167+0000","last_clean":"2024-04-30T23:11:56.784167+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:11:56.784167+0000","last_undegraded":"2024-04-30T23:11:56.784167+0000","last_fullsized":"2024-04-30T23:11:56.784167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:39.023895+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:12:39.023895+0000","last_peered":"2024-04-30T23:12:39.023895+0000","last_clean":"2024-04-30T23:12:39.023895+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:12:39.023895+0000","last_undegraded":"2024-04-30T23:12:39.023895+0000","last_fullsized":"2024-04-30T23:12:39.023895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":146,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123604+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:11:57.123604+0000","last_peered":"2024-04-30T23:11:57.123604+0000","last_clean":"2024-04-30T23:11:57.123604+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:11:57.123604+0000","last_undegraded":"2024-04-30T23:11:57.123604+0000","last_fullsized":"2024-04-30T23:11:57.123604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780807+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:11:56.780807+0000","last_peered":"2024-04-30T23:11:56.780807+0000","last_clean":"2024-04-30T23:11:56.780807+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:11:56.780807+0000","last_undegraded":"2024-04-30T23:11:56.780807+0000","last_fullsized":"2024-04-30T23:11:56.780807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.975125+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:11:56.975125+0000","last_peered":"2024-04-30T23:11:56.975125+0000","last_clean":"2024-04-30T23:11:56.975125+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:11:56.975125+0000","last_undegraded":"2024-04-30T23:11:56.975125+0000","last_fullsized":"2024-04-30T23:11:56.975125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784317+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:11:56.784317+0000","last_peered":"2024-04-30T23:11:56.784317+0000","last_clean":"2024-04-30T23:11:56.784317+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:11:56.784317+0000","last_undegraded":"2024-04-30T23:11:56.784317+0000","last_fullsized":"2024-04-30T23:11:56.784317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779686+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:11:56.779686+0000","last_peered":"2024-04-30T23:11:56.779686+0000","last_clean":"2024-04-30T23:11:56.779686+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:11:56.779686+0000","last_undegraded":"2024-04-30T23:11:56.779686+0000","last_fullsized":"2024-04-30T23:11:56.779686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960738+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:11:56.960738+0000","last_peered":"2024-04-30T23:11:56.960738+0000","last_clean":"2024-04-30T23:11:56.960738+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:11:56.960738+0000","last_undegraded":"2024-04-30T23:11:56.960738+0000","last_fullsized":"2024-04-30T23:11:56.960738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123522+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:11:57.123522+0000","last_peered":"2024-04-30T23:11:57.123522+0000","last_clean":"2024-04-30T23:11:57.123522+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:11:57.123522+0000","last_undegraded":"2024-04-30T23:11:57.123522+0000","last_fullsized":"2024-04-30T23:11:57.123522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781181+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:11:56.781181+0000","last_peered":"2024-04-30T23:11:56.781181+0000","last_clean":"2024-04-30T23:11:56.781181+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:11:56.781181+0000","last_undegraded":"2024-04-30T23:11:56.781181+0000","last_fullsized":"2024-04-30T23:11:56.781181+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:39.032104+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:12:39.032104+0000","last_peered":"2024-04-30T23:12:39.032104+0000","last_clean":"2024-04-30T23:12:39.032104+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:12:39.032104+0000","last_undegraded":"2024-04-30T23:12:39.032104+0000","last_fullsized":"2024-04-30T23:12:39.032104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62333,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784384+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:11:56.784384+0000","last_peered":"2024-04-30T23:11:56.784384+0000","last_clean":"2024-04-30T23:11:56.784384+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:11:56.784384+0000","last_undegraded":"2024-04-30T23:11:56.784384+0000","last_fullsized":"2024-04-30T23:11:56.784384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.961010+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:11:56.961010+0000","last_peered":"2024-04-30T23:11:56.961010+0000","last_clean":"2024-04-30T23:11:56.961010+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:11:56.961010+0000","last_undegraded":"2024-04-30T23:11:56.961010+0000","last_fullsized":"2024-04-30T23:11:56.961010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779800+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:11:56.779800+0000","last_peered":"2024-04-30T23:11:56.779800+0000","last_clean":"2024-04-30T23:11:56.779800+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:11:56.779800+0000","last_undegraded":"2024-04-30T23:11:56.779800+0000","last_fullsized":"2024-04-30T23:11:56.779800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.785156+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:11:56.785156+0000","last_peered":"2024-04-30T23:11:56.785156+0000","last_clean":"2024-04-30T23:11:56.785156+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:11:56.785156+0000","last_undegraded":"2024-04-30T23:11:56.785156+0000","last_fullsized":"2024-04-30T23:11:56.785156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781810+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:11:56.781810+0000","last_peered":"2024-04-30T23:11:56.781810+0000","last_clean":"2024-04-30T23:11:56.781810+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:11:56.781810+0000","last_undegraded":"2024-04-30T23:11:56.781810+0000","last_fullsized":"2024-04-30T23:11:56.781810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960426+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:11:56.960426+0000","last_peered":"2024-04-30T23:11:56.960426+0000","last_clean":"2024-04-30T23:11:56.960426+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:11:56.960426+0000","last_undegraded":"2024-04-30T23:11:56.960426+0000","last_fullsized":"2024-04-30T23:11:56.960426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974305+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:11:56.974305+0000","last_peered":"2024-04-30T23:11:56.974305+0000","last_clean":"2024-04-30T23:11:56.974305+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:11:56.974305+0000","last_undegraded":"2024-04-30T23:11:56.974305+0000","last_fullsized":"2024-04-30T23:11:56.974305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.780962+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:11:56.780962+0000","last_peered":"2024-04-30T23:11:56.780962+0000","last_clean":"2024-04-30T23:11:56.780962+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:11:56.780962+0000","last_undegraded":"2024-04-30T23:11:56.780962+0000","last_fullsized":"2024-04-30T23:11:56.780962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:38.018274+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:12:38.018274+0000","last_peered":"2024-04-30T23:12:38.018274+0000","last_clean":"2024-04-30T23:12:38.018274+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:12:38.018274+0000","last_undegraded":"2024-04-30T23:12:38.018274+0000","last_fullsized":"2024-04-30T23:12:38.018274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974808+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:11:56.974808+0000","last_peered":"2024-04-30T23:11:56.974808+0000","last_clean":"2024-04-30T23:11:56.974808+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:11:56.974808+0000","last_undegraded":"2024-04-30T23:11:56.974808+0000","last_fullsized":"2024-04-30T23:11:56.974808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783026+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:11:56.783026+0000","last_peered":"2024-04-30T23:11:56.783026+0000","last_clean":"2024-04-30T23:11:56.783026+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:11:56.783026+0000","last_undegraded":"2024-04-30T23:11:56.783026+0000","last_fullsized":"2024-04-30T23:11:56.783026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783924+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:11:56.783924+0000","last_peered":"2024-04-30T23:11:56.783924+0000","last_clean":"2024-04-30T23:11:56.783924+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:11:56.783924+0000","last_undegraded":"2024-04-30T23:11:56.783924+0000","last_fullsized":"2024-04-30T23:11:56.783924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959062+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:11:56.959062+0000","last_peered":"2024-04-30T23:11:56.959062+0000","last_clean":"2024-04-30T23:11:56.959062+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:11:56.959062+0000","last_undegraded":"2024-04-30T23:11:56.959062+0000","last_fullsized":"2024-04-30T23:11:56.959062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959699+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:11:56.959699+0000","last_peered":"2024-04-30T23:11:56.959699+0000","last_clean":"2024-04-30T23:11:56.959699+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:11:56.959699+0000","last_undegraded":"2024-04-30T23:11:56.959699+0000","last_fullsized":"2024-04-30T23:11:56.959699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784453+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:11:56.784453+0000","last_peered":"2024-04-30T23:11:56.784453+0000","last_clean":"2024-04-30T23:11:56.784453+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:11:56.784453+0000","last_undegraded":"2024-04-30T23:11:56.784453+0000","last_fullsized":"2024-04-30T23:11:56.784453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782117+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:11:56.782117+0000","last_peered":"2024-04-30T23:11:56.782117+0000","last_clean":"2024-04-30T23:11:56.782117+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:11:56.782117+0000","last_undegraded":"2024-04-30T23:11:56.782117+0000","last_fullsized":"2024-04-30T23:11:56.782117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784102+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:11:56.784102+0000","last_peered":"2024-04-30T23:11:56.784102+0000","last_clean":"2024-04-30T23:11:56.784102+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:11:56.784102+0000","last_undegraded":"2024-04-30T23:11:56.784102+0000","last_fullsized":"2024-04-30T23:11:56.784102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781086+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:11:56.781086+0000","last_peered":"2024-04-30T23:11:56.781086+0000","last_clean":"2024-04-30T23:11:56.781086+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:11:56.781086+0000","last_undegraded":"2024-04-30T23:11:56.781086+0000","last_fullsized":"2024-04-30T23:11:56.781086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955712+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:11:56.955712+0000","last_peered":"2024-04-30T23:11:56.955712+0000","last_clean":"2024-04-30T23:11:56.955712+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:11:56.955712+0000","last_undegraded":"2024-04-30T23:11:56.955712+0000","last_fullsized":"2024-04-30T23:11:56.955712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783997+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:11:56.783997+0000","last_peered":"2024-04-30T23:11:56.783997+0000","last_clean":"2024-04-30T23:11:56.783997+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:11:56.783997+0000","last_undegraded":"2024-04-30T23:11:56.783997+0000","last_fullsized":"2024-04-30T23:11:56.783997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:39.032073+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:12:39.032073+0000","last_peered":"2024-04-30T23:12:39.032073+0000","last_clean":"2024-04-30T23:12:39.032073+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:12:39.032073+0000","last_undegraded":"2024-04-30T23:12:39.032073+0000","last_fullsized":"2024-04-30T23:12:39.032073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.955739+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:11:56.955739+0000","last_peered":"2024-04-30T23:11:56.955739+0000","last_clean":"2024-04-30T23:11:56.955739+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:11:56.955739+0000","last_undegraded":"2024-04-30T23:11:56.955739+0000","last_fullsized":"2024-04-30T23:11:56.955739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783093+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:11:56.783093+0000","last_peered":"2024-04-30T23:11:56.783093+0000","last_clean":"2024-04-30T23:11:56.783093+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:11:56.783093+0000","last_undegraded":"2024-04-30T23:11:56.783093+0000","last_fullsized":"2024-04-30T23:11:56.783093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959008+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:11:56.959008+0000","last_peered":"2024-04-30T23:11:56.959008+0000","last_clean":"2024-04-30T23:11:56.959008+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:11:56.959008+0000","last_undegraded":"2024-04-30T23:11:56.959008+0000","last_fullsized":"2024-04-30T23:11:56.959008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:39.019083+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:12:39.019083+0000","last_peered":"2024-04-30T23:12:39.019083+0000","last_clean":"2024-04-30T23:12:39.019083+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:12:39.019083+0000","last_undegraded":"2024-04-30T23:12:39.019083+0000","last_fullsized":"2024-04-30T23:12:39.019083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974995+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:11:56.974995+0000","last_peered":"2024-04-30T23:11:56.974995+0000","last_clean":"2024-04-30T23:11:56.974995+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:11:56.974995+0000","last_undegraded":"2024-04-30T23:11:56.974995+0000","last_fullsized":"2024-04-30T23:11:56.974995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784427+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:11:56.784427+0000","last_peered":"2024-04-30T23:11:56.784427+0000","last_clean":"2024-04-30T23:11:56.784427+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:11:56.784427+0000","last_undegraded":"2024-04-30T23:11:56.784427+0000","last_fullsized":"2024-04-30T23:11:56.784427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779558+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:11:56.779558+0000","last_peered":"2024-04-30T23:11:56.779558+0000","last_clean":"2024-04-30T23:11:56.779558+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:11:56.779558+0000","last_undegraded":"2024-04-30T23:11:56.779558+0000","last_fullsized":"2024-04-30T23:11:56.779558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974691+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:11:56.974691+0000","last_peered":"2024-04-30T23:11:56.974691+0000","last_clean":"2024-04-30T23:11:56.974691+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:11:56.974691+0000","last_undegraded":"2024-04-30T23:11:56.974691+0000","last_fullsized":"2024-04-30T23:11:56.974691+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960926+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:11:56.960926+0000","last_peered":"2024-04-30T23:11:56.960926+0000","last_clean":"2024-04-30T23:11:56.960926+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:11:56.960926+0000","last_undegraded":"2024-04-30T23:11:56.960926+0000","last_fullsized":"2024-04-30T23:11:56.960926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784564+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:11:56.784564+0000","last_peered":"2024-04-30T23:11:56.784564+0000","last_clean":"2024-04-30T23:11:56.784564+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:11:56.784564+0000","last_undegraded":"2024-04-30T23:11:56.784564+0000","last_fullsized":"2024-04-30T23:11:56.784564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974759+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:11:56.974759+0000","last_peered":"2024-04-30T23:11:56.974759+0000","last_clean":"2024-04-30T23:11:56.974759+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:11:56.974759+0000","last_undegraded":"2024-04-30T23:11:56.974759+0000","last_fullsized":"2024-04-30T23:11:56.974759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.976706+0000","last_change":"2024-04-30T23:11:56.976706+0000","last_active":"2024-04-30T23:11:56.976706+0000","last_peered":"2024-04-30T23:11:56.976706+0000","last_clean":"2024-04-30T23:11:56.976706+0000","last_became_active":"2024-04-30T23:11:56.976251+0000","last_became_peered":"2024-04-30T23:11:56.976251+0000","last_unstale":"2024-04-30T23:11:56.976706+0000","last_undegraded":"2024-04-30T23:11:56.976706+0000","last_fullsized":"2024-04-30T23:11:56.976706+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:12.294435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784474+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:11:56.784474+0000","last_peered":"2024-04-30T23:11:56.784474+0000","last_clean":"2024-04-30T23:11:56.784474+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:11:56.784474+0000","last_undegraded":"2024-04-30T23:11:56.784474+0000","last_fullsized":"2024-04-30T23:11:56.784474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784181+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:11:56.784181+0000","last_peered":"2024-04-30T23:11:56.784181+0000","last_clean":"2024-04-30T23:11:56.784181+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:11:56.784181+0000","last_undegraded":"2024-04-30T23:11:56.784181+0000","last_fullsized":"2024-04-30T23:11:56.784181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783646+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:11:56.783646+0000","last_peered":"2024-04-30T23:11:56.783646+0000","last_clean":"2024-04-30T23:11:56.783646+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:11:56.783646+0000","last_undegraded":"2024-04-30T23:11:56.783646+0000","last_fullsized":"2024-04-30T23:11:56.783646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781002+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:11:56.781002+0000","last_peered":"2024-04-30T23:11:56.781002+0000","last_clean":"2024-04-30T23:11:56.781002+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:11:56.781002+0000","last_undegraded":"2024-04-30T23:11:56.781002+0000","last_fullsized":"2024-04-30T23:11:56.781002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786064+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:11:56.786064+0000","last_peered":"2024-04-30T23:11:56.786064+0000","last_clean":"2024-04-30T23:11:56.786064+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:11:56.786064+0000","last_undegraded":"2024-04-30T23:11:56.786064+0000","last_fullsized":"2024-04-30T23:11:56.786064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778793+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:11:56.778793+0000","last_peered":"2024-04-30T23:11:56.778793+0000","last_clean":"2024-04-30T23:11:56.778793+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:11:56.778793+0000","last_undegraded":"2024-04-30T23:11:56.778793+0000","last_fullsized":"2024-04-30T23:11:56.778793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779465+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:11:56.779465+0000","last_peered":"2024-04-30T23:11:56.779465+0000","last_clean":"2024-04-30T23:11:56.779465+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:11:56.779465+0000","last_undegraded":"2024-04-30T23:11:56.779465+0000","last_fullsized":"2024-04-30T23:11:56.779465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.787447+0000","last_change":"2024-04-30T23:11:56.787447+0000","last_active":"2024-04-30T23:11:56.787447+0000","last_peered":"2024-04-30T23:11:56.787447+0000","last_clean":"2024-04-30T23:11:56.787447+0000","last_became_active":"2024-04-30T23:11:56.786482+0000","last_became_peered":"2024-04-30T23:11:56.786482+0000","last_unstale":"2024-04-30T23:11:56.787447+0000","last_undegraded":"2024-04-30T23:11:56.787447+0000","last_fullsized":"2024-04-30T23:11:56.787447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:40.441920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.962145+0000","last_change":"2024-04-30T23:11:56.962145+0000","last_active":"2024-04-30T23:11:56.962145+0000","last_peered":"2024-04-30T23:11:56.962145+0000","last_clean":"2024-04-30T23:11:56.962145+0000","last_became_active":"2024-04-30T23:11:56.961737+0000","last_became_peered":"2024-04-30T23:11:56.961737+0000","last_unstale":"2024-04-30T23:11:56.962145+0000","last_undegraded":"2024-04-30T23:11:56.962145+0000","last_fullsized":"2024-04-30T23:11:56.962145+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:27:04.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.124531+0000","last_change":"2024-04-30T23:10:59.894525+0000","last_active":"2024-04-30T23:11:57.124531+0000","last_peered":"2024-04-30T23:11:57.124531+0000","last_clean":"2024-04-30T23:11:57.124531+0000","last_became_active":"2024-04-30T23:10:59.894274+0000","last_became_peered":"2024-04-30T23:10:59.894274+0000","last_unstale":"2024-04-30T23:11:57.124531+0000","last_undegraded":"2024-04-30T23:11:57.124531+0000","last_fullsized":"2024-04-30T23:11:57.124531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:33.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783934+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:11:56.783934+0000","last_peered":"2024-04-30T23:11:56.783934+0000","last_clean":"2024-04-30T23:11:56.783934+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:11:56.783934+0000","last_undegraded":"2024-04-30T23:11:56.783934+0000","last_fullsized":"2024-04-30T23:11:56.783934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781086+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:11:56.781086+0000","last_peered":"2024-04-30T23:11:56.781086+0000","last_clean":"2024-04-30T23:11:56.781086+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:11:56.781086+0000","last_undegraded":"2024-04-30T23:11:56.781086+0000","last_fullsized":"2024-04-30T23:11:56.781086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784276+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:11:56.784276+0000","last_peered":"2024-04-30T23:11:56.784276+0000","last_clean":"2024-04-30T23:11:56.784276+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:11:56.784276+0000","last_undegraded":"2024-04-30T23:11:56.784276+0000","last_fullsized":"2024-04-30T23:11:56.784276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781639+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:11:56.781639+0000","last_peered":"2024-04-30T23:11:56.781639+0000","last_clean":"2024-04-30T23:11:56.781639+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:11:56.781639+0000","last_undegraded":"2024-04-30T23:11:56.781639+0000","last_fullsized":"2024-04-30T23:11:56.781639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779169+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:11:56.779169+0000","last_peered":"2024-04-30T23:11:56.779169+0000","last_clean":"2024-04-30T23:11:56.779169+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:11:56.779169+0000","last_undegraded":"2024-04-30T23:11:56.779169+0000","last_fullsized":"2024-04-30T23:11:56.779169+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.132978+0000","last_change":"2024-04-30T23:11:57.132504+0000","last_active":"2024-04-30T23:11:57.132978+0000","last_peered":"2024-04-30T23:11:57.132978+0000","last_clean":"2024-04-30T23:11:57.132978+0000","last_became_active":"2024-04-30T23:11:57.125899+0000","last_became_peered":"2024-04-30T23:11:57.125899+0000","last_unstale":"2024-04-30T23:11:57.132978+0000","last_undegraded":"2024-04-30T23:11:57.132978+0000","last_fullsized":"2024-04-30T23:11:57.132978+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:16.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784904+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:11:56.784904+0000","last_peered":"2024-04-30T23:11:56.784904+0000","last_clean":"2024-04-30T23:11:56.784904+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:11:56.784904+0000","last_undegraded":"2024-04-30T23:11:56.784904+0000","last_fullsized":"2024-04-30T23:11:56.784904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779170+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:11:56.779170+0000","last_peered":"2024-04-30T23:11:56.779170+0000","last_clean":"2024-04-30T23:11:56.779170+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:11:56.779170+0000","last_undegraded":"2024-04-30T23:11:56.779170+0000","last_fullsized":"2024-04-30T23:11:56.779170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784092+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:11:56.784092+0000","last_peered":"2024-04-30T23:11:56.784092+0000","last_clean":"2024-04-30T23:11:56.784092+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:11:56.784092+0000","last_undegraded":"2024-04-30T23:11:56.784092+0000","last_fullsized":"2024-04-30T23:11:56.784092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974263+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:11:56.974263+0000","last_peered":"2024-04-30T23:11:56.974263+0000","last_clean":"2024-04-30T23:11:56.974263+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:11:56.974263+0000","last_undegraded":"2024-04-30T23:11:56.974263+0000","last_fullsized":"2024-04-30T23:11:56.974263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.124512+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:11:57.124512+0000","last_peered":"2024-04-30T23:11:57.124512+0000","last_clean":"2024-04-30T23:11:57.124512+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:11:57.124512+0000","last_undegraded":"2024-04-30T23:11:57.124512+0000","last_fullsized":"2024-04-30T23:11:57.124512+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:12:39.024937+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:12:39.024937+0000","last_peered":"2024-04-30T23:12:39.024937+0000","last_clean":"2024-04-30T23:12:39.024937+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:12:39.024937+0000","last_undegraded":"2024-04-30T23:12:39.024937+0000","last_fullsized":"2024-04-30T23:12:39.024937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974349+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:11:56.974349+0000","last_peered":"2024-04-30T23:11:56.974349+0000","last_clean":"2024-04-30T23:11:56.974349+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:11:56.974349+0000","last_undegraded":"2024-04-30T23:11:56.974349+0000","last_fullsized":"2024-04-30T23:11:56.974349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.125302+0000","last_change":"2024-04-30T23:11:57.125302+0000","last_active":"2024-04-30T23:11:57.125302+0000","last_peered":"2024-04-30T23:11:57.125302+0000","last_clean":"2024-04-30T23:11:57.125302+0000","last_became_active":"2024-04-30T23:11:57.124777+0000","last_became_peered":"2024-04-30T23:11:57.124777+0000","last_unstale":"2024-04-30T23:11:57.125302+0000","last_undegraded":"2024-04-30T23:11:57.125302+0000","last_fullsized":"2024-04-30T23:11:57.125302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:57:20.020845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.960608+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:11:56.960608+0000","last_peered":"2024-04-30T23:11:56.960608+0000","last_clean":"2024-04-30T23:11:56.960608+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:11:56.960608+0000","last_undegraded":"2024-04-30T23:11:56.960608+0000","last_fullsized":"2024-04-30T23:11:56.960608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974309+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:11:56.974309+0000","last_peered":"2024-04-30T23:11:56.974309+0000","last_clean":"2024-04-30T23:11:56.974309+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:11:56.974309+0000","last_undegraded":"2024-04-30T23:11:56.974309+0000","last_fullsized":"2024-04-30T23:11:56.974309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959992+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:11:56.959992+0000","last_peered":"2024-04-30T23:11:56.959992+0000","last_clean":"2024-04-30T23:11:56.959992+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:11:56.959992+0000","last_undegraded":"2024-04-30T23:11:56.959992+0000","last_fullsized":"2024-04-30T23:11:56.959992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783136+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:11:56.783136+0000","last_peered":"2024-04-30T23:11:56.783136+0000","last_clean":"2024-04-30T23:11:56.783136+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:11:56.783136+0000","last_undegraded":"2024-04-30T23:11:56.783136+0000","last_fullsized":"2024-04-30T23:11:56.783136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.974399+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:11:56.974399+0000","last_peered":"2024-04-30T23:11:56.974399+0000","last_clean":"2024-04-30T23:11:56.974399+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:11:56.974399+0000","last_undegraded":"2024-04-30T23:11:56.974399+0000","last_fullsized":"2024-04-30T23:11:56.974399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781666+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:11:56.781666+0000","last_peered":"2024-04-30T23:11:56.781666+0000","last_clean":"2024-04-30T23:11:56.781666+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:11:56.781666+0000","last_undegraded":"2024-04-30T23:11:56.781666+0000","last_fullsized":"2024-04-30T23:11:56.781666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779217+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:11:56.779217+0000","last_peered":"2024-04-30T23:11:56.779217+0000","last_clean":"2024-04-30T23:11:56.779217+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:11:56.779217+0000","last_undegraded":"2024-04-30T23:11:56.779217+0000","last_fullsized":"2024-04-30T23:11:56.779217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.778931+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:11:56.778931+0000","last_peered":"2024-04-30T23:11:56.778931+0000","last_clean":"2024-04-30T23:11:56.778931+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:11:56.778931+0000","last_undegraded":"2024-04-30T23:11:56.778931+0000","last_fullsized":"2024-04-30T23:11:56.778931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784954+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:11:56.784954+0000","last_peered":"2024-04-30T23:11:56.784954+0000","last_clean":"2024-04-30T23:11:56.784954+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:11:56.784954+0000","last_undegraded":"2024-04-30T23:11:56.784954+0000","last_fullsized":"2024-04-30T23:11:56.784954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.787962+0000","last_change":"2024-04-30T23:11:56.787962+0000","last_active":"2024-04-30T23:11:56.787962+0000","last_peered":"2024-04-30T23:11:56.787962+0000","last_clean":"2024-04-30T23:11:56.787962+0000","last_became_active":"2024-04-30T23:11:56.787540+0000","last_became_peered":"2024-04-30T23:11:56.787540+0000","last_unstale":"2024-04-30T23:11:56.787962+0000","last_undegraded":"2024-04-30T23:11:56.787962+0000","last_fullsized":"2024-04-30T23:11:56.787962+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:57:43.364201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.782131+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:11:56.782131+0000","last_peered":"2024-04-30T23:11:56.782131+0000","last_clean":"2024-04-30T23:11:56.782131+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:11:56.782131+0000","last_undegraded":"2024-04-30T23:11:56.782131+0000","last_fullsized":"2024-04-30T23:11:56.782131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.779520+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:11:56.779520+0000","last_peered":"2024-04-30T23:11:56.779520+0000","last_clean":"2024-04-30T23:11:56.779520+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:11:56.779520+0000","last_undegraded":"2024-04-30T23:11:56.779520+0000","last_fullsized":"2024-04-30T23:11:56.779520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.786233+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:11:56.786233+0000","last_peered":"2024-04-30T23:11:56.786233+0000","last_clean":"2024-04-30T23:11:56.786233+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:11:56.786233+0000","last_undegraded":"2024-04-30T23:11:56.786233+0000","last_fullsized":"2024-04-30T23:11:56.786233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.959190+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:11:56.959190+0000","last_peered":"2024-04-30T23:11:56.959190+0000","last_clean":"2024-04-30T23:11:56.959190+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:11:56.959190+0000","last_undegraded":"2024-04-30T23:11:56.959190+0000","last_fullsized":"2024-04-30T23:11:56.959190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.784379+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:11:56.784379+0000","last_peered":"2024-04-30T23:11:56.784379+0000","last_clean":"2024-04-30T23:11:56.784379+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:11:56.784379+0000","last_undegraded":"2024-04-30T23:11:56.784379+0000","last_fullsized":"2024-04-30T23:11:56.784379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:57.123498+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:11:57.123498+0000","last_peered":"2024-04-30T23:11:57.123498+0000","last_clean":"2024-04-30T23:11:57.123498+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:11:57.123498+0000","last_undegraded":"2024-04-30T23:11:57.123498+0000","last_fullsized":"2024-04-30T23:11:57.123498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.783139+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:11:56.783139+0000","last_peered":"2024-04-30T23:11:56.783139+0000","last_clean":"2024-04-30T23:11:56.783139+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:11:56.783139+0000","last_undegraded":"2024-04-30T23:11:56.783139+0000","last_fullsized":"2024-04-30T23:11:56.783139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-30T23:11:56.781993+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:11:56.781993+0000","last_peered":"2024-04-30T23:11:56.781993+0000","last_clean":"2024-04-30T23:11:56.781993+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:11:56.781993+0000","last_undegraded":"2024-04-30T23:11:56.781993+0000","last_fullsized":"2024-04-30T23:11:56.781993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69928,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":776,"num_read_kb":463,"num_write":244,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":501359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645351,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1728512,"data_stored":1150508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":504994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070514,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":501276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1650688,"data_stored":1098164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":496402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":559765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":498249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":560767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":500867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1093355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:12:44.450 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-30T23:12:44.450 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-30T23:12:44.450 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-30T23:12:44.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-30T23:12:44.693 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:44 smithi104 ceph-mon[32987]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:44 smithi104 ceph-mon[32987]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:45.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:44 smithi183 ceph-mon[33560]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:45.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:44 smithi183 ceph-mon[33560]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:45.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:44 smithi100 ceph-mon[29745]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:45.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:44 smithi100 ceph-mon[29745]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:12:46.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:45 smithi100 ceph-mon[29745]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:46.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:45 smithi104 ceph-mon[32987]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:46.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:45 smithi183 ceph-mon[33560]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:46.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 -- 172.21.15.100:0/2395270185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80103220 msgr2=0x7f2f8010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 --2- 172.21.15.100:0/2395270185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80103220 0x7f2f8010f7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800b0a0 tx=0x7f2f7800b3b0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 -- 172.21.15.100:0/2395270185 shutdown_connections 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 --2- 172.21.15.100:0/2395270185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80103220 0x7f2f8010f7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 --2- 172.21.15.100:0/2395270185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80108900 0x7f2f80108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 --2- 172.21.15.100:0/2395270185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 0x7f2f80102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 -- 172.21.15.100:0/2395270185 >> 172.21.15.100:0/2395270185 conn(0x7f2f800fe430 msgr2=0x7f2f80100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 -- 172.21.15.100:0/2395270185 shutdown_connections 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 -- 172.21.15.100:0/2395270185 wait complete. 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.520+0000 7f2f862e5700 1 Processor -- start 2024-04-30T23:12:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 -- start start 2024-04-30T23:12:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 0x7f2f80199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80103220 0x7f2f8019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80112b20 con 0x7f2f80108900 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801129a0 con 0x7f2f801028d0 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f862e5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80112ca0 con 0x7f2f80103220 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34286/0 (socket says 172.21.15.100:34286) 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 -- 172.21.15.100:0/3991443155 learned_addr learned my addr 172.21.15.100:0/3991443155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f7ffff700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 0x7f2f80199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f7f7fe700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80103220 0x7f2f8019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 -- 172.21.15.100:0/3991443155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80103220 msgr2=0x7f2f8019a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80103220 0x7f2f8019a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 -- 172.21.15.100:0/3991443155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 msgr2=0x7f2f80199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.521+0000 7f2f84882700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 0x7f2f80199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f84882700 1 -- 172.21.15.100:0/3991443155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f801a9220 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f84882700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f780062a0 tx=0x7f2f78004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78021070 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f78007c80 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f801a94b0 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7801d450 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.522+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f801a9960 con 0x7f2f80108900 2024-04-30T23:12:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.523+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f80104010 con 0x7f2f80108900 2024-04-30T23:12:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.524+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2f78004020 con 0x7f2f80108900 2024-04-30T23:12:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.525+0000 7f2f7d7fa700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 0x7f2f680a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.525+0000 7f2f7ffff700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 0x7f2f680a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.525+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f2f7800f020 con 0x7f2f80108900 2024-04-30T23:12:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.525+0000 7f2f7ffff700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 0x7f2f680a61e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f80103a10 tx=0x7f2f70009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.530+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2f7802a020 con 0x7f2f80108900 2024-04-30T23:12:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.774+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2f801a9b30 con 0x7f2f80108900 2024-04-30T23:12:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.774+0000 7f2f7d7fa700 1 -- 172.21.15.100:0/3991443155 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2f7809e600 con 0x7f2f80108900 2024-04-30T23:12:46.775 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:46.775 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 msgr2=0x7f2f680a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 0x7f2f680a61e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f80103a10 tx=0x7f2f70009190 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 msgr2=0x7f2f8019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f780062a0 tx=0x7f2f78004e20 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 shutdown_connections 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2f680a3cd0 0x7f2f680a61e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f80108900 0x7f2f8019a5a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f801028d0 0x7f2f80199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 --2- 172.21.15.100:0/3991443155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f80103220 0x7f2f8019a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.776+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 >> 172.21.15.100:0/3991443155 conn(0x7f2f800fe430 msgr2=0x7f2f80100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.777+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 shutdown_connections 2024-04-30T23:12:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:46.777+0000 7f2f862e5700 1 -- 172.21.15.100:0/3991443155 wait complete. 2024-04-30T23:12:47.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:46 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3991443155' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-30T23:12:47.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:46 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3991443155' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-30T23:12:47.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:46 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3991443155' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-30T23:12:47.554 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-30T23:12:47.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:12:47.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 -- 172.21.15.100:0/3291208812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868108960 msgr2=0x7ff86810ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/3291208812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868108960 0x7ff86810ad80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff860009ca0 tx=0x7ff86002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 -- 172.21.15.100:0/3291208812 shutdown_connections 2024-04-30T23:12:47.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/3291208812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868108960 0x7ff86810ad80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/3291208812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868103c60 0x7ff868104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/3291208812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868102a20 0x7ff868103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 -- 172.21.15.100:0/3291208812 >> 172.21.15.100:0/3291208812 conn(0x7ff8680fdc10 msgr2=0x7ff8681000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 -- 172.21.15.100:0/3291208812 shutdown_connections 2024-04-30T23:12:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 -- 172.21.15.100:0/3291208812 wait complete. 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.666+0000 7ff86d2d4640 1 Processor -- start 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 -- start start 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868103c60 0x7ff86819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868108960 0x7ff8681a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810e550 con 0x7ff868102a20 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810e3d0 con 0x7ff868108960 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff86d2d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff86810e6d0 con 0x7ff868103c60 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34312/0 (socket says 172.21.15.100:34312) 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 -- 172.21.15.100:0/1005693882 learned_addr learned my addr 172.21.15.100:0/1005693882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff8677fe640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868108960 0x7ff8681a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff8667fc640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868103c60 0x7ff86819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 -- 172.21.15.100:0/1005693882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868103c60 msgr2=0x7ff86819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868103c60 0x7ff86819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 -- 172.21.15.100:0/1005693882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868108960 msgr2=0x7ff8681a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868108960 0x7ff8681a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.667+0000 7ff866ffd640 1 -- 172.21.15.100:0/1005693882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8681a1df0 con 0x7ff868102a20 2024-04-30T23:12:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff866ffd640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c970 tx=0x7ff85800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858004220 con 0x7ff868102a20 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8681a20e0 con 0x7ff868102a20 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8580043c0 con 0x7ff868102a20 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858004a00 con 0x7ff868102a20 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.668+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8681a2630 con 0x7ff868102a20 2024-04-30T23:12:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.669+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8681a28f0 con 0x7ff868102a20 2024-04-30T23:12:47.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.670+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff8580079b0 con 0x7ff868102a20 2024-04-30T23:12:47.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.671+0000 7ff84ffff640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 0x7ff8500a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.671+0000 7ff8667fc640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 0x7ff8500a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.671+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7ff8580d0b90 con 0x7ff868102a20 2024-04-30T23:12:47.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.672+0000 7ff8667fc640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 0x7ff8500a6150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005fd0 tx=0x7ff85c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:47.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.675+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff858014030 con 0x7ff868102a20 2024-04-30T23:12:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.855+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8681a2ac0 con 0x7ff868102a20 2024-04-30T23:12:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.856+0000 7ff84ffff640 1 -- 172.21.15.100:0/1005693882 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24588 (secure 0 0 0) 0x7ff85809d070 con 0x7ff868102a20 2024-04-30T23:12:47.857 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:47.857 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":91,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:56.768134+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 msgr2=0x7ff8500a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 0x7ff8500a6150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005fd0 tx=0x7ff85c005850 comp rx=0 tx=0).stop 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 msgr2=0x7ff86819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c970 tx=0x7ff85800ce30 comp rx=0 tx=0).stop 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 shutdown_connections 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8500a3c40 0x7ff8500a6150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff868108960 0x7ff8681a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff868103c60 0x7ff86819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 --2- 172.21.15.100:0/1005693882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff868102a20 0x7ff86819a2b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 >> 172.21.15.100:0/1005693882 conn(0x7ff8680fdc10 msgr2=0x7ff868109e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 shutdown_connections 2024-04-30T23:12:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.858+0000 7ff86d2d4640 1 -- 172.21.15.100:0/1005693882 wait complete. 2024-04-30T23:12:47.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:12:47.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.982+0000 7f917bb35640 1 -- 172.21.15.100:0/2150523018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174103b30 msgr2=0x7f9174104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.982+0000 7f917bb35640 1 --2- 172.21.15.100:0/2150523018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174103b30 0x7f9174104830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f916c009900 tx=0x7f916c02a410 comp rx=0 tx=0).stop 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.982+0000 7f917bb35640 1 -- 172.21.15.100:0/2150523018 shutdown_connections 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- 172.21.15.100:0/2150523018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174109a70 0x7f917410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- 172.21.15.100:0/2150523018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174104d70 0x7f9174105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- 172.21.15.100:0/2150523018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174103b30 0x7f9174104830 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- 172.21.15.100:0/2150523018 >> 172.21.15.100:0/2150523018 conn(0x7f91740fed20 msgr2=0x7f91741011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- 172.21.15.100:0/2150523018 shutdown_connections 2024-04-30T23:12:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- 172.21.15.100:0/2150523018 wait complete. 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 Processor -- start 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- start start 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174103b30 0x7f917419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174109a70 0x7f91741a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f917410f630 con 0x7f9174104d70 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f917410f4b0 con 0x7f9174109a70 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.983+0000 7f917bb35640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f917410f7b0 con 0x7f9174103b30 2024-04-30T23:12:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34328/0 (socket says 172.21.15.100:34328) 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 -- 172.21.15.100:0/794769327 learned_addr learned my addr 172.21.15.100:0/794769327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91798d1640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174103b30 0x7f917419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 -- 172.21.15.100:0/794769327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174103b30 msgr2=0x7f917419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174103b30 0x7f917419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f917a0d2640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174109a70 0x7f91741a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 -- 172.21.15.100:0/794769327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174109a70 msgr2=0x7f91741a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174109a70 0x7f91741a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 -- 172.21.15.100:0/794769327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91741a1de0 con 0x7f9174104d70 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f91790d0640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f916400c890 tx=0x7f916400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164004220 con 0x7f9174104d70 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91741a20d0 con 0x7f9174104d70 2024-04-30T23:12:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91640043c0 con 0x7f9174104d70 2024-04-30T23:12:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164004a00 con 0x7f9174104d70 2024-04-30T23:12:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.984+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91741a2670 con 0x7f9174104d70 2024-04-30T23:12:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.985+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9174108880 con 0x7f9174104d70 2024-04-30T23:12:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.986+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f91640079b0 con 0x7f9174104d70 2024-04-30T23:12:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.987+0000 7f916affd640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 0x7f91600a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.987+0000 7f91798d1640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 0x7f91600a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.987+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f91640d0610 con 0x7f9174104d70 2024-04-30T23:12:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.987+0000 7f91798d1640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 0x7f91600a6150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f916c005ab0 tx=0x7f916c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:47.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:47.992+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9164014030 con 0x7f9174104d70 2024-04-30T23:12:48.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.168+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f917402df50 con 0x7f9174104d70 2024-04-30T23:12:48.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.169+0000 7f916affd640 1 -- 172.21.15.100:0/794769327 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f916409cb50 con 0x7f9174104d70 2024-04-30T23:12:48.169 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 msgr2=0x7f91600a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 0x7f91600a6150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f916c005ab0 tx=0x7f916c031400 comp rx=0 tx=0).stop 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 msgr2=0x7f917419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f916400c890 tx=0x7f916400cd50 comp rx=0 tx=0).stop 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 shutdown_connections 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f91600a3c40 0x7f91600a6150 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9174109a70 0x7f91741a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9174104d70 0x7f917419a830 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 --2- 172.21.15.100:0/794769327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174103b30 0x7f917419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 >> 172.21.15.100:0/794769327 conn(0x7f91740fed20 msgr2=0x7f9174105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 shutdown_connections 2024-04-30T23:12:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.171+0000 7f917bb35640 1 -- 172.21.15.100:0/794769327 wait complete. 2024-04-30T23:12:48.181 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:47 smithi100 ceph-mon[29745]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:48.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:12:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 -- 172.21.15.100:0/1453900728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 msgr2=0x7f92f8103e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 --2- 172.21.15.100:0/1453900728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8103e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009900 tx=0x7f92f402a410 comp rx=0 tx=0).stop 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 -- 172.21.15.100:0/1453900728 shutdown_connections 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 --2- 172.21.15.100:0/1453900728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f81044b0 0x7f92f810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 --2- 172.21.15.100:0/1453900728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8103e20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 --2- 172.21.15.100:0/1453900728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f8102f90 0x7f92f81033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 -- 172.21.15.100:0/1453900728 >> 172.21.15.100:0/1453900728 conn(0x7f92f80fd390 msgr2=0x7f92f80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 -- 172.21.15.100:0/1453900728 shutdown_connections 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 -- 172.21.15.100:0/1453900728 wait complete. 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.293+0000 7f93006a8640 1 Processor -- start 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 -- start start 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f8102f90 0x7f92f8199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f81044b0 0x7f92f81a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92f810e560 con 0x7f92f8103970 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f92f810e3e0 con 0x7f92f81044b0 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f93006a8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f92f810e6e0 con 0x7f92f8102f90 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34344/0 (socket says 172.21.15.100:34344) 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 -- 172.21.15.100:0/3095724085 learned_addr learned my addr 172.21.15.100:0/3095724085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fe444640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f8102f90 0x7f92f8199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 -- 172.21.15.100:0/3095724085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f8102f90 msgr2=0x7f92f8199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f8102f90 0x7f92f8199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 -- 172.21.15.100:0/3095724085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f81044b0 msgr2=0x7f92f81a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fec45640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f81044b0 0x7f92f81a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f81044b0 0x7f92f81a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 -- 172.21.15.100:0/3095724085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f81a0bd0 con 0x7f92f8103970 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92fdc43640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f4006010 tx=0x7f92f4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.294+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f403f030 con 0x7f92f8103970 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.295+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f4003cb0 con 0x7f92f8103970 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.295+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f81a0e60 con 0x7f92f8103970 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.295+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4035070 con 0x7f92f8103970 2024-04-30T23:12:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.295+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f81a1260 con 0x7f92f8103970 2024-04-30T23:12:48.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:47 smithi104 ceph-mon[32987]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.296+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f8107930 con 0x7f92f8103970 2024-04-30T23:12:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.297+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f92f4042030 con 0x7f92f8103970 2024-04-30T23:12:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.297+0000 7f92ef7fe640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 0x7f92e40a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.297+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f92f40f1010 con 0x7f92f8103970 2024-04-30T23:12:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.297+0000 7f92fe444640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 0x7f92e40a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.298+0000 7f92fe444640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 0x7f92e40a6150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92e8005fd0 tx=0x7f92e8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:47 smithi183 ceph-mon[33560]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:48.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.302+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f92f4003e60 con 0x7f92f8103970 2024-04-30T23:12:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.480+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f92f80637e0 con 0x7f92f8103970 2024-04-30T23:12:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.480+0000 7f92ef7fe640 1 -- 172.21.15.100:0/3095724085 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f92f40bd550 con 0x7f92f8103970 2024-04-30T23:12:48.481 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 msgr2=0x7f92e40a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 0x7f92e40a6150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92e8005fd0 tx=0x7f92e8005850 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 msgr2=0x7f92f8199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f4006010 tx=0x7f92f4004340 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 shutdown_connections 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92e40a3c40 0x7f92e40a6150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92f81044b0 0x7f92f81a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f8103970 0x7f92f8199680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 --2- 172.21.15.100:0/3095724085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f8102f90 0x7f92f8199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.482+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 >> 172.21.15.100:0/3095724085 conn(0x7f92f80fd390 msgr2=0x7f92f8104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.483+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 shutdown_connections 2024-04-30T23:12:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.483+0000 7f93006a8640 1 -- 172.21.15.100:0/3095724085 wait complete. 2024-04-30T23:12:48.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 -- 172.21.15.100:0/1401385030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c108970 msgr2=0x7f9f3c10ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 --2- 172.21.15.100:0/1401385030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c108970 0x7f9f3c10ad90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009ca0 tx=0x7f9f3402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 -- 172.21.15.100:0/1401385030 shutdown_connections 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 --2- 172.21.15.100:0/1401385030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c108970 0x7f9f3c10ad90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 --2- 172.21.15.100:0/1401385030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f3c103c70 0x7f9f3c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 --2- 172.21.15.100:0/1401385030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c102a30 0x7f9f3c103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 -- 172.21.15.100:0/1401385030 >> 172.21.15.100:0/1401385030 conn(0x7f9f3c0fdc00 msgr2=0x7f9f3c1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 -- 172.21.15.100:0/1401385030 shutdown_connections 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.604+0000 7f9f433ce640 1 -- 172.21.15.100:0/1401385030 wait complete. 2024-04-30T23:12:48.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 Processor -- start 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 -- start start 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 0x7f9f3c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f3c108970 0x7f9f3c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c10e560 con 0x7f9f3c102a30 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c10e3e0 con 0x7f9f3c103c70 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f433ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c10e6e0 con 0x7f9f3c108970 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34362/0 (socket says 172.21.15.100:34362) 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 -- 172.21.15.100:0/621862124 learned_addr learned my addr 172.21.15.100:0/621862124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f40969640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 0x7f9f3c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 -- 172.21.15.100:0/621862124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f3c108970 msgr2=0x7f9f3c1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f3c108970 0x7f9f3c1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 -- 172.21.15.100:0/621862124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 msgr2=0x7f9f3c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 0x7f9f3c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.605+0000 7f9f4116a640 1 -- 172.21.15.100:0/621862124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1a1d20 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f40969640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 0x7f9f3c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f4116a640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800d740 tx=0x7f9f3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38017070 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f3800de50 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c1a1fb0 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38003c20 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.606+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c1a2470 con 0x7f9f3c102a30 2024-04-30T23:12:48.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.607+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c107780 con 0x7f9f3c102a30 2024-04-30T23:12:48.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.609+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f9f38003dc0 con 0x7f9f3c102a30 2024-04-30T23:12:48.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.609+0000 7f9f327fc640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 0x7f9f280a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.610+0000 7f9f40969640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 0x7f9f280a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.610+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f9f380d0830 con 0x7f9f3c102a30 2024-04-30T23:12:48.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.610+0000 7f9f40969640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 0x7f9f280a6150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c075240 tx=0x7f9f2c005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.613+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9f3809cd10 con 0x7f9f3c102a30 2024-04-30T23:12:48.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.791+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f3c02dd40 con 0x7f9f3c102a30 2024-04-30T23:12:48.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.791+0000 7f9f327fc640 1 -- 172.21.15.100:0/621862124 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f9f3809c610 con 0x7f9f3c102a30 2024-04-30T23:12:48.792 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 msgr2=0x7f9f280a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 0x7f9f280a6150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c075240 tx=0x7f9f2c005e70 comp rx=0 tx=0).stop 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 msgr2=0x7f9f3c075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800d740 tx=0x7f9f3800dc00 comp rx=0 tx=0).stop 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 shutdown_connections 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9f280a3c40 0x7f9f280a6150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f3c108970 0x7f9f3c1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f3c103c70 0x7f9f3c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 --2- 172.21.15.100:0/621862124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f3c102a30 0x7f9f3c075830 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 >> 172.21.15.100:0/621862124 conn(0x7f9f3c0fdc00 msgr2=0x7f9f3c104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 shutdown_connections 2024-04-30T23:12:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.793+0000 7f9f433ce640 1 -- 172.21.15.100:0/621862124 wait complete. 2024-04-30T23:12:48.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 -- 172.21.15.100:0/1885727483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 msgr2=0x7fdd00104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 --2- 172.21.15.100:0/1885727483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd00104840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009900 tx=0x7fdcf002a410 comp rx=0 tx=0).stop 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 -- 172.21.15.100:0/1885727483 shutdown_connections 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 --2- 172.21.15.100:0/1885727483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00109a80 0x7fdd0010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 --2- 172.21.15.100:0/1885727483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00104d80 0x7fdd00105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 --2- 172.21.15.100:0/1885727483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd00104840 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 -- 172.21.15.100:0/1885727483 >> 172.21.15.100:0/1885727483 conn(0x7fdd000fed50 msgr2=0x7fdd001011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 -- 172.21.15.100:0/1885727483 shutdown_connections 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.916+0000 7fdd05c29640 1 -- 172.21.15.100:0/1885727483 wait complete. 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 Processor -- start 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 -- start start 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00104d80 0x7fdd0019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 0x7fdd001a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010f620 con 0x7fdd00103b40 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010f4a0 con 0x7fdd00109a80 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdd05c29640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010f7a0 con 0x7fdd00104d80 2024-04-30T23:12:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34372/0 (socket says 172.21.15.100:34372) 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 -- 172.21.15.100:0/3250093574 learned_addr learned my addr 172.21.15.100:0/3250093574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcfffff640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 0x7fdd001a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 -- 172.21.15.100:0/3250093574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00104d80 msgr2=0x7fdd0019a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcfeffd640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00104d80 0x7fdd0019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00104d80 0x7fdd0019a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 -- 172.21.15.100:0/3250093574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 msgr2=0x7fdd001a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 0x7fdd001a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.917+0000 7fdcff7fe640 1 -- 172.21.15.100:0/3250093574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd001a1da0 con 0x7fdd00103b40 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdcfffff640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 0x7fdd001a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdcff7fe640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0006010 tx=0x7fdcf0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf003f030 con 0x7fdd00103b40 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd001a2030 con 0x7fdd00103b40 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf0003aa0 con 0x7fdd00103b40 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0035070 con 0x7fdd00103b40 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.918+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd001a2520 con 0x7fdd00103b40 2024-04-30T23:12:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.919+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd00108890 con 0x7fdd00103b40 2024-04-30T23:12:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.920+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fdcf0042030 con 0x7fdd00103b40 2024-04-30T23:12:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.921+0000 7fdcfcff9640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 0x7fdcec0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.921+0000 7fdcfeffd640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 0x7fdcec0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.921+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fdcf00f1290 con 0x7fdd00103b40 2024-04-30T23:12:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.921+0000 7fdcfeffd640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 0x7fdcec0a6150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdce8005fd0 tx=0x7fdce8005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:48.925+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdcf00bd7d0 con 0x7fdd00103b40 2024-04-30T23:12:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:48 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1005693882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:48 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/794769327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:48 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3095724085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:48 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/621862124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.108+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdd0002dd20 con 0x7fdd00103b40 2024-04-30T23:12:49.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.108+0000 7fdcfcff9640 1 -- 172.21.15.100:0/3250093574 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fdcf00bd0d0 con 0x7fdd00103b40 2024-04-30T23:12:49.109 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 msgr2=0x7fdcec0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 0x7fdcec0a6150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdce8005fd0 tx=0x7fdce8005ce0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 msgr2=0x7fdd0019a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0006010 tx=0x7fdcf0031a50 comp rx=0 tx=0).stop 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 shutdown_connections 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdcec0a3c40 0x7fdcec0a6150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd00109a80 0x7fdd001a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd00104d80 0x7fdd0019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 --2- 172.21.15.100:0/3250093574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd00103b40 0x7fdd0019a310 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.110+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 >> 172.21.15.100:0/3250093574 conn(0x7fdd000fed50 msgr2=0x7fdd00105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.111+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 shutdown_connections 2024-04-30T23:12:49.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.111+0000 7fdd05c29640 1 -- 172.21.15.100:0/3250093574 wait complete. 2024-04-30T23:12:49.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- 172.21.15.100:0/3840034630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 msgr2=0x7fd4241033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 --2- 172.21.15.100:0/3840034630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd4241033a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009ca0 tx=0x7fd41c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- 172.21.15.100:0/3840034630 shutdown_connections 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 --2- 172.21.15.100:0/3840034630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424104490 0x7fd42410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 --2- 172.21.15.100:0/3840034630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424103970 0x7fd424103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 --2- 172.21.15.100:0/3840034630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd4241033a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- 172.21.15.100:0/3840034630 >> 172.21.15.100:0/3840034630 conn(0x7fd4240fd370 msgr2=0x7fd4240ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- 172.21.15.100:0/3840034630 shutdown_connections 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- 172.21.15.100:0/3840034630 wait complete. 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 Processor -- start 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.230+0000 7fd42c429640 1 -- start start 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 0x7fd424199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424104490 0x7fd4241a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd42410e590 con 0x7fd424102f90 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd42410e410 con 0x7fd424104490 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd42410e710 con 0x7fd424103970 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34388/0 (socket says 172.21.15.100:34388) 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 -- 172.21.15.100:0/3289347479 learned_addr learned my addr 172.21.15.100:0/3289347479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd4299c4640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 0x7fd424199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a9c6640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424104490 0x7fd4241a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 -- 172.21.15.100:0/3289347479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 msgr2=0x7fd424199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 0x7fd424199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 -- 172.21.15.100:0/3289347479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424104490 msgr2=0x7fd4241a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424104490 0x7fd4241a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 -- 172.21.15.100:0/3289347479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4241a0c70 con 0x7fd424102f90 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd4299c4640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 0x7fd424199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42a1c5640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd41c031b50 tx=0x7fd41c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c004040 con 0x7fd424102f90 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c004690 con 0x7fd424102f90 2024-04-30T23:12:49.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4241a0f00 con 0x7fd424102f90 2024-04-30T23:12:49.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.231+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c02fe90 con 0x7fd424102f90 2024-04-30T23:12:49.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.232+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4241a13e0 con 0x7fd424102f90 2024-04-30T23:12:49.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.233+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42406a200 con 0x7fd424102f90 2024-04-30T23:12:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.234+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fd41c02f660 con 0x7fd424102f90 2024-04-30T23:12:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.234+0000 7fd41b7fe640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 0x7fd4100a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.234+0000 7fd4299c4640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 0x7fd4100a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.234+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fd41c0f22b0 con 0x7fd424102f90 2024-04-30T23:12:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.235+0000 7fd4299c4640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 0x7fd4100a6150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd414005fd0 tx=0x7fd414005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.238+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd42406a200 con 0x7fd424102f90 2024-04-30T23:12:49.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1005693882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:49.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/794769327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3095724085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:48 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/621862124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:48 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1005693882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:49.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:48 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/794769327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:48 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3095724085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:48 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/621862124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:49.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.451+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd42402dc50 con 0x7fd424102f90 2024-04-30T23:12:49.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.452+0000 7fd41b7fe640 1 -- 172.21.15.100:0/3289347479 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7fd41c0be900 con 0x7fd424102f90 2024-04-30T23:12:49.452 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:49.453 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:12:49.453 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 msgr2=0x7fd4100a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 0x7fd4100a6150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd414005fd0 tx=0x7fd414005ec0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 msgr2=0x7fd424199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd41c031b50 tx=0x7fd41c003ba0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 shutdown_connections 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd4100a3c40 0x7fd4100a6150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd424104490 0x7fd4241a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd424103970 0x7fd424199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 --2- 172.21.15.100:0/3289347479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd424102f90 0x7fd424199130 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 >> 172.21.15.100:0/3289347479 conn(0x7fd4240fd370 msgr2=0x7fd424104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 shutdown_connections 2024-04-30T23:12:49.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.454+0000 7fd42c429640 1 -- 172.21.15.100:0/3289347479 wait complete. 2024-04-30T23:12:49.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2680360759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c101790 msgr2=0x7f5a3c101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2680360759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c101790 0x7f5a3c101c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009900 tx=0x7f5a3002a410 comp rx=0 tx=0).stop 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2680360759 shutdown_connections 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2680360759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 0x7f5a3c10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2680360759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c101790 0x7f5a3c101c00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2680360759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2680360759 >> 172.21.15.100:0/2680360759 conn(0x7f5a3c0fd3f0 msgr2=0x7f5a3c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2680360759 shutdown_connections 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.573+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2680360759 wait complete. 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 Processor -- start 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 -- start start 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c101790 0x7f5a3c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 0x7f5a3c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c10f6a0 con 0x7f5a3c1050e0 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c10f520 con 0x7f5a3c102290 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a40a3b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c10f820 con 0x7f5a3c101790 2024-04-30T23:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a3ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a3ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34418/0 (socket says 172.21.15.100:34418) 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.574+0000 7f5a3ad9d640 1 -- 172.21.15.100:0/2892801318 learned_addr learned my addr 172.21.15.100:0/2892801318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3a59c640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c101790 0x7f5a3c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a39d9b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 0x7f5a3c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 -- 172.21.15.100:0/2892801318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c101790 msgr2=0x7f5a3c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c101790 0x7f5a3c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 -- 172.21.15.100:0/2892801318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 msgr2=0x7f5a3c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 0x7f5a3c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 -- 172.21.15.100:0/2892801318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1a1d80 con 0x7f5a3c1050e0 2024-04-30T23:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a3ad9d640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400eaa0 tx=0x7f5a3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400cdb0 con 0x7f5a3c1050e0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a34005020 con 0x7f5a3c1050e0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c1a2070 con 0x7f5a3c1050e0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a340116d0 con 0x7f5a3c1050e0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.575+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1a2540 con 0x7f5a3c1050e0 2024-04-30T23:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.576+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c108a70 con 0x7f5a3c1050e0 2024-04-30T23:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.577+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5a340051d0 con 0x7f5a3c1050e0 2024-04-30T23:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.578+0000 7f5a2b7fe640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 0x7f5a240a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.578+0000 7f5a3a59c640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 0x7f5a240a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.578+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f5a340d0e10 con 0x7f5a3c1050e0 2024-04-30T23:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.578+0000 7f5a3a59c640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 0x7f5a240a6150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c06b380 tx=0x7f5a2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.582+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5a34016030 con 0x7f5a3c1050e0 2024-04-30T23:12:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.763+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a3c0637e0 con 0x7f5a3c1050e0 2024-04-30T23:12:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.764+0000 7f5a2b7fe640 1 -- 172.21.15.100:0/2892801318 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24588 (secure 0 0 0) 0x7f5a3409cd00 con 0x7f5a3c1050e0 2024-04-30T23:12:49.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:49.767 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":91,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:56.768134+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 msgr2=0x7f5a240a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 0x7f5a240a6150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c06b380 tx=0x7f5a2c00a2d0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 msgr2=0x7f5a3c1a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400eaa0 tx=0x7f5a3400ef60 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 shutdown_connections 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5a240a3c40 0x7f5a240a6150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a3c1050e0 0x7f5a3c1a1710 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a3c102290 0x7f5a3c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 --2- 172.21.15.100:0/2892801318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a3c101790 0x7f5a3c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 >> 172.21.15.100:0/2892801318 conn(0x7f5a3c0fd3f0 msgr2=0x7f5a3c105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.766+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 shutdown_connections 2024-04-30T23:12:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.767+0000 7f5a40a3b640 1 -- 172.21.15.100:0/2892801318 wait complete. 2024-04-30T23:12:49.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:12:49.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:12:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 -- 172.21.15.100:0/1353992698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 msgr2=0x7f0510103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 --2- 172.21.15.100:0/1353992698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f0510103720 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0508009ca0 tx=0x7f050802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 -- 172.21.15.100:0/1353992698 shutdown_connections 2024-04-30T23:12:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 --2- 172.21.15.100:0/1353992698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f051010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 --2- 172.21.15.100:0/1353992698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 0x7f0510104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 --2- 172.21.15.100:0/1353992698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f0510103720 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 -- 172.21.15.100:0/1353992698 >> 172.21.15.100:0/1353992698 conn(0x7f05100fdc10 msgr2=0x7f05101000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 -- 172.21.15.100:0/1353992698 shutdown_connections 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 -- 172.21.15.100:0/1353992698 wait complete. 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.891+0000 7f0517327640 1 Processor -- start 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 -- start start 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 0x7f051019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f05101a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f051010f650 con 0x7f0510102a20 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f051010f4d0 con 0x7f0510103c60 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f0517327640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f051010f7d0 con 0x7f0510108960 2024-04-30T23:12:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34446/0 (socket says 172.21.15.100:34446) 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 -- 172.21.15.100:0/2670477127 learned_addr learned my addr 172.21.15.100:0/2670477127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05148c2640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 0x7f051019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05158c4640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f05101a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 -- 172.21.15.100:0/2670477127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 msgr2=0x7f05101a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f05101a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 -- 172.21.15.100:0/2670477127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 msgr2=0x7f051019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 0x7f051019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 -- 172.21.15.100:0/2670477127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05101a1d60 con 0x7f0510102a20 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05158c4640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f05101a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05150c3640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0508004af0 tx=0x7f0508031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.892+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508003b70 con 0x7f0510102a20 2024-04-30T23:12:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.893+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0508003d10 con 0x7f0510102a20 2024-04-30T23:12:49.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.893+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05101a1ff0 con 0x7f0510102a20 2024-04-30T23:12:49.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.893+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050802fb90 con 0x7f0510102a20 2024-04-30T23:12:49.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.893+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05101a2450 con 0x7f0510102a20 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.893+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0510107770 con 0x7f0510102a20 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.895+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f050802fd30 con 0x7f0510102a20 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.896+0000 7f05067fc640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 0x7f04fc0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.896+0000 7f05148c2640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 0x7f04fc0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.896+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f05080f1f90 con 0x7f0510102a20 2024-04-30T23:12:49.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.897+0000 7f05148c2640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 0x7f04fc0a6150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f051019b370 tx=0x7f050000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:49.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:49.900+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f05080be5e0 con 0x7f0510102a20 2024-04-30T23:12:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3250093574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:50.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3289347479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:49 smithi100 ceph-mon[29745]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:50.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:49 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2892801318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.089+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f051002de00 con 0x7f0510102a20 2024-04-30T23:12:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.089+0000 7f05067fc640 1 -- 172.21.15.100:0/2670477127 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f05080bdee0 con 0x7f0510102a20 2024-04-30T23:12:50.090 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 msgr2=0x7f04fc0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 0x7f04fc0a6150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f051019b370 tx=0x7f050000a2d0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 msgr2=0x7f051019a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0508004af0 tx=0x7f0508031840 comp rx=0 tx=0).stop 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 shutdown_connections 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f04fc0a3c40 0x7f04fc0a6150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510108960 0x7f05101a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0510103c60 0x7f051019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.091+0000 7f0517327640 1 --2- 172.21.15.100:0/2670477127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510102a20 0x7f051019a2d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.092+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 >> 172.21.15.100:0/2670477127 conn(0x7f05100fdc10 msgr2=0x7f0510104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.092+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 shutdown_connections 2024-04-30T23:12:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.092+0000 7f0517327640 1 -- 172.21.15.100:0/2670477127 wait complete. 2024-04-30T23:12:50.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:12:50.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 -- 172.21.15.100:0/2745595096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128103c60 msgr2=0x7ff128104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 --2- 172.21.15.100:0/2745595096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128103c60 0x7ff128104070 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff114009900 tx=0x7ff11402a410 comp rx=0 tx=0).stop 2024-04-30T23:12:50.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 -- 172.21.15.100:0/2745595096 shutdown_connections 2024-04-30T23:12:50.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 --2- 172.21.15.100:0/2745595096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128108960 0x7ff12810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 --2- 172.21.15.100:0/2745595096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128103c60 0x7ff128104070 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 --2- 172.21.15.100:0/2745595096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128102a20 0x7ff128103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 -- 172.21.15.100:0/2745595096 >> 172.21.15.100:0/2745595096 conn(0x7ff1280fdc10 msgr2=0x7ff1281000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 -- 172.21.15.100:0/2745595096 shutdown_connections 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.213+0000 7ff12eed1640 1 -- 172.21.15.100:0/2745595096 wait complete. 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 Processor -- start 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 -- start start 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 0x7ff12819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128108960 0x7ff1281a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810e540 con 0x7ff128102a20 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810e3c0 con 0x7ff128103c60 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12eed1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810e6c0 con 0x7ff128108960 2024-04-30T23:12:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34472/0 (socket says 172.21.15.100:34472) 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 -- 172.21.15.100:0/4057838332 learned_addr learned my addr 172.21.15.100:0/4057838332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12d46e640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128108960 0x7ff1281a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff127fff640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 0x7ff12819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 -- 172.21.15.100:0/4057838332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128108960 msgr2=0x7ff1281a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128108960 0x7ff1281a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 -- 172.21.15.100:0/4057838332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 msgr2=0x7ff12819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 0x7ff12819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 -- 172.21.15.100:0/4057838332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1281a20f0 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff127fff640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 0x7ff12819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.214+0000 7ff12cc6d640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.215+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c017070 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.215+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11c009c30 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.215+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1281a23e0 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.215+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00f620 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.215+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a2930 con 0x7ff128102a20 2024-04-30T23:12:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.216+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12806c2e0 con 0x7ff128102a20 2024-04-30T23:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.217+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff11c01a070 con 0x7ff128102a20 2024-04-30T23:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.218+0000 7ff125ffb640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 0x7ff1180a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.218+0000 7ff127fff640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 0x7ff1180a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.218+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7ff11c0d0370 con 0x7ff128102a20 2024-04-30T23:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.218+0000 7ff127fff640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 0x7ff1180a61d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff114006010 tx=0x7ff114000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.222+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff11c009de0 con 0x7ff128102a20 2024-04-30T23:12:50.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3250093574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:50.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3289347479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:49 smithi104 ceph-mon[32987]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:50.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:49 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2892801318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3250093574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:50.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3289347479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:49 smithi183 ceph-mon[33560]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:12:50.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:49 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2892801318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.399+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1281a2b90 con 0x7ff128102a20 2024-04-30T23:12:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.400+0000 7ff125ffb640 1 -- 172.21.15.100:0/4057838332 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7ff11c09c930 con 0x7ff128102a20 2024-04-30T23:12:50.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:12:50.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 msgr2=0x7ff1180a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 0x7ff1180a61d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff114006010 tx=0x7ff114000bc0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 msgr2=0x7ff12819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00dde0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 shutdown_connections 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff1180a3cc0 0x7ff1180a61d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff128108960 0x7ff1281a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff128103c60 0x7ff12819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 --2- 172.21.15.100:0/4057838332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff128102a20 0x7ff12819a5b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 >> 172.21.15.100:0/4057838332 conn(0x7ff1280fdc10 msgr2=0x7ff128069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 shutdown_connections 2024-04-30T23:12:50.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.402+0000 7ff12eed1640 1 -- 172.21.15.100:0/4057838332 wait complete. 2024-04-30T23:12:50.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:12:50.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 -- 172.21.15.100:0/294905959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8108970 msgr2=0x7fa6b810ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 --2- 172.21.15.100:0/294905959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8108970 0x7fa6b810ad90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ca0 tx=0x7fa6b002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 -- 172.21.15.100:0/294905959 shutdown_connections 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 --2- 172.21.15.100:0/294905959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8108970 0x7fa6b810ad90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 --2- 172.21.15.100:0/294905959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 0x7fa6b8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 --2- 172.21.15.100:0/294905959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8102a30 0x7fa6b8103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 -- 172.21.15.100:0/294905959 >> 172.21.15.100:0/294905959 conn(0x7fa6b80fdc40 msgr2=0x7fa6b81000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 -- 172.21.15.100:0/294905959 shutdown_connections 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.523+0000 7fa6bec61640 1 -- 172.21.15.100:0/294905959 wait complete. 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 Processor -- start 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 -- start start 2024-04-30T23:12:50.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 0x7fa6b81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 0x7fa6b819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b810d450 con 0x7fa6b8102a30 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b810d2d0 con 0x7fa6b8103c70 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bec61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b810d5d0 con 0x7fa6b8108970 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bc9fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bc9fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34496/0 (socket says 172.21.15.100:34496) 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6bc9fd640 1 -- 172.21.15.100:0/2163121555 learned_addr learned my addr 172.21.15.100:0/2163121555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.524+0000 7fa6b7fff640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 0x7fa6b81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bd1fe640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 0x7fa6b819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 -- 172.21.15.100:0/2163121555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 msgr2=0x7fa6b819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 0x7fa6b819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 -- 172.21.15.100:0/2163121555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 msgr2=0x7fa6b81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 0x7fa6b81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 -- 172.21.15.100:0/2163121555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b819fa80 con 0x7fa6b8102a30 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bd1fe640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 0x7fa6b819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bc9fd640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c970 tx=0x7fa6ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007c70 con 0x7fa6b8102a30 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6ac007e10 con 0x7fa6b8102a30 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b819fd70 con 0x7fa6b8102a30 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0187b0 con 0x7fa6b8102a30 2024-04-30T23:12:50.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.525+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b81a0230 con 0x7fa6b8102a30 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.526+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b8069320 con 0x7fa6b8102a30 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.527+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa6ac00fab0 con 0x7fa6b8102a30 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.528+0000 7fa6b5ffb640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 0x7fa6a80a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.528+0000 7fa6b7fff640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 0x7fa6a80a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.528+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fa6ac0d0880 con 0x7fa6b8102a30 2024-04-30T23:12:50.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.528+0000 7fa6b7fff640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 0x7fa6a80a83e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8199100 tx=0x7fa6a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.533+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa6ac014030 con 0x7fa6b8102a30 2024-04-30T23:12:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.713+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa6b802db90 con 0x7fa6b8102a30 2024-04-30T23:12:50.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.713+0000 7fa6b5ffb640 1 -- 172.21.15.100:0/2163121555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fa6ac09cdc0 con 0x7fa6b8102a30 2024-04-30T23:12:50.713 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 msgr2=0x7fa6a80a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 0x7fa6a80a83e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8199100 tx=0x7fa6a400b410 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 msgr2=0x7fa6b8198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c970 tx=0x7fa6ac00ce30 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 shutdown_connections 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa6a80a5ed0 0x7fa6a80a83e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b8108970 0x7fa6b819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6b8103c70 0x7fa6b81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 --2- 172.21.15.100:0/2163121555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6b8102a30 0x7fa6b8198060 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.715+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 >> 172.21.15.100:0/2163121555 conn(0x7fa6b80fdc40 msgr2=0x7fa6b8104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.716+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 shutdown_connections 2024-04-30T23:12:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.716+0000 7fa6bec61640 1 -- 172.21.15.100:0/2163121555 wait complete. 2024-04-30T23:12:50.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:12:50.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/416118522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 msgr2=0x7f7e4810ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/416118522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e4810ada0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009ca0 tx=0x7f7e4002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/416118522 shutdown_connections 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/416118522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e4810ada0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/416118522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48103c80 0x7f7e48104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/416118522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48102a40 0x7f7e48103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/416118522 >> 172.21.15.100:0/416118522 conn(0x7f7e480fdc30 msgr2=0x7f7e481000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/416118522 shutdown_connections 2024-04-30T23:12:50.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.837+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/416118522 wait complete. 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 Processor -- start 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 -- start start 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48102a40 0x7f7e48075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 0x7f7e481a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4810e570 con 0x7f7e48108980 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4810e3f0 con 0x7f7e48103c80 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.838+0000 7f7e4d1c7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4810e6f0 con 0x7f7e48102a40 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34518/0 (socket says 172.21.15.100:34518) 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 -- 172.21.15.100:0/234299941 learned_addr learned my addr 172.21.15.100:0/234299941 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e46d9d640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48102a40 0x7f7e48075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e3ffff640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 0x7f7e481a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 -- 172.21.15.100:0/234299941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48102a40 msgr2=0x7f7e48075830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48102a40 0x7f7e48075830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 -- 172.21.15.100:0/234299941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 msgr2=0x7f7e481a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 0x7f7e481a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 -- 172.21.15.100:0/234299941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481a3f10 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e3ffff640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 0x7f7e481a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4759e640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097b0 tx=0x7f7e40031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40003bf0 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40003d90 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481a41a0 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4002fc30 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.839+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481a4740 con 0x7f7e48108980 2024-04-30T23:12:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.840+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e48107790 con 0x7f7e48108980 2024-04-30T23:12:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.842+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f7e40004040 con 0x7f7e48108980 2024-04-30T23:12:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.842+0000 7f7e44d99640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 0x7f7e340a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.842+0000 7f7e46d9d640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 0x7f7e340a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.842+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f7e400f1fb0 con 0x7f7e48108980 2024-04-30T23:12:50.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.843+0000 7f7e46d9d640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 0x7f7e340a61d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e48103640 tx=0x7f7e38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:50.846+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7e400be600 con 0x7f7e48108980 2024-04-30T23:12:51.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.025+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7e480637e0 con 0x7f7e48108980 2024-04-30T23:12:51.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.025+0000 7f7e44d99640 1 -- 172.21.15.100:0/234299941 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f7e400bdf00 con 0x7f7e48108980 2024-04-30T23:12:51.026 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 msgr2=0x7f7e340a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 0x7f7e340a61d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e48103640 tx=0x7f7e38005f90 comp rx=0 tx=0).stop 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 msgr2=0x7f7e481a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097b0 tx=0x7f7e40031840 comp rx=0 tx=0).stop 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 shutdown_connections 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e340a3cc0 0x7f7e340a61d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e48108980 0x7f7e481a3920 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e48103c80 0x7f7e481a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 --2- 172.21.15.100:0/234299941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e48102a40 0x7f7e48075830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 >> 172.21.15.100:0/234299941 conn(0x7f7e480fdc30 msgr2=0x7f7e48104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 shutdown_connections 2024-04-30T23:12:51.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.027+0000 7f7e4d1c7640 1 -- 172.21.15.100:0/234299941 wait complete. 2024-04-30T23:12:51.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2670477127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4057838332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.038 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:50 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2163121555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.147+0000 7f0ae1b94640 1 -- 172.21.15.100:0/2917166715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 msgr2=0x7f0adc104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.147+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/2917166715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc104090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009900 tx=0x7f0ad002a410 comp rx=0 tx=0).stop 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 -- 172.21.15.100:0/2917166715 shutdown_connections 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/2917166715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc108980 0x7f0adc10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/2917166715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc104090 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/2917166715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc102a40 0x7f0adc103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 -- 172.21.15.100:0/2917166715 >> 172.21.15.100:0/2917166715 conn(0x7f0adc0fdc30 msgr2=0x7f0adc1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 -- 172.21.15.100:0/2917166715 shutdown_connections 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 -- 172.21.15.100:0/2917166715 wait complete. 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 Processor -- start 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.148+0000 7f0ae1b94640 1 -- start start 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc102a40 0x7f0adc19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 0x7f0adc1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc10f670 con 0x7f0adc103c80 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc10f4f0 con 0x7f0adc108980 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc10f7f0 con 0x7f0adc102a40 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34534/0 (socket says 172.21.15.100:34534) 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 -- 172.21.15.100:0/633431259 learned_addr learned my addr 172.21.15.100:0/633431259 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adb7fe640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc102a40 0x7f0adc19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adbfff640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 0x7f0adc1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 -- 172.21.15.100:0/633431259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc102a40 msgr2=0x7f0adc19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc102a40 0x7f0adc19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 -- 172.21.15.100:0/633431259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 msgr2=0x7f0adc1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 0x7f0adc1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 -- 172.21.15.100:0/633431259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc1a1d30 con 0x7f0adc103c80 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adbfff640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 0x7f0adc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0adaffd640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006010 tx=0x7f0ad0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad003f030 con 0x7f0adc103c80 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ad0003cb0 con 0x7f0adc103c80 2024-04-30T23:12:51.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc1a1fc0 con 0x7f0adc103c80 2024-04-30T23:12:51.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0035070 con 0x7f0adc103c80 2024-04-30T23:12:51.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.149+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc1a23d0 con 0x7f0adc103c80 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.150+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc107790 con 0x7f0adc103c80 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.152+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0ad0042030 con 0x7f0adc103c80 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.152+0000 7f0ad8ff9640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 0x7f0ac40a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.152+0000 7f0adb7fe640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 0x7f0ac40a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.152+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f0ad00f15d0 con 0x7f0adc103c80 2024-04-30T23:12:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.153+0000 7f0adb7fe640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 0x7f0ac40a6150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0adc103640 tx=0x7f0acc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.156+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0ad00bdb10 con 0x7f0adc103c80 2024-04-30T23:12:51.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:50 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2670477127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:50 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4057838332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:50 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2163121555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:50 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2670477127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:50 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4057838332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:50 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2163121555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.372+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0adc02db90 con 0x7f0adc103c80 2024-04-30T23:12:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.373+0000 7f0ad8ff9640 1 -- 172.21.15.100:0/633431259 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f0ad0003e60 con 0x7f0adc103c80 2024-04-30T23:12:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:51.374 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:12:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 msgr2=0x7f0ac40a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 0x7f0ac40a6150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0adc103640 tx=0x7f0acc00b390 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 msgr2=0x7f0adc19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006010 tx=0x7f0ad0004340 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 shutdown_connections 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0ac40a3c40 0x7f0ac40a6150 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0adc108980 0x7f0adc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0adc103c80 0x7f0adc19a730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 --2- 172.21.15.100:0/633431259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc102a40 0x7f0adc19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 >> 172.21.15.100:0/633431259 conn(0x7f0adc0fdc30 msgr2=0x7f0adc104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 shutdown_connections 2024-04-30T23:12:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.375+0000 7f0ae1b94640 1 -- 172.21.15.100:0/633431259 wait complete. 2024-04-30T23:12:51.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 -- 172.21.15.100:0/2316307293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050103c80 msgr2=0x7fd050104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 --2- 172.21.15.100:0/2316307293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050103c80 0x7fd050104090 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd038009900 tx=0x7fd03802a410 comp rx=0 tx=0).stop 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 -- 172.21.15.100:0/2316307293 shutdown_connections 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 --2- 172.21.15.100:0/2316307293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050108980 0x7fd05010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 --2- 172.21.15.100:0/2316307293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050103c80 0x7fd050104090 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 --2- 172.21.15.100:0/2316307293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd050103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 -- 172.21.15.100:0/2316307293 >> 172.21.15.100:0/2316307293 conn(0x7fd0500fdc30 msgr2=0x7fd0501000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 -- 172.21.15.100:0/2316307293 shutdown_connections 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.493+0000 7fd05619d640 1 -- 172.21.15.100:0/2316307293 wait complete. 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 Processor -- start 2024-04-30T23:12:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 -- start start 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd0501990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050103c80 0x7fd050199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010e540 con 0x7fd050108980 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010e3c0 con 0x7fd050103c80 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd05619d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010e6c0 con 0x7fd050102a40 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34552/0 (socket says 172.21.15.100:34552) 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 -- 172.21.15.100:0/1973021192 learned_addr learned my addr 172.21.15.100:0/1973021192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04effd640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050103c80 0x7fd050199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04f7fe640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd0501990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 -- 172.21.15.100:0/1973021192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 msgr2=0x7fd0501990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd0501990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 -- 172.21.15.100:0/1973021192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050103c80 msgr2=0x7fd050199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050103c80 0x7fd050199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.494+0000 7fd04ffff640 1 -- 172.21.15.100:0/1973021192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0501a0b70 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd04f7fe640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd0501990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd04ffff640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c970 tx=0x7fd04800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048007bb0 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd048007d50 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0501a0e60 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048018770 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.495+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501a1270 con 0x7fd050108980 2024-04-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.496+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05006a200 con 0x7fd050108980 2024-04-30T23:12:51.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.497+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fd04800f990 con 0x7fd050108980 2024-04-30T23:12:51.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.498+0000 7fd04cff9640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 0x7fd03c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.498+0000 7fd04f7fe640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 0x7fd03c0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.498+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fd0480d0a70 con 0x7fd050108980 2024-04-30T23:12:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.498+0000 7fd04f7fe640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 0x7fd03c0a6150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd050103640 tx=0x7fd040007870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.501+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd05006a200 con 0x7fd050108980 2024-04-30T23:12:51.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.681+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd05002dc50 con 0x7fd050108980 2024-04-30T23:12:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.683+0000 7fd04cff9640 1 -- 172.21.15.100:0/1973021192 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24588 (secure 0 0 0) 0x7fd048014030 con 0x7fd050108980 2024-04-30T23:12:51.684 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:51.684 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":91,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:11:56.768134+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 msgr2=0x7fd03c0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 0x7fd03c0a6150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd050103640 tx=0x7fd040007870 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 msgr2=0x7fd0501a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c970 tx=0x7fd04800ce30 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 shutdown_connections 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd03c0a3c40 0x7fd03c0a6150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd050108980 0x7fd0501a05b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd050103c80 0x7fd050199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 --2- 172.21.15.100:0/1973021192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd050102a40 0x7fd0501990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 >> 172.21.15.100:0/1973021192 conn(0x7fd0500fdc30 msgr2=0x7fd050104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 shutdown_connections 2024-04-30T23:12:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.685+0000 7fd05619d640 1 -- 172.21.15.100:0/1973021192 wait complete. 2024-04-30T23:12:51.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 -- 172.21.15.100:0/2598086117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c106c60 msgr2=0x7f628c109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 --2- 172.21.15.100:0/2598086117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c106c60 0x7f628c109140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f627c009900 tx=0x7f627c02a410 comp rx=0 tx=0).stop 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 -- 172.21.15.100:0/2598086117 shutdown_connections 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 --2- 172.21.15.100:0/2598086117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c1097d0 0x7f628c10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 --2- 172.21.15.100:0/2598086117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c106c60 0x7f628c109140 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 --2- 172.21.15.100:0/2598086117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c101e80 0x7f628c102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 -- 172.21.15.100:0/2598086117 >> 172.21.15.100:0/2598086117 conn(0x7f628c0fd3f0 msgr2=0x7f628c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 -- 172.21.15.100:0/2598086117 shutdown_connections 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.804+0000 7f6291e1b640 1 -- 172.21.15.100:0/2598086117 wait complete. 2024-04-30T23:12:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 Processor -- start 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 -- start start 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c106c60 0x7f628c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 0x7f628c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10f660 con 0x7f628c101e80 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10f4e0 con 0x7f628c1097d0 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f6291e1b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10f7e0 con 0x7f628c106c60 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f628b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f628b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34580/0 (socket says 172.21.15.100:34580) 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.805+0000 7f628b7fe640 1 -- 172.21.15.100:0/32249089 learned_addr learned my addr 172.21.15.100:0/32249089 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628affd640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c106c60 0x7f628c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628bfff640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 0x7f628c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 -- 172.21.15.100:0/32249089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c106c60 msgr2=0x7f628c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c106c60 0x7f628c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 -- 172.21.15.100:0/32249089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 msgr2=0x7f628c1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 0x7f628c1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 -- 172.21.15.100:0/32249089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c1a1c90 con 0x7f628c101e80 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628bfff640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 0x7f628c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f628b7fe640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f628000c970 tx=0x7f628000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280014070 con 0x7f628c101e80 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6280004440 con 0x7f628c101e80 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c1a1f80 con 0x7f628c101e80 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280003e50 con 0x7f628c101e80 2024-04-30T23:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.806+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c1a23e0 con 0x7f628c101e80 2024-04-30T23:12:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.807+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c06a1d0 con 0x7f628c101e80 2024-04-30T23:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.808+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6280017070 con 0x7f628c101e80 2024-04-30T23:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.809+0000 7f6288ff9640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 0x7f62740a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.809+0000 7f628affd640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 0x7f62740a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.809+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f62800d0c70 con 0x7f628c101e80 2024-04-30T23:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.810+0000 7f628affd640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 0x7f62740a62f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f627c000c00 tx=0x7f627c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:51.813+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f628001e030 con 0x7f628c101e80 2024-04-30T23:12:52.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.044+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f628c02dc50 con 0x7f628c101e80 2024-04-30T23:12:52.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.045+0000 7f6288ff9640 1 -- 172.21.15.100:0/32249089 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f628009d1b0 con 0x7f628c101e80 2024-04-30T23:12:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:12:52.045 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:12:52.046 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:12:52.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 msgr2=0x7f62740a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 0x7f62740a62f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f627c000c00 tx=0x7f627c031400 comp rx=0 tx=0).stop 2024-04-30T23:12:52.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 msgr2=0x7f628c19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f628000c970 tx=0x7f628000ce30 comp rx=0 tx=0).stop 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 shutdown_connections 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62740a3de0 0x7f62740a62f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f628c1097d0 0x7f628c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f628c106c60 0x7f628c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 --2- 172.21.15.100:0/32249089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f628c101e80 0x7f628c19a200 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 >> 172.21.15.100:0/32249089 conn(0x7f628c0fd3f0 msgr2=0x7f628c107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 shutdown_connections 2024-04-30T23:12:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.047+0000 7f6291e1b640 1 -- 172.21.15.100:0/32249089 wait complete. 2024-04-30T23:12:52.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/234299941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:52.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/633431259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:51 smithi100 ceph-mon[29745]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:52.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1973021192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-30T23:11:00.289657+0000', 'modified': '2024-04-30T23:11:27.921467+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24545, 'mds_1': 24511, 'mds_2': 24503, 'mds_3': 24496, 'mds_4': 14664}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14652': {'gid': 14652, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6839/1668286182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1668286182}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1668286182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14664': {'gid': 14664, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.100:6841/2201593414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6840', 'nonce': 2201593414}, {'type': 'v1', 'addr': '172.21.15.100:6841', 'nonce': 2201593414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6833/2331654352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 2331654352}, {'type': 'v1', 'addr': '172.21.15.183:6833', 'nonce': 2331654352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.104:6833/176831078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6832', 'nonce': 176831078}, {'type': 'v1', 'addr': '172.21.15.104:6833', 'nonce': 176831078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.104:6835/4094200769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 4094200769}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 4094200769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/2697644609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2697644609}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2697644609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.183:6837/1464515486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1464515486}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1464515486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.104:6837/4190150609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6836', 'nonce': 4190150609}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 4190150609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.183:6839/587252257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 587252257}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 587252257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24545': {'gid': 24545, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6839/1200691747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6838', 'nonce': 1200691747}, {'type': 'v1', 'addr': '172.21.15.104:6839', 'nonce': 1200691747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24545, 'qdb_cluster': [14664, 24511, 24545, 24496, 24503]} 2024-04-30T23:12:52.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-30T23:12:52.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T23:12:52.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 -- 172.21.15.100:0/3835161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 msgr2=0x7f8c0010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 --2- 172.21.15.100:0/3835161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c0010ad80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009ca0 tx=0x7f8bf802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 -- 172.21.15.100:0/3835161222 shutdown_connections 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 --2- 172.21.15.100:0/3835161222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c0010ad80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 --2- 172.21.15.100:0/3835161222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 --2- 172.21.15.100:0/3835161222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 0x7f8c00103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 -- 172.21.15.100:0/3835161222 >> 172.21.15.100:0/3835161222 conn(0x7f8c000fdc10 msgr2=0x7f8c001000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 -- 172.21.15.100:0/3835161222 shutdown_connections 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.168+0000 7f8c0799d640 1 -- 172.21.15.100:0/3835161222 wait complete. 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 Processor -- start 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 -- start start 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 0x7f8c00199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e550 con 0x7f8c00108960 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e3d0 con 0x7f8c00102a20 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c0799d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e6d0 con 0x7f8c00103c60 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34596/0 (socket says 172.21.15.100:34596) 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 -- 172.21.15.100:0/661417899 learned_addr learned my addr 172.21.15.100:0/661417899 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05739640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 0x7f8c00199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c04f38640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 -- 172.21.15.100:0/661417899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 msgr2=0x7f8c00199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 -- 172.21.15.100:0/661417899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 msgr2=0x7f8c00199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 0x7f8c00199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 -- 172.21.15.100:0/661417899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c001a0f40 con 0x7f8c00108960 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c04f38640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.169+0000 7f8c05f3a640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80097b0 tx=0x7f8bf8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.170+0000 7f8bf67fc640 1 -- 172.21.15.100:0/661417899 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf804a070 con 0x7f8c00108960 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.170+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c00069ed0 con 0x7f8c00108960 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.170+0000 7f8bf67fc640 1 -- 172.21.15.100:0/661417899 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bf802f380 con 0x7f8c00108960 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.170+0000 7f8bf67fc640 1 -- 172.21.15.100:0/661417899 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf802fb20 con 0x7f8c00108960 2024-04-30T23:12:52.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.170+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0006a470 con 0x7f8c00108960 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.172+0000 7f8c0e851740 1 Processor -- start 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.172+0000 7f8bf67fc640 1 -- 172.21.15.100:0/661417899 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8bf804d070 con 0x7f8c00108960 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.172+0000 7f8c0e851740 1 -- start start 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.172+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.172+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096f6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c0e851740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558d09650740 con 0x558d093213b0 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c0e851740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558d095ec3a0 con 0x558d09329590 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c0e851740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d0964c700 con 0x558d0934a270 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34610/0 (socket says 172.21.15.100:34610) 2024-04-30T23:12:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 -- 172.21.15.100:0/70469553 learned_addr learned my addr 172.21.15.100:0/70469553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c04f38640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c04f38640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8bf67fc640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 0x7f8bec0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 -- 172.21.15.100:0/70469553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 msgr2=0x558d096ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096ef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 -- 172.21.15.100:0/70469553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 msgr2=0x558d096f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 -- 172.21.15.100:0/70469553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d09608750 con 0x558d093213b0 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c04f38640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05f3a640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 0x7f8bec0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8c05739640 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00bc70 tx=0x7f8bfc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bc1227efa96930 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8bf67fc640 1 -- 172.21.15.100:0/661417899 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8bf80f3170 con 0x7f8c00108960 2024-04-30T23:12:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8beb7fe640 1 -- 172.21.15.100:0/70469553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc004220 con 0x558d093213b0 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8beb7fe640 1 -- 172.21.15.100:0/70469553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc00be20 con 0x558d093213b0 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.173+0000 7f8beb7fe640 1 -- 172.21.15.100:0/70469553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc004c90 con 0x558d093213b0 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 -- 172.21.15.100:0/70469553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 msgr2=0x558d096efa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00bc70 tx=0x7f8bfc0107a0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c05f3a640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 0x7f8bec0a6150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80bba00 tx=0x7f8bf808da30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 -- 172.21.15.100:0/70469553 shutdown_connections 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096efa20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 --2- 172.21.15.100:0/70469553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 -- 172.21.15.100:0/70469553 >> 172.21.15.100:0/70469553 conn(0x558d0933e3c0 msgr2=0x558d096e6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 -- 172.21.15.100:0/70469553 shutdown_connections 2024-04-30T23:12:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.174+0000 7f8c0e851740 1 -- 172.21.15.100:0/70469553 wait complete. 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 -- start start 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 Processor -- start 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d09329590 0x558d096f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d0934a270 0x558d09700790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558d096f7370 con 0x558d093213b0 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558d095d7fe0 con 0x558d0934a270 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d096f74f0 con 0x558d09329590 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c0e851740 10 client.0 _ll_register_callbacks cb 0x558d095f7c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34624/0 (socket says 172.21.15.100:34624) 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 -- 172.21.15.100:0/1596550473 learned_addr learned my addr 172.21.15.100:0/1596550473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d0934a270 0x558d09700790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c05739640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d09329590 0x558d096f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 -- 172.21.15.100:0/1596550473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d09329590 msgr2=0x558d096f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d09329590 0x558d096f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 -- 172.21.15.100:0/1596550473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d0934a270 msgr2=0x558d09700790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.175+0000 7f8c04f38640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d0934a270 0x558d09700790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c04f38640 1 -- 172.21.15.100:0/1596550473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d093622d0 con 0x558d093213b0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c04f38640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00129b0 tx=0x7f8bf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76be2c97a3cc2c56 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000fcd0 con 0x558d093213b0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bfc00be20 con 0x558d093213b0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8bf001e440 con 0x558d093213b0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bf0027050 con 0x558d093213b0 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 10 client.15258 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d0942c6b0 con 0x558d093213b0 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc00be20 con 0x558d093213b0 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8bf001c020 con 0x558d093213b0 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 10 client.15258 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 20 client.15258 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d09308e40 0x558d09707330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 4 client.15258 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.176+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d0965e350 con 0x558d09308e40 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.177+0000 7f8c05739640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d09308e40 0x558d09707330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.177+0000 7f8be8ff9640 10 client.15258 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.177+0000 7f8c05739640 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d09308e40 0x558d09707330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=575bec014a585d24 server_cookie=a823f7a1821ff2d8 in_seq=0 out_seq=0 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8be8ff9640 1 -- 172.21.15.100:0/1596550473 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558d0965e350 con 0x558d09308e40 2024-04-30T23:12:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8be8ff9640 10 client.15258 handle_command_reply: tid=0 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 client.15258 shutdown 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 msgr2=0x558d096f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00129b0 tx=0x7f8bf00046c0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 shutdown_connections 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d09308e40 0x558d09707330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d0934a270 0x558d09700790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d09329590 0x558d096f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8be8ff9640 0 client.15258 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 --2- 172.21.15.100:0/1596550473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096f92f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 >> 172.21.15.100:0/1596550473 conn(0x558d0933e3c0 msgr2=0x558d096e5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 shutdown_connections 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 1 -- 172.21.15.100:0/1596550473 wait complete. 2024-04-30T23:12:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.178+0000 7f8c0e851740 20 client.15258 trim_cache size 0 max 16384 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.196+0000 7f8c0e851740 1 Processor -- start 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.196+0000 7f8c0e851740 1 -- start start 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.196+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 0x558d096f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.196+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.196+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c0e851740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558d09705670 con 0x558d09329590 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c0e851740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558d09705d40 con 0x558d093213b0 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c0e851740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d09706410 con 0x558d0934a270 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34630/0 (socket says 172.21.15.100:34630) 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 -- 172.21.15.100:0/765652717 learned_addr learned my addr 172.21.15.100:0/765652717 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c04f38640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 0x558d096f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c04f38640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 -- 172.21.15.100:0/765652717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 msgr2=0x558d096f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 -- 172.21.15.100:0/765652717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 msgr2=0x558d096f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 0x558d096f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 -- 172.21.15.100:0/765652717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d096f4140 con 0x558d09329590 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c04f38640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 0x558d096f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8c05739640 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc000c00 tx=0x7f8bfc010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840126f8bf48c047 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8beaffd640 1 -- 172.21.15.100:0/765652717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0042c0 con 0x558d09329590 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8beaffd640 1 -- 172.21.15.100:0/765652717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc02d070 con 0x558d09329590 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.197+0000 7f8beaffd640 1 -- 172.21.15.100:0/765652717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003970 con 0x558d09329590 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- 172.21.15.100:0/765652717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 msgr2=0x558d09700720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc000c00 tx=0x7f8bfc010fd0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- 172.21.15.100:0/765652717 shutdown_connections 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d096f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d09329590 0x558d09700720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 --2- 172.21.15.100:0/765652717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d093213b0 0x558d096f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- 172.21.15.100:0/765652717 >> 172.21.15.100:0/765652717 conn(0x558d0933e3c0 msgr2=0x558d096f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- 172.21.15.100:0/765652717 shutdown_connections 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- 172.21.15.100:0/765652717 wait complete. 2024-04-30T23:12:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 -- start start 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.198+0000 7f8c0e851740 1 Processor -- start 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096fba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d0976c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558d097071b0 con 0x558d093213b0 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558d09706ae0 con 0x558d09329590 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d09707880 con 0x558d0934a270 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c0e851740 10 client.0 _ll_register_callbacks cb 0x7f8bf000d640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34640/0 (socket says 172.21.15.100:34640) 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 -- 172.21.15.100:0/2448691817 learned_addr learned my addr 172.21.15.100:0/2448691817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 -- 172.21.15.100:0/2448691817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 msgr2=0x558d0976c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d0976c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c05739640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 -- 172.21.15.100:0/2448691817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 msgr2=0x558d096fba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096fba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 -- 172.21.15.100:0/2448691817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d096fc0d0 con 0x558d093213b0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8c04f38640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d4a0 tx=0x7f8bf0005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f429f1ea0aee783a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.199+0000 7f8be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0010a40 con 0x558d093213b0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8bf0010c60 con 0x558d093213b0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bfc02d070 con 0x558d093213b0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bf0010e60 con 0x558d093213b0 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 10 client.15264 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d0976d6e0 con 0x558d093213b0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc02d070 con 0x558d093213b0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8bf001c030 con 0x558d093213b0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 10 client.15264 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 20 client.15264 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d092de280 0x558d09771030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 4 client.15264 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "status"}) -- 0x558d096581c0 con 0x558d092de280 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.200+0000 7f8c05739640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d092de280 0x558d09771030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8be8ff9640 10 client.15264 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c05739640 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d092de280 0x558d09771030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed0da4b981404f6a server_cookie=873add7bb65c8e74 in_seq=0 out_seq=0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8be8ff9640 1 -- 172.21.15.100:0/2448691817 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558d096581c0 con 0x558d092de280 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8be8ff9640 10 client.15264 handle_command_reply: tid=0 2024-04-30T23:12:52.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 client.15264 shutdown 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 msgr2=0x558d096fb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d4a0 tx=0x7f8bf0005b80 comp rx=0 tx=0).stop 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 shutdown_connections 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x558d092de280 0x558d09771030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d0934a270 0x558d0976c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8be8ff9640 0 client.15264 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558d09329590 0x558d096fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 --2- 172.21.15.100:0/2448691817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d093213b0 0x558d096fb550 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 >> 172.21.15.100:0/2448691817 conn(0x558d0933e3c0 msgr2=0x558d096f28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 shutdown_connections 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 1 -- 172.21.15.100:0/2448691817 wait complete. 2024-04-30T23:12:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.201+0000 7f8c0e851740 20 client.15264 trim_cache size 0 max 16384 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 4, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 14664, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 85.297418749000002, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 91, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:12:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 121.114388523 2024-04-30T23:12:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:12:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 msgr2=0x7f8bec0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 0x7f8bec0a6150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80bba00 tx=0x7f8bf808da30 comp rx=0 tx=0).stop 2024-04-30T23:12:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 msgr2=0x7f8c001a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80097b0 tx=0x7f8bf8003ba0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 shutdown_connections 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8bec0a3c40 0x7f8bec0a6150 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c00108960 0x7f8c001a08d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c00103c60 0x7f8c00199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 --2- 172.21.15.100:0/661417899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c00102a20 0x7f8c00199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 >> 172.21.15.100:0/661417899 conn(0x7f8c000fdc10 msgr2=0x7f8c00104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 shutdown_connections 2024-04-30T23:12:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.202+0000 7f8c0799d640 1 -- 172.21.15.100:0/661417899 wait complete. 2024-04-30T23:12:52.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T23:12:52.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/234299941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:52.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/633431259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:51 smithi104 ceph-mon[32987]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:52.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1973021192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/234299941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:12:52.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/633431259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:51 smithi183 ceph-mon[33560]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:52.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1973021192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 -- 172.21.15.100:0/932571091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34104d80 msgr2=0x7fda34105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/932571091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34104d80 0x7fda34105190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda24009900 tx=0x7fda2402a410 comp rx=0 tx=0).stop 2024-04-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 -- 172.21.15.100:0/932571091 shutdown_connections 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/932571091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34109a80 0x7fda3410bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/932571091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34104d80 0x7fda34105190 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/932571091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda34104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 -- 172.21.15.100:0/932571091 >> 172.21.15.100:0/932571091 conn(0x7fda340fed30 msgr2=0x7fda341011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 -- 172.21.15.100:0/932571091 shutdown_connections 2024-04-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.322+0000 7fda3bbd7640 1 -- 172.21.15.100:0/932571091 wait complete. 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 Processor -- start 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 -- start start 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda3419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34104d80 0x7fda3419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda3410f660 con 0x7fda34109a80 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fda3410f4e0 con 0x7fda34104d80 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3bbd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fda3410f7e0 con 0x7fda34103b40 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34650/0 (socket says 172.21.15.100:34650) 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda3a174640 1 -- 172.21.15.100:0/1968273090 learned_addr learned my addr 172.21.15.100:0/1968273090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda39172640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34104d80 0x7fda3419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.323+0000 7fda39973640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda3419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 -- 172.21.15.100:0/1968273090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 msgr2=0x7fda3419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda3419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 -- 172.21.15.100:0/1968273090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34104d80 msgr2=0x7fda3419c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34104d80 0x7fda3419c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 -- 172.21.15.100:0/1968273090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda341a3fd0 con 0x7fda34109a80 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda39973640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda3419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3a174640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c970 tx=0x7fda3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda2affd640 1 -- 172.21.15.100:0/1968273090 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30007bb0 con 0x7fda34109a80 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda2affd640 1 -- 172.21.15.100:0/1968273090 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda30007d50 con 0x7fda34109a80 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda341a42c0 con 0x7fda34109a80 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda2affd640 1 -- 172.21.15.100:0/1968273090 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30004e60 con 0x7fda34109a80 2024-04-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.324+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda341a47c0 con 0x7fda34109a80 2024-04-30T23:12:52.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.326+0000 7fda2affd640 1 -- 172.21.15.100:0/1968273090 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fda30005020 con 0x7fda34109a80 2024-04-30T23:12:52.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 Processor -- start 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 -- start start 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009204090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda2affd640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 0x7fda200a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560009169740 con 0x560008e3a3b0 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600091053a0 con 0x560008e42590 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda42b6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560009165700 con 0x560008e63270 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda39973640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda39172640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 0x7fda200a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda39973640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34658/0 (socket says 172.21.15.100:34658) 2024-04-30T23:12:52.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda39973640 1 -- 172.21.15.100:0/4243787648 learned_addr learned my addr 172.21.15.100:0/4243787648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda3a174640 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda2affd640 1 -- 172.21.15.100:0/1968273090 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fda300d0610 con 0x7fda34109a80 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.327+0000 7fda39172640 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009204090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 -- 172.21.15.100:0/4243787648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 msgr2=0x560009204090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009204090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 -- 172.21.15.100:0/4243787648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 msgr2=0x56000920b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 -- 172.21.15.100:0/4243787648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560009121750 con 0x560008e3a3b0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39172640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 0x7fda200a6150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda240315a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda39973640 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009ee0 tx=0x7fda2c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a628a984d68d8c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda1ffff640 1 -- 172.21.15.100:0/4243787648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c01a680 con 0x560008e3a3b0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda1ffff640 1 -- 172.21.15.100:0/4243787648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda2c01acd0 con 0x560008e3a3b0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.328+0000 7fda1ffff640 1 -- 172.21.15.100:0/4243787648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011cd0 con 0x560008e3a3b0 2024-04-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- 172.21.15.100:0/4243787648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 msgr2=0x560009204610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009ee0 tx=0x7fda2c00f730 comp rx=0 tx=0).stop 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- 172.21.15.100:0/4243787648 shutdown_connections 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x560009204610 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 --2- 172.21.15.100:0/4243787648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009204090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- 172.21.15.100:0/4243787648 >> 172.21.15.100:0/4243787648 conn(0x560008e573c0 msgr2=0x5600091ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- 172.21.15.100:0/4243787648 shutdown_connections 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- 172.21.15.100:0/4243787648 wait complete. 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 -- start start 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.329+0000 7fda42b6d740 1 Processor -- start 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009215410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56000920bf60 con 0x560008e3a3b0 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600090f0fe0 con 0x560008e42590 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56000920c0e0 con 0x560008e63270 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda42b6d740 10 client.0 _ll_register_callbacks cb 0x560009110c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34664/0 (socket says 172.21.15.100:34664) 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 -- 172.21.15.100:0/3924582825 learned_addr learned my addr 172.21.15.100:0/3924582825 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39172640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda3a174640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009215410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 -- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 msgr2=0x560009215410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009215410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 -- 172.21.15.100:0/3924582825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 msgr2=0x56000920e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 -- 172.21.15.100:0/3924582825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560008e7b2d0 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda3a174640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009215410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39172640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda39973640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005b00 tx=0x7fda2c011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d64ada683f6c56e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.330+0000 7fda1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011c40 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fda2c011de0 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda2c01acd0 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda2c02f050 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 10 client.15276 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560008f456b0 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda2c01acd0 con 0x560008e3a3b0 2024-04-30T23:12:52.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fda2c005020 con 0x560008e3a3b0 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 10 client.15276 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 20 client.15276 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008e21e40 0x56000921bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 4 client.15276 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.331+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560009177350 con 0x560008e21e40 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.332+0000 7fda39172640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008e21e40 0x56000921bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.332+0000 7fda39172640 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008e21e40 0x56000921bdf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1a57859be6abcfc4 server_cookie=c3f5f61d820d9686 in_seq=0 out_seq=0 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.332+0000 7fda1d7fa640 10 client.15276 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda1d7fa640 1 -- 172.21.15.100:0/3924582825 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x560009177350 con 0x560008e21e40 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda1d7fa640 10 client.15276 handle_command_reply: tid=0 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 client.15276 shutdown 2024-04-30T23:12:52.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 msgr2=0x56000920df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005b00 tx=0x7fda2c011670 comp rx=0 tx=0).stop 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 shutdown_connections 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008e21e40 0x56000921bdf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e63270 0x560009215410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x56000920e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 --2- 172.21.15.100:0/3924582825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e3a3b0 0x56000920df70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda1d7fa640 0 client.15276 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 >> 172.21.15.100:0/3924582825 conn(0x560008e573c0 msgr2=0x5600091fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 shutdown_connections 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 1 -- 172.21.15.100:0/3924582825 wait complete. 2024-04-30T23:12:52.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.333+0000 7fda42b6d740 20 client.15276 trim_cache size 0 max 16384 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 Processor -- start 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 -- start start 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 0x56000920c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e42590 0x560009215330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56000921a130 con 0x560008e63270 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56000921a800 con 0x560008e3a3b0 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda42b6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56000921aed0 con 0x560008e42590 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34668/0 (socket says 172.21.15.100:34668) 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 -- 172.21.15.100:0/2302521365 learned_addr learned my addr 172.21.15.100:0/2302521365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda39172640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e42590 0x560009215330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda39973640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 0x56000920c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 -- 172.21.15.100:0/2302521365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e42590 msgr2=0x560009215330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e42590 0x560009215330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 -- 172.21.15.100:0/2302521365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 msgr2=0x56000920c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 0x56000920c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 -- 172.21.15.100:0/2302521365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560009208de0 con 0x560008e63270 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda39973640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 0x56000920c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.352+0000 7fda3a174640 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda3009c150 tx=0x7fda3001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9117431fd815279f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda1f7fe640 1 -- 172.21.15.100:0/2302521365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30099c80 con 0x560008e63270 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda1f7fe640 1 -- 172.21.15.100:0/2302521365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda3009cb50 con 0x560008e63270 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda1f7fe640 1 -- 172.21.15.100:0/2302521365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30099aa0 con 0x560008e63270 2024-04-30T23:12:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 -- 172.21.15.100:0/2302521365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 msgr2=0x56000920c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda3009c150 tx=0x7fda3001b8b0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 -- 172.21.15.100:0/2302521365 shutdown_connections 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x56000920c9f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e42590 0x560009215330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2302521365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e3a3b0 0x56000920c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 -- 172.21.15.100:0/2302521365 >> 172.21.15.100:0/2302521365 conn(0x560008e573c0 msgr2=0x560009207690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 -- 172.21.15.100:0/2302521365 shutdown_connections 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.353+0000 7fda42b6d740 1 -- 172.21.15.100:0/2302521365 wait complete. 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 -- start start 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 Processor -- start 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 0x56000920fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x560009215210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56000921bc70 con 0x560008e63270 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56000921b5a0 con 0x560008e42590 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56000921c340 con 0x560008e3a3b0 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda42b6d740 10 client.0 _ll_register_callbacks cb 0x7fda3000a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda3a174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34670/0 (socket says 172.21.15.100:34670) 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda3a174640 1 -- 172.21.15.100:0/2755861885 learned_addr learned my addr 172.21.15.100:0/2755861885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.354+0000 7fda39973640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 0x56000920fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda39172640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x560009215210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 -- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 msgr2=0x56000920fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 0x56000920fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 -- 172.21.15.100:0/2755861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 msgr2=0x560009215210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x560009215210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 -- 172.21.15.100:0/2755861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560009280b50 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda39973640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 0x56000920fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda3a174640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fda300988b0 tx=0x7fda3009a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf28a7c04fc4bdf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3001d040 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fda300a4c30 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda3009cb50 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda300a4e70 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 10 client.15282 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560009281ca0 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda3009cb50 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fda300b9b90 con 0x560008e63270 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 10 client.15282 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 20 client.15282 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008df7280 0x560009284fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 4 client.15282 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.355+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "status"}) -- 0x5600091711c0 con 0x560008df7280 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda39973640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008df7280 0x560009284fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda1d7fa640 10 client.15282 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda39973640 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008df7280 0x560009284fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=679a166acc04accc server_cookie=84daeedc6f86350f in_seq=0 out_seq=0 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda1d7fa640 1 -- 172.21.15.100:0/2755861885 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5600091711c0 con 0x560008df7280 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda1d7fa640 10 client.15282 handle_command_reply: tid=0 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda42b6d740 1 client.15282 shutdown 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 msgr2=0x560009210300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.356+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fda300988b0 tx=0x7fda3009a690 comp rx=0 tx=0).stop 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 shutdown_connections 2024-04-30T23:12:52.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x560008df7280 0x560009284fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560008e63270 0x560009210300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560008e42590 0x560009215210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 --2- 172.21.15.100:0/2755861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560008e3a3b0 0x56000920fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda1d7fa640 0 client.15282 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 >> 172.21.15.100:0/2755861885 conn(0x560008e573c0 msgr2=0x56000920c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 shutdown_connections 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 1 -- 172.21.15.100:0/2755861885 wait complete. 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda42b6d740 20 client.15282 trim_cache size 0 max 16384 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:12:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 3, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24496, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 85.660767288000002, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 91, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 132.58879014999999 2024-04-30T23:12:52.365 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 msgr2=0x7fda200a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 0x7fda200a6150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda240315a0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 msgr2=0x7fda341a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda3000c970 tx=0x7fda3000ce30 comp rx=0 tx=0).stop 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 shutdown_connections 2024-04-30T23:12:52.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fda200a3c40 0x7fda200a6150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda34109a80 0x7fda341a3960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda34104d80 0x7fda3419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 --2- 172.21.15.100:0/1968273090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda34103b40 0x7fda3419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 >> 172.21.15.100:0/1968273090 conn(0x7fda340fed30 msgr2=0x7fda340ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 shutdown_connections 2024-04-30T23:12:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.357+0000 7fda3bbd7640 1 -- 172.21.15.100:0/1968273090 wait complete. 2024-04-30T23:12:52.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 -- 172.21.15.100:0/1664845887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 msgr2=0x7f8b4410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 --2- 172.21.15.100:0/1664845887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b4410ada0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009ca0 tx=0x7f8b3c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 -- 172.21.15.100:0/1664845887 shutdown_connections 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 --2- 172.21.15.100:0/1664845887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b4410ada0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 --2- 172.21.15.100:0/1664845887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 0x7f8b44104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 --2- 172.21.15.100:0/1664845887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 0x7f8b44103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 -- 172.21.15.100:0/1664845887 >> 172.21.15.100:0/1664845887 conn(0x7f8b440fdc30 msgr2=0x7f8b441000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 -- 172.21.15.100:0/1664845887 shutdown_connections 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.477+0000 7f8b4a443640 1 -- 172.21.15.100:0/1664845887 wait complete. 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 Processor -- start 2024-04-30T23:12:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 -- start start 2024-04-30T23:12:52.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 0x7f8b44199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 0x7f8b44199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4410e550 con 0x7f8b44108980 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4410e3d0 con 0x7f8b44102a40 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b4a443640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4410e6d0 con 0x7f8b44103c80 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b489e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b489e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34696/0 (socket says 172.21.15.100:34696) 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b489e0640 1 -- 172.21.15.100:0/3259087862 learned_addr learned my addr 172.21.15.100:0/3259087862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b43fff640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 0x7f8b44199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.478+0000 7f8b437fe640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 0x7f8b44199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 -- 172.21.15.100:0/3259087862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 msgr2=0x7f8b44199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 0x7f8b44199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 -- 172.21.15.100:0/3259087862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 msgr2=0x7f8b44199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 0x7f8b44199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 -- 172.21.15.100:0/3259087862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b441a0bb0 con 0x7f8b44108980 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b489e0640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c006010 tx=0x7f8b3c02f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b417fa640 1 -- 172.21.15.100:0/3259087862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c003c70 con 0x7f8b44108980 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b417fa640 1 -- 172.21.15.100:0/3259087862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b3c003e10 con 0x7f8b44108980 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b441a0e40 con 0x7f8b44108980 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b417fa640 1 -- 172.21.15.100:0/3259087862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c02fcc0 con 0x7f8b44108980 2024-04-30T23:12:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.479+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b441a12a0 con 0x7f8b44108980 2024-04-30T23:12:52.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.481+0000 7f8b513dd740 1 Processor -- start 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.481+0000 7f8b417fa640 1 -- 172.21.15.100:0/3259087862 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8b3c0305c0 con 0x7f8b44108980 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.481+0000 7f8b513dd740 1 -- start start 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87d0270 0x558ca8b732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87a73b0 0x558ca8b73820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ca8ad6740 con 0x558ca87af590 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ca8a723a0 con 0x558ca87a73b0 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b513dd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558ca8ad2700 con 0x558ca87d0270 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34706/0 (socket says 172.21.15.100:34706) 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 -- 172.21.15.100:0/2788952423 learned_addr learned my addr 172.21.15.100:0/2788952423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b417fa640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 0x7f8b2c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87d0270 0x558ca8b732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b43fff640 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87a73b0 0x558ca8b73820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 -- 172.21.15.100:0/2788952423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87d0270 msgr2=0x558ca8b732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87d0270 0x558ca8b732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 -- 172.21.15.100:0/2788952423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87a73b0 msgr2=0x558ca8b73820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87a73b0 0x558ca8b73820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b489e0640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 0x7f8b2c0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 -- 172.21.15.100:0/2788952423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca8a8e750 con 0x558ca87af590 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b417fa640 1 -- 172.21.15.100:0/3259087862 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8b3c0f1f50 con 0x7f8b44108980 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.482+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800efd0 tx=0x7f8b3800e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6467c7c4213ab9e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b2a7fc640 1 -- 172.21.15.100:0/2788952423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38018070 con 0x558ca87af590 2024-04-30T23:12:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b2a7fc640 1 -- 172.21.15.100:0/2788952423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b38004220 con 0x558ca87af590 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b2a7fc640 1 -- 172.21.15.100:0/2788952423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38003870 con 0x558ca87af590 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b513dd740 1 -- 172.21.15.100:0/2788952423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 msgr2=0x558ca8b7a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b489e0640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 0x7f8b2c0a6150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0ba870 tx=0x7f8b3c040000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.483+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800efd0 tx=0x7f8b3800e610 comp rx=0 tx=0).stop 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- 172.21.15.100:0/2788952423 shutdown_connections 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7a720 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87a73b0 0x558ca8b73820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2788952423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87d0270 0x558ca8b732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- 172.21.15.100:0/2788952423 >> 172.21.15.100:0/2788952423 conn(0x558ca87c43c0 msgr2=0x558ca8b6ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- 172.21.15.100:0/2788952423 shutdown_connections 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- 172.21.15.100:0/2788952423 wait complete. 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- start start 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 Processor -- start 2024-04-30T23:12:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87af590 0x558ca8b7d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8b846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b7b170 con 0x558ca87a73b0 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ca8a5dfe0 con 0x558ca87d0270 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b7b2f0 con 0x558ca87af590 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.484+0000 7f8b513dd740 10 client.0 _ll_register_callbacks cb 0x558ca8a7dc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34710/0 (socket says 172.21.15.100:34710) 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 -- 172.21.15.100:0/1886127034 learned_addr learned my addr 172.21.15.100:0/1886127034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b43fff640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87af590 0x558ca8b7d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 -- 172.21.15.100:0/1886127034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87af590 msgr2=0x558ca8b7d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87af590 0x558ca8b7d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 -- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 msgr2=0x558ca8b846a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8b846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 -- 172.21.15.100:0/1886127034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ca87e82d0 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b38005890 tx=0x7f8b38004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d954bfd53488b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38018070 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8b38003a00 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b38004220 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b38003c00 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b513dd740 10 client.15294 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.485+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ca88b26b0 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b38004220 con 0x558ca87a73b0 2024-04-30T23:12:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8b38026c90 con 0x558ca87a73b0 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 10 client.15294 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 20 client.15294 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca878ee40 0x558ca8b8aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 4 client.15294 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ca8ae4350 con 0x558ca878ee40 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b43fff640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca878ee40 0x558ca8b8aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b237fe640 10 client.15294 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.486+0000 7f8b43fff640 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca878ee40 0x558ca8b8aff0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=342a3734ae748b7b server_cookie=e43b1aa537bbdef0 in_seq=0 out_seq=0 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.487+0000 7f8b237fe640 1 -- 172.21.15.100:0/1886127034 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558ca8ae4350 con 0x558ca878ee40 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.487+0000 7f8b237fe640 10 client.15294 handle_command_reply: tid=0 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.487+0000 7f8b513dd740 1 client.15294 shutdown 2024-04-30T23:12:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.487+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 msgr2=0x558ca8b7d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.487+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b38005890 tx=0x7f8b38004600 comp rx=0 tx=0).stop 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 shutdown_connections 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca878ee40 0x558ca8b8aff0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8b846a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87af590 0x558ca8b7d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b237fe640 0 client.15294 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1886127034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87a73b0 0x558ca8b7d200 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 >> 172.21.15.100:0/1886127034 conn(0x558ca87c43c0 msgr2=0x558ca8b6bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 shutdown_connections 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 1 -- 172.21.15.100:0/1886127034 wait complete. 2024-04-30T23:12:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.488+0000 7f8b513dd740 20 client.15294 trim_cache size 0 max 16384 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 Processor -- start 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 -- start start 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87af590 0x558ca8b84630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b89330 con 0x558ca87d0270 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b89a00 con 0x558ca87af590 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b513dd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b8a0d0 con 0x558ca87a73b0 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34716/0 (socket says 172.21.15.100:34716) 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 -- 172.21.15.100:0/1694100035 learned_addr learned my addr 172.21.15.100:0/1694100035 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b43fff640 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87af590 0x558ca8b84630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 -- 172.21.15.100:0/1694100035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 msgr2=0x558ca8b7b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 -- 172.21.15.100:0/1694100035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87af590 msgr2=0x558ca8b84630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87af590 0x558ca8b84630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.506+0000 7f8b437fe640 1 -- 172.21.15.100:0/1694100035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca8b7e2f0 con 0x558ca87d0270 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b437fe640 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e780 tx=0x7f8b3801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8757d9ad93cb0b06 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b29ffb640 1 -- 172.21.15.100:0/1694100035 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38018070 con 0x558ca87d0270 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b29ffb640 1 -- 172.21.15.100:0/1694100035 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b380054d0 con 0x558ca87d0270 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b29ffb640 1 -- 172.21.15.100:0/1694100035 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38003800 con 0x558ca87d0270 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 -- 172.21.15.100:0/1694100035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 msgr2=0x558ca8b7bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e780 tx=0x7f8b3801f040 comp rx=0 tx=0).stop 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 -- 172.21.15.100:0/1694100035 shutdown_connections 2024-04-30T23:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87d0270 0x558ca8b7bd80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87af590 0x558ca8b84630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.507+0000 7f8b513dd740 1 --2- 172.21.15.100:0/1694100035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- 172.21.15.100:0/1694100035 >> 172.21.15.100:0/1694100035 conn(0x558ca87c43c0 msgr2=0x558ca8b768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- 172.21.15.100:0/1694100035 shutdown_connections 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- 172.21.15.100:0/1694100035 wait complete. 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- start start 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 Processor -- start 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8befd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b8ae70 con 0x558ca87af590 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b8a7a0 con 0x558ca87d0270 2024-04-30T23:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558ca8b8b540 con 0x558ca87a73b0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b513dd740 10 client.0 _ll_register_callbacks cb 0x7f8b3800ef20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34726/0 (socket says 172.21.15.100:34726) 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.508+0000 7f8b43fff640 1 -- 172.21.15.100:0/2618076369 learned_addr learned my addr 172.21.15.100:0/2618076369 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 -- 172.21.15.100:0/2618076369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 msgr2=0x558ca8b7f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8befd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 -- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 msgr2=0x558ca8befd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8befd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 -- 172.21.15.100:0/2618076369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ca8b78020 con 0x558ca87af590 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8befd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b43fff640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8b34005fd0 tx=0x7f8b3400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64abb80078cd2127 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34021070 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f8b3401d580 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b380054d0 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b3402d050 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b513dd740 10 client.15300 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ca8bf1410 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.509+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b380054d0 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8b34011cc0 con 0x558ca87af590 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 10 client.15300 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 10 client.15300 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 20 client.15300 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca8764280 0x558ca8bf4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 4 client.15300 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:12:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "status"}) -- 0x558ca8ade1c0 con 0x558ca8764280 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca8764280 0x558ca8bf4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b237fe640 10 client.15300 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.510+0000 7f8b437fe640 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca8764280 0x558ca8bf4cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3858ca41b964eec server_cookie=58597d3754f2f9c4 in_seq=0 out_seq=0 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b237fe640 1 -- 172.21.15.100:0/2618076369 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558ca8ade1c0 con 0x558ca8764280 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b237fe640 10 client.15300 handle_command_reply: tid=0 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 client.15300 shutdown 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 msgr2=0x558ca8b7fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8b34005fd0 tx=0x7f8b3400be90 comp rx=0 tx=0).stop 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 shutdown_connections 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558ca8764280 0x558ca8bf4cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ca87d0270 0x558ca8befd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ca87af590 0x558ca8b7fb60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 --2- 172.21.15.100:0/2618076369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558ca87a73b0 0x558ca8b7f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b237fe640 0 client.15300 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 >> 172.21.15.100:0/2618076369 conn(0x558ca87c43c0 msgr2=0x558ca8b7b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 shutdown_connections 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 1 -- 172.21.15.100:0/2618076369 wait complete. 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b513dd740 20 client.15300 trim_cache size 0 max 16384 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24503, 2024-04-30T23:12:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 86.821358349999997, 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 91, 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 129.89178541999999 2024-04-30T23:12:52.519 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 msgr2=0x7f8b2c0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 0x7f8b2c0a6150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0ba870 tx=0x7f8b3c040000 comp rx=0 tx=0).stop 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 msgr2=0x7f8b441a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.511+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c006010 tx=0x7f8b3c02f3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 shutdown_connections 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8b2c0a3c40 0x7f8b2c0a6150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b44108980 0x7f8b441a05f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b44103c80 0x7f8b44199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 --2- 172.21.15.100:0/3259087862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b44102a40 0x7f8b44199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 >> 172.21.15.100:0/3259087862 conn(0x7f8b440fdc30 msgr2=0x7f8b44104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 shutdown_connections 2024-04-30T23:12:52.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.512+0000 7f8b4a443640 1 -- 172.21.15.100:0/3259087862 wait complete. 2024-04-30T23:12:52.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-30T23:12:52.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 -- 172.21.15.100:0/3156569968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 msgr2=0x7f217c10ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 --2- 172.21.15.100:0/3156569968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c10ad90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2174009ca0 tx=0x7f217402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 -- 172.21.15.100:0/3156569968 shutdown_connections 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 --2- 172.21.15.100:0/3156569968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c10ad90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 --2- 172.21.15.100:0/3156569968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 0x7f217c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 --2- 172.21.15.100:0/3156569968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 0x7f217c103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 -- 172.21.15.100:0/3156569968 >> 172.21.15.100:0/3156569968 conn(0x7f217c0fdc20 msgr2=0x7f217c1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 -- 172.21.15.100:0/3156569968 shutdown_connections 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.632+0000 7f2181a61640 1 -- 172.21.15.100:0/3156569968 wait complete. 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 Processor -- start 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 -- start start 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 0x7f217c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 0x7f217c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f217c10e540 con 0x7f217c108970 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f217c10e3c0 con 0x7f217c103c70 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2181a61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f217c10e6c0 con 0x7f217c102a30 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34748/0 (socket says 172.21.15.100:34748) 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 -- 172.21.15.100:0/1479916432 learned_addr learned my addr 172.21.15.100:0/1479916432 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217affd640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 0x7f217c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f2173fff640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 0x7f217c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 -- 172.21.15.100:0/1479916432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 msgr2=0x7f217c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 0x7f217c06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 -- 172.21.15.100:0/1479916432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 msgr2=0x7f217c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 0x7f217c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.633+0000 7f217b7fe640 1 -- 172.21.15.100:0/1479916432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1a1d90 con 0x7f217c108970 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f217b7fe640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2174006010 tx=0x7f217402f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f2180a5f640 1 -- 172.21.15.100:0/1479916432 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174003c70 con 0x7f217c108970 2024-04-30T23:12:52.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f2180a5f640 1 -- 172.21.15.100:0/1479916432 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2174003e10 con 0x7f217c108970 2024-04-30T23:12:52.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c1a2020 con 0x7f217c108970 2024-04-30T23:12:52.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f2180a5f640 1 -- 172.21.15.100:0/1479916432 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217402fcc0 con 0x7f217c108970 2024-04-30T23:12:52.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.634+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c1a25c0 con 0x7f217c108970 2024-04-30T23:12:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f2180a5f640 1 -- 172.21.15.100:0/1479916432 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2174004040 con 0x7f217c108970 2024-04-30T23:12:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 Processor -- start 2024-04-30T23:12:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 -- start start 2024-04-30T23:12:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636689f270 0x556366c40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563668763b0 0x556366c40610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556366ba5740 con 0x55636687e590 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556366b413a0 con 0x55636689f270 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.636+0000 7f21889f7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556366ba1700 con 0x5563668763b0 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2180a5f640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 0x7f21680a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34762/0 (socket says 172.21.15.100:34762) 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 -- 172.21.15.100:0/1035853387 learned_addr learned my addr 172.21.15.100:0/1035853387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636689f270 0x556366c40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f217b7fe640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 0x7f21680a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f217affd640 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563668763b0 0x556366c40610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 -- 172.21.15.100:0/1035853387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563668763b0 msgr2=0x556366c40610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563668763b0 0x556366c40610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 -- 172.21.15.100:0/1035853387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636689f270 msgr2=0x556366c40090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2180a5f640 1 -- 172.21.15.100:0/1479916432 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f21740f1ef0 con 0x7f217c108970 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636689f270 0x556366c40090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 -- 172.21.15.100:0/1035853387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556366b5d750 con 0x55636687e590 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2173fff640 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2164013980 tx=0x7f216400c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bd39f81d5f0ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2171ffb640 1 -- 172.21.15.100:0/1035853387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400f960 con 0x55636687e590 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f217b7fe640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 0x7f21680a61d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21740c6580 tx=0x7f217402ec00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2171ffb640 1 -- 172.21.15.100:0/1035853387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216400c9b0 con 0x55636687e590 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.637+0000 7f2171ffb640 1 -- 172.21.15.100:0/1035853387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164011d00 con 0x55636687e590 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- 172.21.15.100:0/1035853387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 msgr2=0x556366c47510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2164013980 tx=0x7f216400c4f0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- 172.21.15.100:0/1035853387 shutdown_connections 2024-04-30T23:12:52.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636687e590 0x556366c47510 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563668763b0 0x556366c40610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 --2- 172.21.15.100:0/1035853387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636689f270 0x556366c40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- 172.21.15.100:0/1035853387 >> 172.21.15.100:0/1035853387 conn(0x5563668933c0 msgr2=0x556366c3ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- 172.21.15.100:0/1035853387 shutdown_connections 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- 172.21.15.100:0/1035853387 wait complete. 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.638+0000 7f21889f7740 1 -- start start 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 Processor -- start 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563668763b0 0x556366c49f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 0x556366c4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556366c47f60 con 0x55636689f270 2024-04-30T23:12:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556366b2cfe0 con 0x5563668763b0 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556366c480e0 con 0x55636687e590 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f21889f7740 10 client.0 _ll_register_callbacks cb 0x556366b4cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34770/0 (socket says 172.21.15.100:34770) 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 -- 172.21.15.100:0/3548667193 learned_addr learned my addr 172.21.15.100:0/3548667193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f217affd640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 0x556366c4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563668763b0 0x556366c49f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 -- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 msgr2=0x556366c4a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 0x556366c4a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 -- 172.21.15.100:0/3548667193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563668763b0 msgr2=0x556366c49f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563668763b0 0x556366c49f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f2173fff640 1 -- 172.21.15.100:0/3548667193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563668b72d0 con 0x55636689f270 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.639+0000 7f217affd640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 0x556366c4a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f2173fff640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2164005bc0 tx=0x7f216400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de3e0f93fff14ef server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164005460 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f216400f760 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216400c9b0 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2164036050 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 10 client.15312 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5563669816b0 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216400c9b0 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f21640049f0 con 0x55636689f270 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 10 client.15312 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 10 client.15312 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 20 client.15312 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55636685de40 0x556366c57d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 4 client.15312 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.640+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556366bb3350 con 0x55636685de40 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.641+0000 7f217affd640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55636685de40 0x556366c57d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.641+0000 7f217affd640 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55636685de40 0x556366c57d40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1075ab14f8c831f server_cookie=c76f9bf34313ca4d in_seq=0 out_seq=0 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.641+0000 7f215affd640 10 client.15312 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f215affd640 1 -- 172.21.15.100:0/3548667193 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556366bb3350 con 0x55636685de40 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f215affd640 10 client.15312 handle_command_reply: tid=0 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 client.15312 shutdown 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 msgr2=0x556366c51410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2164005bc0 tx=0x7f216400c7e0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 shutdown_connections 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55636685de40 0x556366c57d40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636689f270 0x556366c51410 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636687e590 0x556366c4a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f215affd640 0 client.15312 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:12:52.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 --2- 172.21.15.100:0/3548667193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563668763b0 0x556366c49f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 >> 172.21.15.100:0/3548667193 conn(0x5563668933c0 msgr2=0x556366c3ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 shutdown_connections 2024-04-30T23:12:52.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.642+0000 7f21889f7740 1 -- 172.21.15.100:0/3548667193 wait complete. 2024-04-30T23:12:52.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.643+0000 7f21889f7740 20 client.15312 trim_cache size 0 max 16384 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 Processor -- start 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 -- start start 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c51330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556366c56080 con 0x5563668763b0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556366c56750 con 0x55636687e590 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f21889f7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556366c56e20 con 0x55636689f270 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34786/0 (socket says 172.21.15.100:34786) 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 -- 172.21.15.100:0/3666372801 learned_addr learned my addr 172.21.15.100:0/3666372801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f217affd640 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c51330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 -- 172.21.15.100:0/3666372801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 msgr2=0x556366c443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 -- 172.21.15.100:0/3666372801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 msgr2=0x556366c51330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c51330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.661+0000 7f2173fff640 1 -- 172.21.15.100:0/3666372801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556366c4ab70 con 0x5563668763b0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.662+0000 7f2173fff640 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2164004dc0 tx=0x7f2164005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baee99342160f39d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.662+0000 7f21717fa640 1 -- 172.21.15.100:0/3666372801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216403f070 con 0x5563668763b0 2024-04-30T23:12:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.662+0000 7f21717fa640 1 -- 172.21.15.100:0/3666372801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216402a040 con 0x5563668763b0 2024-04-30T23:12:52.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.662+0000 7f21717fa640 1 -- 172.21.15.100:0/3666372801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164017070 con 0x5563668763b0 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- 172.21.15.100:0/3666372801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 msgr2=0x556366c436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2164004dc0 tx=0x7f2164005c90 comp rx=0 tx=0).stop 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- 172.21.15.100:0/3666372801 shutdown_connections 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c51330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- 172.21.15.100:0/3666372801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c436d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- 172.21.15.100:0/3666372801 >> 172.21.15.100:0/3666372801 conn(0x5563668933c0 msgr2=0x556366c3fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- 172.21.15.100:0/3666372801 shutdown_connections 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- 172.21.15.100:0/3666372801 wait complete. 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- start start 2024-04-30T23:12:52.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 Processor -- start 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556366c57bc0 con 0x5563668763b0 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556366c574f0 con 0x55636687e590 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556366c58290 con 0x55636689f270 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f21889f7740 10 client.0 _ll_register_callbacks cb 0x7f216400ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f2173fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34790/0 (socket says 172.21.15.100:34790) 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.663+0000 7f2173fff640 1 -- 172.21.15.100:0/2690005906 learned_addr learned my addr 172.21.15.100:0/2690005906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 -- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 msgr2=0x556366c4f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 -- 172.21.15.100:0/2690005906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 msgr2=0x556366c4ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f217affd640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c4ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 -- 172.21.15.100:0/2690005906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556366c4ff50 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f2173fff640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2164005d00 tx=0x7f21640138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5904ef0b41fa0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f215affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164047060 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f2164005460 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216402a040 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f216404e050 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f21889f7740 10 client.15318 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556366c511d0 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.664+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216402a040 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2164004880 con 0x5563668763b0 2024-04-30T23:12:52.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 10 client.15318 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 10 client.15318 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 20 client.15318 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556366833280 0x556366cc1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 4 client.15318 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "status"}) -- 0x556366bad1c0 con 0x556366833280 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f217affd640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556366833280 0x556366cc1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f217affd640 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556366833280 0x556366cc1a50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2ac6f1ac2b56136 server_cookie=1f5fb9130d60dbf9 in_seq=0 out_seq=0 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.665+0000 7f215affd640 10 client.15318 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f215affd640 1 -- 172.21.15.100:0/2690005906 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556366bad1c0 con 0x556366833280 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f215affd640 10 client.15318 handle_command_reply: tid=0 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 client.15318 shutdown 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 msgr2=0x556366c4c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2164005d00 tx=0x7f21640138f0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 shutdown_connections 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556366833280 0x556366cc1a50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55636689f270 0x556366c4f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55636687e590 0x556366c4ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f215affd640 0 client.15318 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 --2- 172.21.15.100:0/2690005906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563668763b0 0x556366c4c510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 >> 172.21.15.100:0/2690005906 conn(0x5563668933c0 msgr2=0x556366c3fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 shutdown_connections 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 1 -- 172.21.15.100:0/2690005906 wait complete. 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f21889f7740 20 client.15318 trim_cache size 0 max 16384 2024-04-30T23:12:52.672 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24511, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 87.991608885000005, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 91, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 127.285802215 2024-04-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 msgr2=0x7f21680a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 0x7f21680a61d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21740c6580 tx=0x7f217402ec00 comp rx=0 tx=0).stop 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 msgr2=0x7f217c1a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2174006010 tx=0x7f217402f3e0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 shutdown_connections 2024-04-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f21680a3cc0 0x7f21680a61d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f217c108970 0x7f217c1a1570 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f217c103c70 0x7f217c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 --2- 172.21.15.100:0/1479916432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c102a30 0x7f217c06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.666+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 >> 172.21.15.100:0/1479916432 conn(0x7f217c0fdc20 msgr2=0x7f217c104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.667+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 shutdown_connections 2024-04-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.667+0000 7f2181a61640 1 -- 172.21.15.100:0/1479916432 wait complete. 2024-04-30T23:12:52.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-30T23:12:52.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 -- 172.21.15.100:0/2056262952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc103c60 msgr2=0x7fb8bc104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 --2- 172.21.15.100:0/2056262952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc103c60 0x7fb8bc104070 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009900 tx=0x7fb8b802a410 comp rx=0 tx=0).stop 2024-04-30T23:12:52.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 -- 172.21.15.100:0/2056262952 shutdown_connections 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 --2- 172.21.15.100:0/2056262952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 0x7fb8bc10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 --2- 172.21.15.100:0/2056262952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc103c60 0x7fb8bc104070 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 --2- 172.21.15.100:0/2056262952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc102a20 0x7fb8bc103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 -- 172.21.15.100:0/2056262952 >> 172.21.15.100:0/2056262952 conn(0x7fb8bc0fdc10 msgr2=0x7fb8bc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 -- 172.21.15.100:0/2056262952 shutdown_connections 2024-04-30T23:12:52.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.787+0000 7fb8c426a640 1 -- 172.21.15.100:0/2056262952 wait complete. 2024-04-30T23:12:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 Processor -- start 2024-04-30T23:12:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 -- start start 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc103c60 0x7fb8bc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 0x7fb8bc1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc10e5a0 con 0x7fb8bc102a20 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc10e420 con 0x7fb8bc108960 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c426a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc10e720 con 0x7fb8bc103c60 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34810/0 (socket says 172.21.15.100:34810) 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 -- 172.21.15.100:0/1008441809 learned_addr learned my addr 172.21.15.100:0/1008441809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2807640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 0x7fb8bc1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c1805640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc103c60 0x7fb8bc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 -- 172.21.15.100:0/1008441809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc103c60 msgr2=0x7fb8bc19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc103c60 0x7fb8bc19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 -- 172.21.15.100:0/1008441809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 msgr2=0x7fb8bc1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 0x7fb8bc1a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.788+0000 7fb8c2006640 1 -- 172.21.15.100:0/1008441809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc1a2120 con 0x7fb8bc102a20 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8c2006640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8b37fe640 1 -- 172.21.15.100:0/1008441809 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac011830 con 0x7fb8bc102a20 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc1a2410 con 0x7fb8bc102a20 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8b37fe640 1 -- 172.21.15.100:0/1008441809 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8ac016070 con 0x7fb8bc102a20 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8b37fe640 1 -- 172.21.15.100:0/1008441809 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac010e00 con 0x7fb8bc102a20 2024-04-30T23:12:52.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.789+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc1a2a30 con 0x7fb8bc102a20 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.791+0000 7fb8b37fe640 1 -- 172.21.15.100:0/1008441809 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb8ac01b460 con 0x7fb8bc102a20 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 Processor -- start 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 -- start start 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef50da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef147590 0x556eef514920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556eef46e740 con 0x556eef13f3b0 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556eef40a3a0 con 0x556eef168270 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556eef46a700 con 0x556eef147590 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8b37fe640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 0x7fb8a80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8c2006640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef50da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:60130/0 (socket says 172.21.15.100:60130) 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8c2807640 1 -- 172.21.15.100:0/4015658730 learned_addr learned my addr 172.21.15.100:0/4015658730 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8c2807640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 0x7fb8a80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.792+0000 7fb8b37fe640 1 -- 172.21.15.100:0/1008441809 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fb8ac0cfe20 con 0x7fb8bc102a20 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c1805640 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef147590 0x556eef514920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 -- 172.21.15.100:0/4015658730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef147590 msgr2=0x556eef514920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef147590 0x556eef514920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 -- 172.21.15.100:0/4015658730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 msgr2=0x556eef50da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef50da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 -- 172.21.15.100:0/4015658730 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eef426750 con 0x556eef168270 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 0x7fb8a80a6150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011cb0 tx=0x7fb8b4016000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8c2807640 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4005fd0 tx=0x7fb8b40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d78f485ea34594 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8b0bfe640 1 -- 172.21.15.100:0/4015658730 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4024070 con 0x556eef168270 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8b0bfe640 1 -- 172.21.15.100:0/4015658730 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8b400ce20 con 0x556eef168270 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.793+0000 7fb8b0bfe640 1 -- 172.21.15.100:0/4015658730 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4004720 con 0x556eef168270 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/4015658730 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 msgr2=0x556eef50d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4005fd0 tx=0x7fb8b40117b0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/4015658730 shutdown_connections 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef147590 0x556eef514920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef50da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/4015658730 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef168270 0x556eef50d4a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/4015658730 >> 172.21.15.100:0/4015658730 conn(0x556eef15c3c0 msgr2=0x556eef504a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/4015658730 shutdown_connections 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.794+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/4015658730 wait complete. 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 -- start start 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 Processor -- start 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef13f3b0 0x556eef517300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef147590 0x556eef517840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556eef515310 con 0x556eef168270 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556eef3f5fe0 con 0x556eef147590 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556eef515490 con 0x556eef13f3b0 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8cb1fd740 10 client.0 _ll_register_callbacks cb 0x556eef415c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34820/0 (socket says 172.21.15.100:34820) 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 -- 172.21.15.100:0/2663163138 learned_addr learned my addr 172.21.15.100:0/2663163138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c1805640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef147590 0x556eef517840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2006640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef13f3b0 0x556eef517300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 -- 172.21.15.100:0/2663163138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef13f3b0 msgr2=0x556eef517300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef13f3b0 0x556eef517300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 -- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef147590 msgr2=0x556eef517840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef147590 0x556eef517840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.795+0000 7fb8c2807640 1 -- 172.21.15.100:0/2663163138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eef1802d0 con 0x556eef168270 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8c2807640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011e30 tx=0x7fb8b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd4775fec85602 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4035060 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fb8b400cc20 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b400ce20 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8b403c050 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 10 client.15330 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556eef24a6b0 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8b400ce20 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb8b4005040 con 0x556eef168270 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 10 client.15330 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 10 client.15330 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 20 client.15330 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef126e40 0x556eef525200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 4 client.15330 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.796+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eef47c350 con 0x556eef126e40 2024-04-30T23:12:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.797+0000 7fb8c2006640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef126e40 0x556eef525200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.797+0000 7fb8a5ffb640 10 client.15330 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.797+0000 7fb8c2006640 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef126e40 0x556eef525200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7563502840bba5dd server_cookie=a295e261b23ba1 in_seq=0 out_seq=0 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/2663163138 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556eef47c350 con 0x556eef126e40 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8a5ffb640 10 client.15330 handle_command_reply: tid=0 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 client.15330 shutdown 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 msgr2=0x556eef51e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011e30 tx=0x7fb8b40046d0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 shutdown_connections 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef126e40 0x556eef525200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef168270 0x556eef51e7a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8a5ffb640 0 client.15330 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef147590 0x556eef517840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/2663163138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef13f3b0 0x556eef517300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 >> 172.21.15.100:0/2663163138 conn(0x556eef15c3c0 msgr2=0x556eef503c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 shutdown_connections 2024-04-30T23:12:52.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/2663163138 wait complete. 2024-04-30T23:12:52.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.798+0000 7fb8cb1fd740 20 client.15330 trim_cache size 0 max 16384 2024-04-30T23:12:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 Processor -- start 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 -- start start 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef515fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef50d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556eef523540 con 0x556eef13f3b0 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556eef523c10 con 0x556eef15c3c0 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556eef5242e0 con 0x556eef4ffce0 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8c2807640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34828/0 (socket says 172.21.15.100:34828) 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8c2807640 1 -- 172.21.15.100:0/934617300 learned_addr learned my addr 172.21.15.100:0/934617300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.816+0000 7fb8c1805640 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef50d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 -- 172.21.15.100:0/934617300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 msgr2=0x556eef515fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef515fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 -- 172.21.15.100:0/934617300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 msgr2=0x556eef50d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef50d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 -- 172.21.15.100:0/934617300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eef512210 con 0x556eef13f3b0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8c2807640 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cb30 tx=0x7fb8b400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b1ae25297af226 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8a7fff640 1 -- 172.21.15.100:0/934617300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4035070 con 0x556eef13f3b0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8a7fff640 1 -- 172.21.15.100:0/934617300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8b4004740 con 0x556eef13f3b0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.817+0000 7fb8a7fff640 1 -- 172.21.15.100:0/934617300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4024040 con 0x556eef13f3b0 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/934617300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 msgr2=0x556eef51e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cb30 tx=0x7fb8b400af70 comp rx=0 tx=0).stop 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/934617300 shutdown_connections 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef51e6c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef50d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/934617300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef515fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/934617300 >> 172.21.15.100:0/934617300 conn(0x556eef523130 msgr2=0x556eef5078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/934617300 shutdown_connections 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/934617300 wait complete. 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- start start 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 Processor -- start 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef519ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef589f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556eef525080 con 0x556eef13f3b0 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556eef5249b0 con 0x556eef15c3c0 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556eef525750 con 0x556eef4ffce0 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8cb1fd740 10 client.0 _ll_register_callbacks cb 0x7fb8ac0980e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8c2006640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8c2006640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34844/0 (socket says 172.21.15.100:34844) 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8c2006640 1 -- 172.21.15.100:0/681880642 learned_addr learned my addr 172.21.15.100:0/681880642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.818+0000 7fb8c1805640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef519ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 -- 172.21.15.100:0/681880642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 msgr2=0x556eef589f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef589f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 -- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 msgr2=0x556eef519ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef519ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 -- 172.21.15.100:0/681880642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eef58a4d0 con 0x556eef13f3b0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c1805640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef519ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8c2006640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00bde0 tx=0x7fb8ac06a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69142689afb742a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac09bd70 con 0x556eef13f3b0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7fb8ac0cd6e0 con 0x556eef13f3b0 2024-04-30T23:12:52.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b4004740 con 0x556eef13f3b0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8ac0a0120 con 0x556eef13f3b0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8cb1fd740 10 client.15336 fetch_fsmap learned FSMap version 27 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556eef58b800 con 0x556eef13f3b0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8b4004740 con 0x556eef13f3b0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb8ac0b50b0 con 0x556eef13f3b0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.819+0000 7fb8cb1fd740 10 client.15336 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 10 client.15336 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 20 client.15336 populate_metadata read hostname 'smithi100' 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef147590 0x556eef58f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 4 client.15336 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "status"}) -- 0x556eef4761c0 con 0x556eef147590 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8c1805640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef147590 0x556eef58f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:52.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8a5ffb640 10 client.15336 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8c1805640 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef147590 0x556eef58f090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9a23b556d4556f1 server_cookie=9be994b1189e3b48 in_seq=0 out_seq=0 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8a5ffb640 1 -- 172.21.15.100:0/681880642 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x556eef4761c0 con 0x556eef147590 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8a5ffb640 10 client.15336 handle_command_reply: tid=0 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.820+0000 7fb8cb1fd740 1 client.15336 shutdown 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 msgr2=0x556eef519760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00bde0 tx=0x7fb8ac06a770 comp rx=0 tx=0).stop 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 shutdown_connections 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556eef147590 0x556eef58f090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556eef4ffce0 0x556eef589f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8a5ffb640 0 client.15336 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556eef15c3c0 0x556eef519ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 --2- 172.21.15.100:0/681880642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556eef13f3b0 0x556eef519760 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 >> 172.21.15.100:0/681880642 conn(0x556eef523130 msgr2=0x556eef5082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 shutdown_connections 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 1 -- 172.21.15.100:0/681880642 wait complete. 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8cb1fd740 20 client.15336 trim_cache size 0 max 16384 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24545, 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 111.93850639599999, 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:12:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 91, 2024-04-30T23:12:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:12:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 118.85011774 2024-04-30T23:12:52.829 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:12:52.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 msgr2=0x7fb8a80a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 0x7fb8a80a6150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011cb0 tx=0x7fb8b4016000 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 msgr2=0x7fb8bc06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac00b8e0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 shutdown_connections 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb8a80a3c40 0x7fb8a80a6150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8bc108960 0x7fb8bc1a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8bc103c60 0x7fb8bc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 --2- 172.21.15.100:0/1008441809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8bc102a20 0x7fb8bc06a960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 >> 172.21.15.100:0/1008441809 conn(0x7fb8bc0fdc10 msgr2=0x7fb8bc104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.821+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 shutdown_connections 2024-04-30T23:12:52.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:52.822+0000 7fb8c426a640 1 -- 172.21.15.100:0/1008441809 wait complete. 2024-04-30T23:12:52.833 INFO:tasks.cephadm:Setup complete, yielding 2024-04-30T23:12:52.833 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-30T23:12:52.843 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:12:52.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-30T23:12:53.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:52 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/32249089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:53.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:52 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/32249089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:53.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:52 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/32249089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:12:54.239 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:53 smithi100 ceph-mon[29745]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:54.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:53 smithi104 ceph-mon[32987]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:54.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:53 smithi183 ceph-mon[33560]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:12:54.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 -- 172.21.15.100:0/344558262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 msgr2=0x7f2b1c107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 --2- 172.21.15.100:0/344558262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c107180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009990 tx=0x7f2b0c009ca0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 -- 172.21.15.100:0/344558262 shutdown_connections 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 --2- 172.21.15.100:0/344558262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 0x7f2b1c10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 --2- 172.21.15.100:0/344558262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c107180 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 --2- 172.21.15.100:0/344558262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 0x7f2b1c109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 -- 172.21.15.100:0/344558262 >> 172.21.15.100:0/344558262 conn(0x7f2b1c0fe7a0 msgr2=0x7f2b1c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 -- 172.21.15.100:0/344558262 shutdown_connections 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.941+0000 7f2b213bc700 1 -- 172.21.15.100:0/344558262 wait complete. 2024-04-30T23:12:54.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 Processor -- start 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 -- start start 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 0x7f2b1c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 0x7f2b1c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10fca0 con 0x7f2b1c104d60 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10fb20 con 0x7f2b1c1076c0 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b213bc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10fe20 con 0x7f2b1c10a020 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47284/0 (socket says 172.21.15.100:47284) 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 -- 172.21.15.100:0/37403702 learned_addr learned my addr 172.21.15.100:0/37403702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:54.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1b7fe700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 0x7f2b1c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1a7fc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 0x7f2b1c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 -- 172.21.15.100:0/37403702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 msgr2=0x7f2b1c1a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 0x7f2b1c1a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 -- 172.21.15.100:0/37403702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 msgr2=0x7f2b1c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.942+0000 7f2b1affd700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 0x7f2b1c19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b1affd700 1 -- 172.21.15.100:0/37403702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c1a22e0 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b1affd700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c003800 tx=0x7f2b0c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c027070 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1c1a2570 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0c004000 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1c1a2a20 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.943+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c022d30 con 0x7f2b1c104d60 2024-04-30T23:12:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.944+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1c0511d0 con 0x7f2b1c104d60 2024-04-30T23:12:54.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.945+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2b0c02a070 con 0x7f2b1c104d60 2024-04-30T23:12:54.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.946+0000 7f2b03fff700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 0x7f2b040a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:54.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.946+0000 7f2b1a7fc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 0x7f2b040a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:54.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.946+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f2b0c0d1900 con 0x7f2b1c104d60 2024-04-30T23:12:54.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.947+0000 7f2b1a7fc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 0x7f2b040a61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c19b8c0 tx=0x7f2b1000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:54.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:54.950+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b0c013070 con 0x7f2b1c104d60 2024-04-30T23:12:55.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.167+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2b1c02e8d0 con 0x7f2b040a3cd0 2024-04-30T23:12:55.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.168+0000 7f2b03fff700 1 -- 172.21.15.100:0/37403702 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2b1c02e8d0 con 0x7f2b040a3cd0 2024-04-30T23:12:55.168 INFO:teuthology.orchestra.run.smithi100.stdout:Backend: cephadm 2024-04-30T23:12:55.168 INFO:teuthology.orchestra.run.smithi100.stdout:Available: Yes 2024-04-30T23:12:55.168 INFO:teuthology.orchestra.run.smithi100.stdout:Paused: No 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 msgr2=0x7f2b040a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 0x7f2b040a61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c19b8c0 tx=0x7f2b1000a380 comp rx=0 tx=0).stop 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 msgr2=0x7f2b1c19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c003800 tx=0x7f2b0c0047b0 comp rx=0 tx=0).stop 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 shutdown_connections 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2b040a3cd0 0x7f2b040a61e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1c10a020 0x7f2b1c1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:55.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c104d60 0x7f2b1c19a810 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:55.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 --2- 172.21.15.100:0/37403702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b1c1076c0 0x7f2b1c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:55.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 >> 172.21.15.100:0/37403702 conn(0x7f2b1c0fe7a0 msgr2=0x7f2b1c105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:55.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 shutdown_connections 2024-04-30T23:12:55.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:55.171+0000 7f2b213bc700 1 -- 172.21.15.100:0/37403702 wait complete. 2024-04-30T23:12:55.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-30T23:12:56.118 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:12:56.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:56 smithi100 ceph-mon[29745]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:12:56.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:56 smithi100 ceph-mon[29745]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:56.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-30T23:12:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:56 smithi104 ceph-mon[32987]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:12:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:56 smithi104 ceph-mon[32987]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-30T23:12:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:56 smithi183 ceph-mon[33560]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:12:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:56 smithi183 ceph-mon[33560]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:12:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-30T23:12:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-30T23:12:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:57 smithi100 ceph-mon[29745]: osdmap e92: 12 total, 12 up, 12 in 2024-04-30T23:12:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:57 smithi100 ceph-mon[29745]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-30T23:12:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 -- 172.21.15.100:0/1225334688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 msgr2=0x7f0964103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 --2- 172.21.15.100:0/1225334688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f0964103e30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f095400aaa0 tx=0x7f095400adb0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 -- 172.21.15.100:0/1225334688 shutdown_connections 2024-04-30T23:12:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 --2- 172.21.15.100:0/1225334688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641043c0 0x7f096410ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 --2- 172.21.15.100:0/1225334688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641028f0 0x7f0964102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 --2- 172.21.15.100:0/1225334688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f0964103e30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 -- 172.21.15.100:0/1225334688 >> 172.21.15.100:0/1225334688 conn(0x7f09640fdf30 msgr2=0x7f09641003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 -- 172.21.15.100:0/1225334688 shutdown_connections 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.989+0000 7f096b99c700 1 -- 172.21.15.100:0/1225334688 wait complete. 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 Processor -- start 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 -- start start 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641028f0 0x7f096419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641043c0 0x7f09641a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f096410dad0 con 0x7f0964103a20 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f096410d950 con 0x7f09641043c0 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f096b99c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f096410dc50 con 0x7f09641028f0 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47294/0 (socket says 172.21.15.100:47294) 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 -- 172.21.15.100:0/4080479490 learned_addr learned my addr 172.21.15.100:0/4080479490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:12:57.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0969f39700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641043c0 0x7f09641a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0969738700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641028f0 0x7f096419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 -- 172.21.15.100:0/4080479490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641028f0 msgr2=0x7f096419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641028f0 0x7f096419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 -- 172.21.15.100:0/4080479490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641043c0 msgr2=0x7f09641a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641043c0 0x7f09641a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.990+0000 7f0968f37700 1 -- 172.21.15.100:0/4080479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09641a2380 con 0x7f0964103a20 2024-04-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f0968f37700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f095400a9f0 tx=0x7f095400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954023030 con 0x7f0964103a20 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0954004ce0 con 0x7f0964103a20 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09641a2610 con 0x7f0964103a20 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954005210 con 0x7f0964103a20 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.991+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09641a2af0 con 0x7f0964103a20 2024-04-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.992+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09640511d0 con 0x7f0964103a20 2024-04-30T23:12:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.993+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0954026070 con 0x7f0964103a20 2024-04-30T23:12:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.994+0000 7f095a7fc700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 0x7f09500a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:12:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.994+0000 7f0969738700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 0x7f09500a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.994+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f09540d1ae0 con 0x7f0964103a20 2024-04-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.994+0000 7f0969738700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 0x7f09500a6150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0964103920 tx=0x7f0960007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:57.999+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f095409e1f0 con 0x7f0964103a20 2024-04-30T23:12:58.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-30T23:12:58.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:57 smithi104 ceph-mon[32987]: osdmap e92: 12 total, 12 up, 12 in 2024-04-30T23:12:58.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:57 smithi104 ceph-mon[32987]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-30T23:12:58.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-30T23:12:58.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:57 smithi183 ceph-mon[33560]: osdmap e92: 12 total, 12 up, 12 in 2024-04-30T23:12:58.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:57 smithi183 ceph-mon[33560]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-30T23:12:58.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.208+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0964063b10 con 0x7f09500a3c40 2024-04-30T23:12:58.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.222+0000 7f095a7fc700 1 -- 172.21.15.100:0/4080479490 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f0964063b10 con 0x7f09500a3c40 2024-04-30T23:12:58.223 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-30T23:12:58.223 INFO:teuthology.orchestra.run.smithi100.stdout:mds.a smithi100 running (2m) 19s ago 2m 84.9M - 19.0.0-3308-g8505bf41 9433911a4018 9d5e12bbcb0a 2024-04-30T23:12:58.223 INFO:teuthology.orchestra.run.smithi100.stdout:mds.b smithi104 running (2m) 58s ago 2m 98.2M - 19.0.0-3308-g8505bf41 9433911a4018 ee131c2e42e3 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.c smithi183 running (2m) 58s ago 2m 83.9M - 19.0.0-3308-g8505bf41 9433911a4018 75d1d6c83651 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.d smithi100 running (2m) 19s ago 2m 83.9M - 19.0.0-3308-g8505bf41 9433911a4018 b2427507c239 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.e smithi104 running (2m) 58s ago 2m 84.9M - 19.0.0-3308-g8505bf41 9433911a4018 b67f3f72762b 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.f smithi183 running (2m) 58s ago 2m 84.2M - 19.0.0-3308-g8505bf41 9433911a4018 09f856b0dd63 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.g smithi100 running (2m) 19s ago 2m 86.5M - 19.0.0-3308-g8505bf41 9433911a4018 dd6a8bc56243 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.h smithi104 running (2m) 58s ago 2m 84.3M - 19.0.0-3308-g8505bf41 9433911a4018 979dc61feb90 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.i smithi183 running (2m) 58s ago 2m 84.9M - 19.0.0-3308-g8505bf41 9433911a4018 c4076357639e 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.j smithi100 running (2m) 19s ago 2m 83.0M - 19.0.0-3308-g8505bf41 9433911a4018 856b839bf9e8 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.k smithi104 running (2m) 58s ago 2m 83.5M - 19.0.0-3308-g8505bf41 9433911a4018 46ee533fad2c 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mds.l smithi183 running (2m) 58s ago 2m 83.4M - 19.0.0-3308-g8505bf41 9433911a4018 fa9828bdea7b 2024-04-30T23:12:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.x smithi100 *:9283,8765 running (9m) 19s ago 9m 584M - 19.0.0-3308-g8505bf41 9433911a4018 840d9cf80640 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.y smithi104 *:8443,8765 running (7m) 58s ago 7m 521M - 19.0.0-3308-g8505bf41 9433911a4018 abfbd9a97fb5 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.z smithi183 *:8443,8765 running (7m) 58s ago 7m 520M - 19.0.0-3308-g8505bf41 9433911a4018 0b63d055606b 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:mon.a smithi100 running (9m) 19s ago 9m 117M 2048M 19.0.0-3308-g8505bf41 9433911a4018 18fd9f70226e 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:mon.b smithi104 running (8m) 58s ago 8m 106M 2048M 19.0.0-3308-g8505bf41 9433911a4018 52f900d59fc6 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:mon.c smithi183 running (8m) 58s ago 8m 107M 2048M 19.0.0-3308-g8505bf41 9433911a4018 151cf72647b4 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 19s ago 7m 124M 4272M 19.0.0-3308-g8505bf41 9433911a4018 a46f9e3241bd 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi104 running (7m) 58s ago 7m 114M 4272M 19.0.0-3308-g8505bf41 9433911a4018 81446970f4a8 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi183 running (6m) 58s ago 6m 123M 4272M 19.0.0-3308-g8505bf41 9433911a4018 e22b9d0fffec 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi100 running (6m) 19s ago 6m 112M 4272M 19.0.0-3308-g8505bf41 9433911a4018 d24b8a5f5cf3 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi104 running (5m) 58s ago 5m 121M 4272M 19.0.0-3308-g8505bf41 9433911a4018 138f32ec1508 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi183 running (5m) 58s ago 5m 120M 4272M 19.0.0-3308-g8505bf41 9433911a4018 d8b23a34ccce 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 smithi100 running (5m) 19s ago 5m 120M 4272M 19.0.0-3308-g8505bf41 9433911a4018 9b7a36869a5b 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 smithi104 running (4m) 58s ago 4m 121M 4272M 19.0.0-3308-g8505bf41 9433911a4018 4e8f358faa87 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 smithi183 running (4m) 58s ago 4m 119M 4272M 19.0.0-3308-g8505bf41 9433911a4018 5710690d7f51 2024-04-30T23:12:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 smithi100 running (3m) 19s ago 3m 118M 4272M 19.0.0-3308-g8505bf41 9433911a4018 d00e326ad88c 2024-04-30T23:12:58.226 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 smithi104 running (3m) 58s ago 3m 111M 4272M 19.0.0-3308-g8505bf41 9433911a4018 d9cae1e9fce9 2024-04-30T23:12:58.226 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 smithi183 running (2m) 58s ago 2m 112M 4272M 19.0.0-3308-g8505bf41 9433911a4018 768fec3ca1c6 2024-04-30T23:12:58.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 msgr2=0x7f09500a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 0x7f09500a6150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0964103920 tx=0x7f0960007400 comp rx=0 tx=0).stop 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 msgr2=0x7f096419ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f095400a9f0 tx=0x7f095400ce00 comp rx=0 tx=0).stop 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 shutdown_connections 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f09500a3c40 0x7f09500a6150 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09641043c0 0x7f09641a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09641028f0 0x7f096419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 --2- 172.21.15.100:0/4080479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0964103a20 0x7f096419ad60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:12:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.224+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 >> 172.21.15.100:0/4080479490 conn(0x7f09640fdf30 msgr2=0x7f0964106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:12:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.225+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 shutdown_connections 2024-04-30T23:12:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:12:58.225+0000 7f096b99c700 1 -- 172.21.15.100:0/4080479490 wait complete. 2024-04-30T23:12:58.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:58 smithi100 ceph-mon[29745]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-30T23:12:58.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:58 smithi100 ceph-mon[29745]: osdmap e93: 12 total, 12 up, 12 in 2024-04-30T23:12:59.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-30T23:12:59.045 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:58 smithi104 ceph-mon[32987]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-30T23:12:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:58 smithi104 ceph-mon[32987]: osdmap e93: 12 total, 12 up, 12 in 2024-04-30T23:12:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:58 smithi183 ceph-mon[33560]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-30T23:12:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:58 smithi183 ceph-mon[33560]: osdmap e93: 12 total, 12 up, 12 in 2024-04-30T23:12:59.242 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:00.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:12:59 smithi104 ceph-mon[32987]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:00.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:12:59 smithi183 ceph-mon[33560]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:00.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:12:59 smithi100 ceph-mon[29745]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:00.963 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:00 smithi100 ceph-mon[29745]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:13:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:00 smithi104 ceph-mon[32987]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:13:01.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:00 smithi183 ceph-mon[33560]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 -- 172.21.15.100:0/1393685926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0103160 msgr2=0x7fdff0103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 --2- 172.21.15.100:0/1393685926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0103160 0x7fdff0103570 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800b0a0 tx=0x7fdfe800b3b0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 -- 172.21.15.100:0/1393685926 shutdown_connections 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 --2- 172.21.15.100:0/1393685926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0104c30 0x7fdff010b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 --2- 172.21.15.100:0/1393685926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0103160 0x7fdff0103570 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 --2- 172.21.15.100:0/1393685926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104290 0x7fdff01046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.074+0000 7fdff8345700 1 -- 172.21.15.100:0/1393685926 >> 172.21.15.100:0/1393685926 conn(0x7fdff00fe7a0 msgr2=0x7fdff0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- 172.21.15.100:0/1393685926 shutdown_connections 2024-04-30T23:13:01.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- 172.21.15.100:0/1393685926 wait complete. 2024-04-30T23:13:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 Processor -- start 2024-04-30T23:13:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- start start 2024-04-30T23:13:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0103160 0x7fdff0199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 0x7fdff01a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010ebb0 con 0x7fdff0104290 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010ea30 con 0x7fdff0104c30 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff8345700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010ed30 con 0x7fdff0103160 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff58e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff58e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47300/0 (socket says 172.21.15.100:47300) 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.075+0000 7fdff58e0700 1 -- 172.21.15.100:0/336080303 learned_addr learned my addr 172.21.15.100:0/336080303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff60e1700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0103160 0x7fdff0199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff68e2700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 0x7fdff01a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 -- 172.21.15.100:0/336080303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0103160 msgr2=0x7fdff0199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0103160 0x7fdff0199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 -- 172.21.15.100:0/336080303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 msgr2=0x7fdff01a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 0x7fdff01a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 -- 172.21.15.100:0/336080303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff01a11d0 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff68e2700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 0x7fdff01a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff58e0700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c9b0 tx=0x7fdfe400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4007b00 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff01a14c0 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe4007ca0 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4018660 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.076+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff01a1a00 con 0x7fdff0104290 2024-04-30T23:13:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.077+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff00511d0 con 0x7fdff0104290 2024-04-30T23:13:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.078+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fdfe400f450 con 0x7fdff0104290 2024-04-30T23:13:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.079+0000 7fdfef7fe700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 0x7fdfd80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.079+0000 7fdff60e1700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 0x7fdfd80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.079+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fdfe40d09c0 con 0x7fdff0104290 2024-04-30T23:13:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.080+0000 7fdff60e1700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 0x7fdfd80a6150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009fd0 tx=0x7fdfe800b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.083+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdfe4014030 con 0x7fdff0104290 2024-04-30T23:13:01.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.289+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fdff0063b10 con 0x7fdfd80a3c40 2024-04-30T23:13:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.295+0000 7fdfef7fe700 1 -- 172.21.15.100:0/336080303 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fdff0063b10 con 0x7fdfd80a3c40 2024-04-30T23:13:01.297 INFO:teuthology.orchestra.run.smithi100.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-30T23:13:01.297 INFO:teuthology.orchestra.run.smithi100.stdout:mds.all 12/12 61s ago 2m smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi104=b;smithi104=e;smithi104=h;smithi104=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-04-30T23:13:01.297 INFO:teuthology.orchestra.run.smithi100.stdout:mgr 3/3 61s ago 8m smithi100=x;smithi104=y;smithi183=z;count:3 2024-04-30T23:13:01.297 INFO:teuthology.orchestra.run.smithi100.stdout:mon 3/3 61s ago 8m smithi100:172.21.15.100=a;smithi104:172.21.15.104=b;smithi183:172.21.15.183=c;count:3 2024-04-30T23:13:01.297 INFO:teuthology.orchestra.run.smithi100.stdout:osd 12 61s ago - 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 msgr2=0x7fdfd80a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 0x7fdfd80a6150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009fd0 tx=0x7fdfe800b7b0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 msgr2=0x7fdff0199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c9b0 tx=0x7fdfe400ccc0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 shutdown_connections 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdfd80a3c40 0x7fdfd80a6150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdff0104c30 0x7fdff01a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff0103160 0x7fdff0199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 --2- 172.21.15.100:0/336080303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff0104290 0x7fdff0199c40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 >> 172.21.15.100:0/336080303 conn(0x7fdff00fe7a0 msgr2=0x7fdff01074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 shutdown_connections 2024-04-30T23:13:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:01.298+0000 7fdff8345700 1 -- 172.21.15.100:0/336080303 wait complete. 2024-04-30T23:13:02.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-30T23:13:02.412 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:02.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:02 smithi100 ceph-mon[29745]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:02.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:02 smithi100 ceph-mon[29745]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:03.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:02 smithi104 ceph-mon[32987]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:03.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:02 smithi104 ceph-mon[32987]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:02 smithi183 ceph-mon[33560]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:02 smithi183 ceph-mon[33560]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:04.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 -- 172.21.15.100:0/2801266101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104c30 msgr2=0x7f549c10b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:04.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 --2- 172.21.15.100:0/2801266101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104c30 0x7f549c10b4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f549400b0a0 tx=0x7f549400b3b0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 -- 172.21.15.100:0/2801266101 shutdown_connections 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 --2- 172.21.15.100:0/2801266101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104c30 0x7f549c10b4e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 --2- 172.21.15.100:0/2801266101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c103160 0x7f549c103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 --2- 172.21.15.100:0/2801266101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c104290 0x7f549c1046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 -- 172.21.15.100:0/2801266101 >> 172.21.15.100:0/2801266101 conn(0x7f549c0fe7a0 msgr2=0x7f549c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 -- 172.21.15.100:0/2801266101 shutdown_connections 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.278+0000 7f54a475d700 1 -- 172.21.15.100:0/2801266101 wait complete. 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 Processor -- start 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 -- start start 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 0x7f549c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c104c30 0x7f549c1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10fd60 con 0x7f549c104290 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10fbe0 con 0x7f549c103160 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a475d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10fee0 con 0x7f549c104c30 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a1cf8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a1cf8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33154/0 (socket says 172.21.15.100:33154) 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a1cf8700 1 -- 172.21.15.100:0/3244616381 learned_addr learned my addr 172.21.15.100:0/3244616381 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a24f9700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 0x7f549c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.279+0000 7f54a2cfa700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c104c30 0x7f549c1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 -- 172.21.15.100:0/3244616381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c104c30 msgr2=0x7f549c1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c104c30 0x7f549c1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 -- 172.21.15.100:0/3244616381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 msgr2=0x7f549c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 0x7f549c19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 -- 172.21.15.100:0/3244616381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c1a22c0 con 0x7f549c104290 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a24f9700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 0x7f549c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:13:04.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a1cf8700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c920 tx=0x7f548c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c004a30 con 0x7f549c104290 2024-04-30T23:13:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f548c0054d0 con 0x7f549c104290 2024-04-30T23:13:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c007c70 con 0x7f549c104290 2024-04-30T23:13:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c1a25b0 con 0x7f549c104290 2024-04-30T23:13:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.280+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c1a2aa0 con 0x7f549c104290 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.281+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f549c0511d0 con 0x7f549c104290 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.283+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f548c004c60 con 0x7f549c104290 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.284+0000 7f54937fe700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 0x7f54880a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.284+0000 7f54a24f9700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 0x7f54880a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.284+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f548c0d0630 con 0x7f549c104290 2024-04-30T23:13:04.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.284+0000 7f54a24f9700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 0x7f54880a6150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f549c104190 tx=0x7f549800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:04.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.288+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f548c014030 con 0x7f549c104290 2024-04-30T23:13:04.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.493+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f549c063b10 con 0x7f54880a3c40 2024-04-30T23:13:04.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.495+0000 7f54937fe700 1 -- 172.21.15.100:0/3244616381 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f549c063b10 con 0x7f54880a3c40 2024-04-30T23:13:04.496 INFO:teuthology.orchestra.run.smithi100.stdout:HOST ADDR LABELS STATUS 2024-04-30T23:13:04.496 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 172.21.15.100 2024-04-30T23:13:04.496 INFO:teuthology.orchestra.run.smithi100.stdout:smithi104 172.21.15.104 2024-04-30T23:13:04.496 INFO:teuthology.orchestra.run.smithi100.stdout:smithi183 172.21.15.183 2024-04-30T23:13:04.497 INFO:teuthology.orchestra.run.smithi100.stdout:3 hosts in cluster 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 msgr2=0x7f54880a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 0x7f54880a6150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f549c104190 tx=0x7f549800b410 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 msgr2=0x7f549c19aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c920 tx=0x7f548c00cc30 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 shutdown_connections 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f54880a3c40 0x7f54880a6150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f549c104c30 0x7f549c1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f549c103160 0x7f549c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 --2- 172.21.15.100:0/3244616381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f549c104290 0x7f549c19aca0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.497+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 >> 172.21.15.100:0/3244616381 conn(0x7f549c0fe7a0 msgr2=0x7f549c1074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.498+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 shutdown_connections 2024-04-30T23:13:04.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:04.498+0000 7f54a475d700 1 -- 172.21.15.100:0/3244616381 wait complete. 2024-04-30T23:13:04.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:04 smithi100 ceph-mon[29745]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:05.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:04 smithi104 ceph-mon[32987]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:04 smithi183 ceph-mon[33560]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:05.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-30T23:13:05.392 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:05.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:05 smithi100 ceph-mon[29745]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:06.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:05 smithi104 ceph-mon[32987]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:06.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:05 smithi183 ceph-mon[33560]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:06.910 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:06 smithi100 ceph-mon[29745]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 915 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:06.952 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:06 smithi183 ceph-mon[33560]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 915 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:07.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:06 smithi104 ceph-mon[32987]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 915 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 -- 172.21.15.100:0/2552941909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc104290 msgr2=0x7fa3cc1046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/2552941909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc104290 0x7fa3cc1046a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009990 tx=0x7fa3b8009ca0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 -- 172.21.15.100:0/2552941909 shutdown_connections 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/2552941909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 0x7fa3cc10b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/2552941909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc103160 0x7fa3cc103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/2552941909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc104290 0x7fa3cc1046a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 -- 172.21.15.100:0/2552941909 >> 172.21.15.100:0/2552941909 conn(0x7fa3cc0fe7a0 msgr2=0x7fa3cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.172+0000 7fa3d2de6700 1 -- 172.21.15.100:0/2552941909 shutdown_connections 2024-04-30T23:13:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 -- 172.21.15.100:0/2552941909 wait complete. 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 Processor -- start 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 -- start start 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc104290 0x7fa3cc19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 0x7fa3cc1a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:07.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc10ec30 con 0x7fa3cc103160 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc10eab0 con 0x7fa3cc104290 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.173+0000 7fa3d2de6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc10edb0 con 0x7fa3cc104c30 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33172/0 (socket says 172.21.15.100:33172) 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 -- 172.21.15.100:0/301014825 learned_addr learned my addr 172.21.15.100:0/301014825 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3cbfff700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc104290 0x7fa3cc19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d1383700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 0x7fa3cc1a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 -- 172.21.15.100:0/301014825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 msgr2=0x7fa3cc1a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 0x7fa3cc1a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 -- 172.21.15.100:0/301014825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc104290 msgr2=0x7fa3cc19ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc104290 0x7fa3cc19ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 -- 172.21.15.100:0/301014825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc1a2420 con 0x7fa3cc103160 2024-04-30T23:13:07.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d0b82700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d950 tx=0x7fa3c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0017070 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc1a2710 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0009730 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.174+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0003a00 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.175+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc1a2ca0 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.175+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc0511d0 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.176+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa3c0003ba0 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.177+0000 7fa3c9ffb700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 0x7fa3bc0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.177+0000 7fa3cbfff700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 0x7fa3bc0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.177+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa3c00d0230 con 0x7fa3cc103160 2024-04-30T23:13:07.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.178+0000 7fa3cbfff700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 0x7fa3bc0a6150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80038a0 tx=0x7fa3b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:07.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.182+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa3c0020030 con 0x7fa3cc103160 2024-04-30T23:13:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.387+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fa3cc1007d0 con 0x7fa3bc0a3c40 2024-04-30T23:13:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.389+0000 7fa3c9ffb700 1 -- 172.21.15.100:0/301014825 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fa3cc1007d0 con 0x7fa3bc0a3c40 2024-04-30T23:13:07.390 INFO:teuthology.orchestra.run.smithi100.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-30T23:13:07.390 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-30T23:13:07.390 INFO:teuthology.orchestra.run.smithi100.stdout:smithi104 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NW400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-30T23:13:07.391 INFO:teuthology.orchestra.run.smithi100.stdout:smithi183 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 msgr2=0x7fa3bc0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 0x7fa3bc0a6150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80038a0 tx=0x7fa3b801a040 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 msgr2=0x7fa3cc19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d950 tx=0x7fa3c000dc60 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 shutdown_connections 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa3bc0a3c40 0x7fa3bc0a6150 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc104c30 0x7fa3cc1a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3cc103160 0x7fa3cc19a8c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 --2- 172.21.15.100:0/301014825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3cc104290 0x7fa3cc19ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 >> 172.21.15.100:0/301014825 conn(0x7fa3cc0fe7a0 msgr2=0x7fa3cc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:07.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 shutdown_connections 2024-04-30T23:13:07.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:07.391+0000 7fa3d2de6700 1 -- 172.21.15.100:0/301014825 wait complete. 2024-04-30T23:13:08.213 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-30T23:13:08.222 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:13:08.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-30T23:13:08.462 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:08.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:08 smithi100 ceph-mon[29745]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:08.913 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:08 smithi100 ceph-mon[29745]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:09.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:08 smithi104 ceph-mon[32987]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:09.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:08 smithi104 ceph-mon[32987]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:08 smithi183 ceph-mon[33560]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-30T23:13:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:08 smithi183 ceph-mon[33560]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.158+0000 7f6614af1700 1 -- 172.21.15.100:0/2850602311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6610103e70 msgr2=0x7f6610104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.158+0000 7f6614af1700 1 --2- 172.21.15.100:0/2850602311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6610103e70 0x7f6610104280 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6600009990 tx=0x7f6600009ca0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 -- 172.21.15.100:0/2850602311 shutdown_connections 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 --2- 172.21.15.100:0/2850602311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101048f0 0x7f661010c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 --2- 172.21.15.100:0/2850602311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66101058c0 0x7f6610105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 --2- 172.21.15.100:0/2850602311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6610103e70 0x7f6610104280 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 -- 172.21.15.100:0/2850602311 >> 172.21.15.100:0/2850602311 conn(0x7f66100ff8e0 msgr2=0x7f6610101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:10.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 -- 172.21.15.100:0/2850602311 shutdown_connections 2024-04-30T23:13:10.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 -- 172.21.15.100:0/2850602311 wait complete. 2024-04-30T23:13:10.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.159+0000 7f6614af1700 1 Processor -- start 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 -- start start 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610103e70 0x7f6610078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 0x7f6610077070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f661010fdf0 con 0x7f66101048f0 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f661010fc70 con 0x7f66101058c0 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f6614af1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f661010ff70 con 0x7f6610103e70 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33192/0 (socket says 172.21.15.100:33192) 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 -- 172.21.15.100:0/1306139783 learned_addr learned my addr 172.21.15.100:0/1306139783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660e59c700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610103e70 0x7f6610078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660ed9d700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 0x7f6610077070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 -- 172.21.15.100:0/1306139783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610103e70 msgr2=0x7f6610078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610103e70 0x7f6610078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 -- 172.21.15.100:0/1306139783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 msgr2=0x7f6610077070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 0x7f6610077070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 -- 172.21.15.100:0/1306139783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66100776f0 con 0x7f66101048f0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660ed9d700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 0x7f6610077070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.160+0000 7f660dd9b700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6600006010 tx=0x7f66000057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.161+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600027070 con 0x7f66101048f0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.161+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66101a4a60 con 0x7f66101048f0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.161+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66000040c0 con 0x7f66101048f0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.161+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600022da0 con 0x7f66101048f0 2024-04-30T23:13:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.161+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66101a4e00 con 0x7f66101048f0 2024-04-30T23:13:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.162+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66101105b0 con 0x7f66101048f0 2024-04-30T23:13:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.163+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f660002a070 con 0x7f66101048f0 2024-04-30T23:13:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.164+0000 7f65ff7fe700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 0x7f65f80a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.164+0000 7f660e59c700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 0x7f65f80a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.164+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f66000d1ea0 con 0x7f66101048f0 2024-04-30T23:13:10.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.164+0000 7f660e59c700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 0x7f65f80a6150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66101052b0 tx=0x7f660400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.168+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6600031080 con 0x7f66101048f0 2024-04-30T23:13:10.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.408+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f66100511d0 con 0x7f66101048f0 2024-04-30T23:13:10.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.409+0000 7f65ff7fe700 1 -- 172.21.15.100:0/1306139783 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3108 (secure 0 0 0) 0x7f6600013070 con 0x7f66101048f0 2024-04-30T23:13:10.410 INFO:teuthology.orchestra.run.smithi100.stdout:e27 2024-04-30T23:13:10.410 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 27 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-04-30T23:11:00.289657+0000 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-04-30T23:11:27.921467+0000 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 300 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-04-30T23:13:10.411 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 0 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 5 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1,2,3,4 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=24545,1=24511,2=24503,3=24496,4=14664} 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3,4] 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-04-30T23:13:10.412 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 0 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 24545 members: 14664,24511,24545,24496,24503 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b{0:24545} state up:active seq 3 addr [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f{0:24478} state up:standby-replay seq 1 addr [v2:172.21.15.183:6834/2697644609,v1:172.21.15.183:6835/2697644609] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.i{1:24511} state up:active seq 11 addr [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e{1:24470} state up:standby-replay seq 1 addr [v2:172.21.15.104:6834/4094200769,v1:172.21.15.104:6835/4094200769] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.h{2:24503} state up:active seq 12 addr [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.k{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.104:6832/176831078,v1:172.21.15.104:6833/176831078] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c{3:24496} state up:active seq 13 addr [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.l{3:24430} state up:standby-replay seq 1 addr [v2:172.21.15.183:6832/2331654352,v1:172.21.15.183:6833/2331654352] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a{4:14664} state up:active seq 10 addr [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.g{4:14652} state up:standby-replay seq 1 addr [v2:172.21.15.100:6838/1668286182,v1:172.21.15.100:6839/1668286182] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:10.414 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-04-30T23:13:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:10.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.j{-1:14571} state up:standby seq 1 addr [v2:172.21.15.100:6834/2182837858,v1:172.21.15.100:6835/2182837858] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d{-1:14583} state up:standby seq 1 addr [v2:172.21.15.100:6836/1947176646,v1:172.21.15.100:6837/1947176646] compat {c=[1],r=[1],i=[1fff]}] 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 msgr2=0x7f65f80a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 0x7f65f80a6150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66101052b0 tx=0x7f660400a3b0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 msgr2=0x7f6610076b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6600006010 tx=0x7f66000057c0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 shutdown_connections 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f65f80a3c40 0x7f65f80a6150 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66101058c0 0x7f6610077070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610103e70 0x7f6610078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 --2- 172.21.15.100:0/1306139783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66101048f0 0x7f6610076b30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 >> 172.21.15.100:0/1306139783 conn(0x7f66100ff8e0 msgr2=0x7f66101085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 shutdown_connections 2024-04-30T23:13:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:10.411+0000 7f6614af1700 1 -- 172.21.15.100:0/1306139783 wait complete. 2024-04-30T23:13:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:13:11.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:10 smithi104 ceph-mon[32987]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 686 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:11.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:10 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1306139783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-30T23:13:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:10 smithi183 ceph-mon[33560]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 686 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:10 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1306139783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-30T23:13:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:10 smithi100 ceph-mon[29745]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 686 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:10 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1306139783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-30T23:13:11.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-30T23:13:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:12.789 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:12 smithi100 ceph-mon[29745]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 -- 172.21.15.100:0/3291790976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68941043c0 msgr2=0x7f689410ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 --2- 172.21.15.100:0/3291790976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68941043c0 0x7f689410ac70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f688c00b0a0 tx=0x7f688c00b3b0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 -- 172.21.15.100:0/3291790976 shutdown_connections 2024-04-30T23:13:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 --2- 172.21.15.100:0/3291790976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68941043c0 0x7f689410ac70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 --2- 172.21.15.100:0/3291790976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 0x7f6894102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 --2- 172.21.15.100:0/3291790976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6894103a20 0x7f6894103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 -- 172.21.15.100:0/3291790976 >> 172.21.15.100:0/3291790976 conn(0x7f68940fdf30 msgr2=0x7f68941003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 -- 172.21.15.100:0/3291790976 shutdown_connections 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.045+0000 7f689a33d700 1 -- 172.21.15.100:0/3291790976 wait complete. 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 Processor -- start 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 -- start start 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 0x7f689410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68941043c0 0x7f689410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f689410fdb0 con 0x7f6894103a20 2024-04-30T23:13:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f689410fc30 con 0x7f68941043c0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f689a33d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f689410ff30 con 0x7f68941028f0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f688bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f688bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33208/0 (socket says 172.21.15.100:33208) 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f688bfff700 1 -- 172.21.15.100:0/765135034 learned_addr learned my addr 172.21.15.100:0/765135034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f68988da700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68941043c0 0x7f689410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.046+0000 7f6893fff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 0x7f689410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 -- 172.21.15.100:0/765135034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 msgr2=0x7f689410df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 0x7f689410df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 -- 172.21.15.100:0/765135034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68941043c0 msgr2=0x7f689410cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68941043c0 0x7f689410cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 -- 172.21.15.100:0/765135034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689410d200 con 0x7f6894103a20 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f688bfff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c9b0 tx=0x7f687c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c007b00 con 0x7f6894103a20 2024-04-30T23:13:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f687c00ce50 con 0x7f6894103a20 2024-04-30T23:13:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c018660 con 0x7f6894103a20 2024-04-30T23:13:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68941a4900 con 0x7f6894103a20 2024-04-30T23:13:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.047+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68941a4d00 con 0x7f6894103a20 2024-04-30T23:13:13.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:12 smithi104 ceph-mon[32987]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.048+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68940511d0 con 0x7f6894103a20 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.049+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f687c00f450 con 0x7f6894103a20 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.050+0000 7f6891ffb700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 0x7f68800a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.050+0000 7f6893fff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 0x7f68800a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.050+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f687c0d0900 con 0x7f6894103a20 2024-04-30T23:13:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.050+0000 7f6893fff700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 0x7f68800a6150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6894103920 tx=0x7f688400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:13.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:12 smithi183 ceph-mon[33560]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-30T23:13:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.054+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f687c014030 con 0x7f6894103a20 2024-04-30T23:13:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.253+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f689402e550 con 0x7f6894103a20 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.254+0000 7f6891ffb700 1 -- 172.21.15.100:0/765135034 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) ==== 56+0+5616 (secure 0 0 0) 0x7f687c09d010 con 0x7f6894103a20 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 93 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:fsid a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-04-30T23:03:01.857638+0000 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-04-30T23:12:57.673252+0000 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-30T23:13:13.254 INFO:teuthology.orchestra.run.smithi100.stdout:crush_version 27 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:full_ratio 0.95 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:backfillfull_ratio 0.9 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:nearfull_ratio 0.85 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:require_min_compat_client luminous 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:min_compat_client luminous 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:require_osd_release squid 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:stretch_mode_enabled false 2024-04-30T23:13:13.255 INFO:teuthology.orchestra.run.smithi100.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:max_osd 12 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6802/815126249,v1:172.21.15.100:6803/815126249] [v2:172.21.15.100:6804/815126249,v1:172.21.15.100:6805/815126249] exists,up ef7c5b0b-6410-4a8c-bfea-6469f5de392e 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 up in weight 1 up_from 13 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6800/742044421,v1:172.21.15.104:6801/742044421] [v2:172.21.15.104:6802/742044421,v1:172.21.15.104:6803/742044421] exists,up 37aaab18-a336-45c6-a43f-26d4dd5183b6 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/3395265285,v1:172.21.15.183:6801/3395265285] [v2:172.21.15.183:6802/3395265285,v1:172.21.15.183:6803/3395265285] exists,up fe687b16-00c0-432c-9361-0371a0152831 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6810/2399310688,v1:172.21.15.100:6811/2399310688] [v2:172.21.15.100:6812/2399310688,v1:172.21.15.100:6813/2399310688] exists,up 7d12a3f3-d9a4-43a4-879a-4aa2964857ae 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6808/369610864,v1:172.21.15.104:6809/369610864] [v2:172.21.15.104:6810/369610864,v1:172.21.15.104:6811/369610864] exists,up 2aed289f-1846-4fd1-8f0c-b1f293bd50e1 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 up in weight 1 up_from 38 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6808/4049435736,v1:172.21.15.183:6809/4049435736] [v2:172.21.15.183:6810/4049435736,v1:172.21.15.183:6811/4049435736] exists,up ff24999e-56a0-4b18-92e5-f7165c4f5752 2024-04-30T23:13:13.256 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6818/652878635,v1:172.21.15.100:6819/652878635] [v2:172.21.15.100:6820/652878635,v1:172.21.15.100:6821/652878635] exists,up bc4bc468-d384-49f6-a3c3-85963a7d828d 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6816/1321206568,v1:172.21.15.104:6817/1321206568] [v2:172.21.15.104:6818/1321206568,v1:172.21.15.104:6819/1321206568] exists,up 21ba1dd0-804d-435d-b437-8d0975de2d30 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 up in weight 1 up_from 59 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6816/2582979705,v1:172.21.15.183:6817/2582979705] [v2:172.21.15.183:6818/2582979705,v1:172.21.15.183:6819/2582979705] exists,up 3275bb80-7285-4045-909d-0dc4220da519 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 up in weight 1 up_from 67 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6826/3455336884,v1:172.21.15.100:6827/3455336884] [v2:172.21.15.100:6828/3455336884,v1:172.21.15.100:6829/3455336884] exists,up f0f73884-91f7-49e8-8a4d-bf23f66567a2 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 up in weight 1 up_from 72 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6824/452844074,v1:172.21.15.104:6825/452844074] [v2:172.21.15.104:6826/452844074,v1:172.21.15.104:6827/452844074] exists,up 7a9e09c9-e0f3-4359-ba40-3fce08a144d0 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 up in weight 1 up_from 80 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6824/964206536,v1:172.21.15.183:6825/964206536] [v2:172.21.15.183:6826/964206536,v1:172.21.15.183:6827/964206536] exists,up 1c5e3fbe-3128-4f57-93fe-c9fb639c9407 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.8 [2,11] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.a [2,11,8,1] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.6 [4,6] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1b [5,9] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1e [3,9] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.24 [4,9] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 4.3 [5,10] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 4.b [9,8] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 4.e [9,11] 2024-04-30T23:13:13.257 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 4.1b [9,8] 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/57412019 expires 2024-05-01T23:03:55.489561+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/642565197 expires 2024-05-01T23:03:55.489561+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/2011872270 expires 2024-05-01T23:03:28.524392+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/4139962241 expires 2024-05-01T23:03:28.524392+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/3231236282 expires 2024-05-01T23:03:55.489561+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/3389524928 expires 2024-05-01T23:03:28.524392+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/2011872270 expires 2024-05-01T23:03:28.524392+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/820034739 expires 2024-05-01T23:03:28.524392+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/1429245117 expires 2024-05-01T23:03:55.489561+0000 2024-04-30T23:13:13.258 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/642565197 expires 2024-05-01T23:03:55.489561+0000 2024-04-30T23:13:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 msgr2=0x7f68800a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 0x7f68800a6150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6894103920 tx=0x7f688400a380 comp rx=0 tx=0).stop 2024-04-30T23:13:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 msgr2=0x7f689410c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c9b0 tx=0x7f687c00ccc0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 shutdown_connections 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f68800a3c40 0x7f68800a6150 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68941043c0 0x7f689410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68941028f0 0x7f689410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 --2- 172.21.15.100:0/765135034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894103a20 0x7f689410c5f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 >> 172.21.15.100:0/765135034 conn(0x7f68940fdf30 msgr2=0x7f6894106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 shutdown_connections 2024-04-30T23:13:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:13.256+0000 7f689a33d700 1 -- 172.21.15.100:0/765135034 wait complete. 2024-04-30T23:13:13.955 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:13 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/765135034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-30T23:13:13.983 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-30T23:13:13.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:14.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:13 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/765135034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-30T23:13:14.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:13 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/765135034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/835315113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4102a20 msgr2=0x7fb5a4103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/835315113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4102a20 0x7fb5a4103720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009900 tx=0x7fb5a002a410 comp rx=0 tx=0).stop 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/835315113 shutdown_connections 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/835315113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4108960 0x7fb5a410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/835315113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4103c60 0x7fb5a4104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/835315113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4102a20 0x7fb5a4103720 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/835315113 >> 172.21.15.100:0/835315113 conn(0x7fb5a40fdc30 msgr2=0x7fb5a41000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/835315113 shutdown_connections 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.104+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/835315113 wait complete. 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 Processor -- start 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 -- start start 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4102a20 0x7fb5a40758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 0x7fb5a419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a410e580 con 0x7fb5a4108960 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a410e400 con 0x7fb5a4103c60 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5ab8a8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a410e700 con 0x7fb5a4102a20 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36966/0 (socket says 172.21.15.100:36966) 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 -- 172.21.15.100:0/1200687433 learned_addr learned my addr 172.21.15.100:0/1200687433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9644640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4102a20 0x7fb5a40758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a8e43640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 0x7fb5a419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 -- 172.21.15.100:0/1200687433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4102a20 msgr2=0x7fb5a40758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4102a20 0x7fb5a40758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 -- 172.21.15.100:0/1200687433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 msgr2=0x7fb5a419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 0x7fb5a419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 -- 172.21.15.100:0/1200687433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a41a1e70 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a8e43640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 0x7fb5a419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb5a9e45640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00eaa0 tx=0x7fb59c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00cdb0 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.105+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c005020 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.106+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a41a2160 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.106+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0116d0 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.106+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a41a26e0 con 0x7fb5a4108960 2024-04-30T23:13:14.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.106+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a4107770 con 0x7fb5a4108960 2024-04-30T23:13:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.108+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fb59c0051d0 con 0x7fb5a4108960 2024-04-30T23:13:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.108+0000 7fb59a7fc640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 0x7fb5900a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.109+0000 7fb5a9644640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 0x7fb5900a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.109+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb59c0d0db0 con 0x7fb5a4108960 2024-04-30T23:13:14.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.109+0000 7fb5a9644640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 0x7fb5900a60c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005ab0 tx=0x7fb5a0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.113+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb59c016030 con 0x7fb5a4108960 2024-04-30T23:13:14.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.297+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a402dd60 con 0x7fb5a4108960 2024-04-30T23:13:14.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.299+0000 7fb59a7fc640 1 -- 172.21.15.100:0/1200687433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7fb59c09d3d0 con 0x7fb5a4108960 2024-04-30T23:13:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:14.300 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:14.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 msgr2=0x7fb5900a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 0x7fb5900a60c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005ab0 tx=0x7fb5a0031400 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 msgr2=0x7fb5a41a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00eaa0 tx=0x7fb59c00ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 shutdown_connections 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb5900a3bb0 0x7fb5900a60c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4108960 0x7fb5a41a1650 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a4103c60 0x7fb5a419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 --2- 172.21.15.100:0/1200687433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5a4102a20 0x7fb5a40758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 >> 172.21.15.100:0/1200687433 conn(0x7fb5a40fdc30 msgr2=0x7fb5a4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 shutdown_connections 2024-04-30T23:13:14.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.301+0000 7fb5ab8a8640 1 -- 172.21.15.100:0/1200687433 wait complete. 2024-04-30T23:13:14.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:13:14.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:13:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 -- 172.21.15.100:0/2409948507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8108960 msgr2=0x7f3ef810ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 --2- 172.21.15.100:0/2409948507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8108960 0x7f3ef810ad80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009ca0 tx=0x7f3ef002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 -- 172.21.15.100:0/2409948507 shutdown_connections 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 --2- 172.21.15.100:0/2409948507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8108960 0x7f3ef810ad80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 --2- 172.21.15.100:0/2409948507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8103c60 0x7f3ef8104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 --2- 172.21.15.100:0/2409948507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8102a20 0x7f3ef8103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 -- 172.21.15.100:0/2409948507 >> 172.21.15.100:0/2409948507 conn(0x7f3ef80fdc10 msgr2=0x7f3ef81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 -- 172.21.15.100:0/2409948507 shutdown_connections 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.425+0000 7f3eff829640 1 -- 172.21.15.100:0/2409948507 wait complete. 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 Processor -- start 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 -- start start 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8102a20 0x7f3ef8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8108960 0x7f3ef81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef810e550 con 0x7f3ef8103c60 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef810e3d0 con 0x7f3ef8108960 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3eff829640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef810e6d0 con 0x7f3ef8102a20 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36978/0 (socket says 172.21.15.100:36978) 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 -- 172.21.15.100:0/3374861520 learned_addr learned my addr 172.21.15.100:0/3374861520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efd5c5640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8102a20 0x7f3ef8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efddc6640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8108960 0x7f3ef81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 -- 172.21.15.100:0/3374861520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8102a20 msgr2=0x7f3ef8199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8102a20 0x7f3ef8199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 -- 172.21.15.100:0/3374861520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8108960 msgr2=0x7f3ef81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8108960 0x7f3ef81a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.426+0000 7f3efcdc4640 1 -- 172.21.15.100:0/3374861520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef81a0bc0 con 0x7f3ef8103c60 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3efcdc4640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800e9f0 tx=0x7f3ee800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800cd80 con 0x7f3ef8103c60 2024-04-30T23:13:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ee80054d0 con 0x7f3ef8103c60 2024-04-30T23:13:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef81a0eb0 con 0x7f3ef8103c60 2024-04-30T23:13:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8010690 con 0x7f3ef8103c60 2024-04-30T23:13:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.427+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef81a1320 con 0x7f3ef8103c60 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.428+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef8107770 con 0x7f3ef8103c60 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.429+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3ee8004e30 con 0x7f3ef8103c60 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.430+0000 7f3eee7fc640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 0x7f3ee40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.430+0000 7f3efd5c5640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 0x7f3ee40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.430+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f3ee80d0ea0 con 0x7f3ef8103c60 2024-04-30T23:13:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.430+0000 7f3efd5c5640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 0x7f3ee40a60c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40058c0 tx=0x7f3ef4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.433+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ee8053ff0 con 0x7f3ef8103c60 2024-04-30T23:13:14.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.616+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ef802dd20 con 0x7f3ef8103c60 2024-04-30T23:13:14.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.617+0000 7f3eee7fc640 1 -- 172.21.15.100:0/3374861520 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f3ee801f340 con 0x7f3ef8103c60 2024-04-30T23:13:14.617 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:13:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.618+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 msgr2=0x7f3ee40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 0x7f3ee40a60c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40058c0 tx=0x7f3ef4005850 comp rx=0 tx=0).stop 2024-04-30T23:13:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 msgr2=0x7f3ef8199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800e9f0 tx=0x7f3ee800edf0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 shutdown_connections 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3ee40a3bb0 0x7f3ee40a60c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef8108960 0x7f3ef81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef8103c60 0x7f3ef8199670 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 --2- 172.21.15.100:0/3374861520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef8102a20 0x7f3ef8199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 >> 172.21.15.100:0/3374861520 conn(0x7f3ef80fdc10 msgr2=0x7f3ef8104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 shutdown_connections 2024-04-30T23:13:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.619+0000 7f3eff829640 1 -- 172.21.15.100:0/3374861520 wait complete. 2024-04-30T23:13:14.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:13:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 -- 172.21.15.100:0/3732609120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf701039a0 msgr2=0x7fbf70103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/3732609120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf701039a0 0x7fbf70103e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009900 tx=0x7fbf5802a410 comp rx=0 tx=0).stop 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 -- 172.21.15.100:0/3732609120 shutdown_connections 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/3732609120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 0x7fbf7010ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/3732609120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf701039a0 0x7fbf70103e30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/3732609120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf70102fc0 0x7fbf701033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 -- 172.21.15.100:0/3732609120 >> 172.21.15.100:0/3732609120 conn(0x7fbf700fd3c0 msgr2=0x7fbf700ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 -- 172.21.15.100:0/3732609120 shutdown_connections 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.741+0000 7fbf74e5a640 1 -- 172.21.15.100:0/3732609120 wait complete. 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 Processor -- start 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 -- start start 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf701039a0 0x7fbf700fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 0x7fbf700fde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7010e570 con 0x7fbf70102fc0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7010e3f0 con 0x7fbf701039a0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf74e5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7010e6f0 con 0x7fbf701044c0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf6e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf6e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37006/0 (socket says 172.21.15.100:37006) 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf6e59c640 1 -- 172.21.15.100:0/1408822907 learned_addr learned my addr 172.21.15.100:0/1408822907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.742+0000 7fbf6dd9b640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf701039a0 0x7fbf700fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6ed9d640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 0x7fbf700fde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 -- 172.21.15.100:0/1408822907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 msgr2=0x7fbf700fde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 0x7fbf700fde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 -- 172.21.15.100:0/1408822907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf701039a0 msgr2=0x7fbf700fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf701039a0 0x7fbf700fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 -- 172.21.15.100:0/1408822907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700fe560 con 0x7fbf70102fc0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf6e59c640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000d770 tx=0x7fbf6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60017070 con 0x7fbf70102fc0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf701a42f0 con 0x7fbf70102fc0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf60009c30 con 0x7fbf70102fc0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000f620 con 0x7fbf70102fc0 2024-04-30T23:13:14.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.743+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf701a47b0 con 0x7fbf70102fc0 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.744+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf701a4a10 con 0x7fbf70102fc0 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.745+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbf6001a070 con 0x7fbf70102fc0 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.746+0000 7fbf677fe640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 0x7fbf5c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.746+0000 7fbf6dd9b640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 0x7fbf5c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.747+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbf600d0260 con 0x7fbf70102fc0 2024-04-30T23:13:14.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.747+0000 7fbf6dd9b640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 0x7fbf5c0a60c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009230 tx=0x7fbf58031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:14.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.750+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf60009de0 con 0x7fbf70102fc0 2024-04-30T23:13:14.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.928+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf701a4be0 con 0x7fbf70102fc0 2024-04-30T23:13:14.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.929+0000 7fbf677fe640 1 -- 172.21.15.100:0/1408822907 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fbf6009c8e0 con 0x7fbf70102fc0 2024-04-30T23:13:14.929 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 msgr2=0x7fbf5c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 0x7fbf5c0a60c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009230 tx=0x7fbf58031400 comp rx=0 tx=0).stop 2024-04-30T23:13:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 msgr2=0x7fbf700ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000d770 tx=0x7fbf6000dc30 comp rx=0 tx=0).stop 2024-04-30T23:13:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 shutdown_connections 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf5c0a3bb0 0x7fbf5c0a60c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf701044c0 0x7fbf700fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf701039a0 0x7fbf700fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 --2- 172.21.15.100:0/1408822907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf70102fc0 0x7fbf700ff250 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 >> 172.21.15.100:0/1408822907 conn(0x7fbf700fd3c0 msgr2=0x7fbf70109d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 shutdown_connections 2024-04-30T23:13:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:14.931+0000 7fbf74e5a640 1 -- 172.21.15.100:0/1408822907 wait complete. 2024-04-30T23:13:14.941 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:14 smithi100 ceph-mon[29745]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:14.942 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1200687433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:14.942 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:14 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3374861520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:14.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:13:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:14 smithi104 ceph-mon[32987]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1200687433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:14 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3374861520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:14 smithi183 ceph-mon[33560]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1200687433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:14 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3374861520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.053+0000 7f4652243640 1 -- 172.21.15.100:0/107437234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 msgr2=0x7f464c104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.053+0000 7f4652243640 1 --2- 172.21.15.100:0/107437234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c104090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4640009900 tx=0x7f464002a410 comp rx=0 tx=0).stop 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 -- 172.21.15.100:0/107437234 shutdown_connections 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 --2- 172.21.15.100:0/107437234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 0x7f464c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 --2- 172.21.15.100:0/107437234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c104090 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 --2- 172.21.15.100:0/107437234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 -- 172.21.15.100:0/107437234 >> 172.21.15.100:0/107437234 conn(0x7f464c0fdc30 msgr2=0x7f464c1000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 -- 172.21.15.100:0/107437234 shutdown_connections 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 -- 172.21.15.100:0/107437234 wait complete. 2024-04-30T23:13:15.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 Processor -- start 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 -- start start 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.054+0000 7f4652243640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 0x7f464c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f464c10e540 con 0x7f464c103c80 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f464c10e3c0 con 0x7f464c102a40 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f464c10e6c0 con 0x7f464c108980 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37012/0 (socket says 172.21.15.100:37012) 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 -- 172.21.15.100:0/502164717 learned_addr learned my addr 172.21.15.100:0/502164717 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464bfff640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 0x7f464c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464b7fe640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 -- 172.21.15.100:0/502164717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 msgr2=0x7f464c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 0x7f464c1a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 -- 172.21.15.100:0/502164717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 msgr2=0x7f464c1991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c1991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 -- 172.21.15.100:0/502164717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c1a0c60 con 0x7f464c103c80 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464b7fe640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f464affd640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4640006010 tx=0x7f4640004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464003f030 con 0x7f464c103c80 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4640003cb0 con 0x7f464c103c80 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c1a0ef0 con 0x7f464c103c80 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640035070 con 0x7f464c103c80 2024-04-30T23:13:15.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.055+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c1a1300 con 0x7f464c103c80 2024-04-30T23:13:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.056+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c107790 con 0x7f464c103c80 2024-04-30T23:13:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.059+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4640042030 con 0x7f464c103c80 2024-04-30T23:13:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.059+0000 7f4648ff9640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 0x7f46340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.059+0000 7f464b7fe640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 0x7f46340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.059+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f46400f1350 con 0x7f464c103c80 2024-04-30T23:13:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.060+0000 7f464b7fe640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 0x7f46340a60c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f463c0058c0 tx=0x7f463c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.063+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f46400bda70 con 0x7f464c103c80 2024-04-30T23:13:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.240+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f464c063810 con 0x7f464c103c80 2024-04-30T23:13:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.240+0000 7f4648ff9640 1 -- 172.21.15.100:0/502164717 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f46400bd370 con 0x7f464c103c80 2024-04-30T23:13:15.241 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 msgr2=0x7f46340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 0x7f46340a60c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f463c0058c0 tx=0x7f463c005850 comp rx=0 tx=0).stop 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 msgr2=0x7f464c199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4640006010 tx=0x7f4640004340 comp rx=0 tx=0).stop 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 shutdown_connections 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46340a3bb0 0x7f46340a60c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f464c108980 0x7f464c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464c103c80 0x7f464c199710 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 --2- 172.21.15.100:0/502164717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f464c102a40 0x7f464c1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.242+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 >> 172.21.15.100:0/502164717 conn(0x7f464c0fdc30 msgr2=0x7f464c104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.243+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 shutdown_connections 2024-04-30T23:13:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.243+0000 7f4652243640 1 -- 172.21.15.100:0/502164717 wait complete. 2024-04-30T23:13:15.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:13:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2054536616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c60 msgr2=0x7fe5c8104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2054536616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c60 0x7fe5c8104070 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009900 tx=0x7fe5bc02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2054536616 shutdown_connections 2024-04-30T23:13:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2054536616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8108960 0x7fe5c810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2054536616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8103c60 0x7fe5c8104070 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2054536616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8102a20 0x7fe5c8103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2054536616 >> 172.21.15.100:0/2054536616 conn(0x7fe5c80fdc10 msgr2=0x7fe5c81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2054536616 shutdown_connections 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2054536616 wait complete. 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.365+0000 7fe5cdc8b640 1 Processor -- start 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 -- start start 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a20 0x7fe5c819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 0x7fe5c819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810f650 con 0x7fe5c8108960 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810f4d0 con 0x7fe5c8102a20 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5cdc8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c810f7d0 con 0x7fe5c8103c60 2024-04-30T23:13:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37030/0 (socket says 172.21.15.100:37030) 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 -- 172.21.15.100:0/2492243525 learned_addr learned my addr 172.21.15.100:0/2492243525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a20 0x7fe5c819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c6ffd640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 0x7fe5c819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 -- 172.21.15.100:0/2492243525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 msgr2=0x7fe5c819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 0x7fe5c819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 -- 172.21.15.100:0/2492243525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a20 msgr2=0x7fe5c819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a20 0x7fe5c819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 -- 172.21.15.100:0/2492243525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c81a2100 con 0x7fe5c8108960 2024-04-30T23:13:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c6ffd640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 0x7fe5c819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.366+0000 7fe5c7fff640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000eaa0 tx=0x7fe5c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.367+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000cdb0 con 0x7fe5c8108960 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.367+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c81a23f0 con 0x7fe5c8108960 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.367+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c0005020 con 0x7fe5c8108960 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.367+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00116d0 con 0x7fe5c8108960 2024-04-30T23:13:15.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.367+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c81a28f0 con 0x7fe5c8108960 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.368+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c8107770 con 0x7fe5c8108960 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.369+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fe5c00051d0 con 0x7fe5c8108960 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.370+0000 7fe5c4ff9640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 0x7fe5b00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.370+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 0x7fe5b00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.370+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe5c00d0dc0 con 0x7fe5c8108960 2024-04-30T23:13:15.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.370+0000 7fe5c77fe640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 0x7fe5b00a60c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005fd0 tx=0x7fe5b8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.373+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5c0016030 con 0x7fe5c8108960 2024-04-30T23:13:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.550+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe5c802dd70 con 0x7fe5c8108960 2024-04-30T23:13:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.550+0000 7fe5c4ff9640 1 -- 172.21.15.100:0/2492243525 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fe5c009d440 con 0x7fe5c8108960 2024-04-30T23:13:15.551 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 msgr2=0x7fe5b00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 0x7fe5b00a60c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005fd0 tx=0x7fe5b8005850 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 msgr2=0x7fe5c81a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000eaa0 tx=0x7fe5c000ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 shutdown_connections 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5b00a3bb0 0x7fe5b00a60c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c8108960 0x7fe5c81a1a90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5c8103c60 0x7fe5c819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 --2- 172.21.15.100:0/2492243525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5c8102a20 0x7fe5c819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 >> 172.21.15.100:0/2492243525 conn(0x7fe5c80fdc10 msgr2=0x7fe5c8104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 shutdown_connections 2024-04-30T23:13:15.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.552+0000 7fe5cdc8b640 1 -- 172.21.15.100:0/2492243525 wait complete. 2024-04-30T23:13:15.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:13:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 -- 172.21.15.100:0/295997830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738109a90 msgr2=0x7f673810beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 --2- 172.21.15.100:0/295997830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738109a90 0x7f673810beb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6730009ca0 tx=0x7f673002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 -- 172.21.15.100:0/295997830 shutdown_connections 2024-04-30T23:13:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 --2- 172.21.15.100:0/295997830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738109a90 0x7f673810beb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 --2- 172.21.15.100:0/295997830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 0x7f67381051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 --2- 172.21.15.100:0/295997830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738103b50 0x7f6738104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 -- 172.21.15.100:0/295997830 >> 172.21.15.100:0/295997830 conn(0x7f67380fed80 msgr2=0x7f67381011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 -- 172.21.15.100:0/295997830 shutdown_connections 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 -- 172.21.15.100:0/295997830 wait complete. 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.672+0000 7f673ff7d640 1 Processor -- start 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 -- start start 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 0x7f673819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738109a90 0x7f67381a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f673810f680 con 0x7f6738103b50 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f673810f500 con 0x7f6738104d90 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f673810f800 con 0x7f6738109a90 2024-04-30T23:13:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37050/0 (socket says 172.21.15.100:37050) 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 -- 172.21.15.100:0/3672960657 learned_addr learned my addr 172.21.15.100:0/3672960657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673e51a640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738109a90 0x7f67381a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673d518640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 0x7f673819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 -- 172.21.15.100:0/3672960657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738109a90 msgr2=0x7f67381a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738109a90 0x7f67381a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 -- 172.21.15.100:0/3672960657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 msgr2=0x7f673819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 0x7f673819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 -- 172.21.15.100:0/3672960657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381a1d90 con 0x7f6738103b50 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673dd19640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6734005d00 tx=0x7f673400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734017070 con 0x7f6738103b50 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6734009c30 con 0x7f6738103b50 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67381a2080 con 0x7f6738103b50 2024-04-30T23:13:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.673+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673400f620 con 0x7f6738103b50 2024-04-30T23:13:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.674+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67381a2580 con 0x7f6738103b50 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.675+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67381088a0 con 0x7f6738103b50 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.677+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f673401a070 con 0x7f6738103b50 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.677+0000 7f672affd640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 0x7f67240a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.677+0000 7f673d518640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 0x7f67240a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.677+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f67340d0210 con 0x7f6738103b50 2024-04-30T23:13:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.678+0000 7f673d518640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 0x7f67240a60c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f672c0058c0 tx=0x7f672c005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.681+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6734009de0 con 0x7f6738103b50 2024-04-30T23:13:15.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1408822907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:15.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/502164717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:15.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:15 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2492243525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.902+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f673802db90 con 0x7f6738103b50 2024-04-30T23:13:15.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.903+0000 7f672affd640 1 -- 172.21.15.100:0/3672960657 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f673409c890 con 0x7f6738103b50 2024-04-30T23:13:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:15.903 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:13:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:13:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 msgr2=0x7f67240a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 0x7f67240a60c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f672c0058c0 tx=0x7f672c005c80 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 msgr2=0x7f673819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6734005d00 tx=0x7f673400dde0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 shutdown_connections 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67240a3bb0 0x7f67240a60c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6738109a90 0x7f67381a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6738104d90 0x7f673819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 --2- 172.21.15.100:0/3672960657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6738103b50 0x7f673819a250 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 >> 172.21.15.100:0/3672960657 conn(0x7f67380fed80 msgr2=0x7f6738105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 shutdown_connections 2024-04-30T23:13:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:15.905+0000 7f673ff7d640 1 -- 172.21.15.100:0/3672960657 wait complete. 2024-04-30T23:13:15.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 -- 172.21.15.100:0/3099581530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020102a00 msgr2=0x7fa020103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 --2- 172.21.15.100:0/3099581530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020102a00 0x7fa020103700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009900 tx=0x7fa01c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 -- 172.21.15.100:0/3099581530 shutdown_connections 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 --2- 172.21.15.100:0/3099581530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020108940 0x7fa02010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 --2- 172.21.15.100:0/3099581530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020103c40 0x7fa020104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 --2- 172.21.15.100:0/3099581530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020102a00 0x7fa020103700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 -- 172.21.15.100:0/3099581530 >> 172.21.15.100:0/3099581530 conn(0x7fa0200fdc10 msgr2=0x7fa0201000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 -- 172.21.15.100:0/3099581530 shutdown_connections 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.025+0000 7fa0278bd640 1 -- 172.21.15.100:0/3099581530 wait complete. 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 Processor -- start 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 -- start start 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 0x7fa02006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 0x7fa02019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa02010e560 con 0x7fa020108940 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa02010e3e0 con 0x7fa020103c40 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa0278bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa02010e6e0 con 0x7fa020102a00 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa025e5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa025e5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37080/0 (socket says 172.21.15.100:37080) 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.026+0000 7fa025e5a640 1 -- 172.21.15.100:0/716755972 learned_addr learned my addr 172.21.15.100:0/716755972 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa024e58640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 0x7fa02019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025659640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 0x7fa02006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 -- 172.21.15.100:0/716755972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 msgr2=0x7fa02006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 0x7fa02006a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 -- 172.21.15.100:0/716755972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 msgr2=0x7fa02019f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 0x7fa02019f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 -- 172.21.15.100:0/716755972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0201a1de0 con 0x7fa020108940 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa024e58640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 0x7fa02019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025659640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 0x7fa02006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa025e5a640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa01800cad0 tx=0x7fa01800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01800ae20 con 0x7fa020108940 2024-04-30T23:13:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa018005020 con 0x7fa020108940 2024-04-30T23:13:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0201a20d0 con 0x7fa020108940 2024-04-30T23:13:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01800f6b0 con 0x7fa020108940 2024-04-30T23:13:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.027+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0201a2650 con 0x7fa020108940 2024-04-30T23:13:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.028+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020107750 con 0x7fa020108940 2024-04-30T23:13:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.030+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa0180051d0 con 0x7fa020108940 2024-04-30T23:13:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.030+0000 7fa0167fc640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 0x7fa00c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.030+0000 7fa025659640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 0x7fa00c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.030+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa0180d0c60 con 0x7fa020108940 2024-04-30T23:13:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.031+0000 7fa025659640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 0x7fa00c0a60c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa01c005f70 tx=0x7fa01c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.034+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa018014030 con 0x7fa020108940 2024-04-30T23:13:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1408822907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/502164717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:15 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2492243525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1408822907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/502164717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:15 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2492243525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.213+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa02002dd60 con 0x7fa020108940 2024-04-30T23:13:16.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.215+0000 7fa0167fc640 1 -- 172.21.15.100:0/716755972 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7fa01809d2e0 con 0x7fa020108940 2024-04-30T23:13:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:16.215 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 msgr2=0x7fa00c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 0x7fa00c0a60c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa01c005f70 tx=0x7fa01c000bc0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 msgr2=0x7fa0201a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa01800cad0 tx=0x7fa01800cf90 comp rx=0 tx=0).stop 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 shutdown_connections 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa00c0a3bb0 0x7fa00c0a60c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa020108940 0x7fa0201a15c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa020103c40 0x7fa02019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 --2- 172.21.15.100:0/716755972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa020102a00 0x7fa02006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 >> 172.21.15.100:0/716755972 conn(0x7fa0200fdc10 msgr2=0x7fa020104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 shutdown_connections 2024-04-30T23:13:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.217+0000 7fa0278bd640 1 -- 172.21.15.100:0/716755972 wait complete. 2024-04-30T23:13:16.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:13:16.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:13:16.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 -- 172.21.15.100:0/3873894991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec1044c0 msgr2=0x7f70ec10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 --2- 172.21.15.100:0/3873894991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec1044c0 0x7f70ec10ac10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009ca0 tx=0x7f70e402a8e0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 -- 172.21.15.100:0/3873894991 shutdown_connections 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 --2- 172.21.15.100:0/3873894991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec1044c0 0x7f70ec10ac10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 --2- 172.21.15.100:0/3873894991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec103960 0x7f70ec103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 --2- 172.21.15.100:0/3873894991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec102f80 0x7f70ec103390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 -- 172.21.15.100:0/3873894991 >> 172.21.15.100:0/3873894991 conn(0x7f70ec0fd3c0 msgr2=0x7f70ec0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 -- 172.21.15.100:0/3873894991 shutdown_connections 2024-04-30T23:13:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.340+0000 7f70f411b640 1 -- 172.21.15.100:0/3873894991 wait complete. 2024-04-30T23:13:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 Processor -- start 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 -- start start 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec103960 0x7f70ec19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec19f360 0x7f70ec1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10f6f0 con 0x7f70ec102f80 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10f570 con 0x7f70ec19f360 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f411b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10f870 con 0x7f70ec103960 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37102/0 (socket says 172.21.15.100:37102) 2024-04-30T23:13:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 -- 172.21.15.100:0/1721979222 learned_addr learned my addr 172.21.15.100:0/1721979222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f26b8640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec19f360 0x7f70ec1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f16b6640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec103960 0x7f70ec19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 -- 172.21.15.100:0/1721979222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec103960 msgr2=0x7f70ec19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec103960 0x7f70ec19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 -- 172.21.15.100:0/1721979222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec19f360 msgr2=0x7f70ec1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.341+0000 7f70f1eb7640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec19f360 0x7f70ec1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70f1eb7640 1 -- 172.21.15.100:0/1721979222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec1a1d40 con 0x7f70ec102f80 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70f1eb7640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f70e8006fd0 tx=0x7f70e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011830 con 0x7f70ec102f80 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70e8016070 con 0x7f70ec102f80 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8010e00 con 0x7f70ec102f80 2024-04-30T23:13:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec1a1fd0 con 0x7f70ec102f80 2024-04-30T23:13:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.342+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1a2510 con 0x7f70ec102f80 2024-04-30T23:13:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.343+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec109930 con 0x7f70ec102f80 2024-04-30T23:13:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.344+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f70e80119d0 con 0x7f70ec102f80 2024-04-30T23:13:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.345+0000 7f70e2ffd640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 0x7f70d80a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.345+0000 7f70f16b6640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 0x7f70d80a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.345+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f70e80d0310 con 0x7f70ec102f80 2024-04-30T23:13:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.345+0000 7f70f16b6640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 0x7f70d80a6140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70dc005e10 tx=0x7f70dc005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.348+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70e809ca30 con 0x7f70ec102f80 2024-04-30T23:13:16.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.525+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f70ec0637e0 con 0x7f70ec102f80 2024-04-30T23:13:16.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.526+0000 7f70e2ffd640 1 -- 172.21.15.100:0/1721979222 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f70e809c330 con 0x7f70ec102f80 2024-04-30T23:13:16.526 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:13:16.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 msgr2=0x7f70d80a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 0x7f70d80a6140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70dc005e10 tx=0x7f70dc005da0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 msgr2=0x7f70ec199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f70e8006fd0 tx=0x7f70e800b8e0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 shutdown_connections 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f70d80a3c30 0x7f70d80a6140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70ec19f360 0x7f70ec1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70ec103960 0x7f70ec19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 --2- 172.21.15.100:0/1721979222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec102f80 0x7f70ec199ea0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 >> 172.21.15.100:0/1721979222 conn(0x7f70ec0fd3c0 msgr2=0x7f70ec106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 shutdown_connections 2024-04-30T23:13:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.528+0000 7f70f411b640 1 -- 172.21.15.100:0/1721979222 wait complete. 2024-04-30T23:13:16.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 -- 172.21.15.100:0/2972449489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4102a20 msgr2=0x7f1ff4103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/2972449489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4102a20 0x7f1ff4103720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009900 tx=0x7f1fe402a410 comp rx=0 tx=0).stop 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 -- 172.21.15.100:0/2972449489 shutdown_connections 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/2972449489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4108960 0x7f1ff410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/2972449489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 0x7f1ff4104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/2972449489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4102a20 0x7f1ff4103720 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 -- 172.21.15.100:0/2972449489 >> 172.21.15.100:0/2972449489 conn(0x7f1ff40fdc10 msgr2=0x7f1ff41000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 -- 172.21.15.100:0/2972449489 shutdown_connections 2024-04-30T23:13:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.651+0000 7f1ff95ee640 1 -- 172.21.15.100:0/2972449489 wait complete. 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 Processor -- start 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 -- start start 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4102a20 0x7f1ff406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 0x7f1ff419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff410e5a0 con 0x7f1ff4108960 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff410e420 con 0x7f1ff4103c60 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff95ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff410e720 con 0x7f1ff4102a20 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37110/0 (socket says 172.21.15.100:37110) 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff37fe640 1 -- 172.21.15.100:0/3816170814 learned_addr learned my addr 172.21.15.100:0/3816170814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff27fc640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 0x7f1ff419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.652+0000 7f1ff2ffd640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4102a20 0x7f1ff406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 -- 172.21.15.100:0/3816170814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4102a20 msgr2=0x7f1ff406a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4102a20 0x7f1ff406a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 -- 172.21.15.100:0/3816170814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 msgr2=0x7f1ff419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 0x7f1ff419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 -- 172.21.15.100:0/3816170814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff41a2150 con 0x7f1ff4108960 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff37fe640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00cad0 tx=0x7f1fec00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00ad60 con 0x7f1ff4108960 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff41a2440 con 0x7f1ff4108960 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fec005020 con 0x7f1ff4108960 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00f6b0 con 0x7f1ff4108960 2024-04-30T23:13:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.653+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff41a2a10 con 0x7f1ff4108960 2024-04-30T23:13:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.654+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff4107770 con 0x7f1ff4108960 2024-04-30T23:13:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.655+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1fec0051d0 con 0x7f1ff4108960 2024-04-30T23:13:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.656+0000 7f1fdbfff640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 0x7f1fdc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.656+0000 7f1ff2ffd640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 0x7f1fdc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.656+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1fec0d0b30 con 0x7f1ff4108960 2024-04-30T23:13:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.656+0000 7f1ff2ffd640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 0x7f1fdc0a60c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009230 tx=0x7f1fe4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.659+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fec014030 con 0x7f1ff4108960 2024-04-30T23:13:16.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:16 smithi100 ceph-mon[29745]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:16.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3672960657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:16.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/716755972' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:16.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:16 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1721979222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:16.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.839+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1ff402dcb0 con 0x7f1ff4108960 2024-04-30T23:13:16.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.839+0000 7f1fdbfff640 1 -- 172.21.15.100:0/3816170814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f1fec09d1b0 con 0x7f1ff4108960 2024-04-30T23:13:16.839 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 msgr2=0x7f1fdc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 0x7f1fdc0a60c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009230 tx=0x7f1fe4031400 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 msgr2=0x7f1ff41a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00cad0 tx=0x7f1fec00ced0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 shutdown_connections 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1fdc0a3bb0 0x7f1fdc0a60c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff4108960 0x7f1ff41a1930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ff4103c60 0x7f1ff419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 --2- 172.21.15.100:0/3816170814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ff4102a20 0x7f1ff406a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 >> 172.21.15.100:0/3816170814 conn(0x7f1ff40fdc10 msgr2=0x7f1ff4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 shutdown_connections 2024-04-30T23:13:16.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.841+0000 7f1ff95ee640 1 -- 172.21.15.100:0/3816170814 wait complete. 2024-04-30T23:13:16.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.966+0000 7f204b114640 1 -- 172.21.15.100:0/1654074639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 msgr2=0x7f204410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.966+0000 7f204b114640 1 --2- 172.21.15.100:0/1654074639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f204410abd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f203c009ca0 tx=0x7f203c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- 172.21.15.100:0/1654074639 shutdown_connections 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- 172.21.15.100:0/1654074639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f204410abd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- 172.21.15.100:0/1654074639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f2044103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- 172.21.15.100:0/1654074639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 0x7f2044103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- 172.21.15.100:0/1654074639 >> 172.21.15.100:0/1654074639 conn(0x7f20440fd390 msgr2=0x7f20440ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- 172.21.15.100:0/1654074639 shutdown_connections 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- 172.21.15.100:0/1654074639 wait complete. 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 Processor -- start 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- start start 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 0x7f204419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f204419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f204410e560 con 0x7f2044104490 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f204410e3e0 con 0x7f2044102f70 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.967+0000 7f204b114640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f204410e6e0 con 0x7f2044103950 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37122/0 (socket says 172.21.15.100:37122) 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 -- 172.21.15.100:0/4252393556 learned_addr learned my addr 172.21.15.100:0/4252393556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2048eb0640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 0x7f204419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2043fff640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f204419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 -- 172.21.15.100:0/4252393556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 msgr2=0x7f204419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f204419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 -- 172.21.15.100:0/4252393556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 msgr2=0x7f204419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 0x7f204419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 -- 172.21.15.100:0/4252393556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20441a1d20 con 0x7f2044104490 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2043fff640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f204419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f20496b1640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097b0 tx=0x7f203c031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c003bf0 con 0x7f2044104490 2024-04-30T23:13:16.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f203c003d90 con 0x7f2044104490 2024-04-30T23:13:16.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c02fc30 con 0x7f2044104490 2024-04-30T23:13:16.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20441a1fb0 con 0x7f2044104490 2024-04-30T23:13:16.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.968+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20441a2420 con 0x7f2044104490 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.970+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20441a2740 con 0x7f2044104490 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.971+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f203c004b40 con 0x7f2044104490 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.971+0000 7f2041ffb640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 0x7f20340a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.971+0000 7f2048eb0640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 0x7f20340a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.972+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f203c0f1fe0 con 0x7f2044104490 2024-04-30T23:13:16.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.972+0000 7f2048eb0640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 0x7f20340a6140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f204406b4a0 tx=0x7f2038005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:16.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:16.975+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f203c0be6f0 con 0x7f2044104490 2024-04-30T23:13:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:16 smithi104 ceph-mon[32987]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3672960657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/716755972' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:16 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1721979222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:16 smithi183 ceph-mon[33560]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3672960657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/716755972' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:16 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1721979222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:17.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.153+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f20441a2910 con 0x7f2044104490 2024-04-30T23:13:17.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.153+0000 7f2041ffb640 1 -- 172.21.15.100:0/4252393556 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f203c0bdff0 con 0x7f2044104490 2024-04-30T23:13:17.154 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 msgr2=0x7f20340a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 0x7f20340a6140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f204406b4a0 tx=0x7f2038005f90 comp rx=0 tx=0).stop 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 msgr2=0x7f20441a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097b0 tx=0x7f203c031840 comp rx=0 tx=0).stop 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 shutdown_connections 2024-04-30T23:13:17.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20340a3c30 0x7f20340a6140 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2044104490 0x7f20441a16b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044103950 0x7f204419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 --2- 172.21.15.100:0/4252393556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044102f70 0x7f204419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 >> 172.21.15.100:0/4252393556 conn(0x7f20440fd390 msgr2=0x7f20441017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 shutdown_connections 2024-04-30T23:13:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.155+0000 7f204b114640 1 -- 172.21.15.100:0/4252393556 wait complete. 2024-04-30T23:13:17.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:13:17.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- 172.21.15.100:0/3133302261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 msgr2=0x7fb7341033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 --2- 172.21.15.100:0/3133302261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb7341033a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb724009ca0 tx=0x7fb72402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- 172.21.15.100:0/3133302261 shutdown_connections 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 --2- 172.21.15.100:0/3133302261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 0x7fb73410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 --2- 172.21.15.100:0/3133302261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 0x7fb734103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 --2- 172.21.15.100:0/3133302261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb7341033a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- 172.21.15.100:0/3133302261 >> 172.21.15.100:0/3133302261 conn(0x7fb7340fd390 msgr2=0x7fb7340ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- 172.21.15.100:0/3133302261 shutdown_connections 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- 172.21.15.100:0/3133302261 wait complete. 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 Processor -- start 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.277+0000 7fb7395be640 1 -- start start 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 0x7fb73419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 0x7fb7341a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb73410e530 con 0x7fb734102f90 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb73410e3b0 con 0x7fb734104490 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb73410e6b0 con 0x7fb734103970 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37138/0 (socket says 172.21.15.100:37138) 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 -- 172.21.15.100:0/1524356914 learned_addr learned my addr 172.21.15.100:0/1524356914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7327fc640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 0x7fb73419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7337fe640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 0x7fb7341a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 -- 172.21.15.100:0/1524356914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 msgr2=0x7fb73419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 0x7fb73419f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 -- 172.21.15.100:0/1524356914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 msgr2=0x7fb7341a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 0x7fb7341a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 -- 172.21.15.100:0/1524356914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7341a1cf0 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb732ffd640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb72402ade0 tx=0x7fb724003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240317c0 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7341a1f80 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.278+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7240044f0 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.279+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72402fd10 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.279+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7341a23e0 con 0x7fb734102f90 2024-04-30T23:13:17.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.279+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73406a1a0 con 0x7fb734102f90 2024-04-30T23:13:17.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.281+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fb724004040 con 0x7fb734102f90 2024-04-30T23:13:17.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.281+0000 7fb71bfff640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 0x7fb71c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.282+0000 7fb7327fc640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 0x7fb71c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.282+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb7240f1f40 con 0x7fb734102f90 2024-04-30T23:13:17.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.282+0000 7fb7327fc640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 0x7fb71c0a60c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb734101bd0 tx=0x7fb72800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.285+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7240be5c0 con 0x7fb734102f90 2024-04-30T23:13:17.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.461+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb73402dc10 con 0x7fb734102f90 2024-04-30T23:13:17.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.461+0000 7fb71bfff640 1 -- 172.21.15.100:0/1524356914 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fb7240bdec0 con 0x7fb734102f90 2024-04-30T23:13:17.462 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 msgr2=0x7fb71c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 0x7fb71c0a60c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb734101bd0 tx=0x7fb72800b390 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 msgr2=0x7fb734102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb72402ade0 tx=0x7fb724003ba0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 shutdown_connections 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb71c0a3bb0 0x7fb71c0a60c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb734104490 0x7fb7341a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb734103970 0x7fb73419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 --2- 172.21.15.100:0/1524356914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb734102f90 0x7fb734102230 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 >> 172.21.15.100:0/1524356914 conn(0x7fb7340fd390 msgr2=0x7fb734104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 shutdown_connections 2024-04-30T23:13:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.463+0000 7fb7395be640 1 -- 172.21.15.100:0/1524356914 wait complete. 2024-04-30T23:13:17.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:13:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1054652864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 msgr2=0x7fa034104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1054652864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa034104840 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009900 tx=0x7fa02c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1054652864 shutdown_connections 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1054652864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034109a80 0x7fa03410bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1054652864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034104d80 0x7fa034105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1054652864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa034104840 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1054652864 >> 172.21.15.100:0/1054652864 conn(0x7fa0340fed50 msgr2=0x7fa0341011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1054652864 shutdown_connections 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.583+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1054652864 wait complete. 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 Processor -- start 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 -- start start 2024-04-30T23:13:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034104d80 0x7fa03419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 0x7fa0341a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410f620 con 0x7fa034103b40 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410f4a0 con 0x7fa034104d80 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03c7dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410f7a0 con 0x7fa034109a80 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37152/0 (socket says 172.21.15.100:37152) 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 -- 172.21.15.100:0/1182364429 learned_addr learned my addr 172.21.15.100:0/1182364429 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa039d78640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034104d80 0x7fa03419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03ad7a640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 0x7fa0341a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 -- 172.21.15.100:0/1182364429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 msgr2=0x7fa0341a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 0x7fa0341a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 -- 172.21.15.100:0/1182364429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034104d80 msgr2=0x7fa03419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034104d80 0x7fa03419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03a579640 1 -- 172.21.15.100:0/1182364429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0341a1d40 con 0x7fa034103b40 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.584+0000 7fa03ad7a640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 0x7fa0341a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa03a579640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa02c006010 tx=0x7fa02c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02c03f030 con 0x7fa034103b40 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0341a1fd0 con 0x7fa034103b40 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa02c003aa0 con 0x7fa034103b40 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02c035070 con 0x7fa034103b40 2024-04-30T23:13:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.585+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0341a2430 con 0x7fa034103b40 2024-04-30T23:13:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.586+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa034108890 con 0x7fa034103b40 2024-04-30T23:13:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.587+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa02c042030 con 0x7fa034103b40 2024-04-30T23:13:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.588+0000 7fa02b7fe640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 0x7fa0200a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.588+0000 7fa039d78640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 0x7fa0200a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.588+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa02c0f1200 con 0x7fa034103b40 2024-04-30T23:13:17.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.588+0000 7fa039d78640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 0x7fa0200a60c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa024005e10 tx=0x7fa024005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.591+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa02c0bd880 con 0x7fa034103b40 2024-04-30T23:13:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.811+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa03402dcb0 con 0x7fa034103b40 2024-04-30T23:13:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.812+0000 7fa02b7fe640 1 -- 172.21.15.100:0/1182364429 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7fa02c0bd180 con 0x7fa034103b40 2024-04-30T23:13:17.812 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:17.812 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:11:27.921467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:13:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 msgr2=0x7fa0200a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 0x7fa0200a60c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa024005e10 tx=0x7fa024005da0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 msgr2=0x7fa03419a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa02c006010 tx=0x7fa02c004270 comp rx=0 tx=0).stop 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 shutdown_connections 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0200a3bb0 0x7fa0200a60c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa034109a80 0x7fa0341a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa034104d80 0x7fa03419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 --2- 172.21.15.100:0/1182364429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa034103b40 0x7fa03419a2b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 >> 172.21.15.100:0/1182364429 conn(0x7fa0340fed50 msgr2=0x7fa034105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 shutdown_connections 2024-04-30T23:13:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.814+0000 7fa03c7dd640 1 -- 172.21.15.100:0/1182364429 wait complete. 2024-04-30T23:13:17.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:17.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- 172.21.15.100:0/2974702158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 msgr2=0x7f6f0c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 --2- 172.21.15.100:0/2974702158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c104070 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009900 tx=0x7f6ef402a410 comp rx=0 tx=0).stop 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- 172.21.15.100:0/2974702158 shutdown_connections 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 --2- 172.21.15.100:0/2974702158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 --2- 172.21.15.100:0/2974702158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c104070 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 --2- 172.21.15.100:0/2974702158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 0x7f6f0c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- 172.21.15.100:0/2974702158 >> 172.21.15.100:0/2974702158 conn(0x7f6f0c0fdc10 msgr2=0x7f6f0c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- 172.21.15.100:0/2974702158 shutdown_connections 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- 172.21.15.100:0/2974702158 wait complete. 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 Processor -- start 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 -- start start 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.934+0000 7f6f1176c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 0x7f6f0c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c1a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c10e550 con 0x7f6f0c103c60 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c10e3d0 con 0x7f6f0c102a20 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c10e6d0 con 0x7f6f0c108960 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37166/0 (socket says 172.21.15.100:37166) 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 -- 172.21.15.100:0/468563963 learned_addr learned my addr 172.21.15.100:0/468563963 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f0affd640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 0x7f6f0c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f0b7fe640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c1a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 -- 172.21.15.100:0/468563963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 msgr2=0x7f6f0c1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c1a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 -- 172.21.15.100:0/468563963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 msgr2=0x7f6f0c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 0x7f6f0c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 -- 172.21.15.100:0/468563963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c1a20a0 con 0x7f6f0c103c60 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f0b7fe640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c1a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f03fff640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4006010 tx=0x7f6ef40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef403f030 con 0x7f6f0c103c60 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0c1a2330 con 0x7f6f0c103c60 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ef4031910 con 0x7f6f0c103c60 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4035070 con 0x7f6f0c103c60 2024-04-30T23:13:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.935+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c1a2870 con 0x7f6f0c103c60 2024-04-30T23:13:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.937+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0c069bb0 con 0x7f6f0c103c60 2024-04-30T23:13:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.938+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6ef4042030 con 0x7f6f0c103c60 2024-04-30T23:13:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.938+0000 7f6f08ff9640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 0x7f6ef80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.939+0000 7f6f0affd640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 0x7f6ef80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.939+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6ef40f1360 con 0x7f6f0c103c60 2024-04-30T23:13:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.939+0000 7f6f0affd640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 0x7f6ef80a60c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c103620 tx=0x7f6efc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:17.942+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ef40bd9e0 con 0x7f6f0c103c60 2024-04-30T23:13:18.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:17 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3816170814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:17 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4252393556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:17 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1524356914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:17 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3816170814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:17 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4252393556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:17 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1524356914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:17 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3816170814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:17 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4252393556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:17 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1524356914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:18.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.123+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f0c1a2d90 con 0x7f6f0c103c60 2024-04-30T23:13:18.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.125+0000 7f6f08ff9640 1 -- 172.21.15.100:0/468563963 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7f6ef40bd2e0 con 0x7f6f0c103c60 2024-04-30T23:13:18.125 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:18.125 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:18.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 msgr2=0x7f6ef80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 0x7f6ef80a60c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c103620 tx=0x7f6efc005f90 comp rx=0 tx=0).stop 2024-04-30T23:13:18.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 msgr2=0x7f6f0c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4006010 tx=0x7f6ef40042f0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 shutdown_connections 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6ef80a3bb0 0x7f6ef80a60c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f0c108960 0x7f6f0c1a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f0c103c60 0x7f6f0c19aaa0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 --2- 172.21.15.100:0/468563963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f0c102a20 0x7f6f0c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 >> 172.21.15.100:0/468563963 conn(0x7f6f0c0fdc10 msgr2=0x7f6f0c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 shutdown_connections 2024-04-30T23:13:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.127+0000 7f6f1176c640 1 -- 172.21.15.100:0/468563963 wait complete. 2024-04-30T23:13:18.139 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-30T23:11:00.289657+0000', 'modified': '2024-04-30T23:11:27.921467+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24545, 'mds_1': 24511, 'mds_2': 24503, 'mds_3': 24496, 'mds_4': 14664}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14652': {'gid': 14652, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6839/1668286182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1668286182}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1668286182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14664': {'gid': 14664, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.100:6841/2201593414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6840', 'nonce': 2201593414}, {'type': 'v1', 'addr': '172.21.15.100:6841', 'nonce': 2201593414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6833/2331654352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 2331654352}, {'type': 'v1', 'addr': '172.21.15.183:6833', 'nonce': 2331654352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.104:6833/176831078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6832', 'nonce': 176831078}, {'type': 'v1', 'addr': '172.21.15.104:6833', 'nonce': 176831078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.104:6835/4094200769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 4094200769}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 4094200769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/2697644609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2697644609}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2697644609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.183:6837/1464515486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1464515486}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1464515486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.104:6837/4190150609', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6836', 'nonce': 4190150609}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 4190150609}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.183:6839/587252257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 587252257}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 587252257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24545': {'gid': 24545, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6839/1200691747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6838', 'nonce': 1200691747}, {'type': 'v1', 'addr': '172.21.15.104:6839', 'nonce': 1200691747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24545, 'qdb_cluster': [14664, 24511, 24545, 24496, 24503]} 2024-04-30T23:13:18.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-30T23:13:18.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 -- 172.21.15.100:0/2619348997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c1050e0 msgr2=0x7f936c1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 --2- 172.21.15.100:0/2619348997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c1050e0 0x7f936c1054f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f935c009900 tx=0x7f935c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 -- 172.21.15.100:0/2619348997 shutdown_connections 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 --2- 172.21.15.100:0/2619348997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f936c102290 0x7f936c10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 --2- 172.21.15.100:0/2619348997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c101790 0x7f936c101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 --2- 172.21.15.100:0/2619348997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c1050e0 0x7f936c1054f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 -- 172.21.15.100:0/2619348997 >> 172.21.15.100:0/2619348997 conn(0x7f936c0fd390 msgr2=0x7f936c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 -- 172.21.15.100:0/2619348997 shutdown_connections 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.248+0000 7f9374292640 1 -- 172.21.15.100:0/2619348997 wait complete. 2024-04-30T23:13:18.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 Processor -- start 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 -- start start 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 0x7f936c19a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f936c1050e0 0x7f936c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f936c10f630 con 0x7f936c101790 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f936c10f4b0 con 0x7f936c1050e0 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f9374292640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f936c10f7b0 con 0x7f936c102290 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37194/0 (socket says 172.21.15.100:37194) 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 -- 172.21.15.100:0/3762731205 learned_addr learned my addr 172.21.15.100:0/3762731205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937182d640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 0x7f936c19a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 -- 172.21.15.100:0/3762731205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 msgr2=0x7f936c19a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 0x7f936c19a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 -- 172.21.15.100:0/3762731205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f936c1050e0 msgr2=0x7f936c1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f936c1050e0 0x7f936c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 -- 172.21.15.100:0/3762731205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c1a1dc0 con 0x7f936c101790 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937182d640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 0x7f936c19a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.249+0000 7f937202e640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f935c006010 tx=0x7f935c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.250+0000 7f93637fe640 1 -- 172.21.15.100:0/3762731205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c03f030 con 0x7f936c101790 2024-04-30T23:13:18.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.250+0000 7f93637fe640 1 -- 172.21.15.100:0/3762731205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f935c003aa0 con 0x7f936c101790 2024-04-30T23:13:18.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.250+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c1a2050 con 0x7f936c101790 2024-04-30T23:13:18.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.250+0000 7f93637fe640 1 -- 172.21.15.100:0/3762731205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c035070 con 0x7f936c101790 2024-04-30T23:13:18.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.250+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c1a2590 con 0x7f936c101790 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.252+0000 7f93637fe640 1 -- 172.21.15.100:0/3762731205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f935c042030 con 0x7f936c101790 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.252+0000 7f937b222740 1 Processor -- start 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 -- start start 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6cec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ada6c51740 con 0x55ada69223b0 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ada6bed3a0 con 0x55ada692a590 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937b222740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ada6c4d700 con 0x55ada694b270 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f93637fe640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 0x7f93580a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37196/0 (socket says 172.21.15.100:37196) 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 -- 172.21.15.100:0/1493952250 learned_addr learned my addr 172.21.15.100:0/1493952250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937282f640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 0x7f93580a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937182d640 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937282f640 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6cec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f93637fe640 1 -- 172.21.15.100:0/3762731205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f935c0f0dc0 con 0x7f936c101790 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 -- 172.21.15.100:0/1493952250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 msgr2=0x55ada6cec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6cec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 -- 172.21.15.100:0/1493952250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 msgr2=0x55ada6cf3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.253+0000 7f937202e640 1 -- 172.21.15.100:0/1493952250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada6c09750 con 0x55ada69223b0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.254+0000 7f937282f640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 0x7f93580a61c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9364005c40 tx=0x7f9364009c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.254+0000 7f937202e640 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f935c0bcc70 tx=0x7f935c0e7df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e1f82dbd51b3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.254+0000 7f9360bfe640 1 -- 172.21.15.100:0/1493952250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c049040 con 0x55ada69223b0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.254+0000 7f9360bfe640 1 -- 172.21.15.100:0/1493952250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f935c087840 con 0x55ada69223b0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.254+0000 7f9360bfe640 1 -- 172.21.15.100:0/1493952250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c0bafe0 con 0x55ada69223b0 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- 172.21.15.100:0/1493952250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 msgr2=0x55ada6cec610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f935c0bcc70 tx=0x7f935c0e7df0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- 172.21.15.100:0/1493952250 shutdown_connections 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cec610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 --2- 172.21.15.100:0/1493952250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6cec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- 172.21.15.100:0/1493952250 >> 172.21.15.100:0/1493952250 conn(0x55ada693f3c0 msgr2=0x55ada6ce7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- 172.21.15.100:0/1493952250 shutdown_connections 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- 172.21.15.100:0/1493952250 wait complete. 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 -- start start 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.255+0000 7f937b222740 1 Processor -- start 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cf5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cfd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ada6cf3d20 con 0x55ada692a590 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ada6bd8fe0 con 0x55ada694b270 2024-04-30T23:13:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ada6cf3ea0 con 0x55ada69223b0 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 10 client.0 _ll_register_callbacks cb 0x55ada6bf8c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37208/0 (socket says 172.21.15.100:37208) 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 -- 172.21.15.100:0/869294787 learned_addr learned my addr 172.21.15.100:0/869294787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937282f640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cfd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937202e640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cf5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 -- 172.21.15.100:0/869294787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 msgr2=0x55ada6cf5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cf5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 -- 172.21.15.100:0/869294787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 msgr2=0x55ada6cfd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cfd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 -- 172.21.15.100:0/869294787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada69632d0 con 0x55ada692a590 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937282f640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cfd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937202e640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cf5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937182d640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9368009f00 tx=0x7f93680117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fb53f98ca03ffa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f9355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368012860 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9368012a00 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.256+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f935c087840 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9368025050 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 10 client.15468 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ada6a2d6b0 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f935c087840 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f936800f040 con 0x55ada692a590 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 10 client.15468 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 20 client.15468 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada6909e40 0x55ada6d03f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 4 client.15468 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ada6c5f350 con 0x55ada6909e40 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937202e640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada6909e40 0x55ada6d03f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f9355ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.257+0000 7f937202e640 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada6909e40 0x55ada6d03f80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c2db12c66df4a82 server_cookie=49ae47897afd5c6c in_seq=0 out_seq=0 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f9355ffb640 1 -- 172.21.15.100:0/869294787 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55ada6c5f350 con 0x55ada6909e40 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f9355ffb640 10 client.15468 handle_command_reply: tid=0 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 client.15468 shutdown 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 msgr2=0x55ada6cf62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9368009f00 tx=0x7f93680117b0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 shutdown_connections 2024-04-30T23:13:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada6909e40 0x55ada6d03f80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cfd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cf62a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 --2- 172.21.15.100:0/869294787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cf5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f9355ffb640 0 client.15468 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 >> 172.21.15.100:0/869294787 conn(0x55ada693f3c0 msgr2=0x55ada6ce6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 shutdown_connections 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 1 -- 172.21.15.100:0/869294787 wait complete. 2024-04-30T23:13:18.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.258+0000 7f937b222740 20 client.15468 trim_cache size 0 max 16384 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.276+0000 7f937b222740 1 Processor -- start 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.276+0000 7f937b222740 1 -- start start 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cf4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d022c0 con 0x55ada692a590 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d02990 con 0x55ada694b270 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937b222740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d03060 con 0x55ada69223b0 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37222/0 (socket says 172.21.15.100:37222) 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 -- 172.21.15.100:0/219874705 learned_addr learned my addr 172.21.15.100:0/219874705 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937202e640 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 -- 172.21.15.100:0/219874705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 msgr2=0x55ada6cebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 -- 172.21.15.100:0/219874705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 msgr2=0x55ada6cf4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cf4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 -- 172.21.15.100:0/219874705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada6cf0e80 con 0x55ada692a590 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937202e640 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f937182d640 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9368000c00 tx=0x7f9368005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31ef6765f154acd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f9357fff640 1 -- 172.21.15.100:0/219874705 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368019670 con 0x55ada692a590 2024-04-30T23:13:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f9357fff640 1 -- 172.21.15.100:0/219874705 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f936802d070 con 0x55ada692a590 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.277+0000 7f9357fff640 1 -- 172.21.15.100:0/219874705 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93680128c0 con 0x55ada692a590 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- 172.21.15.100:0/219874705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 msgr2=0x55ada6cfd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9368000c00 tx=0x7f9368005850 comp rx=0 tx=0).stop 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- 172.21.15.100:0/219874705 shutdown_connections 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada694b270 0x55ada6cf4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada692a590 0x55ada6cfd120 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 --2- 172.21.15.100:0/219874705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada69223b0 0x55ada6cebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- 172.21.15.100:0/219874705 >> 172.21.15.100:0/219874705 conn(0x55ada693f3c0 msgr2=0x55ada6cf5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- 172.21.15.100:0/219874705 shutdown_connections 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- 172.21.15.100:0/219874705 wait complete. 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 -- start start 2024-04-30T23:13:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.278+0000 7f937b222740 1 Processor -- start 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6d68ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d03e00 con 0x55ada69223b0 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d03730 con 0x55ada692a590 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ada6d044d0 con 0x55ada694b270 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 10 client.0 _ll_register_callbacks cb 0x7f9368009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37230/0 (socket says 172.21.15.100:37230) 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 -- 172.21.15.100:0/1724112064 learned_addr learned my addr 172.21.15.100:0/1724112064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937282f640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6d68ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937182d640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 -- 172.21.15.100:0/1724112064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 msgr2=0x55ada6d68ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6d68ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 -- 172.21.15.100:0/1724112064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 msgr2=0x55ada6cf85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 -- 172.21.15.100:0/1724112064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada6d69220 con 0x55ada69223b0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937202e640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f935c031440 tx=0x7f935c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9415dd5dfe9b7a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f9355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c08c060 con 0x55ada69223b0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f935c03b460 con 0x55ada69223b0 2024-04-30T23:13:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f936802d070 con 0x55ada69223b0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.279+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f935c0d5030 con 0x55ada69223b0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 10 client.15474 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ada6d6a310 con 0x55ada69223b0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f936802d070 con 0x55ada69223b0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f935c003c50 con 0x55ada69223b0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 10 client.15474 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 10 client.15474 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 20 client.15474 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada68df280 0x55ada6d6da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 4 client.15474 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "status"}) -- 0x55ada6c591c0 con 0x55ada68df280 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937182d640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada68df280 0x55ada6d6da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f9355ffb640 10 client.15474 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.280+0000 7f937182d640 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada68df280 0x55ada6d6da10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a4a894e45cee6bfe server_cookie=f9314f8a43f8af48 in_seq=0 out_seq=0 2024-04-30T23:13:18.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9355ffb640 1 -- 172.21.15.100:0/1724112064 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ada6c591c0 con 0x55ada68df280 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9355ffb640 10 client.15474 handle_command_reply: tid=0 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 client.15474 shutdown 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 msgr2=0x55ada6cf8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f935c031440 tx=0x7f935c003f90 comp rx=0 tx=0).stop 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 shutdown_connections 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55ada68df280 0x55ada6d6da10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ada694b270 0x55ada6d68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ada692a590 0x55ada6cf85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 --2- 172.21.15.100:0/1724112064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ada69223b0 0x55ada6cf8090 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9355ffb640 0 client.15474 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 >> 172.21.15.100:0/1724112064 conn(0x55ada693f3c0 msgr2=0x55ada6cea8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 shutdown_connections 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 1 -- 172.21.15.100:0/1724112064 wait complete. 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f937b222740 20 client.15474 trim_cache size 0 max 16384 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 4, 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 14664, 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:13:18.291 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 111.377116571, 2024-04-30T23:13:18.292 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:13:18.292 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 93, 2024-04-30T23:13:18.292 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:13:18.292 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 147.19408625700001 2024-04-30T23:13:18.292 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:18.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 msgr2=0x7f93580a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 0x7f93580a61c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9364005c40 tx=0x7f9364009c70 comp rx=0 tx=0).stop 2024-04-30T23:13:18.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 msgr2=0x7f936c19a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f935c006010 tx=0x7f935c031a50 comp rx=0 tx=0).stop 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 shutdown_connections 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f93580a3cb0 0x7f93580a61c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f936c1050e0 0x7f936c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936c102290 0x7f936c19a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 --2- 172.21.15.100:0/3762731205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c101790 0x7f936c19a2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.281+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 >> 172.21.15.100:0/3762731205 conn(0x7f936c0fd390 msgr2=0x7f936c105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.282+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 shutdown_connections 2024-04-30T23:13:18.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.282+0000 7f9374292640 1 -- 172.21.15.100:0/3762731205 wait complete. 2024-04-30T23:13:18.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T23:13:18.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 -- 172.21.15.100:0/3716966557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc109a70 msgr2=0x7fcccc10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 --2- 172.21.15.100:0/3716966557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc109a70 0x7fcccc10be90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009ca0 tx=0x7fccc402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 -- 172.21.15.100:0/3716966557 shutdown_connections 2024-04-30T23:13:18.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 --2- 172.21.15.100:0/3716966557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc109a70 0x7fcccc10be90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 --2- 172.21.15.100:0/3716966557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc104d70 0x7fcccc105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 --2- 172.21.15.100:0/3716966557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 0x7fcccc104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 -- 172.21.15.100:0/3716966557 >> 172.21.15.100:0/3716966557 conn(0x7fcccc0fed20 msgr2=0x7fcccc1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 -- 172.21.15.100:0/3716966557 shutdown_connections 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.403+0000 7fccd282b640 1 -- 172.21.15.100:0/3716966557 wait complete. 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 Processor -- start 2024-04-30T23:13:18.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 -- start start 2024-04-30T23:13:18.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 0x7fcccc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 0x7fcccc1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.404+0000 7fccd282b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc10f660 con 0x7fcccc104d70 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd282b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc10f4e0 con 0x7fcccc109a70 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd282b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc10f7e0 con 0x7fcccc103b30 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37246/0 (socket says 172.21.15.100:37246) 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 -- 172.21.15.100:0/3437930372 learned_addr learned my addr 172.21.15.100:0/3437930372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccbfff640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 0x7fcccc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 -- 172.21.15.100:0/3437930372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 msgr2=0x7fcccc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 0x7fcccc1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 0x7fcccc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 -- 172.21.15.100:0/3437930372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 msgr2=0x7fcccc1a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 0x7fcccc1a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 -- 172.21.15.100:0/3437930372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc1a1d80 con 0x7fcccc104d70 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 0x7fcccc1a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fccc000d950 tx=0x7fccc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccc97fa640 1 -- 172.21.15.100:0/3437930372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0017070 con 0x7fcccc104d70 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccc97fa640 1 -- 172.21.15.100:0/3437930372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc0009c30 con 0x7fcccc104d70 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc1a2070 con 0x7fcccc104d70 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccc97fa640 1 -- 172.21.15.100:0/3437930372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc000f620 con 0x7fcccc104d70 2024-04-30T23:13:18.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.405+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc1a25c0 con 0x7fcccc104d70 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccc97fa640 1 -- 172.21.15.100:0/3437930372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fccc0010460 con 0x7fcccc104d70 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 Processor -- start 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 -- start start 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fac4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1facb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563e1fa29740 con 0x563e1f6fa3b0 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563e1f9c53a0 con 0x563e1f702590 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd97c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e1fa25700 con 0x563e1f723270 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37252/0 (socket says 172.21.15.100:37252) 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fcccbfff640 1 -- 172.21.15.100:0/493418143 learned_addr learned my addr 172.21.15.100:0/493418143 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccc97fa640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 0x7fccb40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1facb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.408+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fac4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 -- 172.21.15.100:0/493418143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 msgr2=0x563e1fac4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fac4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 -- 172.21.15.100:0/493418143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 msgr2=0x563e1facb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1facb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 -- 172.21.15.100:0/493418143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1f9e1750 con 0x563e1f6fa3b0 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fac4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 0x7fccb40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccc97fa640 1 -- 172.21.15.100:0/3437930372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fccc00d0390 con 0x7fcccc104d70 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fcccbfff640 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00abb0 tx=0x7fccbc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf94c15f202b383 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccb27fc640 1 -- 172.21.15.100:0/493418143 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005220 con 0x563e1f6fa3b0 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccb27fc640 1 -- 172.21.15.100:0/493418143 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.409+0000 7fccb27fc640 1 -- 172.21.15.100:0/493418143 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc018730 con 0x563e1f6fa3b0 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- 172.21.15.100:0/493418143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 msgr2=0x563e1fac4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 0x7fccb40a60c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x563e1fac5260 tx=0x7fccc40095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00abb0 tx=0x7fccbc00f790 comp rx=0 tx=0).stop 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- 172.21.15.100:0/493418143 shutdown_connections 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1facb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fac4610 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 --2- 172.21.15.100:0/493418143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fac4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- 172.21.15.100:0/493418143 >> 172.21.15.100:0/493418143 conn(0x563e1f7173c0 msgr2=0x563e1fabfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- 172.21.15.100:0/493418143 shutdown_connections 2024-04-30T23:13:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- 172.21.15.100:0/493418143 wait complete. 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 -- start start 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.410+0000 7fccd97c2740 1 Processor -- start 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1face480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fad53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563e1facbf60 con 0x563e1f6fa3b0 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563e1f9b0fe0 con 0x563e1f723270 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e1facc0e0 con 0x563e1f702590 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 10 client.0 _ll_register_callbacks cb 0x563e1f9d0c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37268/0 (socket says 172.21.15.100:37268) 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 -- 172.21.15.100:0/2352612988 learned_addr learned my addr 172.21.15.100:0/2352612988 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1face480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fad53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 -- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 msgr2=0x563e1face480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1face480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 -- 172.21.15.100:0/2352612988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 msgr2=0x563e1fad53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fad53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 -- 172.21.15.100:0/2352612988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1f73b2d0 con 0x563e1f6fa3b0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fad53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fccbc01a040 tx=0x7fccbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a96d11adc9baceb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc027020 con 0x563e1f6fa3b0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fccbc004460 con 0x563e1f6fa3b0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.411+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fccbc032050 con 0x563e1f6fa3b0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e1f8056b0 con 0x563e1f6fa3b0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fccbc003b60 con 0x563e1f6fa3b0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 10 client.15486 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 20 client.15486 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6e1e40 0x563e1fadbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 4 client.15486 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e1fa37350 con 0x563e1f6e1e40 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.412+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6e1e40 0x563e1fadbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.413+0000 7fccab7fe640 10 client.15486 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.413+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6e1e40 0x563e1fadbbf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2784eaabf082858e server_cookie=d5232aa69b0341a in_seq=0 out_seq=0 2024-04-30T23:13:18.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.413+0000 7fccab7fe640 1 -- 172.21.15.100:0/2352612988 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7fccc0081bf0 con 0x563e1f6e1e40 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.413+0000 7fccab7fe640 10 client.15486 handle_command_reply: tid=0 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 client.15486 shutdown 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 msgr2=0x563e1facdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fccbc01a040 tx=0x7fccbc0042f0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 shutdown_connections 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6e1e40 0x563e1fadbbf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fad53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccab7fe640 0 client.15486 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1face480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2352612988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1facdf40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 >> 172.21.15.100:0/2352612988 conn(0x563e1f7173c0 msgr2=0x563e1fabec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 shutdown_connections 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 1 -- 172.21.15.100:0/2352612988 wait complete. 2024-04-30T23:13:18.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.414+0000 7fccd97c2740 20 client.15486 trim_cache size 0 max 16384 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 Processor -- start 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 -- start start 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1fad5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fad9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563e1fad9f30 con 0x563e1f6fa3b0 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563e1fada600 con 0x563e1f702590 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fccd97c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e1fadacd0 con 0x563e1f723270 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37272/0 (socket says 172.21.15.100:37272) 2024-04-30T23:13:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 -- 172.21.15.100:0/2715123518 learned_addr learned my addr 172.21.15.100:0/2715123518 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1fad5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 -- 172.21.15.100:0/2715123518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 msgr2=0x563e1fad9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fad9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 -- 172.21.15.100:0/2715123518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 msgr2=0x563e1fad5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1fad5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.432+0000 7fcccbfff640 1 -- 172.21.15.100:0/2715123518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1fac8d60 con 0x563e1f6fa3b0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fcccbfff640 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fccbc004a50 tx=0x7fccbc0057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5029ad02ff95e4b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fccb1ffb640 1 -- 172.21.15.100:0/2715123518 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc027070 con 0x563e1f6fa3b0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fccb1ffb640 1 -- 172.21.15.100:0/2715123518 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fccb1ffb640 1 -- 172.21.15.100:0/2715123518 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005270 con 0x563e1f6fa3b0 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fccd97c2740 1 -- 172.21.15.100:0/2715123518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 msgr2=0x563e1faccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.433+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fccbc004a50 tx=0x7fccbc0057d0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- 172.21.15.100:0/2715123518 shutdown_connections 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f723270 0x563e1fad9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f702590 0x563e1fad5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- 172.21.15.100:0/2715123518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1faccc20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- 172.21.15.100:0/2715123518 >> 172.21.15.100:0/2715123518 conn(0x563e1f7173c0 msgr2=0x563e1facc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- 172.21.15.100:0/2715123518 shutdown_connections 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- 172.21.15.100:0/2715123518 wait complete. 2024-04-30T23:13:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- start start 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 Processor -- start 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1fad06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fb40950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563e1fadba70 con 0x563e1f6fa3b0 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563e1fadb3a0 con 0x563e1f723270 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563e1fadc140 con 0x563e1f702590 2024-04-30T23:13:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fccd97c2740 10 client.0 _ll_register_callbacks cb 0x7fccbc00aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fcccbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37276/0 (socket says 172.21.15.100:37276) 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.434+0000 7fcccbfff640 1 -- 172.21.15.100:0/609074177 learned_addr learned my addr 172.21.15.100:0/609074177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccd0dc8640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fb40950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1fad06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 -- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 msgr2=0x563e1fad06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1fad06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 -- 172.21.15.100:0/609074177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 msgr2=0x563e1fb40950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fb40950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 -- 172.21.15.100:0/609074177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1fad0ca0 con 0x563e1f6fa3b0 2024-04-30T23:13:18.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1fad06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fcccbfff640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fccbc004a50 tx=0x7fccbc005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8990d6b4e1bf07f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc027040 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fccbc018b30 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fccbc047050 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccd97c2740 10 client.15492 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e1fb41ed0 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.435+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc004c50 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fccbc003850 con 0x563e1f6fa3b0 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 10 client.15492 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 10 client.15492 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T23:13:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 20 client.15492 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6b7280 0x563e1fb45400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 4 client.15492 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "status"}) -- 0x563e1fa311c0 con 0x563e1f6b7280 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6b7280 0x563e1fb45400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fccab7fe640 10 client.15492 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.436+0000 7fcccb7fe640 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6b7280 0x563e1fb45400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4cde8e099b0540b1 server_cookie=abc9cf4bed6c8d5f in_seq=0 out_seq=0 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccab7fe640 1 -- 172.21.15.100:0/609074177 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563e1fa311c0 con 0x563e1f6b7280 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccab7fe640 10 client.15492 handle_command_reply: tid=0 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 client.15492 shutdown 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 msgr2=0x563e1fad0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fccbc004a50 tx=0x7fccbc005ce0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 shutdown_connections 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x563e1f6b7280 0x563e1fb45400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563e1f723270 0x563e1fb40950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563e1f702590 0x563e1fad06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 --2- 172.21.15.100:0/609074177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e1f6fa3b0 0x563e1fad0170 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccab7fe640 0 client.15492 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 >> 172.21.15.100:0/609074177 conn(0x563e1f7173c0 msgr2=0x563e1fac28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 shutdown_connections 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 1 -- 172.21.15.100:0/609074177 wait complete. 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd97c2740 20 client.15492 trim_cache size 0 max 16384 2024-04-30T23:13:18.444 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 3, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24496, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 111.74102171, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 93, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 158.66904437599999 2024-04-30T23:13:18.445 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 msgr2=0x7fccb40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 0x7fccb40a60c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x563e1fac5260 tx=0x7fccc40095c0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 msgr2=0x7fcccc19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.437+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fccc000d950 tx=0x7fccc000de10 comp rx=0 tx=0).stop 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 shutdown_connections 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fccb40a3bb0 0x7fccb40a60c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcccc109a70 0x7fcccc1a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcccc104d70 0x7fcccc19a780 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 --2- 172.21.15.100:0/3437930372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcccc103b30 0x7fcccc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 >> 172.21.15.100:0/3437930372 conn(0x7fcccc0fed20 msgr2=0x7fcccc105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 shutdown_connections 2024-04-30T23:13:18.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.438+0000 7fccd282b640 1 -- 172.21.15.100:0/3437930372 wait complete. 2024-04-30T23:13:18.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 -- 172.21.15.100:0/647985399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24103b30 msgr2=0x7f8c24104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/647985399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24103b30 0x7f8c24104830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009900 tx=0x7f8c2002a410 comp rx=0 tx=0).stop 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 -- 172.21.15.100:0/647985399 shutdown_connections 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/647985399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 0x7f8c2410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/647985399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24104d70 0x7f8c24105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/647985399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24103b30 0x7f8c24104830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 -- 172.21.15.100:0/647985399 >> 172.21.15.100:0/647985399 conn(0x7f8c240fed20 msgr2=0x7f8c241011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 -- 172.21.15.100:0/647985399 shutdown_connections 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.557+0000 7f8c2c27f640 1 -- 172.21.15.100:0/647985399 wait complete. 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 Processor -- start 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 -- start start 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24103b30 0x7f8c2419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 0x7f8c241a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2410f610 con 0x7f8c24104d70 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2410f490 con 0x7f8c24103b30 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2c27f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2410f790 con 0x7f8c24109a70 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2981a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2981a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37292/0 (socket says 172.21.15.100:37292) 2024-04-30T23:13:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2981a640 1 -- 172.21.15.100:0/786414898 learned_addr learned my addr 172.21.15.100:0/786414898 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.558+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24103b30 0x7f8c2419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 0x7f8c241a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 -- 172.21.15.100:0/786414898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 msgr2=0x7f8c241a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 0x7f8c241a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 -- 172.21.15.100:0/786414898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24103b30 msgr2=0x7f8c2419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24103b30 0x7f8c2419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 -- 172.21.15.100:0/786414898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c241a1d50 con 0x7f8c24104d70 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2981a640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c920 tx=0x7f8c1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c1b7fe640 1 -- 172.21.15.100:0/786414898 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14007c70 con 0x7f8c24104d70 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c1b7fe640 1 -- 172.21.15.100:0/786414898 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c14007e10 con 0x7f8c24104d70 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c241a1fe0 con 0x7f8c24104d70 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c1b7fe640 1 -- 172.21.15.100:0/786414898 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14018820 con 0x7f8c24104d70 2024-04-30T23:13:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.559+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c241a24a0 con 0x7f8c24104d70 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.561+0000 7f8c1b7fe640 1 -- 172.21.15.100:0/786414898 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8c1400f450 con 0x7f8c24104d70 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.561+0000 7f8c3320b740 1 Processor -- start 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 -- start start 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfb5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfbc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563bdf1a740 con 0x5563bdc14270 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563bdeb63a0 con 0x5563bdbf3590 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c3320b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5563bdf16700 con 0x5563bdbeb3b0 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c1b7fe640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 0x7f8c100a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a81c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfb5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:50740/0 (socket says 172.21.15.100:50740) 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 -- 172.21.15.100:0/1815268848 learned_addr learned my addr 172.21.15.100:0/1815268848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 0x7f8c100a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c1b7fe640 1 -- 172.21.15.100:0/786414898 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c140d0880 con 0x7f8c24104d70 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2981a640 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfbc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 -- 172.21.15.100:0/1815268848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 msgr2=0x5563bdfbc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfbc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 -- 172.21.15.100:0/1815268848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 msgr2=0x5563bdfb5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfb5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.562+0000 7f8c2a01b640 1 -- 172.21.15.100:0/1815268848 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bded2750 con 0x5563bdbeb3b0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.563+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 0x7f8c100a60c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5563bdfb6260 tx=0x7f8c1c004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.563+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009230 tx=0x7f8c20031c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4da636828024e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.563+0000 7f8c18bfe640 1 -- 172.21.15.100:0/1815268848 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20035030 con 0x5563bdbeb3b0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.563+0000 7f8c18bfe640 1 -- 172.21.15.100:0/1815268848 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c20040070 con 0x5563bdbeb3b0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.563+0000 7f8c18bfe640 1 -- 172.21.15.100:0/1815268848 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20003b20 con 0x5563bdbeb3b0 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- 172.21.15.100:0/1815268848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 msgr2=0x5563bdfb5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009230 tx=0x7f8c20031c50 comp rx=0 tx=0).stop 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- 172.21.15.100:0/1815268848 shutdown_connections 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfbc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb5610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 --2- 172.21.15.100:0/1815268848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfb5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- 172.21.15.100:0/1815268848 >> 172.21.15.100:0/1815268848 conn(0x5563bdc083c0 msgr2=0x5563bdfb0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- 172.21.15.100:0/1815268848 shutdown_connections 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- 172.21.15.100:0/1815268848 wait complete. 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 -- start start 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.564+0000 7f8c3320b740 1 Processor -- start 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbf3590 0x5563bdfbf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563bdfc63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfbcf00 con 0x5563bdbeb3b0 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563bdea1fe0 con 0x5563bdc14270 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfbd080 con 0x5563bdbf3590 2024-04-30T23:13:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 10 client.0 _ll_register_callbacks cb 0x5563bdec1c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37304/0 (socket says 172.21.15.100:37304) 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 -- 172.21.15.100:0/2641436822 learned_addr learned my addr 172.21.15.100:0/2641436822 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbf3590 0x5563bdfbf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563bdfc63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 -- 172.21.15.100:0/2641436822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbf3590 msgr2=0x5563bdfbf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbf3590 0x5563bdfbf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 -- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 msgr2=0x5563bdfc63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563bdfc63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 -- 172.21.15.100:0/2641436822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bdc2c2d0 con 0x5563bdbeb3b0 2024-04-30T23:13:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563bdfc63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8c20005ab0 tx=0x7f8c200317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1251740779ebb51c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20035040 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c20004250 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.565+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c20040070 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8c20004450 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 10 client.15504 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5563bdcf66b0 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c20040070 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8c200456a0 con 0x5563bdbeb3b0 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 10 client.15504 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 10 client.15504 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 20 client.15504 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdbd2e40 0x5563bdfcca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 4 client.15504 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563bdf28350 con 0x5563bdbd2e40 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.566+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdbd2e40 0x5563bdfcca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.567+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdbd2e40 0x5563bdfcca50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fad5e4277597fd59 server_cookie=9324624e26d4b705 in_seq=0 out_seq=0 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.567+0000 7f8c0dffb640 10 client.15504 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2641436822 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5563bdf28350 con 0x5563bdbd2e40 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c0dffb640 10 client.15504 handle_command_reply: tid=0 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 client.15504 shutdown 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 msgr2=0x5563bdfbef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8c20005ab0 tx=0x7f8c200317d0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 shutdown_connections 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdbd2e40 0x5563bdfcca50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563bdfc63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbf3590 0x5563bdfbf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c0dffb640 0 client.15504 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2641436822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbeb3b0 0x5563bdfbef20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 >> 172.21.15.100:0/2641436822 conn(0x5563bdc083c0 msgr2=0x5563bdfafc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 shutdown_connections 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 1 -- 172.21.15.100:0/2641436822 wait complete. 2024-04-30T23:13:18.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.568+0000 7f8c3320b740 20 client.15504 trim_cache size 0 max 16384 2024-04-30T23:13:18.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 Processor -- start 2024-04-30T23:13:18.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 -- start start 2024-04-30T23:13:18.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfb98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfcad90 con 0x5563bdc14270 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfcb460 con 0x5563bdbf3590 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c3320b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfcbb30 con 0x5563bdbeb3b0 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37316/0 (socket says 172.21.15.100:37316) 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 -- 172.21.15.100:0/3459713850 learned_addr learned my addr 172.21.15.100:0/3459713850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2981a640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfb98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 -- 172.21.15.100:0/3459713850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 msgr2=0x5563bdfb9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 -- 172.21.15.100:0/3459713850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 msgr2=0x5563bdfb98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfb98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2a81c640 1 -- 172.21.15.100:0/3459713850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bdfbdfa0 con 0x5563bdc14270 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.586+0000 7f8c2981a640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfb98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c013fb0 tx=0x7f8c1c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879ee41d02ab1e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c0ffff640 1 -- 172.21.15.100:0/3459713850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c021510 con 0x5563bdc14270 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c0ffff640 1 -- 172.21.15.100:0/3459713850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c1c027070 con 0x5563bdc14270 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c0ffff640 1 -- 172.21.15.100:0/3459713850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c014900 con 0x5563bdc14270 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 -- 172.21.15.100:0/3459713850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 msgr2=0x5563bdfc62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c013fb0 tx=0x7f8c1c00d000 comp rx=0 tx=0).stop 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 -- 172.21.15.100:0/3459713850 shutdown_connections 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdc14270 0x5563bdfc62e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdbf3590 0x5563bdfb98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 --2- 172.21.15.100:0/3459713850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfb9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 -- 172.21.15.100:0/3459713850 >> 172.21.15.100:0/3459713850 conn(0x5563bdc083c0 msgr2=0x5563bdfb4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 -- 172.21.15.100:0/3459713850 shutdown_connections 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.587+0000 7f8c3320b740 1 -- 172.21.15.100:0/3459713850 wait complete. 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 -- start start 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 Processor -- start 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfc12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563be0317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfcc8d0 con 0x5563bdbf3590 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfcc200 con 0x5563bdc14270 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5563bdfccfa0 con 0x5563bdbeb3b0 2024-04-30T23:13:18.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c3320b740 10 client.0 _ll_register_callbacks cb 0x7f8c1c009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37330/0 (socket says 172.21.15.100:37330) 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 -- 172.21.15.100:0/2142735628 learned_addr learned my addr 172.21.15.100:0/2142735628 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2a81c640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563be0317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfc12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 -- 172.21.15.100:0/2142735628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 msgr2=0x5563bdfc12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfc12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 -- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 msgr2=0x5563be0317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563be0317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.588+0000 7f8c2981a640 1 -- 172.21.15.100:0/2142735628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bdfc6820 con 0x5563bdbf3590 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c2981a640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8c1409c790 tx=0x7f8c14087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d762cdce51e3969d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400fa90 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c1400f740 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c1c027070 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8c14098e70 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 10 client.15510 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5563be032e10 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c1c027070 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8c140a4fe0 con 0x5563bdbf3590 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 10 client.15510 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 10 client.15510 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 20 client.15510 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdba8280 0x5563be033e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 4 client.15510 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:13:18.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.589+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "status"}) -- 0x5563bdf221c0 con 0x5563bdba8280 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdba8280 0x5563be033e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c2a01b640 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdba8280 0x5563be033e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=181af3cf428e02dc server_cookie=b3570784e0040098 in_seq=0 out_seq=0 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c0dffb640 10 client.15510 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c0dffb640 1 -- 172.21.15.100:0/2142735628 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5563bdf221c0 con 0x5563bdba8280 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c0dffb640 10 client.15510 handle_command_reply: tid=0 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 client.15510 shutdown 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 msgr2=0x5563bdfc17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8c1409c790 tx=0x7f8c14087040 comp rx=0 tx=0).stop 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 shutdown_connections 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x5563bdba8280 0x5563be033e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563bdc14270 0x5563be0317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563bdbf3590 0x5563bdfc17e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c0dffb640 0 client.15510 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 --2- 172.21.15.100:0/2142735628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5563bdbeb3b0 0x5563bdfc12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.590+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 >> 172.21.15.100:0/2142735628 conn(0x5563bdc083c0 msgr2=0x5563bdfb9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 shutdown_connections 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c3320b740 1 -- 172.21.15.100:0/2142735628 wait complete. 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c3320b740 20 client.15510 trim_cache size 0 max 16384 2024-04-30T23:13:18.598 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24503, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 112.900942344, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 93, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 155.97136828999999 2024-04-30T23:13:18.599 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:18.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 msgr2=0x7f8c100a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 0x7f8c100a60c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5563bdfb6260 tx=0x7f8c1c004ab0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 msgr2=0x7f8c2419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c920 tx=0x7f8c1400cde0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 shutdown_connections 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c100a3bb0 0x7f8c100a60c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c24109a70 0x7f8c241a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c24104d70 0x7f8c2419a870 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 --2- 172.21.15.100:0/786414898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c24103b30 0x7f8c2419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 >> 172.21.15.100:0/786414898 conn(0x7f8c240fed20 msgr2=0x7f8c24105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 shutdown_connections 2024-04-30T23:13:18.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.591+0000 7f8c2c27f640 1 -- 172.21.15.100:0/786414898 wait complete. 2024-04-30T23:13:18.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 -- 172.21.15.100:0/3406109246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc102a20 msgr2=0x7f0cdc103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 --2- 172.21.15.100:0/3406109246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc102a20 0x7f0cdc103720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009900 tx=0x7f0ccc02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 -- 172.21.15.100:0/3406109246 shutdown_connections 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 --2- 172.21.15.100:0/3406109246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc108960 0x7f0cdc10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 --2- 172.21.15.100:0/3406109246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 0x7f0cdc104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 --2- 172.21.15.100:0/3406109246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc102a20 0x7f0cdc103720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 -- 172.21.15.100:0/3406109246 >> 172.21.15.100:0/3406109246 conn(0x7f0cdc0fdc10 msgr2=0x7f0cdc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 -- 172.21.15.100:0/3406109246 shutdown_connections 2024-04-30T23:13:18.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.711+0000 7f0ce291f640 1 -- 172.21.15.100:0/3406109246 wait complete. 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 Processor -- start 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 -- start start 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc102a20 0x7f0cdc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 0x7f0cdc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc10f650 con 0x7f0cdc108960 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc10f4d0 con 0x7f0cdc103c60 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.712+0000 7f0ce291f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc10f7d0 con 0x7f0cdc102a20 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37356/0 (socket says 172.21.15.100:37356) 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 -- 172.21.15.100:0/500128342 learned_addr learned my addr 172.21.15.100:0/500128342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc102a20 0x7f0cdc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 0x7f0cdc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 -- 172.21.15.100:0/500128342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc102a20 msgr2=0x7f0cdc19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc102a20 0x7f0cdc19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 -- 172.21.15.100:0/500128342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 msgr2=0x7f0cdc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 0x7f0cdc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 -- 172.21.15.100:0/500128342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc1a20c0 con 0x7f0cdc108960 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce0ebc640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400eaa0 tx=0x7f0cd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0cd97fa640 1 -- 172.21.15.100:0/500128342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400cdb0 con 0x7f0cdc108960 2024-04-30T23:13:18.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0cd97fa640 1 -- 172.21.15.100:0/500128342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd4005020 con 0x7f0cdc108960 2024-04-30T23:13:18.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cdc1a23b0 con 0x7f0cdc108960 2024-04-30T23:13:18.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0cd97fa640 1 -- 172.21.15.100:0/500128342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40116d0 con 0x7f0cdc108960 2024-04-30T23:13:18.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.713+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cdc1a2900 con 0x7f0cdc108960 2024-04-30T23:13:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cd97fa640 1 -- 172.21.15.100:0/500128342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0cd40051d0 con 0x7f0cdc108960 2024-04-30T23:13:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 Processor -- start 2024-04-30T23:13:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 -- start start 2024-04-30T23:13:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fbe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bfc590 0x55a075fc5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a075f23740 con 0x55a075bf43b0 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a075ebf3a0 con 0x55a075c1d270 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a075f1f700 con 0x55a075bfc590 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37364/0 (socket says 172.21.15.100:37364) 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cdbfff640 1 -- 172.21.15.100:0/498062565 learned_addr learned my addr 172.21.15.100:0/498062565 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cdb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bfc590 0x55a075fc5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.716+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fbe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cd97fa640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 0x7f0cc40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 -- 172.21.15.100:0/498062565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bfc590 msgr2=0x55a075fc5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bfc590 0x55a075fc5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 -- 172.21.15.100:0/498062565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 msgr2=0x55a075fbe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fbe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 -- 172.21.15.100:0/498062565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a075edb750 con 0x55a075bf43b0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fbe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0ce0ebc640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 0x7f0cc40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef33b7269bb27ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cd97fa640 1 -- 172.21.15.100:0/500128342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0cd40d09a0 con 0x7f0cdc108960 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cc27fc640 1 -- 172.21.15.100:0/498062565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc03f070 con 0x55a075bf43b0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cc27fc640 1 -- 172.21.15.100:0/498062565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc004040 con 0x55a075bf43b0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.717+0000 7f0cc27fc640 1 -- 172.21.15.100:0/498062565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc035070 con 0x55a075bf43b0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- 172.21.15.100:0/498062565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 msgr2=0x55a075fbe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce0ebc640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 0x7f0cc40a60c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4099290 tx=0x7f0cd40bd040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc032ba0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- 172.21.15.100:0/498062565 shutdown_connections 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bfc590 0x55a075fc5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bf43b0 0x55a075fbe610 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/498062565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fbe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- 172.21.15.100:0/498062565 >> 172.21.15.100:0/498062565 conn(0x55a075c113c0 msgr2=0x55a075fb9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- 172.21.15.100:0/498062565 shutdown_connections 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- 172.21.15.100:0/498062565 wait complete. 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 -- start start 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.718+0000 7f0ce97d2740 1 Processor -- start 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fc7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 0x55a075fc8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a075fc5f00 con 0x55a075c1d270 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a075eaafe0 con 0x55a075bfc590 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a075fc6080 con 0x55a075bf43b0 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 10 client.0 _ll_register_callbacks cb 0x55a075ecac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37374/0 (socket says 172.21.15.100:37374) 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 -- 172.21.15.100:0/214022056 learned_addr learned my addr 172.21.15.100:0/214022056 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fc7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 0x55a075fc8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 -- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 msgr2=0x55a075fc7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fc7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 -- 172.21.15.100:0/214022056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 msgr2=0x55a075fc8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 0x55a075fc8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 -- 172.21.15.100:0/214022056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a075c352d0 con 0x55a075c1d270 2024-04-30T23:13:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 0x55a075fc8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0012f70 tx=0x7f0cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171bd4ba6be746c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0005220 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0cd00053c0 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.719+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc004040 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0cd0028050 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 10 client.15522 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a075cff6b0 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc004040 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0cd000f4b0 con 0x55a075c1d270 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 10 client.15522 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 10 client.15522 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 20 client.15522 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bdbe40 0x55a075fd5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 4 client.15522 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a075f31350 con 0x55a075bdbe40 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.720+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bdbe40 0x55a075fd5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.721+0000 7f0cbb7fe640 10 client.15522 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.721+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bdbe40 0x55a075fd5fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9eb67e96c38a4afe server_cookie=68de1170f31f917a in_seq=0 out_seq=0 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.721+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/214022056 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55a075f31350 con 0x55a075bdbe40 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.721+0000 7f0cbb7fe640 10 client.15522 handle_command_reply: tid=0 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 client.15522 shutdown 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 msgr2=0x55a075fcf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0012f70 tx=0x7f0cd00046c0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 shutdown_connections 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bdbe40 0x55a075fd5fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075c1d270 0x55a075fcf3c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bfc590 0x55a075fc8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0cbb7fe640 0 client.15522 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/214022056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fc7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 >> 172.21.15.100:0/214022056 conn(0x55a075c113c0 msgr2=0x55a075fb8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 shutdown_connections 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 1 -- 172.21.15.100:0/214022056 wait complete. 2024-04-30T23:13:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.722+0000 7f0ce97d2740 20 client.15522 trim_cache size 0 max 16384 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 Processor -- start 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 -- start start 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fd39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fc6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd4310 con 0x55a075bfc590 2024-04-30T23:13:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd49e0 con 0x55a075c1d270 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd50b0 con 0x55a075bf43b0 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37388/0 (socket says 172.21.15.100:37388) 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 -- 172.21.15.100:0/4829554 learned_addr learned my addr 172.21.15.100:0/4829554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 -- 172.21.15.100:0/4829554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 msgr2=0x55a075fd39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fd39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 -- 172.21.15.100:0/4829554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 msgr2=0x55a075fc6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fc6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 -- 172.21.15.100:0/4829554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a075fc2e30 con 0x55a075bfc590 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c1e5336c595a39 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.741+0000 7f0cc1ffb640 1 -- 172.21.15.100:0/4829554 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc03f050 con 0x55a075bfc590 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0cc1ffb640 1 -- 172.21.15.100:0/4829554 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc031d10 con 0x55a075bfc590 2024-04-30T23:13:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0cc1ffb640 1 -- 172.21.15.100:0/4829554 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc035040 con 0x55a075bfc590 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 -- 172.21.15.100:0/4829554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 msgr2=0x55a075fcf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 -- 172.21.15.100:0/4829554 shutdown_connections 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075c1d270 0x55a075fc6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fcf2e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/4829554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075bf43b0 0x55a075fd39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 -- 172.21.15.100:0/4829554 >> 172.21.15.100:0/4829554 conn(0x55a075c113c0 msgr2=0x55a075fc16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 -- 172.21.15.100:0/4829554 shutdown_connections 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.742+0000 7f0ce97d2740 1 -- 172.21.15.100:0/4829554 wait complete. 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 -- start start 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 Processor -- start 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 0x55a075fca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075c1d270 0x55a07603ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd5e50 con 0x55a075bfc590 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd5780 con 0x55a075bf43b0 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a075fd6520 con 0x55a075c1d270 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0ce97d2740 10 client.0 _ll_register_callbacks cb 0x7f0cd000c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37404/0 (socket says 172.21.15.100:37404) 2024-04-30T23:13:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.743+0000 7f0cdbfff640 1 -- 172.21.15.100:0/2518131549 learned_addr learned my addr 172.21.15.100:0/2518131549 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 0x55a075fca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075c1d270 0x55a07603ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 -- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075c1d270 msgr2=0x55a07603ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075c1d270 0x55a07603ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 -- 172.21.15.100:0/2518131549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 msgr2=0x55a075fca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 0x55a075fca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 -- 172.21.15.100:0/2518131549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a075fcf4b0 con 0x55a075bfc590 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 0x55a075fca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cdbfff640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005540 tx=0x7f0ccc005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94149e745b0dce9d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc05b070 con 0x55a075bfc590 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0ccc0315a0 con 0x55a075bfc590 2024-04-30T23:13:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc031d10 con 0x55a075bfc590 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc03f070 con 0x55a075bfc590 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0ce97d2740 10 client.15528 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a07603c100 con 0x55a075bfc590 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc031d10 con 0x55a075bfc590 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0ccc044910 con 0x55a075bfc590 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.744+0000 7f0ce97d2740 10 client.15528 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 10 client.15528 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 20 client.15528 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bb1280 0x55a07603f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 4 client.15528 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:13:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "status"}) -- 0x55a075f2b1c0 con 0x55a075bb1280 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bb1280 0x55a07603f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0cbb7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0cdb7fe640 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bb1280 0x55a07603f410 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ca7ff0ba013f10d server_cookie=b0c3ed125af5c15b in_seq=0 out_seq=0 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0cbb7fe640 1 -- 172.21.15.100:0/2518131549 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a075f2b1c0 con 0x55a075bb1280 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0cbb7fe640 10 client.15528 handle_command_reply: tid=0 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.745+0000 7f0ce97d2740 1 client.15528 shutdown 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 msgr2=0x55a075fca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005540 tx=0x7f0ccc005570 comp rx=0 tx=0).stop 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 shutdown_connections 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55a075bb1280 0x55a07603f410 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a075c1d270 0x55a07603ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a075bfc590 0x55a075fca5a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0cbb7fe640 0 client.15528 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 --2- 172.21.15.100:0/2518131549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a075bf43b0 0x55a075fca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 >> 172.21.15.100:0/2518131549 conn(0x55a075c113c0 msgr2=0x55a075fc6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 shutdown_connections 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 1 -- 172.21.15.100:0/2518131549 wait complete. 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce97d2740 20 client.15528 trim_cache size 0 max 16384 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:13:18.754 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24511, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 114.071464969, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 93, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 153.36565791800001 2024-04-30T23:13:18.755 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 msgr2=0x7f0cc40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 0x7f0cc40a60c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4099290 tx=0x7f0cd40bd040 comp rx=0 tx=0).stop 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 msgr2=0x7f0cdc1a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400eaa0 tx=0x7f0cd400ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 shutdown_connections 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0cc40a3bb0 0x7f0cc40a60c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cdc108960 0x7f0cdc1a1a50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cdc103c60 0x7f0cdc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 --2- 172.21.15.100:0/500128342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cdc102a20 0x7f0cdc19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 >> 172.21.15.100:0/500128342 conn(0x7f0cdc0fdc10 msgr2=0x7f0cdc104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 shutdown_connections 2024-04-30T23:13:18.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.746+0000 7f0ce291f640 1 -- 172.21.15.100:0/500128342 wait complete. 2024-04-30T23:13:18.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/1976976972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 msgr2=0x7fc5ec102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/1976976972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec102e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009900 tx=0x7fc5dc02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/1976976972 shutdown_connections 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/1976976972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 0x7fc5ec10a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/1976976972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 0x7fc5ec1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/1976976972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec102e90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/1976976972 >> 172.21.15.100:0/1976976972 conn(0x7fc5ec0fcf60 msgr2=0x7fc5ec0ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/1976976972 shutdown_connections 2024-04-30T23:13:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/1976976972 wait complete. 2024-04-30T23:13:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 Processor -- start 2024-04-30T23:13:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.866+0000 7fc5f2ba8640 1 -- start start 2024-04-30T23:13:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 0x7fc5ec19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 0x7fc5ec1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec10f660 con 0x7fc5ec1024f0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec10f4e0 con 0x7fc5ec1080d0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec10f7e0 con 0x7fc5ec1033d0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37414/0 (socket says 172.21.15.100:37414) 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 -- 172.21.15.100:0/3411412304 learned_addr learned my addr 172.21.15.100:0/3411412304 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 0x7fc5ec19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f1145640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 0x7fc5ec1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 -- 172.21.15.100:0/3411412304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 msgr2=0x7fc5ec19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 0x7fc5ec19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 -- 172.21.15.100:0/3411412304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 msgr2=0x7fc5ec1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 0x7fc5ec1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 -- 172.21.15.100:0/3411412304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec1a1d40 con 0x7fc5ec1024f0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f0944640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc006010 tx=0x7fc5dc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5e9ffb640 1 -- 172.21.15.100:0/3411412304 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc03f030 con 0x7fc5ec1024f0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5e9ffb640 1 -- 172.21.15.100:0/3411412304 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5dc003aa0 con 0x7fc5ec1024f0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec1a1fd0 con 0x7fc5ec1024f0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.867+0000 7fc5e9ffb640 1 -- 172.21.15.100:0/3411412304 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc035070 con 0x7fc5ec1024f0 2024-04-30T23:13:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.868+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec1a23e0 con 0x7fc5ec1024f0 2024-04-30T23:13:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.870+0000 7fc5f9a58740 1 Processor -- start 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.870+0000 7fc5e9ffb640 1 -- 172.21.15.100:0/3411412304 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc5dc042030 con 0x7fc5ec1024f0 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.870+0000 7fc5f9a58740 1 -- start start 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb87a270 0x5577bbc1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 0x5577bbc22510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5577bbb80740 con 0x5577bb8513b0 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5577bbb1c3a0 con 0x5577bb87a270 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5577bbb7c700 con 0x5577bb859590 2024-04-30T23:13:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37418/0 (socket says 172.21.15.100:37418) 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 -- 172.21.15.100:0/4215153347 learned_addr learned my addr 172.21.15.100:0/4215153347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f1145640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb87a270 0x5577bbc1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5e9ffb640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 0x7fc5d40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 0x5577bbc22510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f1145640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 0x7fc5d40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 -- 172.21.15.100:0/4215153347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 msgr2=0x5577bbc22510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 0x5577bbc22510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 -- 172.21.15.100:0/4215153347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb87a270 msgr2=0x5577bbc1b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb87a270 0x5577bbc1b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5f0944640 1 -- 172.21.15.100:0/4215153347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bbb38750 con 0x5577bb8513b0 2024-04-30T23:13:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 0x5577bbc22510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.871+0000 7fc5e9ffb640 1 -- 172.21.15.100:0/3411412304 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc5dc0f0d50 con 0x7fc5ec1024f0 2024-04-30T23:13:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.872+0000 7fc5f0944640 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0740f0 tx=0x7fc5dc04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e167147d674b9c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.872+0000 7fc5f1145640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 0x7fc5d40a60c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5577bbc1c260 tx=0x7fc5e4004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.872+0000 7fc5d2ffd640 1 -- 172.21.15.100:0/4215153347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0bc630 con 0x5577bb8513b0 2024-04-30T23:13:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.872+0000 7fc5d2ffd640 1 -- 172.21.15.100:0/4215153347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5dc0748a0 con 0x5577bb8513b0 2024-04-30T23:13:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.872+0000 7fc5d2ffd640 1 -- 172.21.15.100:0/4215153347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0746a0 con 0x5577bb8513b0 2024-04-30T23:13:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- 172.21.15.100:0/4215153347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 msgr2=0x5577bbc1b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0740f0 tx=0x7fc5dc04b000 comp rx=0 tx=0).stop 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- 172.21.15.100:0/4215153347 shutdown_connections 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb859590 0x5577bbc22510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb8513b0 0x5577bbc1b610 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/4215153347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb87a270 0x5577bbc1b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- 172.21.15.100:0/4215153347 >> 172.21.15.100:0/4215153347 conn(0x5577bb86e3c0 msgr2=0x5577bbc16a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- 172.21.15.100:0/4215153347 shutdown_connections 2024-04-30T23:13:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- 172.21.15.100:0/4215153347 wait complete. 2024-04-30T23:13:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 -- start start 2024-04-30T23:13:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.873+0000 7fc5f9a58740 1 Processor -- start 2024-04-30T23:13:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc24c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc2c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc22d20 con 0x5577bb859590 2024-04-30T23:13:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5577bbb07fe0 con 0x5577bb8513b0 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc22ea0 con 0x5577bb87a270 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 10 client.0 _ll_register_callbacks cb 0x5577bbb27c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37434/0 (socket says 172.21.15.100:37434) 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 -- 172.21.15.100:0/254401093 learned_addr learned my addr 172.21.15.100:0/254401093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f0944640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc24c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f1145640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc2c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 -- 172.21.15.100:0/254401093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 msgr2=0x5577bbc2c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc2c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 -- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 msgr2=0x5577bbc24c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc24c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 -- 172.21.15.100:0/254401093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bb8922d0 con 0x5577bb859590 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f1145640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc2c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000beb0 tx=0x7fc5e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb0d5679c53b243 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004220 con 0x5577bb859590 2024-04-30T23:13:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc5e00043c0 con 0x5577bb859590 2024-04-30T23:13:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.874+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577bbb8e350 con 0x5577bb859590 2024-04-30T23:13:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc5e0024050 con 0x5577bb859590 2024-04-30T23:13:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 10 client.15540 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5577bb95c6b0 con 0x5577bb859590 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5577bbb8e350 con 0x5577bb859590 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc5e001b6f0 con 0x5577bb859590 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 10 client.15540 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 10 client.15540 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 20 client.15540 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb838e40 0x5577bbc32c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 4 client.15540 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577bbb881c0 con 0x5577bb838e40 2024-04-30T23:13:18.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.875+0000 7fc5f0944640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb838e40 0x5577bbc32c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5cbfff640 10 client.15540 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:18.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f0944640 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb838e40 0x5577bbc32c70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc005c272768da4 server_cookie=9f6dd6a84a9ab549 in_seq=0 out_seq=0 2024-04-30T23:13:18.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5cbfff640 1 -- 172.21.15.100:0/254401093 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5577bbb881c0 con 0x5577bb838e40 2024-04-30T23:13:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5cbfff640 10 client.15540 handle_command_reply: tid=0 2024-04-30T23:13:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f9a58740 1 client.15540 shutdown 2024-04-30T23:13:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 msgr2=0x5577bbc25180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000beb0 tx=0x7fc5e00117b0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 shutdown_connections 2024-04-30T23:13:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.876+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb838e40 0x5577bbc32c70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc2c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc25180 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/254401093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc24c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5cbfff640 0 client.15540 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 >> 172.21.15.100:0/254401093 conn(0x5577bb86e3c0 msgr2=0x5577bbc15c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 shutdown_connections 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 1 -- 172.21.15.100:0/254401093 wait complete. 2024-04-30T23:13:18.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.877+0000 7fc5f9a58740 20 client.15540 trim_cache size 0 max 16384 2024-04-30T23:13:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.895+0000 7fc5f9a58740 1 Processor -- start 2024-04-30T23:13:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.895+0000 7fc5f9a58740 1 -- start start 2024-04-30T23:13:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc1ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc24220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc30fb0 con 0x5577bb859590 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc31680 con 0x5577bb8513b0 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc31d50 con 0x5577bb87a270 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37442/0 (socket says 172.21.15.100:37442) 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 -- 172.21.15.100:0/2715620002 learned_addr learned my addr 172.21.15.100:0/2715620002 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f1145640 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc24220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 -- 172.21.15.100:0/2715620002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 msgr2=0x5577bbc24220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5f0944640 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc1ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc24220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 -- 172.21.15.100:0/2715620002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 msgr2=0x5577bbc1ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc1ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 -- 172.21.15.100:0/2715620002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577bbc23cc0 con 0x5577bb859590 2024-04-30T23:13:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc5e001bb40 tx=0x7fc5e000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03a7fc96050d54c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5d27fc640 1 -- 172.21.15.100:0/2715620002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0021040 con 0x5577bb859590 2024-04-30T23:13:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5d27fc640 1 -- 172.21.15.100:0/2715620002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5e002d070 con 0x5577bb859590 2024-04-30T23:13:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.896+0000 7fc5d27fc640 1 -- 172.21.15.100:0/2715620002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00048e0 con 0x5577bb859590 2024-04-30T23:13:18.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- 172.21.15.100:0/2715620002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 msgr2=0x5577bbc2c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc5e001bb40 tx=0x7fc5e000baa0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- 172.21.15.100:0/2715620002 shutdown_connections 2024-04-30T23:13:18.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb87a270 0x5577bbc24220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb859590 0x5577bbc2c000 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/2715620002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb8513b0 0x5577bbc1ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- 172.21.15.100:0/2715620002 >> 172.21.15.100:0/2715620002 conn(0x5577bb86e3c0 msgr2=0x5577bbc1f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- 172.21.15.100:0/2715620002 shutdown_connections 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- 172.21.15.100:0/2715620002 wait complete. 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.897+0000 7fc5f9a58740 1 -- start start 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 Processor -- start 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb8513b0 0x5577bbc27160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb859590 0x5577bbc276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc32af0 con 0x5577bb87a270 2024-04-30T23:13:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc32420 con 0x5577bb859590 2024-04-30T23:13:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5577bbc331c0 con 0x5577bb8513b0 2024-04-30T23:13:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f9a58740 10 client.0 _ll_register_callbacks cb 0x7fc5e000b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37444/0 (socket says 172.21.15.100:37444) 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 -- 172.21.15.100:0/555829406 learned_addr learned my addr 172.21.15.100:0/555829406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5ebfff640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb859590 0x5577bbc276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f0944640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb8513b0 0x5577bbc27160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 -- 172.21.15.100:0/555829406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb8513b0 msgr2=0x5577bbc27160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb8513b0 0x5577bbc27160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 -- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb859590 msgr2=0x5577bbc276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:18.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb859590 0x5577bbc276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.898+0000 7fc5f1145640 1 -- 172.21.15.100:0/555829406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577bbc97f40 con 0x5577bb87a270 2024-04-30T23:13:18.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f1145640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc5e401f520 tx=0x7fc5e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cc30537dc4728a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e402c060 con 0x5577bb87a270 2024-04-30T23:13:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc5e401d840 con 0x5577bb87a270 2024-04-30T23:13:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5e002d070 con 0x5577bb87a270 2024-04-30T23:13:18.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc5e4033050 con 0x5577bb87a270 2024-04-30T23:13:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 10 client.15546 fetch_fsmap learned FSMap version 27 2024-04-30T23:13:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5577bbc99250 con 0x5577bb87a270 2024-04-30T23:13:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5e002d070 con 0x5577bb87a270 2024-04-30T23:13:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc5e4026030 con 0x5577bb87a270 2024-04-30T23:13:18.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 10 client.15546 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 10 client.15546 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 20 client.15546 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb80e280 0x5577bbc9cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 4 client.15546 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.899+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "status"}) -- 0x5577bbb039a0 con 0x5577bb80e280 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f0944640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb80e280 0x5577bbc9cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5cbfff640 10 client.15546 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f0944640 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb80e280 0x5577bbc9cbb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34648edb9a2c56fd server_cookie=1dc1af1fb69a5f6d in_seq=0 out_seq=0 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5cbfff640 1 -- 172.21.15.100:0/555829406 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5577bbb039a0 con 0x5577bb80e280 2024-04-30T23:13:18.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5cbfff640 10 client.15546 handle_command_reply: tid=0 2024-04-30T23:13:18.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 client.15546 shutdown 2024-04-30T23:13:18.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 msgr2=0x5577bbc979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc5e401f520 tx=0x7fc5e4004a40 comp rx=0 tx=0).stop 2024-04-30T23:13:18.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 shutdown_connections 2024-04-30T23:13:18.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5577bb80e280 0x5577bbc9cbb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5577bb87a270 0x5577bbc979d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5577bb859590 0x5577bbc276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5cbfff640 0 client.15546 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 --2- 172.21.15.100:0/555829406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5577bb8513b0 0x5577bbc27160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 >> 172.21.15.100:0/555829406 conn(0x5577bb86e3c0 msgr2=0x5577bbc198c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.900+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 shutdown_connections 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f9a58740 1 -- 172.21.15.100:0/555829406 wait complete. 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f9a58740 20 client.15546 trim_cache size 0 max 16384 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "a34a4a58-0745-11ef-bc93-c7b262605968", 2024-04-30T23:13:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24545, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 138.01819885899999, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 27, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 93, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 89, 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 144.929810417 2024-04-30T23:13:18.919 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 msgr2=0x7fc5d40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 0x7fc5d40a60c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5577bbc1c260 tx=0x7fc5e4004ab0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 msgr2=0x7fc5ec19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc006010 tx=0x7fc5dc031a50 comp rx=0 tx=0).stop 2024-04-30T23:13:18.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 shutdown_connections 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5d40a3bb0 0x7fc5d40a60c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec1080d0 0x7fc5ec1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1033d0 0x7fc5ec19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 --2- 172.21.15.100:0/3411412304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5ec1024f0 0x7fc5ec19a370 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 >> 172.21.15.100:0/3411412304 conn(0x7fc5ec0fcf60 msgr2=0x7fc5ec1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:18.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 shutdown_connections 2024-04-30T23:13:18.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:18.901+0000 7fc5f2ba8640 1 -- 172.21.15.100:0/3411412304 wait complete. 2024-04-30T23:13:18.924 INFO:teuthology.run_tasks:Running task sequential... 2024-04-30T23:13:18.938 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-30T23:13:18.939 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-30T23:13:18.939 INFO:teuthology.task.print:Enabling mgr modules 2024-04-30T23:13:18.940 INFO:teuthology.run_tasks:Running task kclient... 2024-04-30T23:13:18.953 INFO:tasks.kclient:Mounting kernel clients... 2024-04-30T23:13:18.953 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-30T23:13:18.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:18.954 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-30T23:13:18.968 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-30T23:13:18.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:18.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-30T23:13:19.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:18 smithi100 ceph-mon[29745]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:19.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:18 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1182364429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.029 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:18 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/468563963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:19.032 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-04-30T23:13:19.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:18 smithi104 ceph-mon[32987]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:19.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:18 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1182364429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:18 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/468563963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:18 smithi183 ceph-mon[33560]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:18 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1182364429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:18 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/468563963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:19.136 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-30T23:13:19.136 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T23:13:19.137 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:19.137 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-30T23:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:13:20.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:20 smithi100 ceph-mon[29745]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:21.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:20 smithi104 ceph-mon[32987]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:21.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:20 smithi183 ceph-mon[33560]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:21.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- 172.21.15.100:0/3005185690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 msgr2=0x7fdf40108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:21.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 --2- 172.21.15.100:0/3005185690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf40108110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdf280099c0 tx=0x7fdf28009cd0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- 172.21.15.100:0/3005185690 shutdown_connections 2024-04-30T23:13:21.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 --2- 172.21.15.100:0/3005185690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf40108650 0x7fdf4010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 --2- 172.21.15.100:0/3005185690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf401033d0 0x7fdf401037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 --2- 172.21.15.100:0/3005185690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf40108110 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- 172.21.15.100:0/3005185690 >> 172.21.15.100:0/3005185690 conn(0x7fdf400fecd0 msgr2=0x7fdf401010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- 172.21.15.100:0/3005185690 shutdown_connections 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- 172.21.15.100:0/3005185690 wait complete. 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 Processor -- start 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.089+0000 7fdf4553c700 1 -- start start 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf401033d0 0x7fdf4019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:21.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf40108650 0x7fdf40199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40113260 con 0x7fdf40107d00 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401130e0 con 0x7fdf401033d0 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401133e0 con 0x7fdf40108650 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37472/0 (socket says 172.21.15.100:37472) 2024-04-30T23:13:21.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 -- 172.21.15.100:0/508297998 learned_addr learned my addr 172.21.15.100:0/508297998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf3f7fe700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf40108650 0x7fdf40199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf3effd700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf401033d0 0x7fdf4019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 -- 172.21.15.100:0/508297998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf40108650 msgr2=0x7fdf40199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf40108650 0x7fdf40199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 -- 172.21.15.100:0/508297998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf401033d0 msgr2=0x7fdf4019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf401033d0 0x7fdf4019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 -- 172.21.15.100:0/508297998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4019a0f0 con 0x7fdf40107d00 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf37fff700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdf280045e0 tx=0x7fdf28004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28026070 con 0x7fdf40107d00 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.090+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4019a380 con 0x7fdf40107d00 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.091+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2800f460 con 0x7fdf40107d00 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.091+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28009e60 con 0x7fdf40107d00 2024-04-30T23:13:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.091+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf401a66b0 con 0x7fdf40107d00 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.092+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf40104880 con 0x7fdf40107d00 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.093+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fdf28029070 con 0x7fdf40107d00 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.093+0000 7fdf3cff9700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 0x7fdf2c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.093+0000 7fdf3effd700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 0x7fdf2c0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.094+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fdf280d0eb0 con 0x7fdf40107d00 2024-04-30T23:13:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.094+0000 7fdf3effd700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 0x7fdf2c0a6150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005950 tx=0x7fdf3000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.098+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdf28013070 con 0x7fdf40107d00 2024-04-30T23:13:21.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.340+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdf4019af70 con 0x7fdf40107d00 2024-04-30T23:13:21.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.341+0000 7fdf3cff9700 1 -- 172.21.15.100:0/508297998 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7fdf2809d5c0 con 0x7fdf40107d00 2024-04-30T23:13:21.341 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 msgr2=0x7fdf2c0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 0x7fdf2c0a6150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005950 tx=0x7fdf3000a300 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 msgr2=0x7fdf4019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdf280045e0 tx=0x7fdf28004610 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 shutdown_connections 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fdf2c0a3c40 0x7fdf2c0a6150 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf40108650 0x7fdf40199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf401033d0 0x7fdf4019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 --2- 172.21.15.100:0/508297998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40107d00 0x7fdf4019fd60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 >> 172.21.15.100:0/508297998 conn(0x7fdf400fecd0 msgr2=0x7fdf401095b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.343+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 shutdown_connections 2024-04-30T23:13:21.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:21.344+0000 7fdf4553c700 1 -- 172.21.15.100:0/508297998 wait complete. 2024-04-30T23:13:21.933 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:21 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/508297998' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T23:13:21.960 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T23:13:21.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:21.961 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:13:21.976 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42054sec preferred_lft 42054sec 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::9f2f:e944:c89b:fa12/64 scope link noprefixroute 2024-04-30T23:13:21.977 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-30T23:13:21.978 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-30T23:13:21.978 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:13:22.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:21 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/508297998' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:13:22.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:21 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/508297998' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-30T23:13:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:22.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.114 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T23:13:22.136 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-04-30T23:13:22.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.138 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-04-30T23:13:22.193 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-04-30T23:13:22.193 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T23:13:22.193 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T23:13:22.193 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T23:13:22.193 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T23:13:22.194 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:13:22.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:22.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:22.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.317 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-30T23:13:22.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.332 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-04-30T23:13:22.386 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:13:22.387 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:13:22.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T23:13:22.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-30T23:13:22.387 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:13:22.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:22.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:22.502 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-30T23:13:22.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-30T23:13:22.503 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-30T23:13:22.503 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:13:22.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:22.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:22.611 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T23:13:22.611 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-30T23:13:22.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-04-30T23:13:22.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-04-30T23:13:22.612 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-30T23:13:22.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:22.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:22.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T23:13:22.686 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:22.700 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T23:13:22.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T23:13:22.701 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:22.755 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-30T23:13:22.755 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-30T23:13:22.755 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/50f7f738-5072-42da-817a-1f139b16aaf8 2024-04-30T23:13:22.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.755 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/50f7f738-5072-42da-817a-1f139b16aaf8 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-30T23:13:22.815 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:22 smithi100 ceph-mon[29745]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-30T23:13:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-30T23:13:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-04-30T23:13:22.963 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.104:3300,172.21.15.183:3300" 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:3300,172.21.15.104:3300,172.21.15.183:3300:/volumes/qa/sv_1/50f7f738-5072-42da-817a-1f139b16aaf8 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=a34a4a58-0745-11ef-bc93-c7b262605968" will pass to kernel 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T23:13:22.964 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T23:13:22.965 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T23:13:22.966 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T23:13:22.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:22.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:23.034 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T23:13:23.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:22 smithi104 ceph-mon[32987]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:23.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:22 smithi183 ceph-mon[33560]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:23.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T23:13:23.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:23.130 INFO:teuthology.orchestra.run.smithi100.stdout:client25159 2024-04-30T23:13:23.130 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:13:23.130 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:13:23.146 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T23:13:23.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T23:13:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:23.242 INFO:teuthology.orchestra.run.smithi100.stdout:client25159 2024-04-30T23:13:23.242 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T23:13:23.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T23:13:23.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:23.297 INFO:teuthology.orchestra.run.smithi100.stdout:client25159 2024-04-30T23:13:23.298 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a34a4a58-0745-11ef-bc93-c7b262605968.client25159/status') 2024-04-30T23:13:23.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T23:13:23.354 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.25159 (3)172.21.15.100:0/4004290789 2024-04-30T23:13:23.354 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-04-30T23:13:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-04-30T23:13:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-04-30T23:13:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:72 bytes copied, 5.6074e-05 s, 1.3 MB/s 2024-04-30T23:13:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T23:13:23.362 INFO:teuthology.run_tasks:Running task exec... 2024-04-30T23:13:23.372 INFO:teuthology.task.exec:Executing custom commands... 2024-04-30T23:13:23.372 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:13:23.372 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 -- 172.21.15.100:0/3426997304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c104db0 msgr2=0x7f159c1051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 --2- 172.21.15.100:0/3426997304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c104db0 0x7f159c1051c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f158c009900 tx=0x7f158c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 -- 172.21.15.100:0/3426997304 shutdown_connections 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 --2- 172.21.15.100:0/3426997304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c109ab0 0x7f159c10bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 --2- 172.21.15.100:0/3426997304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c104db0 0x7f159c1051c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 --2- 172.21.15.100:0/3426997304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c103b70 0x7f159c104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.480+0000 7f15a32a6640 1 -- 172.21.15.100:0/3426997304 >> 172.21.15.100:0/3426997304 conn(0x7f159c0fed80 msgr2=0x7f159c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- 172.21.15.100:0/3426997304 shutdown_connections 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- 172.21.15.100:0/3426997304 wait complete. 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 Processor -- start 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- start start 2024-04-30T23:13:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c103b70 0x7f159c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c104db0 0x7f159c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f159c10f6f0 con 0x7f159c109ab0 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f159c10f570 con 0x7f159c104db0 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a32a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f159c10f870 con 0x7f159c103b70 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.481+0000 7f15a1843640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34838/0 (socket says 172.21.15.100:34838) 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 -- 172.21.15.100:0/4258817351 learned_addr learned my addr 172.21.15.100:0/4258817351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a0841640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c104db0 0x7f159c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1042640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c103b70 0x7f159c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 -- 172.21.15.100:0/4258817351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c103b70 msgr2=0x7f159c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c103b70 0x7f159c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 -- 172.21.15.100:0/4258817351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c104db0 msgr2=0x7f159c19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c104db0 0x7f159c19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 -- 172.21.15.100:0/4258817351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c1a1db0 con 0x7f159c109ab0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a1843640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f159400eaa0 tx=0x7f159400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400cdb0 con 0x7f159c109ab0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1594005020 con 0x7f159c109ab0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c1a20a0 con 0x7f159c109ab0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940116d0 con 0x7f159c109ab0 2024-04-30T23:13:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.482+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c1a25f0 con 0x7f159c109ab0 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.483+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c1088c0 con 0x7f159c109ab0 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.485+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f15940054a0 con 0x7f159c109ab0 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.485+0000 7f15927fc640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 0x7f15880a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.485+0000 7f15a1042640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 0x7f15880a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.485+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f15940d0d00 con 0x7f159c109ab0 2024-04-30T23:13:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.486+0000 7f15a1042640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 0x7f15880a60b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1598005d00 tx=0x7f1598005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.489+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1594016030 con 0x7f159c109ab0 2024-04-30T23:13:23.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.707+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f159c02dd10 con 0x7f159c109ab0 2024-04-30T23:13:23.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.747+0000 7f15927fc640 1 -- 172.21.15.100:0/4258817351 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f159409d380 con 0x7f159c109ab0 2024-04-30T23:13:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 msgr2=0x7f15880a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 0x7f15880a60b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1598005d00 tx=0x7f1598005c50 comp rx=0 tx=0).stop 2024-04-30T23:13:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 msgr2=0x7f159c1a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f159400eaa0 tx=0x7f159400ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 shutdown_connections 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f15880a3ba0 0x7f15880a60b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c109ab0 0x7f159c1a1740 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f159c104db0 0x7f159c19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 --2- 172.21.15.100:0/4258817351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f159c103b70 0x7f159c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 >> 172.21.15.100:0/4258817351 conn(0x7f159c0fed80 msgr2=0x7f159c105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 shutdown_connections 2024-04-30T23:13:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.750+0000 7f15a32a6640 1 -- 172.21.15.100:0/4258817351 wait complete. 2024-04-30T23:13:23.762 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-30T23:13:23.773 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-30T23:13:23.784 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:23.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.890+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2378560607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 msgr2=0x7ff55810ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.890+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2378560607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff55810ada0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff550009ca0 tx=0x7ff55002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2378560607 shutdown_connections 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2378560607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff55810ada0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2378560607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558103c80 0x7ff558104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2378560607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558102a40 0x7ff558103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2378560607 >> 172.21.15.100:0/2378560607 conn(0x7ff5580fdc30 msgr2=0x7ff5581000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2378560607 shutdown_connections 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2378560607 wait complete. 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 Processor -- start 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.891+0000 7ff55e2f2640 1 -- start start 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558102a40 0x7ff558199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558103c80 0x7ff558199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e570 con 0x7ff558108980 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e3f0 con 0x7ff558102a40 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810e6f0 con 0x7ff558103c80 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34854/0 (socket says 172.21.15.100:34854) 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 -- 172.21.15.100:0/2746667823 learned_addr learned my addr 172.21.15.100:0/2746667823 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff5577fe640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558103c80 0x7ff558199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff557fff640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558102a40 0x7ff558199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 -- 172.21.15.100:0/2746667823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558103c80 msgr2=0x7ff558199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558103c80 0x7ff558199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 -- 172.21.15.100:0/2746667823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558102a40 msgr2=0x7ff558199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558102a40 0x7ff558199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 -- 172.21.15.100:0/2746667823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5581a0ba0 con 0x7ff558108980 2024-04-30T23:13:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55c88f640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097b0 tx=0x7ff550003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550004240 con 0x7ff558108980 2024-04-30T23:13:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55002f380 con 0x7ff558108980 2024-04-30T23:13:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5581a0e30 con 0x7ff558108980 2024-04-30T23:13:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55002fc20 con 0x7ff558108980 2024-04-30T23:13:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.892+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581a1290 con 0x7ff558108980 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.894+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55806a1d0 con 0x7ff558108980 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.895+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff5500043e0 con 0x7ff558108980 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.895+0000 7ff5557fa640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 0x7ff5400a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.896+0000 7ff557fff640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 0x7ff5400a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.896+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff5500f20d0 con 0x7ff558108980 2024-04-30T23:13:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.896+0000 7ff557fff640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 0x7ff5400a60c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff548005fd0 tx=0x7ff548005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:23.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:23.901+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff5500be750 con 0x7ff558108980 2024-04-30T23:13:24.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:23 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-30T23:13:24.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:23 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-30T23:13:24.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:23 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-30T23:13:24.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.083+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5580638a0 con 0x7ff558108980 2024-04-30T23:13:24.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.085+0000 7ff5557fa640 1 -- 172.21.15.100:0/2746667823 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7ff5500098b0 con 0x7ff558108980 2024-04-30T23:13:24.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:24.085 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 msgr2=0x7ff5400a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 0x7ff5400a60c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff548005fd0 tx=0x7ff548005850 comp rx=0 tx=0).stop 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 msgr2=0x7ff5581a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097b0 tx=0x7ff550003c20 comp rx=0 tx=0).stop 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 shutdown_connections 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff5400a3bb0 0x7ff5400a60c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff558108980 0x7ff5581a05e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff558103c80 0x7ff558199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 --2- 172.21.15.100:0/2746667823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff558102a40 0x7ff558199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 >> 172.21.15.100:0/2746667823 conn(0x7ff5580fdc30 msgr2=0x7ff558104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 shutdown_connections 2024-04-30T23:13:24.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.087+0000 7ff55e2f2640 1 -- 172.21.15.100:0/2746667823 wait complete. 2024-04-30T23:13:24.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:13:24.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 -- 172.21.15.100:0/726755351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64103c70 msgr2=0x7f4d64104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 --2- 172.21.15.100:0/726755351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64103c70 0x7f4d64104080 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009900 tx=0x7f4d5402a410 comp rx=0 tx=0).stop 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 -- 172.21.15.100:0/726755351 shutdown_connections 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 --2- 172.21.15.100:0/726755351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64108970 0x7f4d6410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 --2- 172.21.15.100:0/726755351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64103c70 0x7f4d64104080 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 --2- 172.21.15.100:0/726755351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64102a30 0x7f4d64103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 -- 172.21.15.100:0/726755351 >> 172.21.15.100:0/726755351 conn(0x7f4d640fdc00 msgr2=0x7f4d641000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 -- 172.21.15.100:0/726755351 shutdown_connections 2024-04-30T23:13:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.209+0000 7f4d6b365640 1 -- 172.21.15.100:0/726755351 wait complete. 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 Processor -- start 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 -- start start 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64102a30 0x7f4d640758e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64103c70 0x7f4d6419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6410e560 con 0x7f4d64108970 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6410e3e0 con 0x7f4d64103c70 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d6b365640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6410e6e0 con 0x7f4d64102a30 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d69902640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d69902640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34868/0 (socket says 172.21.15.100:34868) 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d69902640 1 -- 172.21.15.100:0/1370328263 learned_addr learned my addr 172.21.15.100:0/1370328263 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.210+0000 7f4d69101640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64102a30 0x7f4d640758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d68900640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64103c70 0x7f4d6419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 -- 172.21.15.100:0/1370328263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64102a30 msgr2=0x7f4d640758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64102a30 0x7f4d640758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 -- 172.21.15.100:0/1370328263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64103c70 msgr2=0x7f4d6419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64103c70 0x7f4d6419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 -- 172.21.15.100:0/1370328263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d641a1d50 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d69902640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00eaa0 tx=0x7f4d5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00cdb0 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d5c005020 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d641a1fe0 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0116d0 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.211+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d641a24a0 con 0x7f4d64108970 2024-04-30T23:13:24.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.212+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d64107780 con 0x7f4d64108970 2024-04-30T23:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.213+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4d5c0051d0 con 0x7f4d64108970 2024-04-30T23:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.214+0000 7f4d5a7fc640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 0x7f4d500a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.214+0000 7f4d69101640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 0x7f4d500a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.214+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4d5c0d0ce0 con 0x7f4d64108970 2024-04-30T23:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.214+0000 7f4d69101640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 0x7f4d500a60c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d64103630 tx=0x7f4d6000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.218+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4d5c016030 con 0x7f4d64108970 2024-04-30T23:13:24.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.394+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4d6402dd20 con 0x7f4d64108970 2024-04-30T23:13:24.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.395+0000 7f4d5a7fc640 1 -- 172.21.15.100:0/1370328263 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f4d5c0bbe20 con 0x7f4d64108970 2024-04-30T23:13:24.396 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 msgr2=0x7f4d500a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 0x7f4d500a60c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d64103630 tx=0x7f4d6000a2d0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 msgr2=0x7f4d641a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00eaa0 tx=0x7f4d5c00ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 shutdown_connections 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4d500a3bb0 0x7f4d500a60c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d64108970 0x7f4d641a1530 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d64103c70 0x7f4d6419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 --2- 172.21.15.100:0/1370328263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d64102a30 0x7f4d640758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 >> 172.21.15.100:0/1370328263 conn(0x7f4d640fdc00 msgr2=0x7f4d64104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 shutdown_connections 2024-04-30T23:13:24.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.397+0000 7f4d6b365640 1 -- 172.21.15.100:0/1370328263 wait complete. 2024-04-30T23:13:24.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:13:24.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2252536070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee81097e0 msgr2=0x7f8ee810bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2252536070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee81097e0 0x7f8ee810bcf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009ca0 tx=0x7f8ee002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2252536070 shutdown_connections 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2252536070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee81097e0 0x7f8ee810bcf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2252536070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8106c70 0x7f8ee8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2252536070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee8101ee0 0x7f8ee81022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2252536070 >> 172.21.15.100:0/2252536070 conn(0x7f8ee80fd390 msgr2=0x7f8ee80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2252536070 shutdown_connections 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.519+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2252536070 wait complete. 2024-04-30T23:13:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 Processor -- start 2024-04-30T23:13:24.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 -- start start 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8101ee0 0x7f8ee819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee81097e0 0x7f8ee81a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee810f670 con 0x7f8ee8106c70 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee810f4f0 con 0x7f8ee81097e0 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8eedcd1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee810f7f0 con 0x7f8ee8101ee0 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34880/0 (socket says 172.21.15.100:34880) 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 -- 172.21.15.100:0/2404387452 learned_addr learned my addr 172.21.15.100:0/2404387452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee7fff640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee81097e0 0x7f8ee81a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee77fe640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8101ee0 0x7f8ee819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 -- 172.21.15.100:0/2404387452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8101ee0 msgr2=0x7f8ee819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8101ee0 0x7f8ee819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 -- 172.21.15.100:0/2404387452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee81097e0 msgr2=0x7f8ee81a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee81097e0 0x7f8ee81a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.520+0000 7f8ee6ffd640 1 -- 172.21.15.100:0/2404387452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee81a1d30 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8ee6ffd640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e9f0 tx=0x7f8edc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00cd80 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8edc0054d0 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee81a1fc0 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc010690 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.521+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81a2460 con 0x7f8ee8106c70 2024-04-30T23:13:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.522+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee80feeb0 con 0x7f8ee8106c70 2024-04-30T23:13:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.523+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8edc004e30 con 0x7f8ee8106c70 2024-04-30T23:13:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.524+0000 7f8ee4ff9640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 0x7f8ed00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.524+0000 7f8ee77fe640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 0x7f8ed00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.524+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8edc0d0e20 con 0x7f8ee8106c70 2024-04-30T23:13:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.524+0000 7f8ee77fe640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 0x7f8ed00a60c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ee806b5a0 tx=0x7f8ed8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.527+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8edc053ff0 con 0x7f8ee8106c70 2024-04-30T23:13:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.706+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8ee802dd20 con 0x7f8ee8106c70 2024-04-30T23:13:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.707+0000 7f8ee4ff9640 1 -- 172.21.15.100:0/2404387452 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f8edc09d4a0 con 0x7f8ee8106c70 2024-04-30T23:13:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 msgr2=0x7f8ed00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 0x7f8ed00a60c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ee806b5a0 tx=0x7f8ed8005f90 comp rx=0 tx=0).stop 2024-04-30T23:13:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 msgr2=0x7f8ee819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e9f0 tx=0x7f8edc00edf0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 shutdown_connections 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8ed00a3bb0 0x7f8ed00a60c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ee81097e0 0x7f8ee81a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ee8106c70 0x7f8ee819a730 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 --2- 172.21.15.100:0/2404387452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ee8101ee0 0x7f8ee819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 >> 172.21.15.100:0/2404387452 conn(0x7f8ee80fd390 msgr2=0x7f8ee8107ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 shutdown_connections 2024-04-30T23:13:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.709+0000 7f8eedcd1640 1 -- 172.21.15.100:0/2404387452 wait complete. 2024-04-30T23:13:24.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/837056761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 msgr2=0x7f3a54106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/837056761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54106a40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009900 tx=0x7f3a4802a410 comp rx=0 tx=0).stop 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/837056761 shutdown_connections 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/837056761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a5410bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/837056761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a541093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/837056761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54106a40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/837056761 >> 172.21.15.100:0/837056761 conn(0x7f3a540fdc00 msgr2=0x7f3a541000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/837056761 shutdown_connections 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.832+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/837056761 wait complete. 2024-04-30T23:13:24.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 Processor -- start 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 -- start start 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a54102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a54102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5410f630 con 0x7f3a54104620 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5410f4b0 con 0x7f3a54106f80 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5aaf0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5410f7b0 con 0x7f3a541098e0 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34900/0 (socket says 172.21.15.100:34900) 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 -- 172.21.15.100:0/3893193110 learned_addr learned my addr 172.21.15.100:0/3893193110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a53fff640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a54102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5908d640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a54102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 -- 172.21.15.100:0/3893193110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 msgr2=0x7f3a54102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a54102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 -- 172.21.15.100:0/3893193110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 msgr2=0x7f3a54102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a54102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5888c640 1 -- 172.21.15.100:0/3893193110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54102cf0 con 0x7f3a54104620 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a53fff640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a54102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.833+0000 7f3a5908d640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a54102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a5888c640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006010 tx=0x7f3a48031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4803f030 con 0x7f3a54104620 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a48003aa0 con 0x7f3a54104620 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48035070 con 0x7f3a54104620 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a541a4350 con 0x7f3a54104620 2024-04-30T23:13:24.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.834+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541a4700 con 0x7f3a54104620 2024-04-30T23:13:24.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.835+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a540ff720 con 0x7f3a54104620 2024-04-30T23:13:24.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.836+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3a48042030 con 0x7f3a54104620 2024-04-30T23:13:24.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.837+0000 7f3a51ffb640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 0x7f3a440a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:24.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.837+0000 7f3a53fff640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 0x7f3a440a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:24.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.837+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f3a480f1170 con 0x7f3a54104620 2024-04-30T23:13:24.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.838+0000 7f3a53fff640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 0x7f3a440a6140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a54103410 tx=0x7f3a40005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:24.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:24.841+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3a480bd7f0 con 0x7f3a54104620 2024-04-30T23:13:25.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.022+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3a540637e0 con 0x7f3a54104620 2024-04-30T23:13:25.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.023+0000 7f3a51ffb640 1 -- 172.21.15.100:0/3893193110 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f3a480bd0f0 con 0x7f3a54104620 2024-04-30T23:13:25.023 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:13:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 msgr2=0x7f3a440a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 0x7f3a440a6140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3a54103410 tx=0x7f3a40005db0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 msgr2=0x7f3a54103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006010 tx=0x7f3a48031a50 comp rx=0 tx=0).stop 2024-04-30T23:13:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 shutdown_connections 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3a440a3c30 0x7f3a440a6140 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a541098e0 0x7f3a54102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a54106f80 0x7f3a54102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 --2- 172.21.15.100:0/3893193110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a54104620 0x7f3a54103a70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 >> 172.21.15.100:0/3893193110 conn(0x7f3a540fdc00 msgr2=0x7f3a54105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 shutdown_connections 2024-04-30T23:13:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.025+0000 7f3a5aaf0640 1 -- 172.21.15.100:0/3893193110 wait complete. 2024-04-30T23:13:25.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:25.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-30T23:13:25.035 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:13:25.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2746667823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:25.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1370328263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.036 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:24 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2404387452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2746667823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1370328263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:24 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2404387452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4258817351' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2746667823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1370328263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:24 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2404387452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 -- 172.21.15.100:0/3279458389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 msgr2=0x7f415810ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 --2- 172.21.15.100:0/3279458389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f415810ada0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4150009ca0 tx=0x7f415002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 -- 172.21.15.100:0/3279458389 shutdown_connections 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 --2- 172.21.15.100:0/3279458389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f415810ada0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 --2- 172.21.15.100:0/3279458389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 0x7f4158104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 --2- 172.21.15.100:0/3279458389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 0x7f4158103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 -- 172.21.15.100:0/3279458389 >> 172.21.15.100:0/3279458389 conn(0x7f41580fdc30 msgr2=0x7f41581000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 -- 172.21.15.100:0/3279458389 shutdown_connections 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.147+0000 7f415ff46640 1 -- 172.21.15.100:0/3279458389 wait complete. 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 Processor -- start 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 -- start start 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 0x7f415819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 0x7f415819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f415810e570 con 0x7f4158108980 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f415810e3f0 con 0x7f4158102a40 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415ff46640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f415810e6f0 con 0x7f4158103c80 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34920/0 (socket says 172.21.15.100:34920) 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 -- 172.21.15.100:0/192192034 learned_addr learned my addr 172.21.15.100:0/192192034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415dce2640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 0x7f415819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415d4e1640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 0x7f415819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 -- 172.21.15.100:0/192192034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 msgr2=0x7f415819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 0x7f415819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 -- 172.21.15.100:0/192192034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 msgr2=0x7f415819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 0x7f415819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.148+0000 7f415e4e3640 1 -- 172.21.15.100:0/192192034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41581a1d20 con 0x7f4158108980 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f415e4e3640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f41500097b0 tx=0x7f4150003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150004240 con 0x7f4158108980 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f415002f380 con 0x7f4158108980 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41581a1fb0 con 0x7f4158108980 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415002fc30 con 0x7f4158108980 2024-04-30T23:13:25.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.149+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41581a2470 con 0x7f4158108980 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.150+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41581a26d0 con 0x7f4158108980 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.151+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f41500043e0 con 0x7f4158108980 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.152+0000 7f414affd640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 0x7f41440a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.152+0000 7f415dce2640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 0x7f41440a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.152+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f41500f1eb0 con 0x7f4158108980 2024-04-30T23:13:25.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.152+0000 7f415dce2640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 0x7f41440a6140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4158103640 tx=0x7f415400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.156+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f41500be530 con 0x7f4158108980 2024-04-30T23:13:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.334+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f41581a28a0 con 0x7f4158108980 2024-04-30T23:13:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.335+0000 7f414affd640 1 -- 172.21.15.100:0/192192034 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f41500098b0 con 0x7f4158108980 2024-04-30T23:13:25.335 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 msgr2=0x7f41440a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 0x7f41440a6140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4158103640 tx=0x7f415400b390 comp rx=0 tx=0).stop 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 msgr2=0x7f41581a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f41500097b0 tx=0x7f4150003c20 comp rx=0 tx=0).stop 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 shutdown_connections 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f41440a3c30 0x7f41440a6140 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4158108980 0x7f41581a16b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4158103c80 0x7f415819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.336+0000 7f415ff46640 1 --2- 172.21.15.100:0/192192034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4158102a40 0x7f415819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.337+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 >> 172.21.15.100:0/192192034 conn(0x7f41580fdc30 msgr2=0x7f4158109df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.337+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 shutdown_connections 2024-04-30T23:13:25.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.337+0000 7f415ff46640 1 -- 172.21.15.100:0/192192034 wait complete. 2024-04-30T23:13:25.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- 172.21.15.100:0/485807489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 msgr2=0x7f5be4106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/485807489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be4106ba0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009ca0 tx=0x7f5be002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- 172.21.15.100:0/485807489 shutdown_connections 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/485807489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5be4109a40 0x7f5be410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/485807489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 0x7f5be4109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/485807489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be4106ba0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- 172.21.15.100:0/485807489 >> 172.21.15.100:0/485807489 conn(0x7f5be40fd370 msgr2=0x7f5be40ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- 172.21.15.100:0/485807489 shutdown_connections 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- 172.21.15.100:0/485807489 wait complete. 2024-04-30T23:13:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 Processor -- start 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- start start 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 0x7f5be419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5be4109a40 0x7f5be41a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.456+0000 7f5bec2d9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5be410f6b0 con 0x7f5be4101f30 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bec2d9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5be410f530 con 0x7f5be4109a40 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bec2d9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5be410f830 con 0x7f5be41070e0 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34934/0 (socket says 172.21.15.100:34934) 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 -- 172.21.15.100:0/1063003845 learned_addr learned my addr 172.21.15.100:0/1063003845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5be9874640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 0x7f5be419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 -- 172.21.15.100:0/1063003845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 msgr2=0x7f5be419a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 0x7f5be419a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 -- 172.21.15.100:0/1063003845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5be4109a40 msgr2=0x7f5be41a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5be4109a40 0x7f5be41a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 -- 172.21.15.100:0/1063003845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be41a1e60 con 0x7f5be4101f30 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bea075640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5be002ade0 tx=0x7f5be0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be002f380 con 0x7f5be4101f30 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5be00317c0 con 0x7f5be4101f30 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be41a20f0 con 0x7f5be4101f30 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be002fc60 con 0x7f5be4101f30 2024-04-30T23:13:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.457+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be41a2640 con 0x7f5be4101f30 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.458+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be40fee90 con 0x7f5be4101f30 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.459+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5be0004040 con 0x7f5be4101f30 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.460+0000 7f5bdb7fe640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 0x7f5bd00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.460+0000 7f5be9874640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 0x7f5bd00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.460+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f5be00f1d90 con 0x7f5be4101f30 2024-04-30T23:13:25.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.460+0000 7f5be9874640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 0x7f5bd00a6260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5be419b3c0 tx=0x7f5bd4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.465+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5be00be410 con 0x7f5be4101f30 2024-04-30T23:13:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.643+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5be402ddb0 con 0x7f5be4101f30 2024-04-30T23:13:25.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.645+0000 7f5bdb7fe640 1 -- 172.21.15.100:0/1063003845 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7f5be00bdd10 con 0x7f5be4101f30 2024-04-30T23:13:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:25.645 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 msgr2=0x7f5bd00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 0x7f5bd00a6260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5be419b3c0 tx=0x7f5bd4005f90 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 msgr2=0x7f5be419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5be002ade0 tx=0x7f5be0003ba0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 shutdown_connections 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5bd00a3d50 0x7f5bd00a6260 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5be4109a40 0x7f5be41a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be41070e0 0x7f5be419a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 --2- 172.21.15.100:0/1063003845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be4101f30 0x7f5be419a320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 >> 172.21.15.100:0/1063003845 conn(0x7f5be40fd370 msgr2=0x7f5be4105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 shutdown_connections 2024-04-30T23:13:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.647+0000 7f5bec2d9640 1 -- 172.21.15.100:0/1063003845 wait complete. 2024-04-30T23:13:25.659 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:13:25.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- 172.21.15.100:0/1169335072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30981050d0 msgr2=0x7f30981054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- 172.21.15.100:0/1169335072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30981050d0 0x7f30981054e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3090009900 tx=0x7f309002a410 comp rx=0 tx=0).stop 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- 172.21.15.100:0/1169335072 shutdown_connections 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- 172.21.15.100:0/1169335072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3098102280 0x7f309810bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- 172.21.15.100:0/1169335072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098101780 0x7f3098101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- 172.21.15.100:0/1169335072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30981050d0 0x7f30981054e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- 172.21.15.100:0/1169335072 >> 172.21.15.100:0/1169335072 conn(0x7f30980fd380 msgr2=0x7f30980ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- 172.21.15.100:0/1169335072 shutdown_connections 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- 172.21.15.100:0/1169335072 wait complete. 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 Processor -- start 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 -- start start 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 0x7f309819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.775+0000 7f309edee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30981050d0 0x7f30981a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309edee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f309810f640 con 0x7f3098101780 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309edee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f309810f4c0 con 0x7f30981050d0 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309edee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f309810f7c0 con 0x7f3098102280 2024-04-30T23:13:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34962/0 (socket says 172.21.15.100:34962) 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 -- 172.21.15.100:0/2264490945 learned_addr learned my addr 172.21.15.100:0/2264490945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f3097fff640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 0x7f309819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309d38b640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30981050d0 0x7f30981a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 -- 172.21.15.100:0/2264490945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 msgr2=0x7f309819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 0x7f309819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 -- 172.21.15.100:0/2264490945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30981050d0 msgr2=0x7f30981a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30981050d0 0x7f30981a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 -- 172.21.15.100:0/2264490945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30981a1d20 con 0x7f3098101780 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f3097fff640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 0x7f309819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309cb8a640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3090006010 tx=0x7f3090031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309003f030 con 0x7f3098101780 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3090003aa0 con 0x7f3098101780 2024-04-30T23:13:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30981a1fb0 con 0x7f3098101780 2024-04-30T23:13:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.776+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090035070 con 0x7f3098101780 2024-04-30T23:13:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.777+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981a23b0 con 0x7f3098101780 2024-04-30T23:13:25.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.777+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3098108a60 con 0x7f3098101780 2024-04-30T23:13:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.779+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3090042030 con 0x7f3098101780 2024-04-30T23:13:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.779+0000 7f3095ffb640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 0x7f30840a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.779+0000 7f3097fff640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 0x7f30840a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.779+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f30900f0db0 con 0x7f3098101780 2024-04-30T23:13:25.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.780+0000 7f3097fff640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 0x7f30840a60c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f309819b330 tx=0x7f3088009400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.784+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f30900bd430 con 0x7f3098101780 2024-04-30T23:13:25.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.961+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3098063810 con 0x7f3098101780 2024-04-30T23:13:25.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.961+0000 7f3095ffb640 1 -- 172.21.15.100:0/2264490945 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f30900bcd30 con 0x7f3098101780 2024-04-30T23:13:25.962 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.963+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 msgr2=0x7f30840a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.963+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 0x7f30840a60c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f309819b330 tx=0x7f3088009400 comp rx=0 tx=0).stop 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.963+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 msgr2=0x7f309819a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.963+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3090006010 tx=0x7f3090031a50 comp rx=0 tx=0).stop 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 shutdown_connections 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f30840a3bb0 0x7f30840a60c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30981050d0 0x7f30981a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3098102280 0x7f309819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 --2- 172.21.15.100:0/2264490945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3098101780 0x7f309819a290 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:25.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 >> 172.21.15.100:0/2264490945 conn(0x7f30980fd380 msgr2=0x7f3098105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:25.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 shutdown_connections 2024-04-30T23:13:25.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:25.964+0000 7f309edee640 1 -- 172.21.15.100:0/2264490945 wait complete. 2024-04-30T23:13:25.974 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3893193110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.974 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/192192034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:25.974 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:25 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1063003845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:25.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:13:26.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3893193110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/192192034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:25 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1063003845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3893193110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/192192034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:25 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1063003845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 -- 172.21.15.100:0/56638288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8103c60 msgr2=0x7f10e8104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/56638288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8103c60 0x7f10e8104070 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009900 tx=0x7f10dc02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 -- 172.21.15.100:0/56638288 shutdown_connections 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/56638288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 0x7f10e810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/56638288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8103c60 0x7f10e8104070 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/56638288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8102a20 0x7f10e8103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 -- 172.21.15.100:0/56638288 >> 172.21.15.100:0/56638288 conn(0x7f10e80fdc10 msgr2=0x7f10e81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 -- 172.21.15.100:0/56638288 shutdown_connections 2024-04-30T23:13:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.085+0000 7f10ee2a6640 1 -- 172.21.15.100:0/56638288 wait complete. 2024-04-30T23:13:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 Processor -- start 2024-04-30T23:13:26.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 -- start start 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 0x7f10e819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 0x7f10e81a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e520 con 0x7f10e8102a20 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e3a0 con 0x7f10e8108960 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10ee2a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e6a0 con 0x7f10e8103c60 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34982/0 (socket says 172.21.15.100:34982) 2024-04-30T23:13:26.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.086+0000 7f10e7fff640 1 -- 172.21.15.100:0/3746156157 learned_addr learned my addr 172.21.15.100:0/3746156157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e77fe640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 0x7f10e819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10ec843640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 0x7f10e81a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 -- 172.21.15.100:0/3746156157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 msgr2=0x7f10e819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 0x7f10e819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 -- 172.21.15.100:0/3746156157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 msgr2=0x7f10e81a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 0x7f10e81a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 -- 172.21.15.100:0/3746156157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e81a1d40 con 0x7f10e8102a20 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e77fe640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 0x7f10e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e7fff640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c970 tx=0x7f10d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8007c70 con 0x7f10e8102a20 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d8007e10 con 0x7f10e8102a20 2024-04-30T23:13:26.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d80187b0 con 0x7f10e8102a20 2024-04-30T23:13:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e81a1fd0 con 0x7f10e8102a20 2024-04-30T23:13:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.087+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81a24e0 con 0x7f10e8102a20 2024-04-30T23:13:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.088+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e81a27a0 con 0x7f10e8102a20 2024-04-30T23:13:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.089+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f10d800fab0 con 0x7f10e8102a20 2024-04-30T23:13:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.090+0000 7f10e57fa640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 0x7f10d00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.090+0000 7f10e77fe640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 0x7f10d00a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.090+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f10d80d0850 con 0x7f10e8102a20 2024-04-30T23:13:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.091+0000 7f10e77fe640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 0x7f10d00a6140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10dc000c00 tx=0x7f10dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.095+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f10d8014030 con 0x7f10e8102a20 2024-04-30T23:13:26.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.272+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f10e81a2a90 con 0x7f10e8102a20 2024-04-30T23:13:26.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.272+0000 7f10e57fa640 1 -- 172.21.15.100:0/3746156157 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f10d809ced0 con 0x7f10e8102a20 2024-04-30T23:13:26.273 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 msgr2=0x7f10d00a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 0x7f10d00a6140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10dc000c00 tx=0x7f10dc031400 comp rx=0 tx=0).stop 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 msgr2=0x7f10e819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c970 tx=0x7f10d800ce30 comp rx=0 tx=0).stop 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 shutdown_connections 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d00a3c30 0x7f10d00a6140 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10e8108960 0x7f10e81a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10e8103c60 0x7f10e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 --2- 172.21.15.100:0/3746156157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10e8102a20 0x7f10e819a300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.274+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 >> 172.21.15.100:0/3746156157 conn(0x7f10e80fdc10 msgr2=0x7f10e8109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.275+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 shutdown_connections 2024-04-30T23:13:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.275+0000 7f10ee2a6640 1 -- 172.21.15.100:0/3746156157 wait complete. 2024-04-30T23:13:26.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- 172.21.15.100:0/2255562750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b941050d0 msgr2=0x7f5b941054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 --2- 172.21.15.100:0/2255562750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b941050d0 0x7f5b941054e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009ca0 tx=0x7f5b8402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- 172.21.15.100:0/2255562750 shutdown_connections 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 --2- 172.21.15.100:0/2255562750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94102280 0x7f5b9410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 --2- 172.21.15.100:0/2255562750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b94101780 0x7f5b94101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 --2- 172.21.15.100:0/2255562750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b941050d0 0x7f5b941054e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- 172.21.15.100:0/2255562750 >> 172.21.15.100:0/2255562750 conn(0x7f5b940fd380 msgr2=0x7f5b940ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- 172.21.15.100:0/2255562750 shutdown_connections 2024-04-30T23:13:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- 172.21.15.100:0/2255562750 wait complete. 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 Processor -- start 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.396+0000 7f5b98de0640 1 -- start start 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94101780 0x7f5b9419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 0x7f5b941a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410f620 con 0x7f5b94102280 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410f4a0 con 0x7f5b941050d0 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410f7a0 con 0x7f5b94101780 2024-04-30T23:13:26.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35000/0 (socket says 172.21.15.100:35000) 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 -- 172.21.15.100:0/1956858516 learned_addr learned my addr 172.21.15.100:0/1956858516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b92d9d640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 0x7f5b941a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b9259c640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94101780 0x7f5b9419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 -- 172.21.15.100:0/1956858516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94101780 msgr2=0x7f5b9419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94101780 0x7f5b9419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 -- 172.21.15.100:0/1956858516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 msgr2=0x7f5b941a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 0x7f5b941a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 -- 172.21.15.100:0/1956858516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b941a1e00 con 0x7f5b94102280 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b92d9d640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 0x7f5b941a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b91d9b640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800e9f0 tx=0x7f5b8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800cd80 con 0x7f5b94102280 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b880108e0 con 0x7f5b94102280 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b941a20f0 con 0x7f5b94102280 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88018980 con 0x7f5b94102280 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.397+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b941a2640 con 0x7f5b94102280 2024-04-30T23:13:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.398+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b94108a60 con 0x7f5b94102280 2024-04-30T23:13:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.400+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5b88010430 con 0x7f5b94102280 2024-04-30T23:13:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.400+0000 7f5b837fe640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 0x7f5b7c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.401+0000 7f5b9259c640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 0x7f5b7c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.401+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f5b880d10f0 con 0x7f5b94102280 2024-04-30T23:13:26.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.401+0000 7f5b9259c640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 0x7f5b7c0a6140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5b84000f80 tx=0x7f5b84004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.404+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b8809d710 con 0x7f5b94102280 2024-04-30T23:13:26.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.584+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5b9402db90 con 0x7f5b94102280 2024-04-30T23:13:26.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.585+0000 7f5b837fe640 1 -- 172.21.15.100:0/1956858516 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f5b8809d010 con 0x7f5b94102280 2024-04-30T23:13:26.585 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 msgr2=0x7f5b7c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 0x7f5b7c0a6140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5b84000f80 tx=0x7f5b84004a40 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 msgr2=0x7f5b9419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800e9f0 tx=0x7f5b8800eeb0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 shutdown_connections 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f5b7c0a3c30 0x7f5b7c0a6140 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b941050d0 0x7f5b941a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b94102280 0x7f5b9419a800 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.586+0000 7f5b98de0640 1 --2- 172.21.15.100:0/1956858516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b94101780 0x7f5b9419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.587+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 >> 172.21.15.100:0/1956858516 conn(0x7f5b940fd380 msgr2=0x7f5b94105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.587+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 shutdown_connections 2024-04-30T23:13:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.587+0000 7f5b98de0640 1 -- 172.21.15.100:0/1956858516 wait complete. 2024-04-30T23:13:26.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 -- 172.21.15.100:0/2181626287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248108110 msgr2=0x7f524810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 --2- 172.21.15.100:0/2181626287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248108110 0x7f524810a530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ca0 tx=0x7f524002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 -- 172.21.15.100:0/2181626287 shutdown_connections 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 --2- 172.21.15.100:0/2181626287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248108110 0x7f524810a530 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 --2- 172.21.15.100:0/2181626287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5248103410 0x7f5248103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 --2- 172.21.15.100:0/2181626287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52481021d0 0x7f5248102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.708+0000 7f52502af640 1 -- 172.21.15.100:0/2181626287 >> 172.21.15.100:0/2181626287 conn(0x7f52480fd3c0 msgr2=0x7f52480ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- 172.21.15.100:0/2181626287 shutdown_connections 2024-04-30T23:13:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- 172.21.15.100:0/2181626287 wait complete. 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 Processor -- start 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- start start 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52481021d0 0x7f524819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 0x7f52481a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f524810f670 con 0x7f5248103410 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f524810f4f0 con 0x7f5248108110 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f52502af640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f524810f7f0 con 0x7f52481021d0 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f524d84a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f524d84a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35022/0 (socket says 172.21.15.100:35022) 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.709+0000 7f524d84a640 1 -- 172.21.15.100:0/2547195824 learned_addr learned my addr 172.21.15.100:0/2547195824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524e04b640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52481021d0 0x7f524819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524e84c640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 0x7f52481a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 -- 172.21.15.100:0/2547195824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52481021d0 msgr2=0x7f524819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52481021d0 0x7f524819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 -- 172.21.15.100:0/2547195824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 msgr2=0x7f52481a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 0x7f52481a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 -- 172.21.15.100:0/2547195824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52481a1bf0 con 0x7f5248103410 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524e84c640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 0x7f52481a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f524d84a640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f523800c920 tx=0x7f523800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238007c70 con 0x7f5248103410 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5238007e10 con 0x7f5248103410 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52481a1ee0 con 0x7f5248103410 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238018820 con 0x7f5248103410 2024-04-30T23:13:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.710+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52481a2350 con 0x7f5248103410 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.711+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248106f20 con 0x7f5248103410 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.712+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f523800f450 con 0x7f5248103410 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.713+0000 7f523f7fe640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 0x7f52340a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.713+0000 7f524e04b640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 0x7f52340a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.713+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f52380d0c20 con 0x7f5248103410 2024-04-30T23:13:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.713+0000 7f524e04b640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 0x7f52340a6140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5244005fd0 tx=0x7f5244005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:26.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.717+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5238014030 con 0x7f5248103410 2024-04-30T23:13:26.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.897+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f524802de00 con 0x7f5248103410 2024-04-30T23:13:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.897+0000 7f523f7fe640 1 -- 172.21.15.100:0/2547195824 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f523809d2d0 con 0x7f5248103410 2024-04-30T23:13:26.898 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 msgr2=0x7f52340a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 0x7f52340a6140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5244005fd0 tx=0x7f5244005ce0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 msgr2=0x7f524819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f523800c920 tx=0x7f523800cde0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 shutdown_connections 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52340a3c30 0x7f52340a6140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5248108110 0x7f52481a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5248103410 0x7f524819a6a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 --2- 172.21.15.100:0/2547195824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52481021d0 0x7f524819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 >> 172.21.15.100:0/2547195824 conn(0x7f52480fd3c0 msgr2=0x7f52481040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.899+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 shutdown_connections 2024-04-30T23:13:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:26.900+0000 7f52502af640 1 -- 172.21.15.100:0/2547195824 wait complete. 2024-04-30T23:13:26.910 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:26 smithi100 ceph-mon[29745]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:13:26.910 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2264490945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.910 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3746156157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.910 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:26 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1956858516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:26.911 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-30T23:13:26.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:13:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 -- 172.21.15.100:0/2229762627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c1098d0 msgr2=0x7f435c10bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 --2- 172.21.15.100:0/2229762627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c1098d0 0x7f435c10bcf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4354009ca0 tx=0x7f435402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 -- 172.21.15.100:0/2229762627 shutdown_connections 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 --2- 172.21.15.100:0/2229762627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c1098d0 0x7f435c10bcf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 --2- 172.21.15.100:0/2229762627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c106f70 0x7f435c109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 --2- 172.21.15.100:0/2229762627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c104610 0x7f435c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 -- 172.21.15.100:0/2229762627 >> 172.21.15.100:0/2229762627 conn(0x7f435c0fdc10 msgr2=0x7f435c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 -- 172.21.15.100:0/2229762627 shutdown_connections 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 -- 172.21.15.100:0/2229762627 wait complete. 2024-04-30T23:13:27.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.020+0000 7f436175e640 1 Processor -- start 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 -- start start 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c104610 0x7f435c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c1098d0 0x7f435c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10f630 con 0x7f435c106f70 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10f4b0 con 0x7f435c104610 2024-04-30T23:13:27.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f436175e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10f7b0 con 0x7f435c1098d0 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35052/0 (socket says 172.21.15.100:35052) 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 -- 172.21.15.100:0/587099303 learned_addr learned my addr 172.21.15.100:0/587099303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435b7fe640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c1098d0 0x7f435c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435affd640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c104610 0x7f435c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 -- 172.21.15.100:0/587099303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c1098d0 msgr2=0x7f435c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c1098d0 0x7f435c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 -- 172.21.15.100:0/587099303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c104610 msgr2=0x7f435c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c104610 0x7f435c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 -- 172.21.15.100:0/587099303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c1a1d50 con 0x7f435c106f70 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.021+0000 7f435a7fc640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f435000d950 tx=0x7f435000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.022+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350017070 con 0x7f435c106f70 2024-04-30T23:13:27.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.022+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4350009c30 con 0x7f435c106f70 2024-04-30T23:13:27.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.022+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c1a1fe0 con 0x7f435c106f70 2024-04-30T23:13:27.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.022+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000f620 con 0x7f435c106f70 2024-04-30T23:13:27.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.022+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1a24d0 con 0x7f435c106f70 2024-04-30T23:13:27.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.023+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c06a1d0 con 0x7f435c106f70 2024-04-30T23:13:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.024+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4350010460 con 0x7f435c106f70 2024-04-30T23:13:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.024+0000 7f4343fff640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 0x7f43440a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.024+0000 7f435affd640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 0x7f43440a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.025+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f43500d0330 con 0x7f435c106f70 2024-04-30T23:13:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.025+0000 7f435affd640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 0x7f43440a60c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f434c005d00 tx=0x7f434c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.029+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f435009ca50 con 0x7f435c106f70 2024-04-30T23:13:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:26 smithi104 ceph-mon[32987]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:13:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2264490945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3746156157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:26 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1956858516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:26 smithi183 ceph-mon[33560]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-30T23:13:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2264490945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3746156157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:26 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1956858516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.249+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f435c02dc30 con 0x7f435c106f70 2024-04-30T23:13:27.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.250+0000 7f4343fff640 1 -- 172.21.15.100:0/587099303 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f435c02dc30 con 0x7f435c106f70 2024-04-30T23:13:27.250 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:27.250 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:13:23.708732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[24503,24496,24545,14664,24511]},"id":1}]} 2024-04-30T23:13:27.250 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 msgr2=0x7f43440a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 0x7f43440a60c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f434c005d00 tx=0x7f434c005c50 comp rx=0 tx=0).stop 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 msgr2=0x7f435c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f435000d950 tx=0x7f435000de10 comp rx=0 tx=0).stop 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 shutdown_connections 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f43440a3bb0 0x7f43440a60c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c1098d0 0x7f435c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c106f70 0x7f435c19a750 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 --2- 172.21.15.100:0/587099303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c104610 0x7f435c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.251+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 >> 172.21.15.100:0/587099303 conn(0x7f435c0fdc10 msgr2=0x7f435c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.252+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 shutdown_connections 2024-04-30T23:13:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.252+0000 7f436175e640 1 -- 172.21.15.100:0/587099303 wait complete. 2024-04-30T23:13:27.264 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-30T23:13:27.264 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-30T23:13:27.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T23:13:27.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.371+0000 7f1952976640 1 -- 172.21.15.100:0/369185821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c104d90 msgr2=0x7f194c1051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.371+0000 7f1952976640 1 --2- 172.21.15.100:0/369185821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c104d90 0x7f194c1051a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1940009900 tx=0x7f194002a410 comp rx=0 tx=0).stop 2024-04-30T23:13:27.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.371+0000 7f1952976640 1 -- 172.21.15.100:0/369185821 shutdown_connections 2024-04-30T23:13:27.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.371+0000 7f1952976640 1 --2- 172.21.15.100:0/369185821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c10beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 --2- 172.21.15.100:0/369185821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c104d90 0x7f194c1051a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 --2- 172.21.15.100:0/369185821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c103b50 0x7f194c104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 -- 172.21.15.100:0/369185821 >> 172.21.15.100:0/369185821 conn(0x7f194c0fed80 msgr2=0x7f194c1011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 -- 172.21.15.100:0/369185821 shutdown_connections 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 -- 172.21.15.100:0/369185821 wait complete. 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 Processor -- start 2024-04-30T23:13:27.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 -- start start 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.372+0000 7f1952976640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 0x7f194c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f194c10f680 con 0x7f194c103b50 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f194c10f500 con 0x7f194c104d90 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f194c10f800 con 0x7f194c109a90 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35080/0 (socket says 172.21.15.100:35080) 2024-04-30T23:13:27.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 -- 172.21.15.100:0/3014366271 learned_addr learned my addr 172.21.15.100:0/3014366271 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1950f13640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194b7fe640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 0x7f194c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 -- 172.21.15.100:0/3014366271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 msgr2=0x7f194c1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c1a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 -- 172.21.15.100:0/3014366271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 msgr2=0x7f194c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 0x7f194c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 -- 172.21.15.100:0/3014366271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c1a1dc0 con 0x7f194c103b50 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1950f13640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194b7fe640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 0x7f194c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f194bfff640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f193c005fd0 tx=0x7f193c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c017070 con 0x7f194c103b50 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f193c009c30 con 0x7f194c103b50 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c003d10 con 0x7f194c103b50 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c1a20b0 con 0x7f194c103b50 2024-04-30T23:13:27.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.373+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1a2600 con 0x7f194c103b50 2024-04-30T23:13:27.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.374+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c1088a0 con 0x7f194c103b50 2024-04-30T23:13:27.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.375+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f193c003eb0 con 0x7f194c103b50 2024-04-30T23:13:27.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.376+0000 7f19497fa640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 0x7f19340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.376+0000 7f194b7fe640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 0x7f19340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.376+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f193c0d0510 con 0x7f194c103b50 2024-04-30T23:13:27.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.376+0000 7f194b7fe640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 0x7f19340a60c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1940006010 tx=0x7f1940000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.381+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f193c020030 con 0x7f194c103b50 2024-04-30T23:13:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.557+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f194c063020 con 0x7f19340a3bb0 2024-04-30T23:13:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.566+0000 7f19497fa640 1 -- 172.21.15.100:0/3014366271 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340527 (secure 0 0 0) 0x7f194c063020 con 0x7f19340a3bb0 2024-04-30T23:13:27.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:27.573 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:13:27.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.569+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 msgr2=0x7f19340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.569+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 0x7f19340a60c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1940006010 tx=0x7f1940000bc0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.569+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 msgr2=0x7f194c19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.569+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f193c005fd0 tx=0x7f193c00dde0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 shutdown_connections 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f19340a3bb0 0x7f19340a60c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f194c109a90 0x7f194c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f194c104d90 0x7f194c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 --2- 172.21.15.100:0/3014366271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c103b50 0x7f194c19a280 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 >> 172.21.15.100:0/3014366271 conn(0x7f194c0fed80 msgr2=0x7f194c105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 shutdown_connections 2024-04-30T23:13:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.570+0000 7f1952976640 1 -- 172.21.15.100:0/3014366271 wait complete. 2024-04-30T23:13:27.581 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-04-30T23:13:25.621085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666132,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1344,"num_read_kb":803,"num_write":443,"num_write_kb":3101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388808,"kb_used_data":14632,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553016,"statfs":{"total":1151940427776,"available":1151542288384,"internally_reserved":0,"allocated":14983168,"data_stored":8197028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":77,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003142"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699516+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:12:57.699516+0000","last_peered":"2024-04-30T23:12:57.699516+0000","last_clean":"2024-04-30T23:12:57.699516+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:12:57.699516+0000","last_undegraded":"2024-04-30T23:12:57.699516+0000","last_fullsized":"2024-04-30T23:12:57.699516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688315+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:12:57.688315+0000","last_peered":"2024-04-30T23:12:57.688315+0000","last_clean":"2024-04-30T23:12:57.688315+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:12:57.688315+0000","last_undegraded":"2024-04-30T23:12:57.688315+0000","last_fullsized":"2024-04-30T23:12:57.688315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688146+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:12:57.688146+0000","last_peered":"2024-04-30T23:12:57.688146+0000","last_clean":"2024-04-30T23:12:57.688146+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:12:57.688146+0000","last_undegraded":"2024-04-30T23:12:57.688146+0000","last_fullsized":"2024-04-30T23:12:57.688146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682397+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:12:57.682397+0000","last_peered":"2024-04-30T23:12:57.682397+0000","last_clean":"2024-04-30T23:12:57.682397+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:12:57.682397+0000","last_undegraded":"2024-04-30T23:12:57.682397+0000","last_fullsized":"2024-04-30T23:12:57.682397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045627+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:12:58.045627+0000","last_peered":"2024-04-30T23:12:58.045627+0000","last_clean":"2024-04-30T23:12:58.045627+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:12:58.045627+0000","last_undegraded":"2024-04-30T23:12:58.045627+0000","last_fullsized":"2024-04-30T23:12:58.045627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046492+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:12:58.046492+0000","last_peered":"2024-04-30T23:12:58.046492+0000","last_clean":"2024-04-30T23:12:58.046492+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:12:58.046492+0000","last_undegraded":"2024-04-30T23:12:58.046492+0000","last_fullsized":"2024-04-30T23:12:58.046492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045640+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:12:58.045640+0000","last_peered":"2024-04-30T23:12:58.045640+0000","last_clean":"2024-04-30T23:12:58.045640+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:12:58.045640+0000","last_undegraded":"2024-04-30T23:12:58.045640+0000","last_fullsized":"2024-04-30T23:12:58.045640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045267+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:12:58.045267+0000","last_peered":"2024-04-30T23:12:58.045267+0000","last_clean":"2024-04-30T23:12:58.045267+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:12:58.045267+0000","last_undegraded":"2024-04-30T23:12:58.045267+0000","last_fullsized":"2024-04-30T23:12:58.045267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686404+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:12:57.686404+0000","last_peered":"2024-04-30T23:12:57.686404+0000","last_clean":"2024-04-30T23:12:57.686404+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:12:57.686404+0000","last_undegraded":"2024-04-30T23:12:57.686404+0000","last_fullsized":"2024-04-30T23:12:57.686404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046149+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:12:58.046149+0000","last_peered":"2024-04-30T23:12:58.046149+0000","last_clean":"2024-04-30T23:12:58.046149+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:12:58.046149+0000","last_undegraded":"2024-04-30T23:12:58.046149+0000","last_fullsized":"2024-04-30T23:12:58.046149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046354+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:12:58.046354+0000","last_peered":"2024-04-30T23:12:58.046354+0000","last_clean":"2024-04-30T23:12:58.046354+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:12:58.046354+0000","last_undegraded":"2024-04-30T23:12:58.046354+0000","last_fullsized":"2024-04-30T23:12:58.046354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682264+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:12:57.682264+0000","last_peered":"2024-04-30T23:12:57.682264+0000","last_clean":"2024-04-30T23:12:57.682264+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:12:57.682264+0000","last_undegraded":"2024-04-30T23:12:57.682264+0000","last_fullsized":"2024-04-30T23:12:57.682264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682053+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:12:57.682053+0000","last_peered":"2024-04-30T23:12:57.682053+0000","last_clean":"2024-04-30T23:12:57.682053+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:12:57.682053+0000","last_undegraded":"2024-04-30T23:12:57.682053+0000","last_fullsized":"2024-04-30T23:12:57.682053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687998+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:12:57.687998+0000","last_peered":"2024-04-30T23:12:57.687998+0000","last_clean":"2024-04-30T23:12:57.687998+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:12:57.687998+0000","last_undegraded":"2024-04-30T23:12:57.687998+0000","last_fullsized":"2024-04-30T23:12:57.687998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687919+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:12:57.687919+0000","last_peered":"2024-04-30T23:12:57.687919+0000","last_clean":"2024-04-30T23:12:57.687919+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:12:57.687919+0000","last_undegraded":"2024-04-30T23:12:57.687919+0000","last_fullsized":"2024-04-30T23:12:57.687919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685928+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:12:57.685928+0000","last_peered":"2024-04-30T23:12:57.685928+0000","last_clean":"2024-04-30T23:12:57.685928+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:12:57.685928+0000","last_undegraded":"2024-04-30T23:12:57.685928+0000","last_fullsized":"2024-04-30T23:12:57.685928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699367+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:12:57.699367+0000","last_peered":"2024-04-30T23:12:57.699367+0000","last_clean":"2024-04-30T23:12:57.699367+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:12:57.699367+0000","last_undegraded":"2024-04-30T23:12:57.699367+0000","last_fullsized":"2024-04-30T23:12:57.699367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688651+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:12:57.688651+0000","last_peered":"2024-04-30T23:12:57.688651+0000","last_clean":"2024-04-30T23:12:57.688651+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:12:57.688651+0000","last_undegraded":"2024-04-30T23:12:57.688651+0000","last_fullsized":"2024-04-30T23:12:57.688651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688341+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:12:57.688341+0000","last_peered":"2024-04-30T23:12:57.688341+0000","last_clean":"2024-04-30T23:12:57.688341+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:12:57.688341+0000","last_undegraded":"2024-04-30T23:12:57.688341+0000","last_fullsized":"2024-04-30T23:12:57.688341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.086367+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:13:22.086367+0000","last_peered":"2024-04-30T23:13:22.086367+0000","last_clean":"2024-04-30T23:13:22.086367+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:13:22.086367+0000","last_undegraded":"2024-04-30T23:13:22.086367+0000","last_fullsized":"2024-04-30T23:13:22.086367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045532+0000","last_change":"2024-04-30T23:11:56.961809+0000","last_active":"2024-04-30T23:12:58.045532+0000","last_peered":"2024-04-30T23:12:58.045532+0000","last_clean":"2024-04-30T23:12:58.045532+0000","last_became_active":"2024-04-30T23:11:56.961461+0000","last_became_peered":"2024-04-30T23:11:56.961461+0000","last_unstale":"2024-04-30T23:12:58.045532+0000","last_undegraded":"2024-04-30T23:12:58.045532+0000","last_fullsized":"2024-04-30T23:12:58.045532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:41:28.814142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681522+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:12:57.681522+0000","last_peered":"2024-04-30T23:12:57.681522+0000","last_clean":"2024-04-30T23:12:57.681522+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.681522+0000","last_undegraded":"2024-04-30T23:12:57.681522+0000","last_fullsized":"2024-04-30T23:12:57.681522+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046014+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:12:58.046014+0000","last_peered":"2024-04-30T23:12:58.046014+0000","last_clean":"2024-04-30T23:12:58.046014+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:12:58.046014+0000","last_undegraded":"2024-04-30T23:12:58.046014+0000","last_fullsized":"2024-04-30T23:12:58.046014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681734+0000","last_change":"2024-04-30T23:11:56.961194+0000","last_active":"2024-04-30T23:12:57.681734+0000","last_peered":"2024-04-30T23:12:57.681734+0000","last_clean":"2024-04-30T23:12:57.681734+0000","last_became_active":"2024-04-30T23:11:56.960793+0000","last_became_peered":"2024-04-30T23:11:56.960793+0000","last_unstale":"2024-04-30T23:12:57.681734+0000","last_undegraded":"2024-04-30T23:12:57.681734+0000","last_fullsized":"2024-04-30T23:12:57.681734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:44:07.845730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046051+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:12:58.046051+0000","last_peered":"2024-04-30T23:12:58.046051+0000","last_clean":"2024-04-30T23:12:58.046051+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:12:58.046051+0000","last_undegraded":"2024-04-30T23:12:58.046051+0000","last_fullsized":"2024-04-30T23:12:58.046051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686032+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:12:57.686032+0000","last_peered":"2024-04-30T23:12:57.686032+0000","last_clean":"2024-04-30T23:12:57.686032+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:12:57.686032+0000","last_undegraded":"2024-04-30T23:12:57.686032+0000","last_fullsized":"2024-04-30T23:12:57.686032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681585+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:12:57.681585+0000","last_peered":"2024-04-30T23:12:57.681585+0000","last_clean":"2024-04-30T23:12:57.681585+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:12:57.681585+0000","last_undegraded":"2024-04-30T23:12:57.681585+0000","last_fullsized":"2024-04-30T23:12:57.681585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045594+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:12:58.045594+0000","last_peered":"2024-04-30T23:12:58.045594+0000","last_clean":"2024-04-30T23:12:58.045594+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:12:58.045594+0000","last_undegraded":"2024-04-30T23:12:58.045594+0000","last_fullsized":"2024-04-30T23:12:58.045594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681638+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:12:57.681638+0000","last_peered":"2024-04-30T23:12:57.681638+0000","last_clean":"2024-04-30T23:12:57.681638+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:12:57.681638+0000","last_undegraded":"2024-04-30T23:12:57.681638+0000","last_fullsized":"2024-04-30T23:12:57.681638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688419+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:12:57.688419+0000","last_peered":"2024-04-30T23:12:57.688419+0000","last_clean":"2024-04-30T23:12:57.688419+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:12:57.688419+0000","last_undegraded":"2024-04-30T23:12:57.688419+0000","last_fullsized":"2024-04-30T23:12:57.688419+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.090455+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:13:22.090455+0000","last_peered":"2024-04-30T23:13:22.090455+0000","last_clean":"2024-04-30T23:13:22.090455+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:13:22.090455+0000","last_undegraded":"2024-04-30T23:13:22.090455+0000","last_fullsized":"2024-04-30T23:13:22.090455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045498+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:12:58.045498+0000","last_peered":"2024-04-30T23:12:58.045498+0000","last_clean":"2024-04-30T23:12:58.045498+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:12:58.045498+0000","last_undegraded":"2024-04-30T23:12:58.045498+0000","last_fullsized":"2024-04-30T23:12:58.045498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688386+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:12:57.688386+0000","last_peered":"2024-04-30T23:12:57.688386+0000","last_clean":"2024-04-30T23:12:57.688386+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:12:57.688386+0000","last_undegraded":"2024-04-30T23:12:57.688386+0000","last_fullsized":"2024-04-30T23:12:57.688386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045390+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:12:58.045390+0000","last_peered":"2024-04-30T23:12:58.045390+0000","last_clean":"2024-04-30T23:12:58.045390+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:12:58.045390+0000","last_undegraded":"2024-04-30T23:12:58.045390+0000","last_fullsized":"2024-04-30T23:12:58.045390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045470+0000","last_change":"2024-04-30T23:11:56.786296+0000","last_active":"2024-04-30T23:12:58.045470+0000","last_peered":"2024-04-30T23:12:58.045470+0000","last_clean":"2024-04-30T23:12:58.045470+0000","last_became_active":"2024-04-30T23:11:56.785834+0000","last_became_peered":"2024-04-30T23:11:56.785834+0000","last_unstale":"2024-04-30T23:12:58.045470+0000","last_undegraded":"2024-04-30T23:12:58.045470+0000","last_fullsized":"2024-04-30T23:12:58.045470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:33.908301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699277+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:12:57.699277+0000","last_peered":"2024-04-30T23:12:57.699277+0000","last_clean":"2024-04-30T23:12:57.699277+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:12:57.699277+0000","last_undegraded":"2024-04-30T23:12:57.699277+0000","last_fullsized":"2024-04-30T23:12:57.699277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681801+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:12:57.681801+0000","last_peered":"2024-04-30T23:12:57.681801+0000","last_clean":"2024-04-30T23:12:57.681801+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:12:57.681801+0000","last_undegraded":"2024-04-30T23:12:57.681801+0000","last_fullsized":"2024-04-30T23:12:57.681801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045153+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:12:58.045153+0000","last_peered":"2024-04-30T23:12:58.045153+0000","last_clean":"2024-04-30T23:12:58.045153+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:12:58.045153+0000","last_undegraded":"2024-04-30T23:12:58.045153+0000","last_fullsized":"2024-04-30T23:12:58.045153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688223+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:12:57.688223+0000","last_peered":"2024-04-30T23:12:57.688223+0000","last_clean":"2024-04-30T23:12:57.688223+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:12:57.688223+0000","last_undegraded":"2024-04-30T23:12:57.688223+0000","last_fullsized":"2024-04-30T23:12:57.688223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681066+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:12:57.681066+0000","last_peered":"2024-04-30T23:12:57.681066+0000","last_clean":"2024-04-30T23:12:57.681066+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:12:57.681066+0000","last_undegraded":"2024-04-30T23:12:57.681066+0000","last_fullsized":"2024-04-30T23:12:57.681066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046188+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:12:58.046188+0000","last_peered":"2024-04-30T23:12:58.046188+0000","last_clean":"2024-04-30T23:12:58.046188+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:12:58.046188+0000","last_undegraded":"2024-04-30T23:12:58.046188+0000","last_fullsized":"2024-04-30T23:12:58.046188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045179+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:12:58.045179+0000","last_peered":"2024-04-30T23:12:58.045179+0000","last_clean":"2024-04-30T23:12:58.045179+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:12:58.045179+0000","last_undegraded":"2024-04-30T23:12:58.045179+0000","last_fullsized":"2024-04-30T23:12:58.045179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'7","reported_seq":274,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.093589+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:13:24.093589+0000","last_peered":"2024-04-30T23:13:24.093589+0000","last_clean":"2024-04-30T23:13:24.093589+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:13:24.093589+0000","last_undegraded":"2024-04-30T23:13:24.093589+0000","last_fullsized":"2024-04-30T23:13:24.093589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686422+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:12:57.686422+0000","last_peered":"2024-04-30T23:12:57.686422+0000","last_clean":"2024-04-30T23:12:57.686422+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:12:57.686422+0000","last_undegraded":"2024-04-30T23:12:57.686422+0000","last_fullsized":"2024-04-30T23:12:57.686422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045193+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:12:58.045193+0000","last_peered":"2024-04-30T23:12:58.045193+0000","last_clean":"2024-04-30T23:12:58.045193+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:12:58.045193+0000","last_undegraded":"2024-04-30T23:12:58.045193+0000","last_fullsized":"2024-04-30T23:12:58.045193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045756+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:12:58.045756+0000","last_peered":"2024-04-30T23:12:58.045756+0000","last_clean":"2024-04-30T23:12:58.045756+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:12:58.045756+0000","last_undegraded":"2024-04-30T23:12:58.045756+0000","last_fullsized":"2024-04-30T23:12:58.045756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688406+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:12:57.688406+0000","last_peered":"2024-04-30T23:12:57.688406+0000","last_clean":"2024-04-30T23:12:57.688406+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:12:57.688406+0000","last_undegraded":"2024-04-30T23:12:57.688406+0000","last_fullsized":"2024-04-30T23:12:57.688406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681974+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:12:57.681974+0000","last_peered":"2024-04-30T23:12:57.681974+0000","last_clean":"2024-04-30T23:12:57.681974+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:12:57.681974+0000","last_undegraded":"2024-04-30T23:12:57.681974+0000","last_fullsized":"2024-04-30T23:12:57.681974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681399+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:12:57.681399+0000","last_peered":"2024-04-30T23:12:57.681399+0000","last_clean":"2024-04-30T23:12:57.681399+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:12:57.681399+0000","last_undegraded":"2024-04-30T23:12:57.681399+0000","last_fullsized":"2024-04-30T23:12:57.681399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686301+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:12:57.686301+0000","last_peered":"2024-04-30T23:12:57.686301+0000","last_clean":"2024-04-30T23:12:57.686301+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:12:57.686301+0000","last_undegraded":"2024-04-30T23:12:57.686301+0000","last_fullsized":"2024-04-30T23:12:57.686301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045329+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:12:58.045329+0000","last_peered":"2024-04-30T23:12:58.045329+0000","last_clean":"2024-04-30T23:12:58.045329+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:12:58.045329+0000","last_undegraded":"2024-04-30T23:12:58.045329+0000","last_fullsized":"2024-04-30T23:12:58.045329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'42","reported_seq":321,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094084+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:13:24.094084+0000","last_peered":"2024-04-30T23:13:24.094084+0000","last_clean":"2024-04-30T23:13:24.094084+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:13:24.094084+0000","last_undegraded":"2024-04-30T23:13:24.094084+0000","last_fullsized":"2024-04-30T23:13:24.094084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":248,"num_read_kb":191,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045873+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:12:58.045873+0000","last_peered":"2024-04-30T23:12:58.045873+0000","last_clean":"2024-04-30T23:12:58.045873+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:12:58.045873+0000","last_undegraded":"2024-04-30T23:12:58.045873+0000","last_fullsized":"2024-04-30T23:12:58.045873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681824+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:12:57.681824+0000","last_peered":"2024-04-30T23:12:57.681824+0000","last_clean":"2024-04-30T23:12:57.681824+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:12:57.681824+0000","last_undegraded":"2024-04-30T23:12:57.681824+0000","last_fullsized":"2024-04-30T23:12:57.681824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688773+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:12:57.688773+0000","last_peered":"2024-04-30T23:12:57.688773+0000","last_clean":"2024-04-30T23:12:57.688773+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:12:57.688773+0000","last_undegraded":"2024-04-30T23:12:57.688773+0000","last_fullsized":"2024-04-30T23:12:57.688773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681944+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:12:57.681944+0000","last_peered":"2024-04-30T23:12:57.681944+0000","last_clean":"2024-04-30T23:12:57.681944+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:12:57.681944+0000","last_undegraded":"2024-04-30T23:12:57.681944+0000","last_fullsized":"2024-04-30T23:12:57.681944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.698970+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:12:57.698970+0000","last_peered":"2024-04-30T23:12:57.698970+0000","last_clean":"2024-04-30T23:12:57.698970+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:12:57.698970+0000","last_undegraded":"2024-04-30T23:12:57.698970+0000","last_fullsized":"2024-04-30T23:12:57.698970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681556+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:12:57.681556+0000","last_peered":"2024-04-30T23:12:57.681556+0000","last_clean":"2024-04-30T23:12:57.681556+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:12:57.681556+0000","last_undegraded":"2024-04-30T23:12:57.681556+0000","last_fullsized":"2024-04-30T23:12:57.681556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046162+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:12:58.046162+0000","last_peered":"2024-04-30T23:12:58.046162+0000","last_clean":"2024-04-30T23:12:58.046162+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:12:58.046162+0000","last_undegraded":"2024-04-30T23:12:58.046162+0000","last_fullsized":"2024-04-30T23:12:58.046162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045314+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:12:58.045314+0000","last_peered":"2024-04-30T23:12:58.045314+0000","last_clean":"2024-04-30T23:12:58.045314+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:12:58.045314+0000","last_undegraded":"2024-04-30T23:12:58.045314+0000","last_fullsized":"2024-04-30T23:12:58.045314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:23.088487+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:13:23.088487+0000","last_peered":"2024-04-30T23:13:23.088487+0000","last_clean":"2024-04-30T23:13:23.088487+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:13:23.088487+0000","last_undegraded":"2024-04-30T23:13:23.088487+0000","last_fullsized":"2024-04-30T23:13:23.088487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045542+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:12:58.045542+0000","last_peered":"2024-04-30T23:12:58.045542+0000","last_clean":"2024-04-30T23:12:58.045542+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:12:58.045542+0000","last_undegraded":"2024-04-30T23:12:58.045542+0000","last_fullsized":"2024-04-30T23:12:58.045542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682329+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:12:57.682329+0000","last_peered":"2024-04-30T23:12:57.682329+0000","last_clean":"2024-04-30T23:12:57.682329+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:12:57.682329+0000","last_undegraded":"2024-04-30T23:12:57.682329+0000","last_fullsized":"2024-04-30T23:12:57.682329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045428+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:12:58.045428+0000","last_peered":"2024-04-30T23:12:58.045428+0000","last_clean":"2024-04-30T23:12:58.045428+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:12:58.045428+0000","last_undegraded":"2024-04-30T23:12:58.045428+0000","last_fullsized":"2024-04-30T23:12:58.045428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681130+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:12:57.681130+0000","last_peered":"2024-04-30T23:12:57.681130+0000","last_clean":"2024-04-30T23:12:57.681130+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:12:57.681130+0000","last_undegraded":"2024-04-30T23:12:57.681130+0000","last_fullsized":"2024-04-30T23:12:57.681130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681209+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:12:57.681209+0000","last_peered":"2024-04-30T23:12:57.681209+0000","last_clean":"2024-04-30T23:12:57.681209+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:12:57.681209+0000","last_undegraded":"2024-04-30T23:12:57.681209+0000","last_fullsized":"2024-04-30T23:12:57.681209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046114+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:12:58.046114+0000","last_peered":"2024-04-30T23:12:58.046114+0000","last_clean":"2024-04-30T23:12:58.046114+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:12:58.046114+0000","last_undegraded":"2024-04-30T23:12:58.046114+0000","last_fullsized":"2024-04-30T23:12:58.046114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699284+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:12:57.699284+0000","last_peered":"2024-04-30T23:12:57.699284+0000","last_clean":"2024-04-30T23:12:57.699284+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:12:57.699284+0000","last_undegraded":"2024-04-30T23:12:57.699284+0000","last_fullsized":"2024-04-30T23:12:57.699284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045535+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:12:58.045535+0000","last_peered":"2024-04-30T23:12:58.045535+0000","last_clean":"2024-04-30T23:12:58.045535+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:12:58.045535+0000","last_undegraded":"2024-04-30T23:12:58.045535+0000","last_fullsized":"2024-04-30T23:12:58.045535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046015+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:12:58.046015+0000","last_peered":"2024-04-30T23:12:58.046015+0000","last_clean":"2024-04-30T23:12:58.046015+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:12:58.046015+0000","last_undegraded":"2024-04-30T23:12:58.046015+0000","last_fullsized":"2024-04-30T23:12:58.046015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046160+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:12:58.046160+0000","last_peered":"2024-04-30T23:12:58.046160+0000","last_clean":"2024-04-30T23:12:58.046160+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:12:58.046160+0000","last_undegraded":"2024-04-30T23:12:58.046160+0000","last_fullsized":"2024-04-30T23:12:58.046160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682174+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:12:57.682174+0000","last_peered":"2024-04-30T23:12:57.682174+0000","last_clean":"2024-04-30T23:12:57.682174+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:12:57.682174+0000","last_undegraded":"2024-04-30T23:12:57.682174+0000","last_fullsized":"2024-04-30T23:12:57.682174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:19.083285+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:13:19.083285+0000","last_peered":"2024-04-30T23:13:19.083285+0000","last_clean":"2024-04-30T23:13:19.083285+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:13:19.083285+0000","last_undegraded":"2024-04-30T23:13:19.083285+0000","last_fullsized":"2024-04-30T23:13:19.083285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046295+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:12:58.046295+0000","last_peered":"2024-04-30T23:12:58.046295+0000","last_clean":"2024-04-30T23:12:58.046295+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:12:58.046295+0000","last_undegraded":"2024-04-30T23:12:58.046295+0000","last_fullsized":"2024-04-30T23:12:58.046295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682276+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:12:57.682276+0000","last_peered":"2024-04-30T23:12:57.682276+0000","last_clean":"2024-04-30T23:12:57.682276+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:12:57.682276+0000","last_undegraded":"2024-04-30T23:12:57.682276+0000","last_fullsized":"2024-04-30T23:12:57.682276+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681462+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:12:57.681462+0000","last_peered":"2024-04-30T23:12:57.681462+0000","last_clean":"2024-04-30T23:12:57.681462+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:12:57.681462+0000","last_undegraded":"2024-04-30T23:12:57.681462+0000","last_fullsized":"2024-04-30T23:12:57.681462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:19.083074+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:13:19.083074+0000","last_peered":"2024-04-30T23:13:19.083074+0000","last_clean":"2024-04-30T23:13:19.083074+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:13:19.083074+0000","last_undegraded":"2024-04-30T23:13:19.083074+0000","last_fullsized":"2024-04-30T23:13:19.083074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046090+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:12:58.046090+0000","last_peered":"2024-04-30T23:12:58.046090+0000","last_clean":"2024-04-30T23:12:58.046090+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:12:58.046090+0000","last_undegraded":"2024-04-30T23:12:58.046090+0000","last_fullsized":"2024-04-30T23:12:58.046090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045311+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:12:58.045311+0000","last_peered":"2024-04-30T23:12:58.045311+0000","last_clean":"2024-04-30T23:12:58.045311+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:12:58.045311+0000","last_undegraded":"2024-04-30T23:12:58.045311+0000","last_fullsized":"2024-04-30T23:12:58.045311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681835+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:12:57.681835+0000","last_peered":"2024-04-30T23:12:57.681835+0000","last_clean":"2024-04-30T23:12:57.681835+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:12:57.681835+0000","last_undegraded":"2024-04-30T23:12:57.681835+0000","last_fullsized":"2024-04-30T23:12:57.681835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045312+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:12:58.045312+0000","last_peered":"2024-04-30T23:12:58.045312+0000","last_clean":"2024-04-30T23:12:58.045312+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:12:58.045312+0000","last_undegraded":"2024-04-30T23:12:58.045312+0000","last_fullsized":"2024-04-30T23:12:58.045312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681420+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:12:57.681420+0000","last_peered":"2024-04-30T23:12:57.681420+0000","last_clean":"2024-04-30T23:12:57.681420+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:12:57.681420+0000","last_undegraded":"2024-04-30T23:12:57.681420+0000","last_fullsized":"2024-04-30T23:12:57.681420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681756+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:12:57.681756+0000","last_peered":"2024-04-30T23:12:57.681756+0000","last_clean":"2024-04-30T23:12:57.681756+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:12:57.681756+0000","last_undegraded":"2024-04-30T23:12:57.681756+0000","last_fullsized":"2024-04-30T23:12:57.681756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045539+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:12:58.045539+0000","last_peered":"2024-04-30T23:12:58.045539+0000","last_clean":"2024-04-30T23:12:58.045539+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:12:58.045539+0000","last_undegraded":"2024-04-30T23:12:58.045539+0000","last_fullsized":"2024-04-30T23:12:58.045539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699174+0000","last_change":"2024-04-30T23:11:56.976706+0000","last_active":"2024-04-30T23:12:57.699174+0000","last_peered":"2024-04-30T23:12:57.699174+0000","last_clean":"2024-04-30T23:12:57.699174+0000","last_became_active":"2024-04-30T23:11:56.976251+0000","last_became_peered":"2024-04-30T23:11:56.976251+0000","last_unstale":"2024-04-30T23:12:57.699174+0000","last_undegraded":"2024-04-30T23:12:57.699174+0000","last_fullsized":"2024-04-30T23:12:57.699174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:12.294435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045996+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:12:58.045996+0000","last_peered":"2024-04-30T23:12:58.045996+0000","last_clean":"2024-04-30T23:12:58.045996+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:12:58.045996+0000","last_undegraded":"2024-04-30T23:12:58.045996+0000","last_fullsized":"2024-04-30T23:12:58.045996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682280+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:12:57.682280+0000","last_peered":"2024-04-30T23:12:57.682280+0000","last_clean":"2024-04-30T23:12:57.682280+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:12:57.682280+0000","last_undegraded":"2024-04-30T23:12:57.682280+0000","last_fullsized":"2024-04-30T23:12:57.682280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045091+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:12:58.045091+0000","last_peered":"2024-04-30T23:12:58.045091+0000","last_clean":"2024-04-30T23:12:58.045091+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:12:58.045091+0000","last_undegraded":"2024-04-30T23:12:58.045091+0000","last_fullsized":"2024-04-30T23:12:58.045091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045827+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:12:58.045827+0000","last_peered":"2024-04-30T23:12:58.045827+0000","last_clean":"2024-04-30T23:12:58.045827+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:12:58.045827+0000","last_undegraded":"2024-04-30T23:12:58.045827+0000","last_fullsized":"2024-04-30T23:12:58.045827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045533+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:12:58.045533+0000","last_peered":"2024-04-30T23:12:58.045533+0000","last_clean":"2024-04-30T23:12:58.045533+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:12:58.045533+0000","last_undegraded":"2024-04-30T23:12:58.045533+0000","last_fullsized":"2024-04-30T23:12:58.045533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688124+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:12:57.688124+0000","last_peered":"2024-04-30T23:12:57.688124+0000","last_clean":"2024-04-30T23:12:57.688124+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:12:57.688124+0000","last_undegraded":"2024-04-30T23:12:57.688124+0000","last_fullsized":"2024-04-30T23:12:57.688124+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682207+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:12:57.682207+0000","last_peered":"2024-04-30T23:12:57.682207+0000","last_clean":"2024-04-30T23:12:57.682207+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:12:57.682207+0000","last_undegraded":"2024-04-30T23:12:57.682207+0000","last_fullsized":"2024-04-30T23:12:57.682207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:56.787447+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:56.786482+0000","last_became_peered":"2024-04-30T23:11:56.786482+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:40.441920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682046+0000","last_change":"2024-04-30T23:11:56.962145+0000","last_active":"2024-04-30T23:12:57.682046+0000","last_peered":"2024-04-30T23:12:57.682046+0000","last_clean":"2024-04-30T23:12:57.682046+0000","last_became_active":"2024-04-30T23:11:56.961737+0000","last_became_peered":"2024-04-30T23:11:56.961737+0000","last_unstale":"2024-04-30T23:12:57.682046+0000","last_undegraded":"2024-04-30T23:12:57.682046+0000","last_fullsized":"2024-04-30T23:12:57.682046+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:27:04.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.703317+0000","last_change":"2024-04-30T23:12:57.702862+0000","last_active":"2024-04-30T23:12:57.703317+0000","last_peered":"2024-04-30T23:12:57.703317+0000","last_clean":"2024-04-30T23:12:57.703317+0000","last_became_active":"2024-04-30T23:12:57.700095+0000","last_became_peered":"2024-04-30T23:12:57.700095+0000","last_unstale":"2024-04-30T23:12:57.703317+0000","last_undegraded":"2024-04-30T23:12:57.703317+0000","last_fullsized":"2024-04-30T23:12:57.703317+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:38.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045454+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:12:58.045454+0000","last_peered":"2024-04-30T23:12:58.045454+0000","last_clean":"2024-04-30T23:12:58.045454+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:12:58.045454+0000","last_undegraded":"2024-04-30T23:12:58.045454+0000","last_fullsized":"2024-04-30T23:12:58.045454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046402+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:12:58.046402+0000","last_peered":"2024-04-30T23:12:58.046402+0000","last_clean":"2024-04-30T23:12:58.046402+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:12:58.046402+0000","last_undegraded":"2024-04-30T23:12:58.046402+0000","last_fullsized":"2024-04-30T23:12:58.046402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046094+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:12:58.046094+0000","last_peered":"2024-04-30T23:12:58.046094+0000","last_clean":"2024-04-30T23:12:58.046094+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:12:58.046094+0000","last_undegraded":"2024-04-30T23:12:58.046094+0000","last_fullsized":"2024-04-30T23:12:58.046094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699455+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:12:57.699455+0000","last_peered":"2024-04-30T23:12:57.699455+0000","last_clean":"2024-04-30T23:12:57.699455+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:12:57.699455+0000","last_undegraded":"2024-04-30T23:12:57.699455+0000","last_fullsized":"2024-04-30T23:12:57.699455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681925+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:12:57.681925+0000","last_peered":"2024-04-30T23:12:57.681925+0000","last_clean":"2024-04-30T23:12:57.681925+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:12:57.681925+0000","last_undegraded":"2024-04-30T23:12:57.681925+0000","last_fullsized":"2024-04-30T23:12:57.681925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.698854+0000","last_change":"2024-04-30T23:11:57.132504+0000","last_active":"2024-04-30T23:12:57.698854+0000","last_peered":"2024-04-30T23:12:57.698854+0000","last_clean":"2024-04-30T23:12:57.698854+0000","last_became_active":"2024-04-30T23:11:57.125899+0000","last_became_peered":"2024-04-30T23:11:57.125899+0000","last_unstale":"2024-04-30T23:12:57.698854+0000","last_undegraded":"2024-04-30T23:12:57.698854+0000","last_fullsized":"2024-04-30T23:12:57.698854+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:16.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045931+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:12:58.045931+0000","last_peered":"2024-04-30T23:12:58.045931+0000","last_clean":"2024-04-30T23:12:58.045931+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:12:58.045931+0000","last_undegraded":"2024-04-30T23:12:58.045931+0000","last_fullsized":"2024-04-30T23:12:58.045931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682014+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:12:57.682014+0000","last_peered":"2024-04-30T23:12:57.682014+0000","last_clean":"2024-04-30T23:12:57.682014+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.682014+0000","last_undegraded":"2024-04-30T23:12:57.682014+0000","last_fullsized":"2024-04-30T23:12:57.682014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045667+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:12:58.045667+0000","last_peered":"2024-04-30T23:12:58.045667+0000","last_clean":"2024-04-30T23:12:58.045667+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:12:58.045667+0000","last_undegraded":"2024-04-30T23:12:58.045667+0000","last_fullsized":"2024-04-30T23:12:58.045667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046478+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:12:58.046478+0000","last_peered":"2024-04-30T23:12:58.046478+0000","last_clean":"2024-04-30T23:12:58.046478+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:12:58.046478+0000","last_undegraded":"2024-04-30T23:12:58.046478+0000","last_fullsized":"2024-04-30T23:12:58.046478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685842+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:12:57.685842+0000","last_peered":"2024-04-30T23:12:57.685842+0000","last_clean":"2024-04-30T23:12:57.685842+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:12:57.685842+0000","last_undegraded":"2024-04-30T23:12:57.685842+0000","last_fullsized":"2024-04-30T23:12:57.685842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094190+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:13:24.094190+0000","last_peered":"2024-04-30T23:13:24.094190+0000","last_clean":"2024-04-30T23:13:24.094190+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:13:24.094190+0000","last_undegraded":"2024-04-30T23:13:24.094190+0000","last_fullsized":"2024-04-30T23:13:24.094190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2010,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046395+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:12:58.046395+0000","last_peered":"2024-04-30T23:12:58.046395+0000","last_clean":"2024-04-30T23:12:58.046395+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:12:58.046395+0000","last_undegraded":"2024-04-30T23:12:58.046395+0000","last_fullsized":"2024-04-30T23:12:58.046395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687890+0000","last_change":"2024-04-30T23:11:57.125302+0000","last_active":"2024-04-30T23:12:57.687890+0000","last_peered":"2024-04-30T23:12:57.687890+0000","last_clean":"2024-04-30T23:12:57.687890+0000","last_became_active":"2024-04-30T23:11:57.124777+0000","last_became_peered":"2024-04-30T23:11:57.124777+0000","last_unstale":"2024-04-30T23:12:57.687890+0000","last_undegraded":"2024-04-30T23:12:57.687890+0000","last_fullsized":"2024-04-30T23:12:57.687890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:57:20.020845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681686+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:12:57.681686+0000","last_peered":"2024-04-30T23:12:57.681686+0000","last_clean":"2024-04-30T23:12:57.681686+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:12:57.681686+0000","last_undegraded":"2024-04-30T23:12:57.681686+0000","last_fullsized":"2024-04-30T23:12:57.681686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045832+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:12:58.045832+0000","last_peered":"2024-04-30T23:12:58.045832+0000","last_clean":"2024-04-30T23:12:58.045832+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:12:58.045832+0000","last_undegraded":"2024-04-30T23:12:58.045832+0000","last_fullsized":"2024-04-30T23:12:58.045832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.680862+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:12:57.680862+0000","last_peered":"2024-04-30T23:12:57.680862+0000","last_clean":"2024-04-30T23:12:57.680862+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:12:57.680862+0000","last_undegraded":"2024-04-30T23:12:57.680862+0000","last_fullsized":"2024-04-30T23:12:57.680862+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682354+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:12:57.682354+0000","last_peered":"2024-04-30T23:12:57.682354+0000","last_clean":"2024-04-30T23:12:57.682354+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:12:57.682354+0000","last_undegraded":"2024-04-30T23:12:57.682354+0000","last_fullsized":"2024-04-30T23:12:57.682354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046352+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:12:58.046352+0000","last_peered":"2024-04-30T23:12:58.046352+0000","last_clean":"2024-04-30T23:12:58.046352+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:12:58.046352+0000","last_undegraded":"2024-04-30T23:12:58.046352+0000","last_fullsized":"2024-04-30T23:12:58.046352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699470+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:12:57.699470+0000","last_peered":"2024-04-30T23:12:57.699470+0000","last_clean":"2024-04-30T23:12:57.699470+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:12:57.699470+0000","last_undegraded":"2024-04-30T23:12:57.699470+0000","last_fullsized":"2024-04-30T23:12:57.699470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688320+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:12:57.688320+0000","last_peered":"2024-04-30T23:12:57.688320+0000","last_clean":"2024-04-30T23:12:57.688320+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:12:57.688320+0000","last_undegraded":"2024-04-30T23:12:57.688320+0000","last_fullsized":"2024-04-30T23:12:57.688320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688210+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:12:57.688210+0000","last_peered":"2024-04-30T23:12:57.688210+0000","last_clean":"2024-04-30T23:12:57.688210+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:12:57.688210+0000","last_undegraded":"2024-04-30T23:12:57.688210+0000","last_fullsized":"2024-04-30T23:12:57.688210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688035+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:12:57.688035+0000","last_peered":"2024-04-30T23:12:57.688035+0000","last_clean":"2024-04-30T23:12:57.688035+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:12:57.688035+0000","last_undegraded":"2024-04-30T23:12:57.688035+0000","last_fullsized":"2024-04-30T23:12:57.688035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682200+0000","last_change":"2024-04-30T23:11:56.787962+0000","last_active":"2024-04-30T23:12:57.682200+0000","last_peered":"2024-04-30T23:12:57.682200+0000","last_clean":"2024-04-30T23:12:57.682200+0000","last_became_active":"2024-04-30T23:11:56.787540+0000","last_became_peered":"2024-04-30T23:11:56.787540+0000","last_unstale":"2024-04-30T23:12:57.682200+0000","last_undegraded":"2024-04-30T23:12:57.682200+0000","last_fullsized":"2024-04-30T23:12:57.682200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:57:43.364201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699423+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:12:57.699423+0000","last_peered":"2024-04-30T23:12:57.699423+0000","last_clean":"2024-04-30T23:12:57.699423+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:12:57.699423+0000","last_undegraded":"2024-04-30T23:12:57.699423+0000","last_fullsized":"2024-04-30T23:12:57.699423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688984+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:12:57.688984+0000","last_peered":"2024-04-30T23:12:57.688984+0000","last_clean":"2024-04-30T23:12:57.688984+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:12:57.688984+0000","last_undegraded":"2024-04-30T23:12:57.688984+0000","last_fullsized":"2024-04-30T23:12:57.688984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681278+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:12:57.681278+0000","last_peered":"2024-04-30T23:12:57.681278+0000","last_clean":"2024-04-30T23:12:57.681278+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:12:57.681278+0000","last_undegraded":"2024-04-30T23:12:57.681278+0000","last_fullsized":"2024-04-30T23:12:57.681278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045724+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:12:58.045724+0000","last_peered":"2024-04-30T23:12:58.045724+0000","last_clean":"2024-04-30T23:12:58.045724+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:12:58.045724+0000","last_undegraded":"2024-04-30T23:12:58.045724+0000","last_fullsized":"2024-04-30T23:12:58.045724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686196+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:12:57.686196+0000","last_peered":"2024-04-30T23:12:57.686196+0000","last_clean":"2024-04-30T23:12:57.686196+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:12:57.686196+0000","last_undegraded":"2024-04-30T23:12:57.686196+0000","last_fullsized":"2024-04-30T23:12:57.686196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682156+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:12:57.682156+0000","last_peered":"2024-04-30T23:12:57.682156+0000","last_clean":"2024-04-30T23:12:57.682156+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:12:57.682156+0000","last_undegraded":"2024-04-30T23:12:57.682156+0000","last_fullsized":"2024-04-30T23:12:57.682156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699203+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:12:57.699203+0000","last_peered":"2024-04-30T23:12:57.699203+0000","last_clean":"2024-04-30T23:12:57.699203+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:12:57.699203+0000","last_undegraded":"2024-04-30T23:12:57.699203+0000","last_fullsized":"2024-04-30T23:12:57.699203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75530,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1218,"num_read_kb":694,"num_write":260,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":221352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383721,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":520137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645360,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1765376,"data_stored":1174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":523631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":519913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36988,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708164,"statfs":{"total":95995035648,"available":95957159936,"internally_reserved":0,"allocated":1683456,"data_stored":1117083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":515039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":578651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":517027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36468,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708684,"statfs":{"total":95995035648,"available":95957692416,"internally_reserved":0,"allocated":1159168,"data_stored":584865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":514747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920847,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":519645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1112133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:13:27.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 -- 172.21.15.100:0/2632439150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 msgr2=0x7ff7c410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 --2- 172.21.15.100:0/2632439150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c410ada0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009ca0 tx=0x7ff7bc02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 -- 172.21.15.100:0/2632439150 shutdown_connections 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 --2- 172.21.15.100:0/2632439150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c410ada0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 --2- 172.21.15.100:0/2632439150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4103c80 0x7ff7c4104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 --2- 172.21.15.100:0/2632439150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4102a40 0x7ff7c4103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 -- 172.21.15.100:0/2632439150 >> 172.21.15.100:0/2632439150 conn(0x7ff7c40fdc30 msgr2=0x7ff7c41000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 -- 172.21.15.100:0/2632439150 shutdown_connections 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.730+0000 7ff7cc386640 1 -- 172.21.15.100:0/2632439150 wait complete. 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 Processor -- start 2024-04-30T23:13:27.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 -- start start 2024-04-30T23:13:27.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4102a40 0x7ff7c4075880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4103c80 0x7ff7c419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410e570 con 0x7ff7c4108980 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410e3f0 con 0x7ff7c4103c80 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7cc386640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410e6f0 con 0x7ff7c4102a40 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35102/0 (socket says 172.21.15.100:35102) 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 -- 172.21.15.100:0/1633138917 learned_addr learned my addr 172.21.15.100:0/1633138917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7c9921640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4103c80 0x7ff7c419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca122640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4102a40 0x7ff7c4075880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 -- 172.21.15.100:0/1633138917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4102a40 msgr2=0x7ff7c4075880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4102a40 0x7ff7c4075880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 -- 172.21.15.100:0/1633138917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4103c80 msgr2=0x7ff7c419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4103c80 0x7ff7c419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.731+0000 7ff7ca923640 1 -- 172.21.15.100:0/1633138917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41a1d00 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7ca923640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097b0 tx=0x7ff7bc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc004240 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7bc02f380 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c41a1f90 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc02fc30 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.732+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c41a23f0 con 0x7ff7c4108980 2024-04-30T23:13:27.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.733+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c406a1d0 con 0x7ff7c4108980 2024-04-30T23:13:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.734+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff7bc0043e0 con 0x7ff7c4108980 2024-04-30T23:13:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.735+0000 7ff7bb7fe640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 0x7ff7b00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.735+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff7bc0f2050 con 0x7ff7c4108980 2024-04-30T23:13:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.735+0000 7ff7ca122640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 0x7ff7b00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:27.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.735+0000 7ff7ca122640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 0x7ff7b00a60c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005fd0 tx=0x7ff7b4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:27.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.739+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7bc0be6d0 con 0x7ff7c4108980 2024-04-30T23:13:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.916+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7c4063020 con 0x7ff7b00a3bb0 2024-04-30T23:13:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.926+0000 7ff7bb7fe640 1 -- 172.21.15.100:0/1633138917 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340528 (secure 0 0 0) 0x7ff7c4063020 con 0x7ff7b00a3bb0 2024-04-30T23:13:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.929+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 msgr2=0x7ff7b00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 0x7ff7b00a60c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005fd0 tx=0x7ff7b4005850 comp rx=0 tx=0).stop 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 msgr2=0x7ff7c41a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097b0 tx=0x7ff7bc003c20 comp rx=0 tx=0).stop 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 shutdown_connections 2024-04-30T23:13:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff7b00a3bb0 0x7ff7b00a60c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c4108980 0x7ff7c41a14e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7c4103c80 0x7ff7c419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 --2- 172.21.15.100:0/1633138917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7c4102a40 0x7ff7c4075880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 >> 172.21.15.100:0/1633138917 conn(0x7ff7c40fdc30 msgr2=0x7ff7c4104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 shutdown_connections 2024-04-30T23:13:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:27.930+0000 7ff7cc386640 1 -- 172.21.15.100:0/1633138917 wait complete. 2024-04-30T23:13:27.940 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:27 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2547195824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:27.940 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:27 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/587099303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:27.942 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-04-30T23:13:27.621673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666132,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1354,"num_read_kb":808,"num_write":445,"num_write_kb":3102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388796,"kb_used_data":14636,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553028,"statfs":{"total":1151940427776,"available":1151542300672,"internally_reserved":0,"allocated":14987264,"data_stored":8202266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":62,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003284"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699516+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:12:57.699516+0000","last_peered":"2024-04-30T23:12:57.699516+0000","last_clean":"2024-04-30T23:12:57.699516+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:12:57.699516+0000","last_undegraded":"2024-04-30T23:12:57.699516+0000","last_fullsized":"2024-04-30T23:12:57.699516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688315+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:12:57.688315+0000","last_peered":"2024-04-30T23:12:57.688315+0000","last_clean":"2024-04-30T23:12:57.688315+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:12:57.688315+0000","last_undegraded":"2024-04-30T23:12:57.688315+0000","last_fullsized":"2024-04-30T23:12:57.688315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688146+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:12:57.688146+0000","last_peered":"2024-04-30T23:12:57.688146+0000","last_clean":"2024-04-30T23:12:57.688146+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:12:57.688146+0000","last_undegraded":"2024-04-30T23:12:57.688146+0000","last_fullsized":"2024-04-30T23:12:57.688146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682397+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:12:57.682397+0000","last_peered":"2024-04-30T23:12:57.682397+0000","last_clean":"2024-04-30T23:12:57.682397+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:12:57.682397+0000","last_undegraded":"2024-04-30T23:12:57.682397+0000","last_fullsized":"2024-04-30T23:12:57.682397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045627+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:12:58.045627+0000","last_peered":"2024-04-30T23:12:58.045627+0000","last_clean":"2024-04-30T23:12:58.045627+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:12:58.045627+0000","last_undegraded":"2024-04-30T23:12:58.045627+0000","last_fullsized":"2024-04-30T23:12:58.045627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046492+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:12:58.046492+0000","last_peered":"2024-04-30T23:12:58.046492+0000","last_clean":"2024-04-30T23:12:58.046492+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:12:58.046492+0000","last_undegraded":"2024-04-30T23:12:58.046492+0000","last_fullsized":"2024-04-30T23:12:58.046492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045640+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:12:58.045640+0000","last_peered":"2024-04-30T23:12:58.045640+0000","last_clean":"2024-04-30T23:12:58.045640+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:12:58.045640+0000","last_undegraded":"2024-04-30T23:12:58.045640+0000","last_fullsized":"2024-04-30T23:12:58.045640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045267+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:12:58.045267+0000","last_peered":"2024-04-30T23:12:58.045267+0000","last_clean":"2024-04-30T23:12:58.045267+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:12:58.045267+0000","last_undegraded":"2024-04-30T23:12:58.045267+0000","last_fullsized":"2024-04-30T23:12:58.045267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686437+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:12:57.686437+0000","last_peered":"2024-04-30T23:12:57.686437+0000","last_clean":"2024-04-30T23:12:57.686437+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:12:57.686437+0000","last_undegraded":"2024-04-30T23:12:57.686437+0000","last_fullsized":"2024-04-30T23:12:57.686437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046149+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:12:58.046149+0000","last_peered":"2024-04-30T23:12:58.046149+0000","last_clean":"2024-04-30T23:12:58.046149+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:12:58.046149+0000","last_undegraded":"2024-04-30T23:12:58.046149+0000","last_fullsized":"2024-04-30T23:12:58.046149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046399+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:12:58.046399+0000","last_peered":"2024-04-30T23:12:58.046399+0000","last_clean":"2024-04-30T23:12:58.046399+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:12:58.046399+0000","last_undegraded":"2024-04-30T23:12:58.046399+0000","last_fullsized":"2024-04-30T23:12:58.046399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682264+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:12:57.682264+0000","last_peered":"2024-04-30T23:12:57.682264+0000","last_clean":"2024-04-30T23:12:57.682264+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:12:57.682264+0000","last_undegraded":"2024-04-30T23:12:57.682264+0000","last_fullsized":"2024-04-30T23:12:57.682264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682138+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:12:57.682138+0000","last_peered":"2024-04-30T23:12:57.682138+0000","last_clean":"2024-04-30T23:12:57.682138+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:12:57.682138+0000","last_undegraded":"2024-04-30T23:12:57.682138+0000","last_fullsized":"2024-04-30T23:12:57.682138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687998+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:12:57.687998+0000","last_peered":"2024-04-30T23:12:57.687998+0000","last_clean":"2024-04-30T23:12:57.687998+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:12:57.687998+0000","last_undegraded":"2024-04-30T23:12:57.687998+0000","last_fullsized":"2024-04-30T23:12:57.687998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687919+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:12:57.687919+0000","last_peered":"2024-04-30T23:12:57.687919+0000","last_clean":"2024-04-30T23:12:57.687919+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:12:57.687919+0000","last_undegraded":"2024-04-30T23:12:57.687919+0000","last_fullsized":"2024-04-30T23:12:57.687919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685928+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:12:57.685928+0000","last_peered":"2024-04-30T23:12:57.685928+0000","last_clean":"2024-04-30T23:12:57.685928+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:12:57.685928+0000","last_undegraded":"2024-04-30T23:12:57.685928+0000","last_fullsized":"2024-04-30T23:12:57.685928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699367+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:12:57.699367+0000","last_peered":"2024-04-30T23:12:57.699367+0000","last_clean":"2024-04-30T23:12:57.699367+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:12:57.699367+0000","last_undegraded":"2024-04-30T23:12:57.699367+0000","last_fullsized":"2024-04-30T23:12:57.699367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688651+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:12:57.688651+0000","last_peered":"2024-04-30T23:12:57.688651+0000","last_clean":"2024-04-30T23:12:57.688651+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:12:57.688651+0000","last_undegraded":"2024-04-30T23:12:57.688651+0000","last_fullsized":"2024-04-30T23:12:57.688651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688341+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:12:57.688341+0000","last_peered":"2024-04-30T23:12:57.688341+0000","last_clean":"2024-04-30T23:12:57.688341+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:12:57.688341+0000","last_undegraded":"2024-04-30T23:12:57.688341+0000","last_fullsized":"2024-04-30T23:12:57.688341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.086367+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:13:22.086367+0000","last_peered":"2024-04-30T23:13:22.086367+0000","last_clean":"2024-04-30T23:13:22.086367+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:13:22.086367+0000","last_undegraded":"2024-04-30T23:13:22.086367+0000","last_fullsized":"2024-04-30T23:13:22.086367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045532+0000","last_change":"2024-04-30T23:11:56.961809+0000","last_active":"2024-04-30T23:12:58.045532+0000","last_peered":"2024-04-30T23:12:58.045532+0000","last_clean":"2024-04-30T23:12:58.045532+0000","last_became_active":"2024-04-30T23:11:56.961461+0000","last_became_peered":"2024-04-30T23:11:56.961461+0000","last_unstale":"2024-04-30T23:12:58.045532+0000","last_undegraded":"2024-04-30T23:12:58.045532+0000","last_fullsized":"2024-04-30T23:12:58.045532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:41:28.814142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681522+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:12:57.681522+0000","last_peered":"2024-04-30T23:12:57.681522+0000","last_clean":"2024-04-30T23:12:57.681522+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.681522+0000","last_undegraded":"2024-04-30T23:12:57.681522+0000","last_fullsized":"2024-04-30T23:12:57.681522+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046014+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:12:58.046014+0000","last_peered":"2024-04-30T23:12:58.046014+0000","last_clean":"2024-04-30T23:12:58.046014+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:12:58.046014+0000","last_undegraded":"2024-04-30T23:12:58.046014+0000","last_fullsized":"2024-04-30T23:12:58.046014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681734+0000","last_change":"2024-04-30T23:11:56.961194+0000","last_active":"2024-04-30T23:12:57.681734+0000","last_peered":"2024-04-30T23:12:57.681734+0000","last_clean":"2024-04-30T23:12:57.681734+0000","last_became_active":"2024-04-30T23:11:56.960793+0000","last_became_peered":"2024-04-30T23:11:56.960793+0000","last_unstale":"2024-04-30T23:12:57.681734+0000","last_undegraded":"2024-04-30T23:12:57.681734+0000","last_fullsized":"2024-04-30T23:12:57.681734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:44:07.845730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046051+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:12:58.046051+0000","last_peered":"2024-04-30T23:12:58.046051+0000","last_clean":"2024-04-30T23:12:58.046051+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:12:58.046051+0000","last_undegraded":"2024-04-30T23:12:58.046051+0000","last_fullsized":"2024-04-30T23:12:58.046051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686032+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:12:57.686032+0000","last_peered":"2024-04-30T23:12:57.686032+0000","last_clean":"2024-04-30T23:12:57.686032+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:12:57.686032+0000","last_undegraded":"2024-04-30T23:12:57.686032+0000","last_fullsized":"2024-04-30T23:12:57.686032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681585+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:12:57.681585+0000","last_peered":"2024-04-30T23:12:57.681585+0000","last_clean":"2024-04-30T23:12:57.681585+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:12:57.681585+0000","last_undegraded":"2024-04-30T23:12:57.681585+0000","last_fullsized":"2024-04-30T23:12:57.681585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045594+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:12:58.045594+0000","last_peered":"2024-04-30T23:12:58.045594+0000","last_clean":"2024-04-30T23:12:58.045594+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:12:58.045594+0000","last_undegraded":"2024-04-30T23:12:58.045594+0000","last_fullsized":"2024-04-30T23:12:58.045594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681638+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:12:57.681638+0000","last_peered":"2024-04-30T23:12:57.681638+0000","last_clean":"2024-04-30T23:12:57.681638+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:12:57.681638+0000","last_undegraded":"2024-04-30T23:12:57.681638+0000","last_fullsized":"2024-04-30T23:12:57.681638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688419+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:12:57.688419+0000","last_peered":"2024-04-30T23:12:57.688419+0000","last_clean":"2024-04-30T23:12:57.688419+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:12:57.688419+0000","last_undegraded":"2024-04-30T23:12:57.688419+0000","last_fullsized":"2024-04-30T23:12:57.688419+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.090455+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:13:22.090455+0000","last_peered":"2024-04-30T23:13:22.090455+0000","last_clean":"2024-04-30T23:13:22.090455+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:13:22.090455+0000","last_undegraded":"2024-04-30T23:13:22.090455+0000","last_fullsized":"2024-04-30T23:13:22.090455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045498+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:12:58.045498+0000","last_peered":"2024-04-30T23:12:58.045498+0000","last_clean":"2024-04-30T23:12:58.045498+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:12:58.045498+0000","last_undegraded":"2024-04-30T23:12:58.045498+0000","last_fullsized":"2024-04-30T23:12:58.045498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688386+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:12:57.688386+0000","last_peered":"2024-04-30T23:12:57.688386+0000","last_clean":"2024-04-30T23:12:57.688386+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:12:57.688386+0000","last_undegraded":"2024-04-30T23:12:57.688386+0000","last_fullsized":"2024-04-30T23:12:57.688386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045390+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:12:58.045390+0000","last_peered":"2024-04-30T23:12:58.045390+0000","last_clean":"2024-04-30T23:12:58.045390+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:12:58.045390+0000","last_undegraded":"2024-04-30T23:12:58.045390+0000","last_fullsized":"2024-04-30T23:12:58.045390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045470+0000","last_change":"2024-04-30T23:11:56.786296+0000","last_active":"2024-04-30T23:12:58.045470+0000","last_peered":"2024-04-30T23:12:58.045470+0000","last_clean":"2024-04-30T23:12:58.045470+0000","last_became_active":"2024-04-30T23:11:56.785834+0000","last_became_peered":"2024-04-30T23:11:56.785834+0000","last_unstale":"2024-04-30T23:12:58.045470+0000","last_undegraded":"2024-04-30T23:12:58.045470+0000","last_fullsized":"2024-04-30T23:12:58.045470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:33.908301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699277+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:12:57.699277+0000","last_peered":"2024-04-30T23:12:57.699277+0000","last_clean":"2024-04-30T23:12:57.699277+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:12:57.699277+0000","last_undegraded":"2024-04-30T23:12:57.699277+0000","last_fullsized":"2024-04-30T23:12:57.699277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681833+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:12:57.681833+0000","last_peered":"2024-04-30T23:12:57.681833+0000","last_clean":"2024-04-30T23:12:57.681833+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:12:57.681833+0000","last_undegraded":"2024-04-30T23:12:57.681833+0000","last_fullsized":"2024-04-30T23:12:57.681833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045153+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:12:58.045153+0000","last_peered":"2024-04-30T23:12:58.045153+0000","last_clean":"2024-04-30T23:12:58.045153+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:12:58.045153+0000","last_undegraded":"2024-04-30T23:12:58.045153+0000","last_fullsized":"2024-04-30T23:12:58.045153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688223+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:12:57.688223+0000","last_peered":"2024-04-30T23:12:57.688223+0000","last_clean":"2024-04-30T23:12:57.688223+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:12:57.688223+0000","last_undegraded":"2024-04-30T23:12:57.688223+0000","last_fullsized":"2024-04-30T23:12:57.688223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681066+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:12:57.681066+0000","last_peered":"2024-04-30T23:12:57.681066+0000","last_clean":"2024-04-30T23:12:57.681066+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:12:57.681066+0000","last_undegraded":"2024-04-30T23:12:57.681066+0000","last_fullsized":"2024-04-30T23:12:57.681066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046188+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:12:58.046188+0000","last_peered":"2024-04-30T23:12:58.046188+0000","last_clean":"2024-04-30T23:12:58.046188+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:12:58.046188+0000","last_undegraded":"2024-04-30T23:12:58.046188+0000","last_fullsized":"2024-04-30T23:12:58.046188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045179+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:12:58.045179+0000","last_peered":"2024-04-30T23:12:58.045179+0000","last_clean":"2024-04-30T23:12:58.045179+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:12:58.045179+0000","last_undegraded":"2024-04-30T23:12:58.045179+0000","last_fullsized":"2024-04-30T23:12:58.045179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'7","reported_seq":274,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.093589+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:13:24.093589+0000","last_peered":"2024-04-30T23:13:24.093589+0000","last_clean":"2024-04-30T23:13:24.093589+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:13:24.093589+0000","last_undegraded":"2024-04-30T23:13:24.093589+0000","last_fullsized":"2024-04-30T23:13:24.093589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686456+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:12:57.686456+0000","last_peered":"2024-04-30T23:12:57.686456+0000","last_clean":"2024-04-30T23:12:57.686456+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:12:57.686456+0000","last_undegraded":"2024-04-30T23:12:57.686456+0000","last_fullsized":"2024-04-30T23:12:57.686456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045193+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:12:58.045193+0000","last_peered":"2024-04-30T23:12:58.045193+0000","last_clean":"2024-04-30T23:12:58.045193+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:12:58.045193+0000","last_undegraded":"2024-04-30T23:12:58.045193+0000","last_fullsized":"2024-04-30T23:12:58.045193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045834+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:12:58.045834+0000","last_peered":"2024-04-30T23:12:58.045834+0000","last_clean":"2024-04-30T23:12:58.045834+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:12:58.045834+0000","last_undegraded":"2024-04-30T23:12:58.045834+0000","last_fullsized":"2024-04-30T23:12:58.045834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688434+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:12:57.688434+0000","last_peered":"2024-04-30T23:12:57.688434+0000","last_clean":"2024-04-30T23:12:57.688434+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:12:57.688434+0000","last_undegraded":"2024-04-30T23:12:57.688434+0000","last_fullsized":"2024-04-30T23:12:57.688434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681974+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:12:57.681974+0000","last_peered":"2024-04-30T23:12:57.681974+0000","last_clean":"2024-04-30T23:12:57.681974+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:12:57.681974+0000","last_undegraded":"2024-04-30T23:12:57.681974+0000","last_fullsized":"2024-04-30T23:12:57.681974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681399+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:12:57.681399+0000","last_peered":"2024-04-30T23:12:57.681399+0000","last_clean":"2024-04-30T23:12:57.681399+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:12:57.681399+0000","last_undegraded":"2024-04-30T23:12:57.681399+0000","last_fullsized":"2024-04-30T23:12:57.681399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686301+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:12:57.686301+0000","last_peered":"2024-04-30T23:12:57.686301+0000","last_clean":"2024-04-30T23:12:57.686301+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:12:57.686301+0000","last_undegraded":"2024-04-30T23:12:57.686301+0000","last_fullsized":"2024-04-30T23:12:57.686301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045329+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:12:58.045329+0000","last_peered":"2024-04-30T23:12:58.045329+0000","last_clean":"2024-04-30T23:12:58.045329+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:12:58.045329+0000","last_undegraded":"2024-04-30T23:12:58.045329+0000","last_fullsized":"2024-04-30T23:12:58.045329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'42","reported_seq":321,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094084+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:13:24.094084+0000","last_peered":"2024-04-30T23:13:24.094084+0000","last_clean":"2024-04-30T23:13:24.094084+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:13:24.094084+0000","last_undegraded":"2024-04-30T23:13:24.094084+0000","last_fullsized":"2024-04-30T23:13:24.094084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":248,"num_read_kb":191,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045960+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:12:58.045960+0000","last_peered":"2024-04-30T23:12:58.045960+0000","last_clean":"2024-04-30T23:12:58.045960+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:12:58.045960+0000","last_undegraded":"2024-04-30T23:12:58.045960+0000","last_fullsized":"2024-04-30T23:12:58.045960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681824+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:12:57.681824+0000","last_peered":"2024-04-30T23:12:57.681824+0000","last_clean":"2024-04-30T23:12:57.681824+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:12:57.681824+0000","last_undegraded":"2024-04-30T23:12:57.681824+0000","last_fullsized":"2024-04-30T23:12:57.681824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688773+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:12:57.688773+0000","last_peered":"2024-04-30T23:12:57.688773+0000","last_clean":"2024-04-30T23:12:57.688773+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:12:57.688773+0000","last_undegraded":"2024-04-30T23:12:57.688773+0000","last_fullsized":"2024-04-30T23:12:57.688773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681944+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:12:57.681944+0000","last_peered":"2024-04-30T23:12:57.681944+0000","last_clean":"2024-04-30T23:12:57.681944+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:12:57.681944+0000","last_undegraded":"2024-04-30T23:12:57.681944+0000","last_fullsized":"2024-04-30T23:12:57.681944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699037+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:12:57.699037+0000","last_peered":"2024-04-30T23:12:57.699037+0000","last_clean":"2024-04-30T23:12:57.699037+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:12:57.699037+0000","last_undegraded":"2024-04-30T23:12:57.699037+0000","last_fullsized":"2024-04-30T23:12:57.699037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681556+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:12:57.681556+0000","last_peered":"2024-04-30T23:12:57.681556+0000","last_clean":"2024-04-30T23:12:57.681556+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:12:57.681556+0000","last_undegraded":"2024-04-30T23:12:57.681556+0000","last_fullsized":"2024-04-30T23:12:57.681556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046162+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:12:58.046162+0000","last_peered":"2024-04-30T23:12:58.046162+0000","last_clean":"2024-04-30T23:12:58.046162+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:12:58.046162+0000","last_undegraded":"2024-04-30T23:12:58.046162+0000","last_fullsized":"2024-04-30T23:12:58.046162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045314+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:12:58.045314+0000","last_peered":"2024-04-30T23:12:58.045314+0000","last_clean":"2024-04-30T23:12:58.045314+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:12:58.045314+0000","last_undegraded":"2024-04-30T23:12:58.045314+0000","last_fullsized":"2024-04-30T23:12:58.045314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:23.088487+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:13:23.088487+0000","last_peered":"2024-04-30T23:13:23.088487+0000","last_clean":"2024-04-30T23:13:23.088487+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:13:23.088487+0000","last_undegraded":"2024-04-30T23:13:23.088487+0000","last_fullsized":"2024-04-30T23:13:23.088487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045542+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:12:58.045542+0000","last_peered":"2024-04-30T23:12:58.045542+0000","last_clean":"2024-04-30T23:12:58.045542+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:12:58.045542+0000","last_undegraded":"2024-04-30T23:12:58.045542+0000","last_fullsized":"2024-04-30T23:12:58.045542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682329+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:12:57.682329+0000","last_peered":"2024-04-30T23:12:57.682329+0000","last_clean":"2024-04-30T23:12:57.682329+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:12:57.682329+0000","last_undegraded":"2024-04-30T23:12:57.682329+0000","last_fullsized":"2024-04-30T23:12:57.682329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045428+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:12:58.045428+0000","last_peered":"2024-04-30T23:12:58.045428+0000","last_clean":"2024-04-30T23:12:58.045428+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:12:58.045428+0000","last_undegraded":"2024-04-30T23:12:58.045428+0000","last_fullsized":"2024-04-30T23:12:58.045428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681130+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:12:57.681130+0000","last_peered":"2024-04-30T23:12:57.681130+0000","last_clean":"2024-04-30T23:12:57.681130+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:12:57.681130+0000","last_undegraded":"2024-04-30T23:12:57.681130+0000","last_fullsized":"2024-04-30T23:12:57.681130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681209+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:12:57.681209+0000","last_peered":"2024-04-30T23:12:57.681209+0000","last_clean":"2024-04-30T23:12:57.681209+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:12:57.681209+0000","last_undegraded":"2024-04-30T23:12:57.681209+0000","last_fullsized":"2024-04-30T23:12:57.681209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046114+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:12:58.046114+0000","last_peered":"2024-04-30T23:12:58.046114+0000","last_clean":"2024-04-30T23:12:58.046114+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:12:58.046114+0000","last_undegraded":"2024-04-30T23:12:58.046114+0000","last_fullsized":"2024-04-30T23:12:58.046114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699284+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:12:57.699284+0000","last_peered":"2024-04-30T23:12:57.699284+0000","last_clean":"2024-04-30T23:12:57.699284+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:12:57.699284+0000","last_undegraded":"2024-04-30T23:12:57.699284+0000","last_fullsized":"2024-04-30T23:12:57.699284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045535+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:12:58.045535+0000","last_peered":"2024-04-30T23:12:58.045535+0000","last_clean":"2024-04-30T23:12:58.045535+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:12:58.045535+0000","last_undegraded":"2024-04-30T23:12:58.045535+0000","last_fullsized":"2024-04-30T23:12:58.045535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046015+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:12:58.046015+0000","last_peered":"2024-04-30T23:12:58.046015+0000","last_clean":"2024-04-30T23:12:58.046015+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:12:58.046015+0000","last_undegraded":"2024-04-30T23:12:58.046015+0000","last_fullsized":"2024-04-30T23:12:58.046015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046160+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:12:58.046160+0000","last_peered":"2024-04-30T23:12:58.046160+0000","last_clean":"2024-04-30T23:12:58.046160+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:12:58.046160+0000","last_undegraded":"2024-04-30T23:12:58.046160+0000","last_fullsized":"2024-04-30T23:12:58.046160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682174+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:12:57.682174+0000","last_peered":"2024-04-30T23:12:57.682174+0000","last_clean":"2024-04-30T23:12:57.682174+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:12:57.682174+0000","last_undegraded":"2024-04-30T23:12:57.682174+0000","last_fullsized":"2024-04-30T23:12:57.682174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.089220+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:13:24.089220+0000","last_peered":"2024-04-30T23:13:24.089220+0000","last_clean":"2024-04-30T23:13:24.089220+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:13:24.089220+0000","last_undegraded":"2024-04-30T23:13:24.089220+0000","last_fullsized":"2024-04-30T23:13:24.089220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046295+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:12:58.046295+0000","last_peered":"2024-04-30T23:12:58.046295+0000","last_clean":"2024-04-30T23:12:58.046295+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:12:58.046295+0000","last_undegraded":"2024-04-30T23:12:58.046295+0000","last_fullsized":"2024-04-30T23:12:58.046295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682276+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:12:57.682276+0000","last_peered":"2024-04-30T23:12:57.682276+0000","last_clean":"2024-04-30T23:12:57.682276+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:12:57.682276+0000","last_undegraded":"2024-04-30T23:12:57.682276+0000","last_fullsized":"2024-04-30T23:12:57.682276+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681462+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:12:57.681462+0000","last_peered":"2024-04-30T23:12:57.681462+0000","last_clean":"2024-04-30T23:12:57.681462+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:12:57.681462+0000","last_undegraded":"2024-04-30T23:12:57.681462+0000","last_fullsized":"2024-04-30T23:12:57.681462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.089208+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:13:24.089208+0000","last_peered":"2024-04-30T23:13:24.089208+0000","last_clean":"2024-04-30T23:13:24.089208+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:13:24.089208+0000","last_undegraded":"2024-04-30T23:13:24.089208+0000","last_fullsized":"2024-04-30T23:13:24.089208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046090+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:12:58.046090+0000","last_peered":"2024-04-30T23:12:58.046090+0000","last_clean":"2024-04-30T23:12:58.046090+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:12:58.046090+0000","last_undegraded":"2024-04-30T23:12:58.046090+0000","last_fullsized":"2024-04-30T23:12:58.046090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045311+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:12:58.045311+0000","last_peered":"2024-04-30T23:12:58.045311+0000","last_clean":"2024-04-30T23:12:58.045311+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:12:58.045311+0000","last_undegraded":"2024-04-30T23:12:58.045311+0000","last_fullsized":"2024-04-30T23:12:58.045311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681835+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:12:57.681835+0000","last_peered":"2024-04-30T23:12:57.681835+0000","last_clean":"2024-04-30T23:12:57.681835+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:12:57.681835+0000","last_undegraded":"2024-04-30T23:12:57.681835+0000","last_fullsized":"2024-04-30T23:12:57.681835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045312+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:12:58.045312+0000","last_peered":"2024-04-30T23:12:58.045312+0000","last_clean":"2024-04-30T23:12:58.045312+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:12:58.045312+0000","last_undegraded":"2024-04-30T23:12:58.045312+0000","last_fullsized":"2024-04-30T23:12:58.045312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681420+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:12:57.681420+0000","last_peered":"2024-04-30T23:12:57.681420+0000","last_clean":"2024-04-30T23:12:57.681420+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:12:57.681420+0000","last_undegraded":"2024-04-30T23:12:57.681420+0000","last_fullsized":"2024-04-30T23:12:57.681420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681756+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:12:57.681756+0000","last_peered":"2024-04-30T23:12:57.681756+0000","last_clean":"2024-04-30T23:12:57.681756+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:12:57.681756+0000","last_undegraded":"2024-04-30T23:12:57.681756+0000","last_fullsized":"2024-04-30T23:12:57.681756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045539+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:12:58.045539+0000","last_peered":"2024-04-30T23:12:58.045539+0000","last_clean":"2024-04-30T23:12:58.045539+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:12:58.045539+0000","last_undegraded":"2024-04-30T23:12:58.045539+0000","last_fullsized":"2024-04-30T23:12:58.045539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699174+0000","last_change":"2024-04-30T23:11:56.976706+0000","last_active":"2024-04-30T23:12:57.699174+0000","last_peered":"2024-04-30T23:12:57.699174+0000","last_clean":"2024-04-30T23:12:57.699174+0000","last_became_active":"2024-04-30T23:11:56.976251+0000","last_became_peered":"2024-04-30T23:11:56.976251+0000","last_unstale":"2024-04-30T23:12:57.699174+0000","last_undegraded":"2024-04-30T23:12:57.699174+0000","last_fullsized":"2024-04-30T23:12:57.699174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:12.294435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045996+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:12:58.045996+0000","last_peered":"2024-04-30T23:12:58.045996+0000","last_clean":"2024-04-30T23:12:58.045996+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:12:58.045996+0000","last_undegraded":"2024-04-30T23:12:58.045996+0000","last_fullsized":"2024-04-30T23:12:58.045996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682280+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:12:57.682280+0000","last_peered":"2024-04-30T23:12:57.682280+0000","last_clean":"2024-04-30T23:12:57.682280+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:12:57.682280+0000","last_undegraded":"2024-04-30T23:12:57.682280+0000","last_fullsized":"2024-04-30T23:12:57.682280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045091+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:12:58.045091+0000","last_peered":"2024-04-30T23:12:58.045091+0000","last_clean":"2024-04-30T23:12:58.045091+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:12:58.045091+0000","last_undegraded":"2024-04-30T23:12:58.045091+0000","last_fullsized":"2024-04-30T23:12:58.045091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045827+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:12:58.045827+0000","last_peered":"2024-04-30T23:12:58.045827+0000","last_clean":"2024-04-30T23:12:58.045827+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:12:58.045827+0000","last_undegraded":"2024-04-30T23:12:58.045827+0000","last_fullsized":"2024-04-30T23:12:58.045827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045533+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:12:58.045533+0000","last_peered":"2024-04-30T23:12:58.045533+0000","last_clean":"2024-04-30T23:12:58.045533+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:12:58.045533+0000","last_undegraded":"2024-04-30T23:12:58.045533+0000","last_fullsized":"2024-04-30T23:12:58.045533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688124+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:12:57.688124+0000","last_peered":"2024-04-30T23:12:57.688124+0000","last_clean":"2024-04-30T23:12:57.688124+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:12:57.688124+0000","last_undegraded":"2024-04-30T23:12:57.688124+0000","last_fullsized":"2024-04-30T23:12:57.688124+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682207+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:12:57.682207+0000","last_peered":"2024-04-30T23:12:57.682207+0000","last_clean":"2024-04-30T23:12:57.682207+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:12:57.682207+0000","last_undegraded":"2024-04-30T23:12:57.682207+0000","last_fullsized":"2024-04-30T23:12:57.682207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:56.787447+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:56.786482+0000","last_became_peered":"2024-04-30T23:11:56.786482+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:40.441920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682046+0000","last_change":"2024-04-30T23:11:56.962145+0000","last_active":"2024-04-30T23:12:57.682046+0000","last_peered":"2024-04-30T23:12:57.682046+0000","last_clean":"2024-04-30T23:12:57.682046+0000","last_became_active":"2024-04-30T23:11:56.961737+0000","last_became_peered":"2024-04-30T23:11:56.961737+0000","last_unstale":"2024-04-30T23:12:57.682046+0000","last_undegraded":"2024-04-30T23:12:57.682046+0000","last_fullsized":"2024-04-30T23:12:57.682046+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:27:04.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.703317+0000","last_change":"2024-04-30T23:12:57.702862+0000","last_active":"2024-04-30T23:12:57.703317+0000","last_peered":"2024-04-30T23:12:57.703317+0000","last_clean":"2024-04-30T23:12:57.703317+0000","last_became_active":"2024-04-30T23:12:57.700095+0000","last_became_peered":"2024-04-30T23:12:57.700095+0000","last_unstale":"2024-04-30T23:12:57.703317+0000","last_undegraded":"2024-04-30T23:12:57.703317+0000","last_fullsized":"2024-04-30T23:12:57.703317+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:38.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045454+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:12:58.045454+0000","last_peered":"2024-04-30T23:12:58.045454+0000","last_clean":"2024-04-30T23:12:58.045454+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:12:58.045454+0000","last_undegraded":"2024-04-30T23:12:58.045454+0000","last_fullsized":"2024-04-30T23:12:58.045454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046402+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:12:58.046402+0000","last_peered":"2024-04-30T23:12:58.046402+0000","last_clean":"2024-04-30T23:12:58.046402+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:12:58.046402+0000","last_undegraded":"2024-04-30T23:12:58.046402+0000","last_fullsized":"2024-04-30T23:12:58.046402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046094+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:12:58.046094+0000","last_peered":"2024-04-30T23:12:58.046094+0000","last_clean":"2024-04-30T23:12:58.046094+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:12:58.046094+0000","last_undegraded":"2024-04-30T23:12:58.046094+0000","last_fullsized":"2024-04-30T23:12:58.046094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699455+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:12:57.699455+0000","last_peered":"2024-04-30T23:12:57.699455+0000","last_clean":"2024-04-30T23:12:57.699455+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:12:57.699455+0000","last_undegraded":"2024-04-30T23:12:57.699455+0000","last_fullsized":"2024-04-30T23:12:57.699455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681925+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:12:57.681925+0000","last_peered":"2024-04-30T23:12:57.681925+0000","last_clean":"2024-04-30T23:12:57.681925+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:12:57.681925+0000","last_undegraded":"2024-04-30T23:12:57.681925+0000","last_fullsized":"2024-04-30T23:12:57.681925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.698919+0000","last_change":"2024-04-30T23:11:57.132504+0000","last_active":"2024-04-30T23:12:57.698919+0000","last_peered":"2024-04-30T23:12:57.698919+0000","last_clean":"2024-04-30T23:12:57.698919+0000","last_became_active":"2024-04-30T23:11:57.125899+0000","last_became_peered":"2024-04-30T23:11:57.125899+0000","last_unstale":"2024-04-30T23:12:57.698919+0000","last_undegraded":"2024-04-30T23:12:57.698919+0000","last_fullsized":"2024-04-30T23:12:57.698919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:16.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045931+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:12:58.045931+0000","last_peered":"2024-04-30T23:12:58.045931+0000","last_clean":"2024-04-30T23:12:58.045931+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:12:58.045931+0000","last_undegraded":"2024-04-30T23:12:58.045931+0000","last_fullsized":"2024-04-30T23:12:58.045931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682014+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:12:57.682014+0000","last_peered":"2024-04-30T23:12:57.682014+0000","last_clean":"2024-04-30T23:12:57.682014+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.682014+0000","last_undegraded":"2024-04-30T23:12:57.682014+0000","last_fullsized":"2024-04-30T23:12:57.682014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045667+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:12:58.045667+0000","last_peered":"2024-04-30T23:12:58.045667+0000","last_clean":"2024-04-30T23:12:58.045667+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:12:58.045667+0000","last_undegraded":"2024-04-30T23:12:58.045667+0000","last_fullsized":"2024-04-30T23:12:58.045667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046478+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:12:58.046478+0000","last_peered":"2024-04-30T23:12:58.046478+0000","last_clean":"2024-04-30T23:12:58.046478+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:12:58.046478+0000","last_undegraded":"2024-04-30T23:12:58.046478+0000","last_fullsized":"2024-04-30T23:12:58.046478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685842+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:12:57.685842+0000","last_peered":"2024-04-30T23:12:57.685842+0000","last_clean":"2024-04-30T23:12:57.685842+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:12:57.685842+0000","last_undegraded":"2024-04-30T23:12:57.685842+0000","last_fullsized":"2024-04-30T23:12:57.685842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094190+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:13:24.094190+0000","last_peered":"2024-04-30T23:13:24.094190+0000","last_clean":"2024-04-30T23:13:24.094190+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:13:24.094190+0000","last_undegraded":"2024-04-30T23:13:24.094190+0000","last_fullsized":"2024-04-30T23:13:24.094190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2010,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046395+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:12:58.046395+0000","last_peered":"2024-04-30T23:12:58.046395+0000","last_clean":"2024-04-30T23:12:58.046395+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:12:58.046395+0000","last_undegraded":"2024-04-30T23:12:58.046395+0000","last_fullsized":"2024-04-30T23:12:58.046395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687890+0000","last_change":"2024-04-30T23:11:57.125302+0000","last_active":"2024-04-30T23:12:57.687890+0000","last_peered":"2024-04-30T23:12:57.687890+0000","last_clean":"2024-04-30T23:12:57.687890+0000","last_became_active":"2024-04-30T23:11:57.124777+0000","last_became_peered":"2024-04-30T23:11:57.124777+0000","last_unstale":"2024-04-30T23:12:57.687890+0000","last_undegraded":"2024-04-30T23:12:57.687890+0000","last_fullsized":"2024-04-30T23:12:57.687890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:57:20.020845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681686+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:12:57.681686+0000","last_peered":"2024-04-30T23:12:57.681686+0000","last_clean":"2024-04-30T23:12:57.681686+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:12:57.681686+0000","last_undegraded":"2024-04-30T23:12:57.681686+0000","last_fullsized":"2024-04-30T23:12:57.681686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045832+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:12:58.045832+0000","last_peered":"2024-04-30T23:12:58.045832+0000","last_clean":"2024-04-30T23:12:58.045832+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:12:58.045832+0000","last_undegraded":"2024-04-30T23:12:58.045832+0000","last_fullsized":"2024-04-30T23:12:58.045832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.680862+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:12:57.680862+0000","last_peered":"2024-04-30T23:12:57.680862+0000","last_clean":"2024-04-30T23:12:57.680862+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:12:57.680862+0000","last_undegraded":"2024-04-30T23:12:57.680862+0000","last_fullsized":"2024-04-30T23:12:57.680862+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682354+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:12:57.682354+0000","last_peered":"2024-04-30T23:12:57.682354+0000","last_clean":"2024-04-30T23:12:57.682354+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:12:57.682354+0000","last_undegraded":"2024-04-30T23:12:57.682354+0000","last_fullsized":"2024-04-30T23:12:57.682354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046352+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:12:58.046352+0000","last_peered":"2024-04-30T23:12:58.046352+0000","last_clean":"2024-04-30T23:12:58.046352+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:12:58.046352+0000","last_undegraded":"2024-04-30T23:12:58.046352+0000","last_fullsized":"2024-04-30T23:12:58.046352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699470+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:12:57.699470+0000","last_peered":"2024-04-30T23:12:57.699470+0000","last_clean":"2024-04-30T23:12:57.699470+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:12:57.699470+0000","last_undegraded":"2024-04-30T23:12:57.699470+0000","last_fullsized":"2024-04-30T23:12:57.699470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688320+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:12:57.688320+0000","last_peered":"2024-04-30T23:12:57.688320+0000","last_clean":"2024-04-30T23:12:57.688320+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:12:57.688320+0000","last_undegraded":"2024-04-30T23:12:57.688320+0000","last_fullsized":"2024-04-30T23:12:57.688320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688210+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:12:57.688210+0000","last_peered":"2024-04-30T23:12:57.688210+0000","last_clean":"2024-04-30T23:12:57.688210+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:12:57.688210+0000","last_undegraded":"2024-04-30T23:12:57.688210+0000","last_fullsized":"2024-04-30T23:12:57.688210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688035+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:12:57.688035+0000","last_peered":"2024-04-30T23:12:57.688035+0000","last_clean":"2024-04-30T23:12:57.688035+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:12:57.688035+0000","last_undegraded":"2024-04-30T23:12:57.688035+0000","last_fullsized":"2024-04-30T23:12:57.688035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682200+0000","last_change":"2024-04-30T23:11:56.787962+0000","last_active":"2024-04-30T23:12:57.682200+0000","last_peered":"2024-04-30T23:12:57.682200+0000","last_clean":"2024-04-30T23:12:57.682200+0000","last_became_active":"2024-04-30T23:11:56.787540+0000","last_became_peered":"2024-04-30T23:11:56.787540+0000","last_unstale":"2024-04-30T23:12:57.682200+0000","last_undegraded":"2024-04-30T23:12:57.682200+0000","last_fullsized":"2024-04-30T23:12:57.682200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:57:43.364201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699423+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:12:57.699423+0000","last_peered":"2024-04-30T23:12:57.699423+0000","last_clean":"2024-04-30T23:12:57.699423+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:12:57.699423+0000","last_undegraded":"2024-04-30T23:12:57.699423+0000","last_fullsized":"2024-04-30T23:12:57.699423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688984+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:12:57.688984+0000","last_peered":"2024-04-30T23:12:57.688984+0000","last_clean":"2024-04-30T23:12:57.688984+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:12:57.688984+0000","last_undegraded":"2024-04-30T23:12:57.688984+0000","last_fullsized":"2024-04-30T23:12:57.688984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681278+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:12:57.681278+0000","last_peered":"2024-04-30T23:12:57.681278+0000","last_clean":"2024-04-30T23:12:57.681278+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:12:57.681278+0000","last_undegraded":"2024-04-30T23:12:57.681278+0000","last_fullsized":"2024-04-30T23:12:57.681278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045724+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:12:58.045724+0000","last_peered":"2024-04-30T23:12:58.045724+0000","last_clean":"2024-04-30T23:12:58.045724+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:12:58.045724+0000","last_undegraded":"2024-04-30T23:12:58.045724+0000","last_fullsized":"2024-04-30T23:12:58.045724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686196+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:12:57.686196+0000","last_peered":"2024-04-30T23:12:57.686196+0000","last_clean":"2024-04-30T23:12:57.686196+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:12:57.686196+0000","last_undegraded":"2024-04-30T23:12:57.686196+0000","last_fullsized":"2024-04-30T23:12:57.686196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682156+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:12:57.682156+0000","last_peered":"2024-04-30T23:12:57.682156+0000","last_clean":"2024-04-30T23:12:57.682156+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:12:57.682156+0000","last_undegraded":"2024-04-30T23:12:57.682156+0000","last_fullsized":"2024-04-30T23:12:57.682156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699203+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:12:57.699203+0000","last_peered":"2024-04-30T23:12:57.699203+0000","last_clean":"2024-04-30T23:12:57.699203+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:12:57.699203+0000","last_undegraded":"2024-04-30T23:12:57.699203+0000","last_fullsized":"2024-04-30T23:12:57.699203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75530,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1228,"num_read_kb":699,"num_write":262,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":520445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645360,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1765376,"data_stored":1174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":523631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070523,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":519913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36988,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708164,"statfs":{"total":95995035648,"available":95957159936,"internally_reserved":0,"allocated":1683456,"data_stored":1117083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":515039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1138688,"data_stored":583273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":517335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36468,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708684,"statfs":{"total":95995035648,"available":95957692416,"internally_reserved":0,"allocated":1159168,"data_stored":584865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":514747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920847,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":519645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1112133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:13:27.947 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-30T23:13:27.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T23:13:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:27 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2547195824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:28.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:27 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/587099303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:27 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2547195824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:28.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:27 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/587099303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.089+0000 7f2d26a62640 1 -- 172.21.15.100:0/3133584267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 msgr2=0x7f2d20116870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.089+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3133584267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d20116870 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009ca0 tx=0x7f2d1802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 -- 172.21.15.100:0/3133584267 shutdown_connections 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3133584267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d20116870 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3133584267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 0x7f2d2010fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3133584267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d2010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 -- 172.21.15.100:0/3133584267 >> 172.21.15.100:0/3133584267 conn(0x7f2d2006e420 msgr2=0x7f2d2010bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 -- 172.21.15.100:0/3133584267 shutdown_connections 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 -- 172.21.15.100:0/3133584267 wait complete. 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 Processor -- start 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.090+0000 7f2d26a62640 1 -- start start 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d201a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 0x7f2d201a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2011a030 con 0x7f2d20114450 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20119eb0 con 0x7f2d2010f750 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2011a1b0 con 0x7f2d2010e510 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35128/0 (socket says 172.21.15.100:35128) 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 -- 172.21.15.100:0/3284631112 learned_addr learned my addr 172.21.15.100:0/3284631112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d201a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 -- 172.21.15.100:0/3284631112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 msgr2=0x7f2d201a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d201a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1f7fe640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 0x7f2d201a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 -- 172.21.15.100:0/3284631112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 msgr2=0x7f2d201a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 0x7f2d201a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 -- 172.21.15.100:0/3284631112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d201ac670 con 0x7f2d20114450 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d201a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d24fff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097b0 tx=0x7f2d18003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18004240 con 0x7f2d20114450 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d180317c0 con 0x7f2d20114450 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1802fde0 con 0x7f2d20114450 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d201ac900 con 0x7f2d20114450 2024-04-30T23:13:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.091+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d201ace50 con 0x7f2d20114450 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.092+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d20113260 con 0x7f2d20114450 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.094+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2d180043e0 con 0x7f2d20114450 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.094+0000 7f2d1d7fa640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 0x7f2d080a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.094+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 0x7f2d080a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.094+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2d180f2160 con 0x7f2d20114450 2024-04-30T23:13:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.095+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 0x7f2d080a60c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2d2010f110 tx=0x7f2d10005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.099+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2d180be7e0 con 0x7f2d20114450 2024-04-30T23:13:28.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.273+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 --> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d20063020 con 0x7f2d080a3bb0 2024-04-30T23:13:28.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.282+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/3284631112 <== mgr.14152 v2:172.21.15.100:6800/3346272580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340528 (secure 0 0 0) 0x7f2d20063020 con 0x7f2d080a3bb0 2024-04-30T23:13:28.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:28.288 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-04-30T23:13:28.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 msgr2=0x7f2d080a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 0x7f2d080a60c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2d2010f110 tx=0x7f2d10005db0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 msgr2=0x7f2d201ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097b0 tx=0x7f2d18003c20 comp rx=0 tx=0).stop 2024-04-30T23:13:28.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 shutdown_connections 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2d080a3bb0 0x7f2d080a60c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d20114450 0x7f2d201ac0b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d2010f750 0x7f2d201a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 --2- 172.21.15.100:0/3284631112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d2010e510 0x7f2d201a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 >> 172.21.15.100:0/3284631112 conn(0x7f2d2006e420 msgr2=0x7f2d20110430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 shutdown_connections 2024-04-30T23:13:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.286+0000 7f2d26a62640 1 -- 172.21.15.100:0/3284631112 wait complete. 2024-04-30T23:13:28.298 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-04-30T23:13:27.621673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666132,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1354,"num_read_kb":808,"num_write":445,"num_write_kb":3102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388796,"kb_used_data":14636,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553028,"statfs":{"total":1151940427776,"available":1151542300672,"internally_reserved":0,"allocated":14987264,"data_stored":8202266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":62,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003284"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699516+0000","last_change":"2024-04-30T23:11:00.915516+0000","last_active":"2024-04-30T23:12:57.699516+0000","last_peered":"2024-04-30T23:12:57.699516+0000","last_clean":"2024-04-30T23:12:57.699516+0000","last_became_active":"2024-04-30T23:11:00.914675+0000","last_became_peered":"2024-04-30T23:11:00.914675+0000","last_unstale":"2024-04-30T23:12:57.699516+0000","last_undegraded":"2024-04-30T23:12:57.699516+0000","last_fullsized":"2024-04-30T23:12:57.699516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:44:10.930689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688315+0000","last_change":"2024-04-30T23:11:00.901958+0000","last_active":"2024-04-30T23:12:57.688315+0000","last_peered":"2024-04-30T23:12:57.688315+0000","last_clean":"2024-04-30T23:12:57.688315+0000","last_became_active":"2024-04-30T23:11:00.901596+0000","last_became_peered":"2024-04-30T23:11:00.901596+0000","last_unstale":"2024-04-30T23:12:57.688315+0000","last_undegraded":"2024-04-30T23:12:57.688315+0000","last_fullsized":"2024-04-30T23:12:57.688315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:02:17.627447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688146+0000","last_change":"2024-04-30T23:11:00.920016+0000","last_active":"2024-04-30T23:12:57.688146+0000","last_peered":"2024-04-30T23:12:57.688146+0000","last_clean":"2024-04-30T23:12:57.688146+0000","last_became_active":"2024-04-30T23:11:00.919636+0000","last_became_peered":"2024-04-30T23:11:00.919636+0000","last_unstale":"2024-04-30T23:12:57.688146+0000","last_undegraded":"2024-04-30T23:12:57.688146+0000","last_fullsized":"2024-04-30T23:12:57.688146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:30:30.598340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682397+0000","last_change":"2024-04-30T23:11:00.923387+0000","last_active":"2024-04-30T23:12:57.682397+0000","last_peered":"2024-04-30T23:12:57.682397+0000","last_clean":"2024-04-30T23:12:57.682397+0000","last_became_active":"2024-04-30T23:11:00.923017+0000","last_became_peered":"2024-04-30T23:11:00.923017+0000","last_unstale":"2024-04-30T23:12:57.682397+0000","last_undegraded":"2024-04-30T23:12:57.682397+0000","last_fullsized":"2024-04-30T23:12:57.682397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:00:28.393253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045627+0000","last_change":"2024-04-30T23:11:00.899439+0000","last_active":"2024-04-30T23:12:58.045627+0000","last_peered":"2024-04-30T23:12:58.045627+0000","last_clean":"2024-04-30T23:12:58.045627+0000","last_became_active":"2024-04-30T23:11:00.899031+0000","last_became_peered":"2024-04-30T23:11:00.899031+0000","last_unstale":"2024-04-30T23:12:58.045627+0000","last_undegraded":"2024-04-30T23:12:58.045627+0000","last_fullsized":"2024-04-30T23:12:58.045627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:59.583465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046492+0000","last_change":"2024-04-30T23:11:00.904265+0000","last_active":"2024-04-30T23:12:58.046492+0000","last_peered":"2024-04-30T23:12:58.046492+0000","last_clean":"2024-04-30T23:12:58.046492+0000","last_became_active":"2024-04-30T23:11:00.903892+0000","last_became_peered":"2024-04-30T23:11:00.903892+0000","last_unstale":"2024-04-30T23:12:58.046492+0000","last_undegraded":"2024-04-30T23:12:58.046492+0000","last_fullsized":"2024-04-30T23:12:58.046492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:26:34.158780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045640+0000","last_change":"2024-04-30T23:11:00.921041+0000","last_active":"2024-04-30T23:12:58.045640+0000","last_peered":"2024-04-30T23:12:58.045640+0000","last_clean":"2024-04-30T23:12:58.045640+0000","last_became_active":"2024-04-30T23:11:00.920684+0000","last_became_peered":"2024-04-30T23:11:00.920684+0000","last_unstale":"2024-04-30T23:12:58.045640+0000","last_undegraded":"2024-04-30T23:12:58.045640+0000","last_fullsized":"2024-04-30T23:12:58.045640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:28:01.072897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045267+0000","last_change":"2024-04-30T23:11:00.902192+0000","last_active":"2024-04-30T23:12:58.045267+0000","last_peered":"2024-04-30T23:12:58.045267+0000","last_clean":"2024-04-30T23:12:58.045267+0000","last_became_active":"2024-04-30T23:11:00.901823+0000","last_became_peered":"2024-04-30T23:11:00.901823+0000","last_unstale":"2024-04-30T23:12:58.045267+0000","last_undegraded":"2024-04-30T23:12:58.045267+0000","last_fullsized":"2024-04-30T23:12:58.045267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:23:44.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686437+0000","last_change":"2024-04-30T23:11:00.913732+0000","last_active":"2024-04-30T23:12:57.686437+0000","last_peered":"2024-04-30T23:12:57.686437+0000","last_clean":"2024-04-30T23:12:57.686437+0000","last_became_active":"2024-04-30T23:11:00.913094+0000","last_became_peered":"2024-04-30T23:11:00.913094+0000","last_unstale":"2024-04-30T23:12:57.686437+0000","last_undegraded":"2024-04-30T23:12:57.686437+0000","last_fullsized":"2024-04-30T23:12:57.686437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:38:20.014474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046149+0000","last_change":"2024-04-30T23:11:00.902913+0000","last_active":"2024-04-30T23:12:58.046149+0000","last_peered":"2024-04-30T23:12:58.046149+0000","last_clean":"2024-04-30T23:12:58.046149+0000","last_became_active":"2024-04-30T23:11:00.902431+0000","last_became_peered":"2024-04-30T23:11:00.902431+0000","last_unstale":"2024-04-30T23:12:58.046149+0000","last_undegraded":"2024-04-30T23:12:58.046149+0000","last_fullsized":"2024-04-30T23:12:58.046149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:48:14.213119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046399+0000","last_change":"2024-04-30T23:11:00.925351+0000","last_active":"2024-04-30T23:12:58.046399+0000","last_peered":"2024-04-30T23:12:58.046399+0000","last_clean":"2024-04-30T23:12:58.046399+0000","last_became_active":"2024-04-30T23:11:00.924955+0000","last_became_peered":"2024-04-30T23:11:00.924955+0000","last_unstale":"2024-04-30T23:12:58.046399+0000","last_undegraded":"2024-04-30T23:12:58.046399+0000","last_fullsized":"2024-04-30T23:12:58.046399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:27:50.890177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682264+0000","last_change":"2024-04-30T23:11:00.923557+0000","last_active":"2024-04-30T23:12:57.682264+0000","last_peered":"2024-04-30T23:12:57.682264+0000","last_clean":"2024-04-30T23:12:57.682264+0000","last_became_active":"2024-04-30T23:11:00.923210+0000","last_became_peered":"2024-04-30T23:11:00.923210+0000","last_unstale":"2024-04-30T23:12:57.682264+0000","last_undegraded":"2024-04-30T23:12:57.682264+0000","last_fullsized":"2024-04-30T23:12:57.682264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:37.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682138+0000","last_change":"2024-04-30T23:11:00.895031+0000","last_active":"2024-04-30T23:12:57.682138+0000","last_peered":"2024-04-30T23:12:57.682138+0000","last_clean":"2024-04-30T23:12:57.682138+0000","last_became_active":"2024-04-30T23:11:00.892640+0000","last_became_peered":"2024-04-30T23:11:00.892640+0000","last_unstale":"2024-04-30T23:12:57.682138+0000","last_undegraded":"2024-04-30T23:12:57.682138+0000","last_fullsized":"2024-04-30T23:12:57.682138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:46:50.833823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687998+0000","last_change":"2024-04-30T23:11:00.915385+0000","last_active":"2024-04-30T23:12:57.687998+0000","last_peered":"2024-04-30T23:12:57.687998+0000","last_clean":"2024-04-30T23:12:57.687998+0000","last_became_active":"2024-04-30T23:11:00.914062+0000","last_became_peered":"2024-04-30T23:11:00.914062+0000","last_unstale":"2024-04-30T23:12:57.687998+0000","last_undegraded":"2024-04-30T23:12:57.687998+0000","last_fullsized":"2024-04-30T23:12:57.687998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:23:19.093225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687919+0000","last_change":"2024-04-30T23:11:00.917047+0000","last_active":"2024-04-30T23:12:57.687919+0000","last_peered":"2024-04-30T23:12:57.687919+0000","last_clean":"2024-04-30T23:12:57.687919+0000","last_became_active":"2024-04-30T23:11:00.916653+0000","last_became_peered":"2024-04-30T23:11:00.916653+0000","last_unstale":"2024-04-30T23:12:57.687919+0000","last_undegraded":"2024-04-30T23:12:57.687919+0000","last_fullsized":"2024-04-30T23:12:57.687919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:56.008949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685928+0000","last_change":"2024-04-30T23:11:00.910758+0000","last_active":"2024-04-30T23:12:57.685928+0000","last_peered":"2024-04-30T23:12:57.685928+0000","last_clean":"2024-04-30T23:12:57.685928+0000","last_became_active":"2024-04-30T23:11:00.910407+0000","last_became_peered":"2024-04-30T23:11:00.910407+0000","last_unstale":"2024-04-30T23:12:57.685928+0000","last_undegraded":"2024-04-30T23:12:57.685928+0000","last_fullsized":"2024-04-30T23:12:57.685928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:01:38.284247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699367+0000","last_change":"2024-04-30T23:11:00.915111+0000","last_active":"2024-04-30T23:12:57.699367+0000","last_peered":"2024-04-30T23:12:57.699367+0000","last_clean":"2024-04-30T23:12:57.699367+0000","last_became_active":"2024-04-30T23:11:00.914176+0000","last_became_peered":"2024-04-30T23:11:00.914176+0000","last_unstale":"2024-04-30T23:12:57.699367+0000","last_undegraded":"2024-04-30T23:12:57.699367+0000","last_fullsized":"2024-04-30T23:12:57.699367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:20:08.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.915642+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.915087+0000","last_became_peered":"2024-04-30T23:11:00.915087+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:50:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688651+0000","last_change":"2024-04-30T23:11:00.910270+0000","last_active":"2024-04-30T23:12:57.688651+0000","last_peered":"2024-04-30T23:12:57.688651+0000","last_clean":"2024-04-30T23:12:57.688651+0000","last_became_active":"2024-04-30T23:11:00.909890+0000","last_became_peered":"2024-04-30T23:11:00.909890+0000","last_unstale":"2024-04-30T23:12:57.688651+0000","last_undegraded":"2024-04-30T23:12:57.688651+0000","last_fullsized":"2024-04-30T23:12:57.688651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:14:01.809131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688341+0000","last_change":"2024-04-30T23:11:04.935975+0000","last_active":"2024-04-30T23:12:57.688341+0000","last_peered":"2024-04-30T23:12:57.688341+0000","last_clean":"2024-04-30T23:12:57.688341+0000","last_became_active":"2024-04-30T23:11:04.935525+0000","last_became_peered":"2024-04-30T23:11:04.935525+0000","last_unstale":"2024-04-30T23:12:57.688341+0000","last_undegraded":"2024-04-30T23:12:57.688341+0000","last_fullsized":"2024-04-30T23:12:57.688341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:47:57.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.086367+0000","last_change":"2024-04-30T23:10:59.898836+0000","last_active":"2024-04-30T23:13:22.086367+0000","last_peered":"2024-04-30T23:13:22.086367+0000","last_clean":"2024-04-30T23:13:22.086367+0000","last_became_active":"2024-04-30T23:10:59.898452+0000","last_became_peered":"2024-04-30T23:10:59.898452+0000","last_unstale":"2024-04-30T23:13:22.086367+0000","last_undegraded":"2024-04-30T23:13:22.086367+0000","last_fullsized":"2024-04-30T23:13:22.086367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:50.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045532+0000","last_change":"2024-04-30T23:11:56.961809+0000","last_active":"2024-04-30T23:12:58.045532+0000","last_peered":"2024-04-30T23:12:58.045532+0000","last_clean":"2024-04-30T23:12:58.045532+0000","last_became_active":"2024-04-30T23:11:56.961461+0000","last_became_peered":"2024-04-30T23:11:56.961461+0000","last_unstale":"2024-04-30T23:12:58.045532+0000","last_undegraded":"2024-04-30T23:12:58.045532+0000","last_fullsized":"2024-04-30T23:12:58.045532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:41:28.814142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681522+0000","last_change":"2024-04-30T23:11:04.935636+0000","last_active":"2024-04-30T23:12:57.681522+0000","last_peered":"2024-04-30T23:12:57.681522+0000","last_clean":"2024-04-30T23:12:57.681522+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.681522+0000","last_undegraded":"2024-04-30T23:12:57.681522+0000","last_fullsized":"2024-04-30T23:12:57.681522+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:16:38.855345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046014+0000","last_change":"2024-04-30T23:10:59.897550+0000","last_active":"2024-04-30T23:12:58.046014+0000","last_peered":"2024-04-30T23:12:58.046014+0000","last_clean":"2024-04-30T23:12:58.046014+0000","last_became_active":"2024-04-30T23:10:59.896521+0000","last_became_peered":"2024-04-30T23:10:59.896521+0000","last_unstale":"2024-04-30T23:12:58.046014+0000","last_undegraded":"2024-04-30T23:12:58.046014+0000","last_fullsized":"2024-04-30T23:12:58.046014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:05.117954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:00.914342+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:00.913891+0000","last_became_peered":"2024-04-30T23:11:00.913891+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:33:50.710657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681734+0000","last_change":"2024-04-30T23:11:56.961194+0000","last_active":"2024-04-30T23:12:57.681734+0000","last_peered":"2024-04-30T23:12:57.681734+0000","last_clean":"2024-04-30T23:12:57.681734+0000","last_became_active":"2024-04-30T23:11:56.960793+0000","last_became_peered":"2024-04-30T23:11:56.960793+0000","last_unstale":"2024-04-30T23:12:57.681734+0000","last_undegraded":"2024-04-30T23:12:57.681734+0000","last_fullsized":"2024-04-30T23:12:57.681734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:44:07.845730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046051+0000","last_change":"2024-04-30T23:10:59.899393+0000","last_active":"2024-04-30T23:12:58.046051+0000","last_peered":"2024-04-30T23:12:58.046051+0000","last_clean":"2024-04-30T23:12:58.046051+0000","last_became_active":"2024-04-30T23:10:59.898984+0000","last_became_peered":"2024-04-30T23:10:59.898984+0000","last_unstale":"2024-04-30T23:12:58.046051+0000","last_undegraded":"2024-04-30T23:12:58.046051+0000","last_fullsized":"2024-04-30T23:12:58.046051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:53:43.839942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686032+0000","last_change":"2024-04-30T23:11:00.913423+0000","last_active":"2024-04-30T23:12:57.686032+0000","last_peered":"2024-04-30T23:12:57.686032+0000","last_clean":"2024-04-30T23:12:57.686032+0000","last_became_active":"2024-04-30T23:11:00.913002+0000","last_became_peered":"2024-04-30T23:11:00.913002+0000","last_unstale":"2024-04-30T23:12:57.686032+0000","last_undegraded":"2024-04-30T23:12:57.686032+0000","last_fullsized":"2024-04-30T23:12:57.686032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:37:54.429591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681585+0000","last_change":"2024-04-30T23:11:04.935617+0000","last_active":"2024-04-30T23:12:57.681585+0000","last_peered":"2024-04-30T23:12:57.681585+0000","last_clean":"2024-04-30T23:12:57.681585+0000","last_became_active":"2024-04-30T23:11:04.935187+0000","last_became_peered":"2024-04-30T23:11:04.935187+0000","last_unstale":"2024-04-30T23:12:57.681585+0000","last_undegraded":"2024-04-30T23:12:57.681585+0000","last_fullsized":"2024-04-30T23:12:57.681585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:04:52.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045594+0000","last_change":"2024-04-30T23:10:59.898277+0000","last_active":"2024-04-30T23:12:58.045594+0000","last_peered":"2024-04-30T23:12:58.045594+0000","last_clean":"2024-04-30T23:12:58.045594+0000","last_became_active":"2024-04-30T23:10:59.897873+0000","last_became_peered":"2024-04-30T23:10:59.897873+0000","last_unstale":"2024-04-30T23:12:58.045594+0000","last_undegraded":"2024-04-30T23:12:58.045594+0000","last_fullsized":"2024-04-30T23:12:58.045594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:05.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681638+0000","last_change":"2024-04-30T23:11:00.920463+0000","last_active":"2024-04-30T23:12:57.681638+0000","last_peered":"2024-04-30T23:12:57.681638+0000","last_clean":"2024-04-30T23:12:57.681638+0000","last_became_active":"2024-04-30T23:11:00.919996+0000","last_became_peered":"2024-04-30T23:11:00.919996+0000","last_unstale":"2024-04-30T23:12:57.681638+0000","last_undegraded":"2024-04-30T23:12:57.681638+0000","last_fullsized":"2024-04-30T23:12:57.681638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:31:28.053017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688419+0000","last_change":"2024-04-30T23:11:04.926234+0000","last_active":"2024-04-30T23:12:57.688419+0000","last_peered":"2024-04-30T23:12:57.688419+0000","last_clean":"2024-04-30T23:12:57.688419+0000","last_became_active":"2024-04-30T23:11:04.922545+0000","last_became_peered":"2024-04-30T23:11:04.922545+0000","last_unstale":"2024-04-30T23:12:57.688419+0000","last_undegraded":"2024-04-30T23:12:57.688419+0000","last_fullsized":"2024-04-30T23:12:57.688419+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:10:41.160549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:22.090455+0000","last_change":"2024-04-30T23:10:59.898573+0000","last_active":"2024-04-30T23:13:22.090455+0000","last_peered":"2024-04-30T23:13:22.090455+0000","last_clean":"2024-04-30T23:13:22.090455+0000","last_became_active":"2024-04-30T23:10:59.898183+0000","last_became_peered":"2024-04-30T23:10:59.898183+0000","last_unstale":"2024-04-30T23:13:22.090455+0000","last_undegraded":"2024-04-30T23:13:22.090455+0000","last_fullsized":"2024-04-30T23:13:22.090455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:14:32.098434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045498+0000","last_change":"2024-04-30T23:11:00.912364+0000","last_active":"2024-04-30T23:12:58.045498+0000","last_peered":"2024-04-30T23:12:58.045498+0000","last_clean":"2024-04-30T23:12:58.045498+0000","last_became_active":"2024-04-30T23:11:00.911905+0000","last_became_peered":"2024-04-30T23:11:00.911905+0000","last_unstale":"2024-04-30T23:12:58.045498+0000","last_undegraded":"2024-04-30T23:12:58.045498+0000","last_fullsized":"2024-04-30T23:12:58.045498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:41:37.470224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688386+0000","last_change":"2024-04-30T23:11:04.927158+0000","last_active":"2024-04-30T23:12:57.688386+0000","last_peered":"2024-04-30T23:12:57.688386+0000","last_clean":"2024-04-30T23:12:57.688386+0000","last_became_active":"2024-04-30T23:11:04.926629+0000","last_became_peered":"2024-04-30T23:11:04.926629+0000","last_unstale":"2024-04-30T23:12:57.688386+0000","last_undegraded":"2024-04-30T23:12:57.688386+0000","last_fullsized":"2024-04-30T23:12:57.688386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:32.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045390+0000","last_change":"2024-04-30T23:10:59.899152+0000","last_active":"2024-04-30T23:12:58.045390+0000","last_peered":"2024-04-30T23:12:58.045390+0000","last_clean":"2024-04-30T23:12:58.045390+0000","last_became_active":"2024-04-30T23:10:59.898709+0000","last_became_peered":"2024-04-30T23:10:59.898709+0000","last_unstale":"2024-04-30T23:12:58.045390+0000","last_undegraded":"2024-04-30T23:12:58.045390+0000","last_fullsized":"2024-04-30T23:12:58.045390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:59:10.708259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045470+0000","last_change":"2024-04-30T23:11:56.786296+0000","last_active":"2024-04-30T23:12:58.045470+0000","last_peered":"2024-04-30T23:12:58.045470+0000","last_clean":"2024-04-30T23:12:58.045470+0000","last_became_active":"2024-04-30T23:11:56.785834+0000","last_became_peered":"2024-04-30T23:11:56.785834+0000","last_unstale":"2024-04-30T23:12:58.045470+0000","last_undegraded":"2024-04-30T23:12:58.045470+0000","last_fullsized":"2024-04-30T23:12:58.045470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:33.908301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699277+0000","last_change":"2024-04-30T23:11:04.924357+0000","last_active":"2024-04-30T23:12:57.699277+0000","last_peered":"2024-04-30T23:12:57.699277+0000","last_clean":"2024-04-30T23:12:57.699277+0000","last_became_active":"2024-04-30T23:11:04.923839+0000","last_became_peered":"2024-04-30T23:11:04.923839+0000","last_unstale":"2024-04-30T23:12:57.699277+0000","last_undegraded":"2024-04-30T23:12:57.699277+0000","last_fullsized":"2024-04-30T23:12:57.699277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:02:57.533707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681833+0000","last_change":"2024-04-30T23:10:59.900026+0000","last_active":"2024-04-30T23:12:57.681833+0000","last_peered":"2024-04-30T23:12:57.681833+0000","last_clean":"2024-04-30T23:12:57.681833+0000","last_became_active":"2024-04-30T23:10:59.899660+0000","last_became_peered":"2024-04-30T23:10:59.899660+0000","last_unstale":"2024-04-30T23:12:57.681833+0000","last_undegraded":"2024-04-30T23:12:57.681833+0000","last_fullsized":"2024-04-30T23:12:57.681833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:07:49.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045153+0000","last_change":"2024-04-30T23:11:00.900085+0000","last_active":"2024-04-30T23:12:58.045153+0000","last_peered":"2024-04-30T23:12:58.045153+0000","last_clean":"2024-04-30T23:12:58.045153+0000","last_became_active":"2024-04-30T23:11:00.899775+0000","last_became_peered":"2024-04-30T23:11:00.899775+0000","last_unstale":"2024-04-30T23:12:58.045153+0000","last_undegraded":"2024-04-30T23:12:58.045153+0000","last_fullsized":"2024-04-30T23:12:58.045153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:01:59.146573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688223+0000","last_change":"2024-04-30T23:11:04.930808+0000","last_active":"2024-04-30T23:12:57.688223+0000","last_peered":"2024-04-30T23:12:57.688223+0000","last_clean":"2024-04-30T23:12:57.688223+0000","last_became_active":"2024-04-30T23:11:04.930317+0000","last_became_peered":"2024-04-30T23:11:04.930317+0000","last_unstale":"2024-04-30T23:12:57.688223+0000","last_undegraded":"2024-04-30T23:12:57.688223+0000","last_fullsized":"2024-04-30T23:12:57.688223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:47:15.197319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681066+0000","last_change":"2024-04-30T23:10:59.900025+0000","last_active":"2024-04-30T23:12:57.681066+0000","last_peered":"2024-04-30T23:12:57.681066+0000","last_clean":"2024-04-30T23:12:57.681066+0000","last_became_active":"2024-04-30T23:10:59.899685+0000","last_became_peered":"2024-04-30T23:10:59.899685+0000","last_unstale":"2024-04-30T23:12:57.681066+0000","last_undegraded":"2024-04-30T23:12:57.681066+0000","last_fullsized":"2024-04-30T23:12:57.681066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:04.951221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046188+0000","last_change":"2024-04-30T23:11:00.902264+0000","last_active":"2024-04-30T23:12:58.046188+0000","last_peered":"2024-04-30T23:12:58.046188+0000","last_clean":"2024-04-30T23:12:58.046188+0000","last_became_active":"2024-04-30T23:11:00.901934+0000","last_became_peered":"2024-04-30T23:11:00.901934+0000","last_unstale":"2024-04-30T23:12:58.046188+0000","last_undegraded":"2024-04-30T23:12:58.046188+0000","last_fullsized":"2024-04-30T23:12:58.046188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:49.627448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045179+0000","last_change":"2024-04-30T23:11:04.934478+0000","last_active":"2024-04-30T23:12:58.045179+0000","last_peered":"2024-04-30T23:12:58.045179+0000","last_clean":"2024-04-30T23:12:58.045179+0000","last_became_active":"2024-04-30T23:11:04.933848+0000","last_became_peered":"2024-04-30T23:11:04.933848+0000","last_unstale":"2024-04-30T23:12:58.045179+0000","last_undegraded":"2024-04-30T23:12:58.045179+0000","last_fullsized":"2024-04-30T23:12:58.045179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:18.009939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'7","reported_seq":274,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.093589+0000","last_change":"2024-04-30T23:10:59.899041+0000","last_active":"2024-04-30T23:13:24.093589+0000","last_peered":"2024-04-30T23:13:24.093589+0000","last_clean":"2024-04-30T23:13:24.093589+0000","last_became_active":"2024-04-30T23:10:59.898684+0000","last_became_peered":"2024-04-30T23:10:59.898684+0000","last_unstale":"2024-04-30T23:13:24.093589+0000","last_undegraded":"2024-04-30T23:13:24.093589+0000","last_fullsized":"2024-04-30T23:13:24.093589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:27.907245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686456+0000","last_change":"2024-04-30T23:11:00.914750+0000","last_active":"2024-04-30T23:12:57.686456+0000","last_peered":"2024-04-30T23:12:57.686456+0000","last_clean":"2024-04-30T23:12:57.686456+0000","last_became_active":"2024-04-30T23:11:00.914353+0000","last_became_peered":"2024-04-30T23:11:00.914353+0000","last_unstale":"2024-04-30T23:12:57.686456+0000","last_undegraded":"2024-04-30T23:12:57.686456+0000","last_fullsized":"2024-04-30T23:12:57.686456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:03:02.320499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045193+0000","last_change":"2024-04-30T23:11:04.926531+0000","last_active":"2024-04-30T23:12:58.045193+0000","last_peered":"2024-04-30T23:12:58.045193+0000","last_clean":"2024-04-30T23:12:58.045193+0000","last_became_active":"2024-04-30T23:11:04.926125+0000","last_became_peered":"2024-04-30T23:11:04.926125+0000","last_unstale":"2024-04-30T23:12:58.045193+0000","last_undegraded":"2024-04-30T23:12:58.045193+0000","last_fullsized":"2024-04-30T23:12:58.045193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:57:16.715608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045834+0000","last_change":"2024-04-30T23:10:59.897453+0000","last_active":"2024-04-30T23:12:58.045834+0000","last_peered":"2024-04-30T23:12:58.045834+0000","last_clean":"2024-04-30T23:12:58.045834+0000","last_became_active":"2024-04-30T23:10:59.896658+0000","last_became_peered":"2024-04-30T23:10:59.896658+0000","last_unstale":"2024-04-30T23:12:58.045834+0000","last_undegraded":"2024-04-30T23:12:58.045834+0000","last_fullsized":"2024-04-30T23:12:58.045834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:22:11.558042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688434+0000","last_change":"2024-04-30T23:11:00.905939+0000","last_active":"2024-04-30T23:12:57.688434+0000","last_peered":"2024-04-30T23:12:57.688434+0000","last_clean":"2024-04-30T23:12:57.688434+0000","last_became_active":"2024-04-30T23:11:00.905154+0000","last_became_peered":"2024-04-30T23:11:00.905154+0000","last_unstale":"2024-04-30T23:12:57.688434+0000","last_undegraded":"2024-04-30T23:12:57.688434+0000","last_fullsized":"2024-04-30T23:12:57.688434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:31:24.359399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681974+0000","last_change":"2024-04-30T23:11:04.929250+0000","last_active":"2024-04-30T23:12:57.681974+0000","last_peered":"2024-04-30T23:12:57.681974+0000","last_clean":"2024-04-30T23:12:57.681974+0000","last_became_active":"2024-04-30T23:11:04.928756+0000","last_became_peered":"2024-04-30T23:11:04.928756+0000","last_unstale":"2024-04-30T23:12:57.681974+0000","last_undegraded":"2024-04-30T23:12:57.681974+0000","last_fullsized":"2024-04-30T23:12:57.681974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.092164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681399+0000","last_change":"2024-04-30T23:10:59.902260+0000","last_active":"2024-04-30T23:12:57.681399+0000","last_peered":"2024-04-30T23:12:57.681399+0000","last_clean":"2024-04-30T23:12:57.681399+0000","last_became_active":"2024-04-30T23:10:59.901955+0000","last_became_peered":"2024-04-30T23:10:59.901955+0000","last_unstale":"2024-04-30T23:12:57.681399+0000","last_undegraded":"2024-04-30T23:12:57.681399+0000","last_fullsized":"2024-04-30T23:12:57.681399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:18.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686301+0000","last_change":"2024-04-30T23:11:00.915154+0000","last_active":"2024-04-30T23:12:57.686301+0000","last_peered":"2024-04-30T23:12:57.686301+0000","last_clean":"2024-04-30T23:12:57.686301+0000","last_became_active":"2024-04-30T23:11:00.914527+0000","last_became_peered":"2024-04-30T23:11:00.914527+0000","last_unstale":"2024-04-30T23:12:57.686301+0000","last_undegraded":"2024-04-30T23:12:57.686301+0000","last_fullsized":"2024-04-30T23:12:57.686301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.937196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045329+0000","last_change":"2024-04-30T23:11:04.921282+0000","last_active":"2024-04-30T23:12:58.045329+0000","last_peered":"2024-04-30T23:12:58.045329+0000","last_clean":"2024-04-30T23:12:58.045329+0000","last_became_active":"2024-04-30T23:11:04.920795+0000","last_became_peered":"2024-04-30T23:11:04.920795+0000","last_unstale":"2024-04-30T23:12:58.045329+0000","last_undegraded":"2024-04-30T23:12:58.045329+0000","last_fullsized":"2024-04-30T23:12:58.045329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:20:59.419737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'42","reported_seq":321,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094084+0000","last_change":"2024-04-30T23:10:59.898485+0000","last_active":"2024-04-30T23:13:24.094084+0000","last_peered":"2024-04-30T23:13:24.094084+0000","last_clean":"2024-04-30T23:13:24.094084+0000","last_became_active":"2024-04-30T23:10:59.895988+0000","last_became_peered":"2024-04-30T23:10:59.895988+0000","last_unstale":"2024-04-30T23:13:24.094084+0000","last_undegraded":"2024-04-30T23:13:24.094084+0000","last_fullsized":"2024-04-30T23:13:24.094084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:09:48.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":248,"num_read_kb":191,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045960+0000","last_change":"2024-04-30T23:11:00.920960+0000","last_active":"2024-04-30T23:12:58.045960+0000","last_peered":"2024-04-30T23:12:58.045960+0000","last_clean":"2024-04-30T23:12:58.045960+0000","last_became_active":"2024-04-30T23:11:00.920420+0000","last_became_peered":"2024-04-30T23:11:00.920420+0000","last_unstale":"2024-04-30T23:12:58.045960+0000","last_undegraded":"2024-04-30T23:12:58.045960+0000","last_fullsized":"2024-04-30T23:12:58.045960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:26.753905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681824+0000","last_change":"2024-04-30T23:11:04.935450+0000","last_active":"2024-04-30T23:12:57.681824+0000","last_peered":"2024-04-30T23:12:57.681824+0000","last_clean":"2024-04-30T23:12:57.681824+0000","last_became_active":"2024-04-30T23:11:04.934952+0000","last_became_peered":"2024-04-30T23:11:04.934952+0000","last_unstale":"2024-04-30T23:12:57.681824+0000","last_undegraded":"2024-04-30T23:12:57.681824+0000","last_fullsized":"2024-04-30T23:12:57.681824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:44:38.516350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688773+0000","last_change":"2024-04-30T23:10:59.894707+0000","last_active":"2024-04-30T23:12:57.688773+0000","last_peered":"2024-04-30T23:12:57.688773+0000","last_clean":"2024-04-30T23:12:57.688773+0000","last_became_active":"2024-04-30T23:10:59.894344+0000","last_became_peered":"2024-04-30T23:10:59.894344+0000","last_unstale":"2024-04-30T23:12:57.688773+0000","last_undegraded":"2024-04-30T23:12:57.688773+0000","last_fullsized":"2024-04-30T23:12:57.688773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:58:12.262029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681944+0000","last_change":"2024-04-30T23:11:00.911122+0000","last_active":"2024-04-30T23:12:57.681944+0000","last_peered":"2024-04-30T23:12:57.681944+0000","last_clean":"2024-04-30T23:12:57.681944+0000","last_became_active":"2024-04-30T23:11:00.910810+0000","last_became_peered":"2024-04-30T23:11:00.910810+0000","last_unstale":"2024-04-30T23:12:57.681944+0000","last_undegraded":"2024-04-30T23:12:57.681944+0000","last_fullsized":"2024-04-30T23:12:57.681944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:11.726590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699037+0000","last_change":"2024-04-30T23:11:04.930333+0000","last_active":"2024-04-30T23:12:57.699037+0000","last_peered":"2024-04-30T23:12:57.699037+0000","last_clean":"2024-04-30T23:12:57.699037+0000","last_became_active":"2024-04-30T23:11:04.929862+0000","last_became_peered":"2024-04-30T23:11:04.929862+0000","last_unstale":"2024-04-30T23:12:57.699037+0000","last_undegraded":"2024-04-30T23:12:57.699037+0000","last_fullsized":"2024-04-30T23:12:57.699037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:02:18.710951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681556+0000","last_change":"2024-04-30T23:10:59.897689+0000","last_active":"2024-04-30T23:12:57.681556+0000","last_peered":"2024-04-30T23:12:57.681556+0000","last_clean":"2024-04-30T23:12:57.681556+0000","last_became_active":"2024-04-30T23:10:59.897331+0000","last_became_peered":"2024-04-30T23:10:59.897331+0000","last_unstale":"2024-04-30T23:12:57.681556+0000","last_undegraded":"2024-04-30T23:12:57.681556+0000","last_fullsized":"2024-04-30T23:12:57.681556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:12:03.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046162+0000","last_change":"2024-04-30T23:11:00.914611+0000","last_active":"2024-04-30T23:12:58.046162+0000","last_peered":"2024-04-30T23:12:58.046162+0000","last_clean":"2024-04-30T23:12:58.046162+0000","last_became_active":"2024-04-30T23:11:00.914257+0000","last_became_peered":"2024-04-30T23:11:00.914257+0000","last_unstale":"2024-04-30T23:12:58.046162+0000","last_undegraded":"2024-04-30T23:12:58.046162+0000","last_fullsized":"2024-04-30T23:12:58.046162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:13.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045314+0000","last_change":"2024-04-30T23:11:04.932629+0000","last_active":"2024-04-30T23:12:58.045314+0000","last_peered":"2024-04-30T23:12:58.045314+0000","last_clean":"2024-04-30T23:12:58.045314+0000","last_became_active":"2024-04-30T23:11:04.932201+0000","last_became_peered":"2024-04-30T23:11:04.932201+0000","last_unstale":"2024-04-30T23:12:58.045314+0000","last_undegraded":"2024-04-30T23:12:58.045314+0000","last_fullsized":"2024-04-30T23:12:58.045314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:21:59.863046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:23.088487+0000","last_change":"2024-04-30T23:10:59.893597+0000","last_active":"2024-04-30T23:13:23.088487+0000","last_peered":"2024-04-30T23:13:23.088487+0000","last_clean":"2024-04-30T23:13:23.088487+0000","last_became_active":"2024-04-30T23:10:59.893135+0000","last_became_peered":"2024-04-30T23:10:59.893135+0000","last_unstale":"2024-04-30T23:13:23.088487+0000","last_undegraded":"2024-04-30T23:13:23.088487+0000","last_fullsized":"2024-04-30T23:13:23.088487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:43:14.694206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045542+0000","last_change":"2024-04-30T23:11:00.919786+0000","last_active":"2024-04-30T23:12:58.045542+0000","last_peered":"2024-04-30T23:12:58.045542+0000","last_clean":"2024-04-30T23:12:58.045542+0000","last_became_active":"2024-04-30T23:11:00.919357+0000","last_became_peered":"2024-04-30T23:11:00.919357+0000","last_unstale":"2024-04-30T23:12:58.045542+0000","last_undegraded":"2024-04-30T23:12:58.045542+0000","last_fullsized":"2024-04-30T23:12:58.045542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:48:55.750823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682329+0000","last_change":"2024-04-30T23:11:04.936144+0000","last_active":"2024-04-30T23:12:57.682329+0000","last_peered":"2024-04-30T23:12:57.682329+0000","last_clean":"2024-04-30T23:12:57.682329+0000","last_became_active":"2024-04-30T23:11:04.935668+0000","last_became_peered":"2024-04-30T23:11:04.935668+0000","last_unstale":"2024-04-30T23:12:57.682329+0000","last_undegraded":"2024-04-30T23:12:57.682329+0000","last_fullsized":"2024-04-30T23:12:57.682329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:31:07.504351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045428+0000","last_change":"2024-04-30T23:10:59.895929+0000","last_active":"2024-04-30T23:12:58.045428+0000","last_peered":"2024-04-30T23:12:58.045428+0000","last_clean":"2024-04-30T23:12:58.045428+0000","last_became_active":"2024-04-30T23:10:59.895493+0000","last_became_peered":"2024-04-30T23:10:59.895493+0000","last_unstale":"2024-04-30T23:12:58.045428+0000","last_undegraded":"2024-04-30T23:12:58.045428+0000","last_fullsized":"2024-04-30T23:12:58.045428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:56.463650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681130+0000","last_change":"2024-04-30T23:11:00.906830+0000","last_active":"2024-04-30T23:12:57.681130+0000","last_peered":"2024-04-30T23:12:57.681130+0000","last_clean":"2024-04-30T23:12:57.681130+0000","last_became_active":"2024-04-30T23:11:00.905592+0000","last_became_peered":"2024-04-30T23:11:00.905592+0000","last_unstale":"2024-04-30T23:12:57.681130+0000","last_undegraded":"2024-04-30T23:12:57.681130+0000","last_fullsized":"2024-04-30T23:12:57.681130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:31:29.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681209+0000","last_change":"2024-04-30T23:11:04.936150+0000","last_active":"2024-04-30T23:12:57.681209+0000","last_peered":"2024-04-30T23:12:57.681209+0000","last_clean":"2024-04-30T23:12:57.681209+0000","last_became_active":"2024-04-30T23:11:04.935709+0000","last_became_peered":"2024-04-30T23:11:04.935709+0000","last_unstale":"2024-04-30T23:12:57.681209+0000","last_undegraded":"2024-04-30T23:12:57.681209+0000","last_fullsized":"2024-04-30T23:12:57.681209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:15.285431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046114+0000","last_change":"2024-04-30T23:10:59.894192+0000","last_active":"2024-04-30T23:12:58.046114+0000","last_peered":"2024-04-30T23:12:58.046114+0000","last_clean":"2024-04-30T23:12:58.046114+0000","last_became_active":"2024-04-30T23:10:59.893747+0000","last_became_peered":"2024-04-30T23:10:59.893747+0000","last_unstale":"2024-04-30T23:12:58.046114+0000","last_undegraded":"2024-04-30T23:12:58.046114+0000","last_fullsized":"2024-04-30T23:12:58.046114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:11:36.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699284+0000","last_change":"2024-04-30T23:11:00.904775+0000","last_active":"2024-04-30T23:12:57.699284+0000","last_peered":"2024-04-30T23:12:57.699284+0000","last_clean":"2024-04-30T23:12:57.699284+0000","last_became_active":"2024-04-30T23:11:00.904320+0000","last_became_peered":"2024-04-30T23:11:00.904320+0000","last_unstale":"2024-04-30T23:12:57.699284+0000","last_undegraded":"2024-04-30T23:12:57.699284+0000","last_fullsized":"2024-04-30T23:12:57.699284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:11:52.708047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045535+0000","last_change":"2024-04-30T23:11:04.923716+0000","last_active":"2024-04-30T23:12:58.045535+0000","last_peered":"2024-04-30T23:12:58.045535+0000","last_clean":"2024-04-30T23:12:58.045535+0000","last_became_active":"2024-04-30T23:11:04.923202+0000","last_became_peered":"2024-04-30T23:11:04.923202+0000","last_unstale":"2024-04-30T23:12:58.045535+0000","last_undegraded":"2024-04-30T23:12:58.045535+0000","last_fullsized":"2024-04-30T23:12:58.045535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:10:44.995426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046015+0000","last_change":"2024-04-30T23:10:59.892253+0000","last_active":"2024-04-30T23:12:58.046015+0000","last_peered":"2024-04-30T23:12:58.046015+0000","last_clean":"2024-04-30T23:12:58.046015+0000","last_became_active":"2024-04-30T23:10:59.891679+0000","last_became_peered":"2024-04-30T23:10:59.891679+0000","last_unstale":"2024-04-30T23:12:58.046015+0000","last_undegraded":"2024-04-30T23:12:58.046015+0000","last_fullsized":"2024-04-30T23:12:58.046015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:36.462874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046160+0000","last_change":"2024-04-30T23:11:00.894456+0000","last_active":"2024-04-30T23:12:58.046160+0000","last_peered":"2024-04-30T23:12:58.046160+0000","last_clean":"2024-04-30T23:12:58.046160+0000","last_became_active":"2024-04-30T23:11:00.894068+0000","last_became_peered":"2024-04-30T23:11:00.894068+0000","last_unstale":"2024-04-30T23:12:58.046160+0000","last_undegraded":"2024-04-30T23:12:58.046160+0000","last_fullsized":"2024-04-30T23:12:58.046160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:13:10.681301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682174+0000","last_change":"2024-04-30T23:11:04.927450+0000","last_active":"2024-04-30T23:12:57.682174+0000","last_peered":"2024-04-30T23:12:57.682174+0000","last_clean":"2024-04-30T23:12:57.682174+0000","last_became_active":"2024-04-30T23:11:04.926607+0000","last_became_peered":"2024-04-30T23:11:04.926607+0000","last_unstale":"2024-04-30T23:12:57.682174+0000","last_undegraded":"2024-04-30T23:12:57.682174+0000","last_fullsized":"2024-04-30T23:12:57.682174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:29:30.093158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.089220+0000","last_change":"2024-04-30T23:10:59.900270+0000","last_active":"2024-04-30T23:13:24.089220+0000","last_peered":"2024-04-30T23:13:24.089220+0000","last_clean":"2024-04-30T23:13:24.089220+0000","last_became_active":"2024-04-30T23:10:59.899906+0000","last_became_peered":"2024-04-30T23:10:59.899906+0000","last_unstale":"2024-04-30T23:13:24.089220+0000","last_undegraded":"2024-04-30T23:13:24.089220+0000","last_fullsized":"2024-04-30T23:13:24.089220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:57.173656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046295+0000","last_change":"2024-04-30T23:11:00.904215+0000","last_active":"2024-04-30T23:12:58.046295+0000","last_peered":"2024-04-30T23:12:58.046295+0000","last_clean":"2024-04-30T23:12:58.046295+0000","last_became_active":"2024-04-30T23:11:00.903847+0000","last_became_peered":"2024-04-30T23:11:00.903847+0000","last_unstale":"2024-04-30T23:12:58.046295+0000","last_undegraded":"2024-04-30T23:12:58.046295+0000","last_fullsized":"2024-04-30T23:12:58.046295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T11:05:49.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682276+0000","last_change":"2024-04-30T23:11:04.924043+0000","last_active":"2024-04-30T23:12:57.682276+0000","last_peered":"2024-04-30T23:12:57.682276+0000","last_clean":"2024-04-30T23:12:57.682276+0000","last_became_active":"2024-04-30T23:11:04.923613+0000","last_became_peered":"2024-04-30T23:11:04.923613+0000","last_unstale":"2024-04-30T23:12:57.682276+0000","last_undegraded":"2024-04-30T23:12:57.682276+0000","last_fullsized":"2024-04-30T23:12:57.682276+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:01.390185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681462+0000","last_change":"2024-04-30T23:11:00.907782+0000","last_active":"2024-04-30T23:12:57.681462+0000","last_peered":"2024-04-30T23:12:57.681462+0000","last_clean":"2024-04-30T23:12:57.681462+0000","last_became_active":"2024-04-30T23:11:00.907419+0000","last_became_peered":"2024-04-30T23:11:00.907419+0000","last_unstale":"2024-04-30T23:12:57.681462+0000","last_undegraded":"2024-04-30T23:12:57.681462+0000","last_fullsized":"2024-04-30T23:12:57.681462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:49:29.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.089208+0000","last_change":"2024-04-30T23:10:59.895387+0000","last_active":"2024-04-30T23:13:24.089208+0000","last_peered":"2024-04-30T23:13:24.089208+0000","last_clean":"2024-04-30T23:13:24.089208+0000","last_became_active":"2024-04-30T23:10:59.895048+0000","last_became_peered":"2024-04-30T23:10:59.895048+0000","last_unstale":"2024-04-30T23:13:24.089208+0000","last_undegraded":"2024-04-30T23:13:24.089208+0000","last_fullsized":"2024-04-30T23:13:24.089208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:41:14.679878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046090+0000","last_change":"2024-04-30T23:11:04.922282+0000","last_active":"2024-04-30T23:12:58.046090+0000","last_peered":"2024-04-30T23:12:58.046090+0000","last_clean":"2024-04-30T23:12:58.046090+0000","last_became_active":"2024-04-30T23:11:04.921855+0000","last_became_peered":"2024-04-30T23:11:04.921855+0000","last_unstale":"2024-04-30T23:12:58.046090+0000","last_undegraded":"2024-04-30T23:12:58.046090+0000","last_fullsized":"2024-04-30T23:12:58.046090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:52:40.710986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045311+0000","last_change":"2024-04-30T23:11:00.911789+0000","last_active":"2024-04-30T23:12:58.045311+0000","last_peered":"2024-04-30T23:12:58.045311+0000","last_clean":"2024-04-30T23:12:58.045311+0000","last_became_active":"2024-04-30T23:11:00.910911+0000","last_became_peered":"2024-04-30T23:11:00.910911+0000","last_unstale":"2024-04-30T23:12:58.045311+0000","last_undegraded":"2024-04-30T23:12:58.045311+0000","last_fullsized":"2024-04-30T23:12:58.045311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:04:31.192506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681835+0000","last_change":"2024-04-30T23:10:59.895662+0000","last_active":"2024-04-30T23:12:57.681835+0000","last_peered":"2024-04-30T23:12:57.681835+0000","last_clean":"2024-04-30T23:12:57.681835+0000","last_became_active":"2024-04-30T23:10:59.895172+0000","last_became_peered":"2024-04-30T23:10:59.895172+0000","last_unstale":"2024-04-30T23:12:57.681835+0000","last_undegraded":"2024-04-30T23:12:57.681835+0000","last_fullsized":"2024-04-30T23:12:57.681835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:39:32.664008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045312+0000","last_change":"2024-04-30T23:09:47.887450+0000","last_active":"2024-04-30T23:12:58.045312+0000","last_peered":"2024-04-30T23:12:58.045312+0000","last_clean":"2024-04-30T23:12:58.045312+0000","last_became_active":"2024-04-30T23:09:47.886859+0000","last_became_peered":"2024-04-30T23:09:47.886859+0000","last_unstale":"2024-04-30T23:12:58.045312+0000","last_undegraded":"2024-04-30T23:12:58.045312+0000","last_fullsized":"2024-04-30T23:12:58.045312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:06:22.195159+0000","last_clean_scrub_stamp":"2024-04-30T23:06:22.195159+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:06:56.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681420+0000","last_change":"2024-04-30T23:11:04.927335+0000","last_active":"2024-04-30T23:12:57.681420+0000","last_peered":"2024-04-30T23:12:57.681420+0000","last_clean":"2024-04-30T23:12:57.681420+0000","last_became_active":"2024-04-30T23:11:04.926787+0000","last_became_peered":"2024-04-30T23:11:04.926787+0000","last_unstale":"2024-04-30T23:12:57.681420+0000","last_undegraded":"2024-04-30T23:12:57.681420+0000","last_fullsized":"2024-04-30T23:12:57.681420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:36:39.939229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681756+0000","last_change":"2024-04-30T23:11:00.907982+0000","last_active":"2024-04-30T23:12:57.681756+0000","last_peered":"2024-04-30T23:12:57.681756+0000","last_clean":"2024-04-30T23:12:57.681756+0000","last_became_active":"2024-04-30T23:11:00.907615+0000","last_became_peered":"2024-04-30T23:11:00.907615+0000","last_unstale":"2024-04-30T23:12:57.681756+0000","last_undegraded":"2024-04-30T23:12:57.681756+0000","last_fullsized":"2024-04-30T23:12:57.681756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:16.140281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045539+0000","last_change":"2024-04-30T23:10:59.898860+0000","last_active":"2024-04-30T23:12:58.045539+0000","last_peered":"2024-04-30T23:12:58.045539+0000","last_clean":"2024-04-30T23:12:58.045539+0000","last_became_active":"2024-04-30T23:10:59.898155+0000","last_became_peered":"2024-04-30T23:10:59.898155+0000","last_unstale":"2024-04-30T23:12:58.045539+0000","last_undegraded":"2024-04-30T23:12:58.045539+0000","last_fullsized":"2024-04-30T23:12:58.045539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:03:22.404485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699174+0000","last_change":"2024-04-30T23:11:56.976706+0000","last_active":"2024-04-30T23:12:57.699174+0000","last_peered":"2024-04-30T23:12:57.699174+0000","last_clean":"2024-04-30T23:12:57.699174+0000","last_became_active":"2024-04-30T23:11:56.976251+0000","last_became_peered":"2024-04-30T23:11:56.976251+0000","last_unstale":"2024-04-30T23:12:57.699174+0000","last_undegraded":"2024-04-30T23:12:57.699174+0000","last_fullsized":"2024-04-30T23:12:57.699174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:12.294435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,7,6],"acting":[11,10,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045996+0000","last_change":"2024-04-30T23:10:59.903719+0000","last_active":"2024-04-30T23:12:58.045996+0000","last_peered":"2024-04-30T23:12:58.045996+0000","last_clean":"2024-04-30T23:12:58.045996+0000","last_became_active":"2024-04-30T23:10:59.902769+0000","last_became_peered":"2024-04-30T23:10:59.902769+0000","last_unstale":"2024-04-30T23:12:58.045996+0000","last_undegraded":"2024-04-30T23:12:58.045996+0000","last_fullsized":"2024-04-30T23:12:58.045996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:36:17.874345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682280+0000","last_change":"2024-04-30T23:11:00.908477+0000","last_active":"2024-04-30T23:12:57.682280+0000","last_peered":"2024-04-30T23:12:57.682280+0000","last_clean":"2024-04-30T23:12:57.682280+0000","last_became_active":"2024-04-30T23:11:00.907626+0000","last_became_peered":"2024-04-30T23:11:00.907626+0000","last_unstale":"2024-04-30T23:12:57.682280+0000","last_undegraded":"2024-04-30T23:12:57.682280+0000","last_fullsized":"2024-04-30T23:12:57.682280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:39:40.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045091+0000","last_change":"2024-04-30T23:11:04.931537+0000","last_active":"2024-04-30T23:12:58.045091+0000","last_peered":"2024-04-30T23:12:58.045091+0000","last_clean":"2024-04-30T23:12:58.045091+0000","last_became_active":"2024-04-30T23:11:04.930990+0000","last_became_peered":"2024-04-30T23:11:04.930990+0000","last_unstale":"2024-04-30T23:12:58.045091+0000","last_undegraded":"2024-04-30T23:12:58.045091+0000","last_fullsized":"2024-04-30T23:12:58.045091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:14.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045827+0000","last_change":"2024-04-30T23:10:59.898914+0000","last_active":"2024-04-30T23:12:58.045827+0000","last_peered":"2024-04-30T23:12:58.045827+0000","last_clean":"2024-04-30T23:12:58.045827+0000","last_became_active":"2024-04-30T23:10:59.898533+0000","last_became_peered":"2024-04-30T23:10:59.898533+0000","last_unstale":"2024-04-30T23:12:58.045827+0000","last_undegraded":"2024-04-30T23:12:58.045827+0000","last_fullsized":"2024-04-30T23:12:58.045827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:31:54.132388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045533+0000","last_change":"2024-04-30T23:11:00.910379+0000","last_active":"2024-04-30T23:12:58.045533+0000","last_peered":"2024-04-30T23:12:58.045533+0000","last_clean":"2024-04-30T23:12:58.045533+0000","last_became_active":"2024-04-30T23:11:00.910080+0000","last_became_peered":"2024-04-30T23:11:00.910080+0000","last_unstale":"2024-04-30T23:12:58.045533+0000","last_undegraded":"2024-04-30T23:12:58.045533+0000","last_fullsized":"2024-04-30T23:12:58.045533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:18.264118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688124+0000","last_change":"2024-04-30T23:11:04.928138+0000","last_active":"2024-04-30T23:12:57.688124+0000","last_peered":"2024-04-30T23:12:57.688124+0000","last_clean":"2024-04-30T23:12:57.688124+0000","last_became_active":"2024-04-30T23:11:04.926980+0000","last_became_peered":"2024-04-30T23:11:04.926980+0000","last_unstale":"2024-04-30T23:12:57.688124+0000","last_undegraded":"2024-04-30T23:12:57.688124+0000","last_fullsized":"2024-04-30T23:12:57.688124+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:38.465467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682207+0000","last_change":"2024-04-30T23:10:59.904882+0000","last_active":"2024-04-30T23:12:57.682207+0000","last_peered":"2024-04-30T23:12:57.682207+0000","last_clean":"2024-04-30T23:12:57.682207+0000","last_became_active":"2024-04-30T23:10:59.904530+0000","last_became_peered":"2024-04-30T23:10:59.904530+0000","last_unstale":"2024-04-30T23:12:57.682207+0000","last_undegraded":"2024-04-30T23:12:57.682207+0000","last_fullsized":"2024-04-30T23:12:57.682207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:05.148855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688340+0000","last_change":"2024-04-30T23:11:56.787447+0000","last_active":"2024-04-30T23:12:57.688340+0000","last_peered":"2024-04-30T23:12:57.688340+0000","last_clean":"2024-04-30T23:12:57.688340+0000","last_became_active":"2024-04-30T23:11:56.786482+0000","last_became_peered":"2024-04-30T23:11:56.786482+0000","last_unstale":"2024-04-30T23:12:57.688340+0000","last_undegraded":"2024-04-30T23:12:57.688340+0000","last_fullsized":"2024-04-30T23:12:57.688340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:40.441920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682046+0000","last_change":"2024-04-30T23:11:56.962145+0000","last_active":"2024-04-30T23:12:57.682046+0000","last_peered":"2024-04-30T23:12:57.682046+0000","last_clean":"2024-04-30T23:12:57.682046+0000","last_became_active":"2024-04-30T23:11:56.961737+0000","last_became_peered":"2024-04-30T23:11:56.961737+0000","last_unstale":"2024-04-30T23:12:57.682046+0000","last_undegraded":"2024-04-30T23:12:57.682046+0000","last_fullsized":"2024-04-30T23:12:57.682046+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:27:04.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.703317+0000","last_change":"2024-04-30T23:12:57.702862+0000","last_active":"2024-04-30T23:12:57.703317+0000","last_peered":"2024-04-30T23:12:57.703317+0000","last_clean":"2024-04-30T23:12:57.703317+0000","last_became_active":"2024-04-30T23:12:57.700095+0000","last_became_peered":"2024-04-30T23:12:57.700095+0000","last_unstale":"2024-04-30T23:12:57.703317+0000","last_undegraded":"2024-04-30T23:12:57.703317+0000","last_fullsized":"2024-04-30T23:12:57.703317+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T07:12:38.867304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045454+0000","last_change":"2024-04-30T23:11:00.917048+0000","last_active":"2024-04-30T23:12:58.045454+0000","last_peered":"2024-04-30T23:12:58.045454+0000","last_clean":"2024-04-30T23:12:58.045454+0000","last_became_active":"2024-04-30T23:11:00.914763+0000","last_became_peered":"2024-04-30T23:11:00.914763+0000","last_unstale":"2024-04-30T23:12:58.045454+0000","last_undegraded":"2024-04-30T23:12:58.045454+0000","last_fullsized":"2024-04-30T23:12:58.045454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:26.813760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046402+0000","last_change":"2024-04-30T23:11:04.939306+0000","last_active":"2024-04-30T23:12:58.046402+0000","last_peered":"2024-04-30T23:12:58.046402+0000","last_clean":"2024-04-30T23:12:58.046402+0000","last_became_active":"2024-04-30T23:11:04.938482+0000","last_became_peered":"2024-04-30T23:11:04.938482+0000","last_unstale":"2024-04-30T23:12:58.046402+0000","last_undegraded":"2024-04-30T23:12:58.046402+0000","last_fullsized":"2024-04-30T23:12:58.046402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:47.918243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046094+0000","last_change":"2024-04-30T23:10:59.896997+0000","last_active":"2024-04-30T23:12:58.046094+0000","last_peered":"2024-04-30T23:12:58.046094+0000","last_clean":"2024-04-30T23:12:58.046094+0000","last_became_active":"2024-04-30T23:10:59.894656+0000","last_became_peered":"2024-04-30T23:10:59.894656+0000","last_unstale":"2024-04-30T23:12:58.046094+0000","last_undegraded":"2024-04-30T23:12:58.046094+0000","last_fullsized":"2024-04-30T23:12:58.046094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.666542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699455+0000","last_change":"2024-04-30T23:11:00.903080+0000","last_active":"2024-04-30T23:12:57.699455+0000","last_peered":"2024-04-30T23:12:57.699455+0000","last_clean":"2024-04-30T23:12:57.699455+0000","last_became_active":"2024-04-30T23:11:00.902379+0000","last_became_peered":"2024-04-30T23:11:00.902379+0000","last_unstale":"2024-04-30T23:12:57.699455+0000","last_undegraded":"2024-04-30T23:12:57.699455+0000","last_fullsized":"2024-04-30T23:12:57.699455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:11.518515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681925+0000","last_change":"2024-04-30T23:11:04.932029+0000","last_active":"2024-04-30T23:12:57.681925+0000","last_peered":"2024-04-30T23:12:57.681925+0000","last_clean":"2024-04-30T23:12:57.681925+0000","last_became_active":"2024-04-30T23:11:04.931521+0000","last_became_peered":"2024-04-30T23:11:04.931521+0000","last_unstale":"2024-04-30T23:12:57.681925+0000","last_undegraded":"2024-04-30T23:12:57.681925+0000","last_fullsized":"2024-04-30T23:12:57.681925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T10:16:40.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.698919+0000","last_change":"2024-04-30T23:11:57.132504+0000","last_active":"2024-04-30T23:12:57.698919+0000","last_peered":"2024-04-30T23:12:57.698919+0000","last_clean":"2024-04-30T23:12:57.698919+0000","last_became_active":"2024-04-30T23:11:57.125899+0000","last_became_peered":"2024-04-30T23:11:57.125899+0000","last_unstale":"2024-04-30T23:12:57.698919+0000","last_undegraded":"2024-04-30T23:12:57.698919+0000","last_fullsized":"2024-04-30T23:12:57.698919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:09:16.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045931+0000","last_change":"2024-04-30T23:11:00.903712+0000","last_active":"2024-04-30T23:12:58.045931+0000","last_peered":"2024-04-30T23:12:58.045931+0000","last_clean":"2024-04-30T23:12:58.045931+0000","last_became_active":"2024-04-30T23:11:00.903352+0000","last_became_peered":"2024-04-30T23:11:00.903352+0000","last_unstale":"2024-04-30T23:12:58.045931+0000","last_undegraded":"2024-04-30T23:12:58.045931+0000","last_fullsized":"2024-04-30T23:12:58.045931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:49.991590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682014+0000","last_change":"2024-04-30T23:11:04.936228+0000","last_active":"2024-04-30T23:12:57.682014+0000","last_peered":"2024-04-30T23:12:57.682014+0000","last_clean":"2024-04-30T23:12:57.682014+0000","last_became_active":"2024-04-30T23:11:04.935225+0000","last_became_peered":"2024-04-30T23:11:04.935225+0000","last_unstale":"2024-04-30T23:12:57.682014+0000","last_undegraded":"2024-04-30T23:12:57.682014+0000","last_fullsized":"2024-04-30T23:12:57.682014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:02:08.658269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045667+0000","last_change":"2024-04-30T23:10:59.895038+0000","last_active":"2024-04-30T23:12:58.045667+0000","last_peered":"2024-04-30T23:12:58.045667+0000","last_clean":"2024-04-30T23:12:58.045667+0000","last_became_active":"2024-04-30T23:10:59.894660+0000","last_became_peered":"2024-04-30T23:10:59.894660+0000","last_unstale":"2024-04-30T23:12:58.045667+0000","last_undegraded":"2024-04-30T23:12:58.045667+0000","last_fullsized":"2024-04-30T23:12:58.045667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:39:18.744332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046478+0000","last_change":"2024-04-30T23:11:00.913408+0000","last_active":"2024-04-30T23:12:58.046478+0000","last_peered":"2024-04-30T23:12:58.046478+0000","last_clean":"2024-04-30T23:12:58.046478+0000","last_became_active":"2024-04-30T23:11:00.913073+0000","last_became_peered":"2024-04-30T23:11:00.913073+0000","last_unstale":"2024-04-30T23:12:58.046478+0000","last_undegraded":"2024-04-30T23:12:58.046478+0000","last_fullsized":"2024-04-30T23:12:58.046478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:48.632063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.685842+0000","last_change":"2024-04-30T23:11:04.924090+0000","last_active":"2024-04-30T23:12:57.685842+0000","last_peered":"2024-04-30T23:12:57.685842+0000","last_clean":"2024-04-30T23:12:57.685842+0000","last_became_active":"2024-04-30T23:11:04.923629+0000","last_became_peered":"2024-04-30T23:11:04.923629+0000","last_unstale":"2024-04-30T23:12:57.685842+0000","last_undegraded":"2024-04-30T23:12:57.685842+0000","last_fullsized":"2024-04-30T23:12:57.685842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:47.780313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:13:24.094190+0000","last_change":"2024-04-30T23:10:59.893385+0000","last_active":"2024-04-30T23:13:24.094190+0000","last_peered":"2024-04-30T23:13:24.094190+0000","last_clean":"2024-04-30T23:13:24.094190+0000","last_became_active":"2024-04-30T23:10:59.892912+0000","last_became_peered":"2024-04-30T23:10:59.892912+0000","last_unstale":"2024-04-30T23:13:24.094190+0000","last_undegraded":"2024-04-30T23:13:24.094190+0000","last_fullsized":"2024-04-30T23:13:24.094190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:32.156651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2010,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046395+0000","last_change":"2024-04-30T23:11:00.920363+0000","last_active":"2024-04-30T23:12:58.046395+0000","last_peered":"2024-04-30T23:12:58.046395+0000","last_clean":"2024-04-30T23:12:58.046395+0000","last_became_active":"2024-04-30T23:11:00.919791+0000","last_became_peered":"2024-04-30T23:11:00.919791+0000","last_unstale":"2024-04-30T23:12:58.046395+0000","last_undegraded":"2024-04-30T23:12:58.046395+0000","last_fullsized":"2024-04-30T23:12:58.046395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:59.297777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.687890+0000","last_change":"2024-04-30T23:11:57.125302+0000","last_active":"2024-04-30T23:12:57.687890+0000","last_peered":"2024-04-30T23:12:57.687890+0000","last_clean":"2024-04-30T23:12:57.687890+0000","last_became_active":"2024-04-30T23:11:57.124777+0000","last_became_peered":"2024-04-30T23:11:57.124777+0000","last_unstale":"2024-04-30T23:12:57.687890+0000","last_undegraded":"2024-04-30T23:12:57.687890+0000","last_fullsized":"2024-04-30T23:12:57.687890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:57:20.020845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681686+0000","last_change":"2024-04-30T23:10:59.904972+0000","last_active":"2024-04-30T23:12:57.681686+0000","last_peered":"2024-04-30T23:12:57.681686+0000","last_clean":"2024-04-30T23:12:57.681686+0000","last_became_active":"2024-04-30T23:10:59.904602+0000","last_became_peered":"2024-04-30T23:10:59.904602+0000","last_unstale":"2024-04-30T23:12:57.681686+0000","last_undegraded":"2024-04-30T23:12:57.681686+0000","last_fullsized":"2024-04-30T23:12:57.681686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:53:12.127427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045832+0000","last_change":"2024-04-30T23:11:00.921117+0000","last_active":"2024-04-30T23:12:58.045832+0000","last_peered":"2024-04-30T23:12:58.045832+0000","last_clean":"2024-04-30T23:12:58.045832+0000","last_became_active":"2024-04-30T23:11:00.920707+0000","last_became_peered":"2024-04-30T23:11:00.920707+0000","last_unstale":"2024-04-30T23:12:58.045832+0000","last_undegraded":"2024-04-30T23:12:58.045832+0000","last_fullsized":"2024-04-30T23:12:58.045832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:21:46.031187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.680862+0000","last_change":"2024-04-30T23:11:04.922075+0000","last_active":"2024-04-30T23:12:57.680862+0000","last_peered":"2024-04-30T23:12:57.680862+0000","last_clean":"2024-04-30T23:12:57.680862+0000","last_became_active":"2024-04-30T23:11:04.921563+0000","last_became_peered":"2024-04-30T23:11:04.921563+0000","last_unstale":"2024-04-30T23:12:57.680862+0000","last_undegraded":"2024-04-30T23:12:57.680862+0000","last_fullsized":"2024-04-30T23:12:57.680862+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:11:03.900478+0000","last_clean_scrub_stamp":"2024-04-30T23:11:03.900478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:04:34.727837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682354+0000","last_change":"2024-04-30T23:10:59.901879+0000","last_active":"2024-04-30T23:12:57.682354+0000","last_peered":"2024-04-30T23:12:57.682354+0000","last_clean":"2024-04-30T23:12:57.682354+0000","last_became_active":"2024-04-30T23:10:59.901557+0000","last_became_peered":"2024-04-30T23:10:59.901557+0000","last_unstale":"2024-04-30T23:12:57.682354+0000","last_undegraded":"2024-04-30T23:12:57.682354+0000","last_fullsized":"2024-04-30T23:12:57.682354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:58.867819+0000","last_clean_scrub_stamp":"2024-04-30T23:10:58.867819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:57:31.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.046352+0000","last_change":"2024-04-30T23:11:00.923452+0000","last_active":"2024-04-30T23:12:58.046352+0000","last_peered":"2024-04-30T23:12:58.046352+0000","last_clean":"2024-04-30T23:12:58.046352+0000","last_became_active":"2024-04-30T23:11:00.923097+0000","last_became_peered":"2024-04-30T23:11:00.923097+0000","last_unstale":"2024-04-30T23:12:58.046352+0000","last_undegraded":"2024-04-30T23:12:58.046352+0000","last_fullsized":"2024-04-30T23:12:58.046352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:47.368940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699470+0000","last_change":"2024-04-30T23:11:00.907589+0000","last_active":"2024-04-30T23:12:57.699470+0000","last_peered":"2024-04-30T23:12:57.699470+0000","last_clean":"2024-04-30T23:12:57.699470+0000","last_became_active":"2024-04-30T23:11:00.907190+0000","last_became_peered":"2024-04-30T23:11:00.907190+0000","last_unstale":"2024-04-30T23:12:57.699470+0000","last_undegraded":"2024-04-30T23:12:57.699470+0000","last_fullsized":"2024-04-30T23:12:57.699470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:00:33.908015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688320+0000","last_change":"2024-04-30T23:11:00.909431+0000","last_active":"2024-04-30T23:12:57.688320+0000","last_peered":"2024-04-30T23:12:57.688320+0000","last_clean":"2024-04-30T23:12:57.688320+0000","last_became_active":"2024-04-30T23:11:00.909027+0000","last_became_peered":"2024-04-30T23:11:00.909027+0000","last_unstale":"2024-04-30T23:12:57.688320+0000","last_undegraded":"2024-04-30T23:12:57.688320+0000","last_fullsized":"2024-04-30T23:12:57.688320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T09:35:19.486932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688210+0000","last_change":"2024-04-30T23:11:00.914798+0000","last_active":"2024-04-30T23:12:57.688210+0000","last_peered":"2024-04-30T23:12:57.688210+0000","last_clean":"2024-04-30T23:12:57.688210+0000","last_became_active":"2024-04-30T23:11:00.914329+0000","last_became_peered":"2024-04-30T23:11:00.914329+0000","last_unstale":"2024-04-30T23:12:57.688210+0000","last_undegraded":"2024-04-30T23:12:57.688210+0000","last_fullsized":"2024-04-30T23:12:57.688210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:10:30.033559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688035+0000","last_change":"2024-04-30T23:11:00.904948+0000","last_active":"2024-04-30T23:12:57.688035+0000","last_peered":"2024-04-30T23:12:57.688035+0000","last_clean":"2024-04-30T23:12:57.688035+0000","last_became_active":"2024-04-30T23:11:00.904617+0000","last_became_peered":"2024-04-30T23:11:00.904617+0000","last_unstale":"2024-04-30T23:12:57.688035+0000","last_undegraded":"2024-04-30T23:12:57.688035+0000","last_fullsized":"2024-04-30T23:12:57.688035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T08:26:19.785144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682200+0000","last_change":"2024-04-30T23:11:56.787962+0000","last_active":"2024-04-30T23:12:57.682200+0000","last_peered":"2024-04-30T23:12:57.682200+0000","last_clean":"2024-04-30T23:12:57.682200+0000","last_became_active":"2024-04-30T23:11:56.787540+0000","last_became_peered":"2024-04-30T23:11:56.787540+0000","last_unstale":"2024-04-30T23:12:57.682200+0000","last_undegraded":"2024-04-30T23:12:57.682200+0000","last_fullsized":"2024-04-30T23:12:57.682200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:57:43.364201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699423+0000","last_change":"2024-04-30T23:11:00.902713+0000","last_active":"2024-04-30T23:12:57.699423+0000","last_peered":"2024-04-30T23:12:57.699423+0000","last_clean":"2024-04-30T23:12:57.699423+0000","last_became_active":"2024-04-30T23:11:00.901555+0000","last_became_peered":"2024-04-30T23:11:00.901555+0000","last_unstale":"2024-04-30T23:12:57.699423+0000","last_undegraded":"2024-04-30T23:12:57.699423+0000","last_fullsized":"2024-04-30T23:12:57.699423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T06:45:11.421737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.688984+0000","last_change":"2024-04-30T23:11:00.921476+0000","last_active":"2024-04-30T23:12:57.688984+0000","last_peered":"2024-04-30T23:12:57.688984+0000","last_clean":"2024-04-30T23:12:57.688984+0000","last_became_active":"2024-04-30T23:11:00.921092+0000","last_became_peered":"2024-04-30T23:11:00.921092+0000","last_unstale":"2024-04-30T23:12:57.688984+0000","last_undegraded":"2024-04-30T23:12:57.688984+0000","last_fullsized":"2024-04-30T23:12:57.688984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:45:51.659873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045711+0000","last_change":"2024-04-30T23:11:00.904273+0000","last_active":"2024-04-30T23:12:58.045711+0000","last_peered":"2024-04-30T23:12:58.045711+0000","last_clean":"2024-04-30T23:12:58.045711+0000","last_became_active":"2024-04-30T23:11:00.902045+0000","last_became_peered":"2024-04-30T23:11:00.902045+0000","last_unstale":"2024-04-30T23:12:58.045711+0000","last_undegraded":"2024-04-30T23:12:58.045711+0000","last_fullsized":"2024-04-30T23:12:58.045711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:17.559967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.681278+0000","last_change":"2024-04-30T23:11:00.902158+0000","last_active":"2024-04-30T23:12:57.681278+0000","last_peered":"2024-04-30T23:12:57.681278+0000","last_clean":"2024-04-30T23:12:57.681278+0000","last_became_active":"2024-04-30T23:11:00.901765+0000","last_became_peered":"2024-04-30T23:11:00.901765+0000","last_unstale":"2024-04-30T23:12:57.681278+0000","last_undegraded":"2024-04-30T23:12:57.681278+0000","last_fullsized":"2024-04-30T23:12:57.681278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:59.490343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:58.045724+0000","last_change":"2024-04-30T23:11:00.901772+0000","last_active":"2024-04-30T23:12:58.045724+0000","last_peered":"2024-04-30T23:12:58.045724+0000","last_clean":"2024-04-30T23:12:58.045724+0000","last_became_active":"2024-04-30T23:11:00.900948+0000","last_became_peered":"2024-04-30T23:11:00.900948+0000","last_unstale":"2024-04-30T23:12:58.045724+0000","last_undegraded":"2024-04-30T23:12:58.045724+0000","last_fullsized":"2024-04-30T23:12:58.045724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:02:24.200480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.686196+0000","last_change":"2024-04-30T23:11:00.910909+0000","last_active":"2024-04-30T23:12:57.686196+0000","last_peered":"2024-04-30T23:12:57.686196+0000","last_clean":"2024-04-30T23:12:57.686196+0000","last_became_active":"2024-04-30T23:11:00.910568+0000","last_became_peered":"2024-04-30T23:11:00.910568+0000","last_unstale":"2024-04-30T23:12:57.686196+0000","last_undegraded":"2024-04-30T23:12:57.686196+0000","last_fullsized":"2024-04-30T23:12:57.686196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:08.945751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.682156+0000","last_change":"2024-04-30T23:11:00.909665+0000","last_active":"2024-04-30T23:12:57.682156+0000","last_peered":"2024-04-30T23:12:57.682156+0000","last_clean":"2024-04-30T23:12:57.682156+0000","last_became_active":"2024-04-30T23:11:00.909303+0000","last_became_peered":"2024-04-30T23:11:00.909303+0000","last_unstale":"2024-04-30T23:12:57.682156+0000","last_undegraded":"2024-04-30T23:12:57.682156+0000","last_fullsized":"2024-04-30T23:12:57.682156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:58:12.208621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-30T23:12:57.699203+0000","last_change":"2024-04-30T23:11:00.905062+0000","last_active":"2024-04-30T23:12:57.699203+0000","last_peered":"2024-04-30T23:12:57.699203+0000","last_clean":"2024-04-30T23:12:57.699203+0000","last_became_active":"2024-04-30T23:11:00.904350+0000","last_became_peered":"2024-04-30T23:11:00.904350+0000","last_unstale":"2024-04-30T23:12:57.699203+0000","last_undegraded":"2024-04-30T23:12:57.699203+0000","last_fullsized":"2024-04-30T23:12:57.699203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T23:10:59.872073+0000","last_clean_scrub_stamp":"2024-04-30T23:10:59.872073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:13:52.477657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75530,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1228,"num_read_kb":699,"num_write":262,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":520445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645360,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1765376,"data_stored":1174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":523631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070523,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":519913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36988,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708164,"statfs":{"total":95995035648,"available":95957159936,"internally_reserved":0,"allocated":1683456,"data_stored":1117083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":515039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1138688,"data_stored":583273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":517335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36468,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708684,"statfs":{"total":95995035648,"available":95957692416,"internally_reserved":0,"allocated":1159168,"data_stored":584865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":514747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920847,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":519645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1112133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T23:13:28.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 -- 172.21.15.100:0/295353235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 msgr2=0x7fd81c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 --2- 172.21.15.100:0/295353235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c104070 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009900 tx=0x7fd80c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 -- 172.21.15.100:0/295353235 shutdown_connections 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 --2- 172.21.15.100:0/295353235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c108960 0x7fd81c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 --2- 172.21.15.100:0/295353235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c104070 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 --2- 172.21.15.100:0/295353235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c102a20 0x7fd81c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 -- 172.21.15.100:0/295353235 >> 172.21.15.100:0/295353235 conn(0x7fd81c0fdc10 msgr2=0x7fd81c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 -- 172.21.15.100:0/295353235 shutdown_connections 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.446+0000 7fd823f94640 1 -- 172.21.15.100:0/295353235 wait complete. 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 Processor -- start 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 -- start start 2024-04-30T23:13:28.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c102a20 0x7fd81c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c108960 0x7fd81c1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c10e550 con 0x7fd81c103c60 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c10e3d0 con 0x7fd81c108960 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd823f94640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c10e6d0 con 0x7fd81c102a20 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35136/0 (socket says 172.21.15.100:35136) 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 -- 172.21.15.100:0/3827480986 learned_addr learned my addr 172.21.15.100:0/3827480986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd821d30640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c102a20 0x7fd81c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd822531640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c108960 0x7fd81c1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 -- 172.21.15.100:0/3827480986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c102a20 msgr2=0x7fd81c0758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c102a20 0x7fd81c0758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.447+0000 7fd82152f640 1 -- 172.21.15.100:0/3827480986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c108960 msgr2=0x7fd81c1a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd82152f640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c108960 0x7fd81c1a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd82152f640 1 -- 172.21.15.100:0/3827480986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c1a1db0 con 0x7fd81c103c60 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd82152f640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c03f030 con 0x7fd81c103c60 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd80c003aa0 con 0x7fd81c103c60 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81c1a2040 con 0x7fd81c103c60 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c035070 con 0x7fd81c103c60 2024-04-30T23:13:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.448+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c1a2580 con 0x7fd81c103c60 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.449+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81c107770 con 0x7fd81c103c60 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.451+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd80c042030 con 0x7fd81c103c60 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.451+0000 7fd812ffd640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 0x7fd8080a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.452+0000 7fd821d30640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 0x7fd8080a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.452+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd80c0f0f00 con 0x7fd81c103c60 2024-04-30T23:13:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.452+0000 7fd821d30640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 0x7fd8080a6140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd81c103620 tx=0x7fd814009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.455+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd80c0bced0 con 0x7fd81c103c60 2024-04-30T23:13:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.637+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd81c0637e0 con 0x7fd81c103c60 2024-04-30T23:13:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.639+0000 7fd812ffd640 1 -- 172.21.15.100:0/3827480986 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7fd80c0c11d0 con 0x7fd81c103c60 2024-04-30T23:13:28.639 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 msgr2=0x7fd8080a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 0x7fd8080a6140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd81c103620 tx=0x7fd814009670 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 msgr2=0x7fd81c19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c031a50 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 shutdown_connections 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd8080a3c30 0x7fd8080a6140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd81c108960 0x7fd81c1a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd81c103c60 0x7fd81c19f020 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 --2- 172.21.15.100:0/3827480986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c102a20 0x7fd81c0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 >> 172.21.15.100:0/3827480986 conn(0x7fd81c0fdc10 msgr2=0x7fd81c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 shutdown_connections 2024-04-30T23:13:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.641+0000 7fd823f94640 1 -- 172.21.15.100:0/3827480986 wait complete. 2024-04-30T23:13:28.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:13:28.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:13:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- 172.21.15.100:0/1618441975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934103c60 msgr2=0x7f3934104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 --2- 172.21.15.100:0/1618441975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934103c60 0x7f3934104070 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f391c009900 tx=0x7f391c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- 172.21.15.100:0/1618441975 shutdown_connections 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 --2- 172.21.15.100:0/1618441975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934108960 0x7f393410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 --2- 172.21.15.100:0/1618441975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934103c60 0x7f3934104070 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 --2- 172.21.15.100:0/1618441975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 0x7f3934103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- 172.21.15.100:0/1618441975 >> 172.21.15.100:0/1618441975 conn(0x7f39340fdc10 msgr2=0x7f39341000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- 172.21.15.100:0/1618441975 shutdown_connections 2024-04-30T23:13:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- 172.21.15.100:0/1618441975 wait complete. 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 Processor -- start 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.765+0000 7f393935e640 1 -- start start 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 0x7f393406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934103c60 0x7f393419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f393410e550 con 0x7f3934108960 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f393410e3d0 con 0x7f3934102a20 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f393935e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f393410e6d0 con 0x7f3934103c60 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35160/0 (socket says 172.21.15.100:35160) 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 -- 172.21.15.100:0/849042881 learned_addr learned my addr 172.21.15.100:0/849042881 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f3932ffd640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 0x7f393406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f392bfff640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934103c60 0x7f393419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 -- 172.21.15.100:0/849042881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934103c60 msgr2=0x7f393419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934103c60 0x7f393419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 -- 172.21.15.100:0/849042881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 msgr2=0x7f393406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 0x7f393406a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 -- 172.21.15.100:0/849042881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39341a20a0 con 0x7f3934108960 2024-04-30T23:13:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.766+0000 7f39337fe640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f392c00eaa0 tx=0x7f392c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.769+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c00cdb0 con 0x7f3934108960 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.769+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392c005020 con 0x7f3934108960 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.769+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0116d0 con 0x7f3934108960 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.769+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39341a2390 con 0x7f3934108960 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.769+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39341a2930 con 0x7f3934108960 2024-04-30T23:13:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.770+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3934107770 con 0x7f3934108960 2024-04-30T23:13:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.772+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f392c0051d0 con 0x7f3934108960 2024-04-30T23:13:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.772+0000 7f3930ff9640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 0x7f39200a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.772+0000 7f3932ffd640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 0x7f39200a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.772+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f392c0d0740 con 0x7f3934108960 2024-04-30T23:13:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.773+0000 7f3932ffd640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 0x7f39200a6140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3924005fd0 tx=0x7f392400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:28.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.777+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f392c016030 con 0x7f3934108960 2024-04-30T23:13:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.956+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f393402dd70 con 0x7f3934108960 2024-04-30T23:13:28.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.956+0000 7f3930ff9640 1 -- 172.21.15.100:0/849042881 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f392c09c770 con 0x7f3934108960 2024-04-30T23:13:28.957 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 msgr2=0x7f39200a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 0x7f39200a6140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3924005fd0 tx=0x7f392400b410 comp rx=0 tx=0).stop 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 msgr2=0x7f39341a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f392c00eaa0 tx=0x7f392c00ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 shutdown_connections 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f39200a3c30 0x7f39200a6140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3934108960 0x7f39341a1880 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3934103c60 0x7f393419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 --2- 172.21.15.100:0/849042881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3934102a20 0x7f393406a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.958+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 >> 172.21.15.100:0/849042881 conn(0x7f39340fdc10 msgr2=0x7f3934104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.959+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 shutdown_connections 2024-04-30T23:13:28.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:28.959+0000 7f393935e640 1 -- 172.21.15.100:0/849042881 wait complete. 2024-04-30T23:13:28.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:28 smithi100 ceph-mon[29745]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:28.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:28 smithi100 ceph-mon[29745]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:28.969 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:28 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3827480986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:28.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:13:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:28 smithi104 ceph-mon[32987]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:28 smithi104 ceph-mon[32987]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:28 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3827480986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:28 smithi183 ceph-mon[33560]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:28 smithi183 ceph-mon[33560]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:28 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3827480986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 -- 172.21.15.100:0/1568505468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 msgr2=0x7fd0c4104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 --2- 172.21.15.100:0/1568505468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c4104040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009900 tx=0x7fd0b802a410 comp rx=0 tx=0).stop 2024-04-30T23:13:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 -- 172.21.15.100:0/1568505468 shutdown_connections 2024-04-30T23:13:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 --2- 172.21.15.100:0/1568505468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c41046d0 0x7fd0c410ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 --2- 172.21.15.100:0/1568505468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c4104040 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 --2- 172.21.15.100:0/1568505468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4103010 0x7fd0c4103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 -- 172.21.15.100:0/1568505468 >> 172.21.15.100:0/1568505468 conn(0x7fd0c40fd390 msgr2=0x7fd0c40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 -- 172.21.15.100:0/1568505468 shutdown_connections 2024-04-30T23:13:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.081+0000 7fd0c89be640 1 -- 172.21.15.100:0/1568505468 wait complete. 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 Processor -- start 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 -- start start 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 0x7fd0c419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c419f520 0x7fd0c41a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c410f8a0 con 0x7fd0c4103b70 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c410f720 con 0x7fd0c4103010 2024-04-30T23:13:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c89be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c410fa20 con 0x7fd0c419f520 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35178/0 (socket says 172.21.15.100:35178) 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 -- 172.21.15.100:0/528271131 learned_addr learned my addr 172.21.15.100:0/528271131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c2d9d640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c419f520 0x7fd0c41a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c259c640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 0x7fd0c419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 -- 172.21.15.100:0/528271131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c419f520 msgr2=0x7fd0c41a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c419f520 0x7fd0c41a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 -- 172.21.15.100:0/528271131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 msgr2=0x7fd0c419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 0x7fd0c419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 -- 172.21.15.100:0/528271131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c41a1fb0 con 0x7fd0c4103b70 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c259c640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 0x7fd0c419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.082+0000 7fd0c1d9b640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006010 tx=0x7fd0b80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.083+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b803f030 con 0x7fd0c4103b70 2024-04-30T23:13:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.083+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b8003cb0 con 0x7fd0c4103b70 2024-04-30T23:13:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.083+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c41a2240 con 0x7fd0c4103b70 2024-04-30T23:13:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.083+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8035070 con 0x7fd0c4103b70 2024-04-30T23:13:29.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.083+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c41a2730 con 0x7fd0c4103b70 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.084+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c406b370 con 0x7fd0c4103b70 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.085+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd0b8042030 con 0x7fd0c4103b70 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.085+0000 7fd0b37fe640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 0x7fd0ac0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.086+0000 7fd0c259c640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 0x7fd0ac0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.086+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd0b80f1540 con 0x7fd0c4103b70 2024-04-30T23:13:29.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.086+0000 7fd0c259c640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 0x7fd0ac0a60c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40058c0 tx=0x7fd0b4005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.089+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd0b80bdbc0 con 0x7fd0c4103b70 2024-04-30T23:13:29.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.266+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd0c402dde0 con 0x7fd0c4103b70 2024-04-30T23:13:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.267+0000 7fd0b37fe640 1 -- 172.21.15.100:0/528271131 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fd0b80bd4c0 con 0x7fd0c4103b70 2024-04-30T23:13:29.267 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 msgr2=0x7fd0ac0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 0x7fd0ac0a60c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40058c0 tx=0x7fd0b4005d30 comp rx=0 tx=0).stop 2024-04-30T23:13:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 msgr2=0x7fd0c419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006010 tx=0x7fd0b80043b0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 shutdown_connections 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd0ac0a3bb0 0x7fd0ac0a60c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c419f520 0x7fd0c41a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0c4103b70 0x7fd0c419a5a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 --2- 172.21.15.100:0/528271131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0c4103010 0x7fd0c419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 >> 172.21.15.100:0/528271131 conn(0x7fd0c40fd390 msgr2=0x7fd0c40ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 shutdown_connections 2024-04-30T23:13:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.269+0000 7fd0c89be640 1 -- 172.21.15.100:0/528271131 wait complete. 2024-04-30T23:13:29.281 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:13:29.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 -- 172.21.15.100:0/3437527776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841039b0 msgr2=0x7fbf84103e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 --2- 172.21.15.100:0/3437527776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841039b0 0x7fbf84103e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009900 tx=0x7fbf7802a410 comp rx=0 tx=0).stop 2024-04-30T23:13:29.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 -- 172.21.15.100:0/3437527776 shutdown_connections 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 --2- 172.21.15.100:0/3437527776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841044b0 0x7fbf8410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 --2- 172.21.15.100:0/3437527776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841039b0 0x7fbf84103e20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 --2- 172.21.15.100:0/3437527776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 -- 172.21.15.100:0/3437527776 >> 172.21.15.100:0/3437527776 conn(0x7fbf840fd390 msgr2=0x7fbf840ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 -- 172.21.15.100:0/3437527776 shutdown_connections 2024-04-30T23:13:29.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 -- 172.21.15.100:0/3437527776 wait complete. 2024-04-30T23:13:29.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.391+0000 7fbf8a453640 1 Processor -- start 2024-04-30T23:13:29.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 -- start start 2024-04-30T23:13:29.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841039b0 0x7fbf84199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410e570 con 0x7fbf841044b0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410e3f0 con 0x7fbf841039b0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf8a453640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410e6f0 con 0x7fbf84102fd0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35194/0 (socket says 172.21.15.100:35194) 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 -- 172.21.15.100:0/2636348344 learned_addr learned my addr 172.21.15.100:0/2636348344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf83fff640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf837fe640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841039b0 0x7fbf84199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 -- 172.21.15.100:0/2636348344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 msgr2=0x7fbf841991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 -- 172.21.15.100:0/2636348344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841039b0 msgr2=0x7fbf84199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841039b0 0x7fbf84199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 -- 172.21.15.100:0/2636348344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf841a0ca0 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf83fff640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.392+0000 7fbf889f0640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00eaa0 tx=0x7fbf7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.393+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00cdb0 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.393+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf7c005020 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.393+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0116d0 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.393+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf841a0f90 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.393+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf841a13f0 con 0x7fbf841044b0 2024-04-30T23:13:29.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.394+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8406a1a0 con 0x7fbf841044b0 2024-04-30T23:13:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.395+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbf7c0051d0 con 0x7fbf841044b0 2024-04-30T23:13:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.395+0000 7fbf817fa640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 0x7fbf6c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.396+0000 7fbf83fff640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 0x7fbf6c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.396+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbf7c0d0d30 con 0x7fbf841044b0 2024-04-30T23:13:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.396+0000 7fbf83fff640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 0x7fbf6c0a6140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf740058c0 tx=0x7fbf74005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.399+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf7c016030 con 0x7fbf841044b0 2024-04-30T23:13:29.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.577+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbf8402dc10 con 0x7fbf841044b0 2024-04-30T23:13:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.577+0000 7fbf817fa640 1 -- 172.21.15.100:0/2636348344 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fbf7c09d430 con 0x7fbf841044b0 2024-04-30T23:13:29.578 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:13:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 msgr2=0x7fbf6c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 0x7fbf6c0a6140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf740058c0 tx=0x7fbf74005850 comp rx=0 tx=0).stop 2024-04-30T23:13:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 msgr2=0x7fbf841a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00eaa0 tx=0x7fbf7c00ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 shutdown_connections 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf6c0a3c30 0x7fbf6c0a6140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf841044b0 0x7fbf841a0630 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf841039b0 0x7fbf84199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 --2- 172.21.15.100:0/2636348344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf84102fd0 0x7fbf841991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 >> 172.21.15.100:0/2636348344 conn(0x7fbf840fd390 msgr2=0x7fbf84104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 shutdown_connections 2024-04-30T23:13:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.580+0000 7fbf8a453640 1 -- 172.21.15.100:0/2636348344 wait complete. 2024-04-30T23:13:29.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 -- 172.21.15.100:0/65889087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894102290 msgr2=0x7ff89410bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/65889087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894102290 0x7ff89410bcf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009ca0 tx=0x7ff88c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 -- 172.21.15.100:0/65889087 shutdown_connections 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/65889087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894102290 0x7ff89410bcf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/65889087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff894101790 0x7ff894101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/65889087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8941050e0 0x7ff8941054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 -- 172.21.15.100:0/65889087 >> 172.21.15.100:0/65889087 conn(0x7ff8940fd390 msgr2=0x7ff8940ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 -- 172.21.15.100:0/65889087 shutdown_connections 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.703+0000 7ff89b0a8640 1 -- 172.21.15.100:0/65889087 wait complete. 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 Processor -- start 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 -- start start 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 0x7ff89419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8941050e0 0x7ff8941a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410f670 con 0x7ff894101790 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410f4f0 con 0x7ff8941050e0 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff89b0a8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410f7f0 con 0x7ff894102290 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35204/0 (socket says 172.21.15.100:35204) 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 -- 172.21.15.100:0/120616115 learned_addr learned my addr 172.21.15.100:0/120616115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff899645640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8941050e0 0x7ff8941a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff893fff640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 0x7ff89419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 -- 172.21.15.100:0/120616115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 msgr2=0x7ff89419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 0x7ff89419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 -- 172.21.15.100:0/120616115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8941050e0 msgr2=0x7ff8941a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8941050e0 0x7ff8941a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.704+0000 7ff898e44640 1 -- 172.21.15.100:0/120616115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8941a1d40 con 0x7ff894101790 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff893fff640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 0x7ff89419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff898e44640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c970 tx=0x7ff88800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888004220 con 0x7ff894101790 2024-04-30T23:13:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8880043c0 con 0x7ff894101790 2024-04-30T23:13:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941a1fd0 con 0x7ff894101790 2024-04-30T23:13:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888004a00 con 0x7ff894101790 2024-04-30T23:13:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.705+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941a2440 con 0x7ff894101790 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.706+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89410aa80 con 0x7ff894101790 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.707+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff8880079b0 con 0x7ff894101790 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.708+0000 7ff891ffb640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 0x7ff8840a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.708+0000 7ff893fff640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 0x7ff8840a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.708+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff8880d04f0 con 0x7ff894101790 2024-04-30T23:13:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.708+0000 7ff893fff640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 0x7ff8840a60c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff89419b2a0 tx=0x7ff880005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:29.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.712+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff888014030 con 0x7ff894101790 2024-04-30T23:13:29.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.890+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff8940637e0 con 0x7ff894101790 2024-04-30T23:13:29.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.890+0000 7ff891ffb640 1 -- 172.21.15.100:0/120616115 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7ff88809cb70 con 0x7ff894101790 2024-04-30T23:13:29.891 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 msgr2=0x7ff8840a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 0x7ff8840a60c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff89419b2a0 tx=0x7ff880005f90 comp rx=0 tx=0).stop 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 msgr2=0x7ff89419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c970 tx=0x7ff88800ce30 comp rx=0 tx=0).stop 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 shutdown_connections 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8840a3bb0 0x7ff8840a60c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8941050e0 0x7ff8941a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff894102290 0x7ff89419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 --2- 172.21.15.100:0/120616115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff894101790 0x7ff89419a250 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.892+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 >> 172.21.15.100:0/120616115 conn(0x7ff8940fd390 msgr2=0x7ff894107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.893+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 shutdown_connections 2024-04-30T23:13:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:29.893+0000 7ff89b0a8640 1 -- 172.21.15.100:0/120616115 wait complete. 2024-04-30T23:13:29.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:29 smithi100 ceph-mon[29745]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:29.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:29 smithi100 ceph-mon[29745]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:29.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/849042881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:29.903 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/528271131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:29.904 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2636348344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:29.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3761245959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41023a0 msgr2=0x7fd5e4109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3761245959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41023a0 0x7fd5e4109130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009900 tx=0x7fd5d802a410 comp rx=0 tx=0).stop 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3761245959 shutdown_connections 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3761245959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41097c0 0x7fd5e410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3761245959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41023a0 0x7fd5e4109130 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3761245959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 0x7fd5e4106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3761245959 >> 172.21.15.100:0/3761245959 conn(0x7fd5e40fd3f0 msgr2=0x7fd5e40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3761245959 shutdown_connections 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.012+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3761245959 wait complete. 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 Processor -- start 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 -- start start 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 0x7fd5e4104370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41023a0 0x7fd5e4102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410f690 con 0x7fd5e41097c0 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410f510 con 0x7fd5e4101ea0 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.013+0000 7fd5e96b1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410f810 con 0x7fd5e41023a0 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35224/0 (socket says 172.21.15.100:35224) 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 -- 172.21.15.100:0/3468780045 learned_addr learned my addr 172.21.15.100:0/3468780045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e2ffd640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 0x7fd5e4104370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e27fc640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41023a0 0x7fd5e4102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 -- 172.21.15.100:0/3468780045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41023a0 msgr2=0x7fd5e4102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41023a0 0x7fd5e4102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 -- 172.21.15.100:0/3468780045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 msgr2=0x7fd5e4104370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 0x7fd5e4104370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 -- 172.21.15.100:0/3468780045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e4103680 con 0x7fd5e41097c0 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e37fe640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b970 tx=0x7fd5dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc019070 con 0x7fd5e41097c0 2024-04-30T23:13:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e41a42c0 con 0x7fd5e41097c0 2024-04-30T23:13:30.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5dc014440 con 0x7fd5e41097c0 2024-04-30T23:13:30.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0075d0 con 0x7fd5e41097c0 2024-04-30T23:13:30.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.014+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41a4800 con 0x7fd5e41097c0 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.015+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e40fef10 con 0x7fd5e41097c0 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.017+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd5dc01c070 con 0x7fd5e41097c0 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.017+0000 7fd5cbfff640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 0x7fd5cc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.017+0000 7fd5e2ffd640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 0x7fd5cc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.017+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd5dc0d0110 con 0x7fd5e41097c0 2024-04-30T23:13:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.018+0000 7fd5e2ffd640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 0x7fd5cc0a60c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400bbe0 tx=0x7fd5d400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.021+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5dc09c140 con 0x7fd5e41097c0 2024-04-30T23:13:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:29 smithi104 ceph-mon[32987]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:29 smithi104 ceph-mon[32987]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/849042881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/528271131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2636348344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:29 smithi183 ceph-mon[33560]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:29 smithi183 ceph-mon[33560]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-30T23:13:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/849042881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/528271131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2636348344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.236+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5e402db90 con 0x7fd5e41097c0 2024-04-30T23:13:30.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.237+0000 7fd5cbfff640 1 -- 172.21.15.100:0/3468780045 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7fd5dc0a0440 con 0x7fd5e41097c0 2024-04-30T23:13:30.237 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:13:23.708732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[24503,24496,24545,14664,24511]},"id":1}]} 2024-04-30T23:13:30.237 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 msgr2=0x7fd5cc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 0x7fd5cc0a60c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400bbe0 tx=0x7fd5d400b390 comp rx=0 tx=0).stop 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 msgr2=0x7fd5e4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b970 tx=0x7fd5dc00be30 comp rx=0 tx=0).stop 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 shutdown_connections 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd5cc0a3bb0 0x7fd5cc0a60c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e41097c0 0x7fd5e4102f50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5e41023a0 0x7fd5e4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 --2- 172.21.15.100:0/3468780045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5e4101ea0 0x7fd5e4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 >> 172.21.15.100:0/3468780045 conn(0x7fd5e40fd3f0 msgr2=0x7fd5e41051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 shutdown_connections 2024-04-30T23:13:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.239+0000 7fd5e96b1640 1 -- 172.21.15.100:0/3468780045 wait complete. 2024-04-30T23:13:30.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:13:30.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 -- 172.21.15.100:0/1709415505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3594104510 msgr2=0x7f359410ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 --2- 172.21.15.100:0/1709415505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3594104510 0x7f359410ac50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f358c009ca0 tx=0x7f358c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 -- 172.21.15.100:0/1709415505 shutdown_connections 2024-04-30T23:13:30.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 --2- 172.21.15.100:0/1709415505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3594104510 0x7f359410ac50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 --2- 172.21.15.100:0/1709415505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35941039d0 0x7f3594103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 --2- 172.21.15.100:0/1709415505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 0x7f3594103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 -- 172.21.15.100:0/1709415505 >> 172.21.15.100:0/1709415505 conn(0x7f35940fd3f0 msgr2=0x7f35940ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 -- 172.21.15.100:0/1709415505 shutdown_connections 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 -- 172.21.15.100:0/1709415505 wait complete. 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.360+0000 7f359c114640 1 Processor -- start 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 -- start start 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 0x7f3594102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3594104510 0x7f35941a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f359410e570 con 0x7f35941039d0 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f359410e3f0 con 0x7f3594102ff0 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359c114640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f359410e6f0 con 0x7f3594104510 2024-04-30T23:13:30.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35238/0 (socket says 172.21.15.100:35238) 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 -- 172.21.15.100:0/2725767790 learned_addr learned my addr 172.21.15.100:0/2725767790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f359a6b1640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3594104510 0x7f35941a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f3599eb0640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 0x7f3594102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 -- 172.21.15.100:0/2725767790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3594104510 msgr2=0x7f35941a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3594104510 0x7f35941a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 -- 172.21.15.100:0/2725767790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 msgr2=0x7f3594102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 0x7f3594102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 -- 172.21.15.100:0/2725767790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941a1cf0 con 0x7f35941039d0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.361+0000 7f35996af640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f358400c970 tx=0x7f358400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.362+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584007bb0 con 0x7f35941039d0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.362+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3584007d50 con 0x7f35941039d0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.362+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35941a1fe0 con 0x7f35941039d0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.362+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358400f450 con 0x7f35941039d0 2024-04-30T23:13:30.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.362+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35941a23f0 con 0x7f35941039d0 2024-04-30T23:13:30.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.363+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35941099a0 con 0x7f35941039d0 2024-04-30T23:13:30.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.364+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3584004f00 con 0x7f35941039d0 2024-04-30T23:13:30.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.365+0000 7f358affd640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 0x7f35800a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.365+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f35840d0790 con 0x7f35941039d0 2024-04-30T23:13:30.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.365+0000 7f3599eb0640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 0x7f35800a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.365+0000 7f3599eb0640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 0x7f35800a60c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35900058c0 tx=0x7f359000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.369+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3584014030 con 0x7f35941039d0 2024-04-30T23:13:30.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.555+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f359402dd60 con 0x7f35941039d0 2024-04-30T23:13:30.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.557+0000 7f358affd640 1 -- 172.21.15.100:0/2725767790 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7f358409c7c0 con 0x7f35941039d0 2024-04-30T23:13:30.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:13:30.632 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:13:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 msgr2=0x7f35800a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 0x7f35800a60c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35900058c0 tx=0x7f359000a2d0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 msgr2=0x7f359419efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f358400c970 tx=0x7f358400ce30 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 shutdown_connections 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f35800a3bb0 0x7f35800a60c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3594104510 0x7f35941a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35941039d0 0x7f359419efa0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 --2- 172.21.15.100:0/2725767790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3594102ff0 0x7f3594102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 >> 172.21.15.100:0/2725767790 conn(0x7f35940fd3f0 msgr2=0x7f3594106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 shutdown_connections 2024-04-30T23:13:30.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.559+0000 7f359c114640 1 -- 172.21.15.100:0/2725767790 wait complete. 2024-04-30T23:13:30.635 DEBUG:tasks.fwd_scrub:Yielding 2024-04-30T23:13:30.635 INFO:teuthology.run_tasks:Running task workunit... 2024-04-30T23:13:30.747 INFO:tasks.workunit:Pulling workunits from ref 8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:13:30.747 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-30T23:13:30.747 INFO:tasks.workunit:timeout=6h 2024-04-30T23:13:30.747 INFO:tasks.workunit:cleanup=True 2024-04-30T23:13:30.747 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:30.748 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-30T23:13:30.748 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:13:30.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:13:30.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-30 23:11:28.144203823 +0000 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-30 23:11:28.144203823 +0000 2024-04-30T23:13:30.764 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-30 23:13:23.028434318 +0000 2024-04-30T23:13:30.765 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-30 23:11:28.144203823 +0000 2024-04-30T23:13:30.765 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-30T23:13:30.765 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-30T23:13:30.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:30 smithi100 ceph-mon[29745]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:30.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/120616115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:30.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3468780045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:30.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2725767790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:30.839 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8505bf412a33fc9b7838e91f3a227044bc06f5ed 2024-04-30T23:13:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 -- 172.21.15.100:0/893752999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 msgr2=0x7f41401054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 --2- 172.21.15.100:0/893752999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401054d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f413c009900 tx=0x7f413c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 -- 172.21.15.100:0/893752999 shutdown_connections 2024-04-30T23:13:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 --2- 172.21.15.100:0/893752999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140102270 0x7f414010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 --2- 172.21.15.100:0/893752999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140101770 0x7f4140101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 --2- 172.21.15.100:0/893752999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401054d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.864+0000 7f41476c4640 1 -- 172.21.15.100:0/893752999 >> 172.21.15.100:0/893752999 conn(0x7f41400fd390 msgr2=0x7f41400ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- 172.21.15.100:0/893752999 shutdown_connections 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- 172.21.15.100:0/893752999 wait complete. 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 Processor -- start 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- start start 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 0x7f414019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140102270 0x7f414019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f414010f630 con 0x7f41401050c0 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f414010f4b0 con 0x7f4140102270 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f41476c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f414010f7b0 con 0x7f4140101770 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f4145c61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f4145c61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35262/0 (socket says 172.21.15.100:35262) 2024-04-30T23:13:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.865+0000 7f4145c61640 1 -- 172.21.15.100:0/2611595647 learned_addr learned my addr 172.21.15.100:0/2611595647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140102270 0x7f414019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145460640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 0x7f414019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 -- 172.21.15.100:0/2611595647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 msgr2=0x7f414019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 0x7f414019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 -- 172.21.15.100:0/2611595647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140102270 msgr2=0x7f414019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140102270 0x7f414019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 -- 172.21.15.100:0/2611595647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41401a3f80 con 0x7f41401050c0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145460640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 0x7f414019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f4145c61640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f413800eaa0 tx=0x7f413800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f41367fc640 1 -- 172.21.15.100:0/2611595647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413800cdb0 con 0x7f41401050c0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41401a4270 con 0x7f41401050c0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f41367fc640 1 -- 172.21.15.100:0/2611595647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4138005020 con 0x7f41401050c0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f41367fc640 1 -- 172.21.15.100:0/2611595647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380116d0 con 0x7f41401050c0 2024-04-30T23:13:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.866+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41401a4810 con 0x7f41401050c0 2024-04-30T23:13:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.869+0000 7f414e57e740 1 Processor -- start 2024-04-30T23:13:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.869+0000 7f41367fc640 1 -- 172.21.15.100:0/2611595647 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4138011870 con 0x7f41401050c0 2024-04-30T23:13:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.869+0000 7f414e57e740 1 -- start start 2024-04-30T23:13:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 0x557caab49210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557caaaadb00 con 0x557caa7a7410 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557caaa49920 con 0x557caa77e550 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f414e57e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557caaaa9ac0 con 0x557caa786730 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35278/0 (socket says 172.21.15.100:35278) 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 -- 172.21.15.100:0/3135620705 learned_addr learned my addr 172.21.15.100:0/3135620705 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4145460640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 0x557caab49210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f41367fc640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 0x7f412c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 -- 172.21.15.100:0/3135620705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 msgr2=0x557caab50110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab50110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 -- 172.21.15.100:0/3135620705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 msgr2=0x557caab49210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 0x557caab49210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 -- 172.21.15.100:0/3135620705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557caa8877e0 con 0x557caa7a7410 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4145460640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 0x557caab49210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4145c61640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 0x7f412c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f413000bf10 tx=0x7f413000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b80aef6ccf2fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.870+0000 7f41367fc640 1 -- 172.21.15.100:0/2611595647 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f41380d0840 con 0x7f41401050c0 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.871+0000 7f412b7fe640 1 -- 172.21.15.100:0/3135620705 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130004020 con 0x557caa7a7410 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.871+0000 7f412b7fe640 1 -- 172.21.15.100:0/3135620705 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41300041c0 con 0x557caa7a7410 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.871+0000 7f412b7fe640 1 -- 172.21.15.100:0/3135620705 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130010750 con 0x557caa7a7410 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- 172.21.15.100:0/3135620705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 msgr2=0x557caab48c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f4145c61640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 0x7f412c0a60c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41380cdfe0 tx=0x7f4138091ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f413000bf10 tx=0x7f413000b8c0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- 172.21.15.100:0/3135620705 shutdown_connections 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab50110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa77e550 0x557caab49210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 --2- 172.21.15.100:0/3135620705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa7a7410 0x557caab48c90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- 172.21.15.100:0/3135620705 >> 172.21.15.100:0/3135620705 conn(0x557caa79b560 msgr2=0x557caab44620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- 172.21.15.100:0/3135620705 shutdown_connections 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- 172.21.15.100:0/3135620705 wait complete. 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 -- start start 2024-04-30T23:13:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.872+0000 7f414e57e740 1 Processor -- start 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 0x557caab52db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa7a7410 0x557caab59d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557caab50b00 con 0x557caa77e550 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557caaa475d0 con 0x557caa786730 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557caab50c80 con 0x557caa7a7410 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f414e57e740 10 client.0 _ll_register_callbacks cb 0x557caaa56a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 0x557caab52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35282/0 (socket says 172.21.15.100:35282) 2024-04-30T23:13:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4144c5f640 1 -- 172.21.15.100:0/1704468476 learned_addr learned my addr 172.21.15.100:0/1704468476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4144c5f640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa7a7410 0x557caab59d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 -- 172.21.15.100:0/1704468476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa7a7410 msgr2=0x557caab59d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa7a7410 0x557caab59d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 -- 172.21.15.100:0/1704468476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 msgr2=0x557caab52870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4145460640 1 -- 172.21.15.100:0/1704468476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557caa8e7f70 con 0x557caa786730 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.873+0000 7f4144c5f640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4145460640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 0x557caab52db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f413c009230 tx=0x7f413c0317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d85d1bf631458f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4128ff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c03f070 con 0x557caa786730 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41300041c0 con 0x557caa786730 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f413c004450 con 0x557caa786730 2024-04-30T23:13:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f413c04c050 con 0x557caa786730 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f414e57e740 10 client.25262 fetch_fsmap learned FSMap version 28 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557caa77f170 con 0x557caa786730 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.874+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41300041c0 con 0x557caa786730 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f413c004aa0 con 0x557caa786730 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 10 client.25262 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 20 client.25262 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa7661f0 0x557caab60460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 4 client.25262 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557caaabb710 con 0x557caa7661f0 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f4144c5f640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa7661f0 0x557caab60460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f4144c5f640 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa7661f0 0x557caab60460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72adda861d51be0 server_cookie=1db974a2fe4b8042 in_seq=0 out_seq=0 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.875+0000 7f4128ff9640 10 client.25262 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f4128ff9640 1 -- 172.21.15.100:0/1704468476 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x557caaabb710 con 0x557caa7661f0 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f4128ff9640 10 client.25262 handle_command_reply: tid=0 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 client.25262 shutdown 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 msgr2=0x557caab52db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 0x557caab52db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f413c009230 tx=0x7f413c0317d0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 shutdown_connections 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa7661f0 0x557caab60460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa7a7410 0x557caab59d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa786730 0x557caab52db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 --2- 172.21.15.100:0/1704468476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab52870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f4128ff9640 0 client.25262 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.876+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 >> 172.21.15.100:0/1704468476 conn(0x557caa79b560 msgr2=0x557caab435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.877+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 shutdown_connections 2024-04-30T23:13:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.877+0000 7f414e57e740 1 -- 172.21.15.100:0/1704468476 wait complete. 2024-04-30T23:13:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.877+0000 7f414e57e740 20 client.25262 trim_cache size 0 max 16384 2024-04-30T23:13:30.883 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.895+0000 7f414e57e740 1 Processor -- start 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 -- start start 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab48070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caab4ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41401aeb80 con 0x557caa77e550 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41401b06c0 con 0x557caa7a7410 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f414e57e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f41401af250 con 0x557caa786730 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35298/0 (socket says 172.21.15.100:35298) 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 -- 172.21.15.100:0/3581140978 learned_addr learned my addr 172.21.15.100:0/3581140978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4145460640 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab48070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caab4ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 -- 172.21.15.100:0/3581140978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 msgr2=0x557caab48070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab48070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 -- 172.21.15.100:0/3581140978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 msgr2=0x557caab4ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caab4ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 -- 172.21.15.100:0/3581140978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557caab50dc0 con 0x557caa77e550 2024-04-30T23:13:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.896+0000 7f4144c5f640 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4130005d00 tx=0x7f413000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c4239112e625fa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.897+0000 7f412affd640 1 -- 172.21.15.100:0/3581140978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130033070 con 0x557caa77e550 2024-04-30T23:13:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.897+0000 7f412affd640 1 -- 172.21.15.100:0/3581140978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41300041c0 con 0x557caa77e550 2024-04-30T23:13:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.897+0000 7f412affd640 1 -- 172.21.15.100:0/3581140978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413002c9a0 con 0x557caa77e550 2024-04-30T23:13:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.897+0000 7f414e57e740 1 -- 172.21.15.100:0/3581140978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 msgr2=0x557caab47b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.897+0000 7f414e57e740 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4130005d00 tx=0x7f413000b630 comp rx=0 tx=0).stop 2024-04-30T23:13:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- 172.21.15.100:0/3581140978 shutdown_connections 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caab4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa786730 0x557caab48070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- 172.21.15.100:0/3581140978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa77e550 0x557caab47b30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- 172.21.15.100:0/3581140978 >> 172.21.15.100:0/3581140978 conn(0x557caa79b560 msgr2=0x557caab47420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- 172.21.15.100:0/3581140978 shutdown_connections 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- 172.21.15.100:0/3581140978 wait complete. 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- start start 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 Processor -- start 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 0x557caabbe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caabc59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41401afff0 con 0x557caa786730 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41401af920 con 0x557caa7a7410 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f41401acb60 con 0x557caa77e550 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.898+0000 7f414e57e740 10 client.0 _ll_register_callbacks cb 0x7f413c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4145460640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4145460640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35312/0 (socket says 172.21.15.100:35312) 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4145460640 1 -- 172.21.15.100:0/2616256018 learned_addr learned my addr 172.21.15.100:0/2616256018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 0x557caabbe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caabc59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 -- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 msgr2=0x557caabc59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caabc59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 -- 172.21.15.100:0/2616256018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 msgr2=0x557caabbeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 -- 172.21.15.100:0/2616256018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557caab4d780 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4145460640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4144c5f640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 0x557caabbe570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4130005690 tx=0x7f41300040a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=656f19492c0f5a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4128ff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130033040 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41300041c0 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.899+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f413002c9a0 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41300035f0 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 10 client.25258 fetch_fsmap learned FSMap version 28 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557caab44bc0 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41300041c0 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4130038030 con 0x557caa77e550 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 10 client.25258 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:13:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 20 client.25258 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa73b630 0x557caabc9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 4 client.25258 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557caaab5580 con 0x557caa73b630 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.900+0000 7f4145460640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa73b630 0x557caabc9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.901+0000 7f4128ff9640 10 client.25258 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.901+0000 7f4145460640 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa73b630 0x557caabc9580 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f37ab6002cc189c server_cookie=bbafad14265c5323 in_seq=0 out_seq=0 2024-04-30T23:13:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f4128ff9640 1 -- 172.21.15.100:0/2616256018 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557caaab5580 con 0x557caa73b630 2024-04-30T23:13:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f4128ff9640 10 client.25258 handle_command_reply: tid=0 2024-04-30T23:13:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 client.25258 shutdown 2024-04-30T23:13:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 msgr2=0x557caabbe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 0x557caabbe570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4130005690 tx=0x7f41300040a0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 shutdown_connections 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557caa73b630 0x557caabc9580 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557caa7a7410 0x557caabc59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557caa786730 0x557caabbeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 --2- 172.21.15.100:0/2616256018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557caa77e550 0x557caabbe570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f4128ff9640 0 client.25258 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 >> 172.21.15.100:0/2616256018 conn(0x557caa79b560 msgr2=0x557caab47e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 shutdown_connections 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 1 -- 172.21.15.100:0/2616256018 wait complete. 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.903+0000 7f414e57e740 20 client.25258 trim_cache size 0 max 16384 2024-04-30T23:13:30.908 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:30.909 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:13:30.909 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "fb7fb6d3-25b8-41a5-a60a-0d3e78232348", 2024-04-30T23:13:30.909 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:13:30.909 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 msgr2=0x7f412c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 0x7f412c0a60c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41380cdfe0 tx=0x7f4138091ca0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 msgr2=0x7f41401a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f413800eaa0 tx=0x7f413800ef60 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 shutdown_connections 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f412c0a3bb0 0x7f412c0a60c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41401050c0 0x7f41401a3910 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4140102270 0x7f414019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 --2- 172.21.15.100:0/2611595647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4140101770 0x7f414019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 >> 172.21.15.100:0/2611595647 conn(0x7f41400fd390 msgr2=0x7f41400fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 shutdown_connections 2024-04-30T23:13:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:30.904+0000 7f41476c4640 1 -- 172.21.15.100:0/2611595647 wait complete. 2024-04-30T23:13:30.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:13:30.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:13:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:30 smithi104 ceph-mon[32987]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/120616115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3468780045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2725767790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:30 smithi183 ceph-mon[33560]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/120616115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:13:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3468780045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:13:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2725767790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 -- 172.21.15.100:0/513637557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c106f70 msgr2=0x7f363c109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 --2- 172.21.15.100:0/513637557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c106f70 0x7f363c109390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f362c009900 tx=0x7f362c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 -- 172.21.15.100:0/513637557 shutdown_connections 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 --2- 172.21.15.100:0/513637557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c1098d0 0x7f363c10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 --2- 172.21.15.100:0/513637557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c106f70 0x7f363c109390 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 --2- 172.21.15.100:0/513637557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 0x7f363c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.067+0000 7f3644229640 1 -- 172.21.15.100:0/513637557 >> 172.21.15.100:0/513637557 conn(0x7f363c0fdc10 msgr2=0x7f363c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.068+0000 7f3644229640 1 -- 172.21.15.100:0/513637557 shutdown_connections 2024-04-30T23:13:31.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.068+0000 7f3644229640 1 -- 172.21.15.100:0/513637557 wait complete. 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.068+0000 7f3644229640 1 Processor -- start 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.068+0000 7f3644229640 1 -- start start 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 0x7f363c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 0x7f363c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10f650 con 0x7f363c1098d0 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10f4d0 con 0x7f363c106f70 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3644229640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10f7d0 con 0x7f363c104610 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35320/0 (socket says 172.21.15.100:35320) 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 -- 172.21.15.100:0/2656961482 learned_addr learned my addr 172.21.15.100:0/2656961482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3641fc5640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 0x7f363c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36417c4640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 0x7f363c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 -- 172.21.15.100:0/2656961482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 msgr2=0x7f363c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 0x7f363c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 -- 172.21.15.100:0/2656961482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 msgr2=0x7f363c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 0x7f363c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 -- 172.21.15.100:0/2656961482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c1a2150 con 0x7f363c1098d0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36417c4640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 0x7f363c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f36427c6640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f363400eb40 tx=0x7f363400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.069+0000 7f3632ffd640 1 -- 172.21.15.100:0/2656961482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634004b20 con 0x7f363c1098d0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.070+0000 7f3632ffd640 1 -- 172.21.15.100:0/2656961482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3634004cc0 con 0x7f363c1098d0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.070+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363c1a2440 con 0x7f363c1098d0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.070+0000 7f3632ffd640 1 -- 172.21.15.100:0/2656961482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634010720 con 0x7f363c1098d0 2024-04-30T23:13:31.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.070+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363c1a2940 con 0x7f363c1098d0 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.072+0000 7f364b1bb740 1 Processor -- start 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.072+0000 7f3632ffd640 1 -- 172.21.15.100:0/2656961482 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3634005560 con 0x7f363c1098d0 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.072+0000 7f364b1bb740 1 -- start start 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.072+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da7734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da774700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f364b1bb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d6da68ab10 con 0x55d6da3a84d0 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f364b1bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6da6d7d80 con 0x55d6da3d1390 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f364b1bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d6da6918b0 con 0x55d6da3b06b0 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35330/0 (socket says 172.21.15.100:35330) 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 -- 172.21.15.100:0/325035996 learned_addr learned my addr 172.21.15.100:0/325035996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f36417c4640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da774700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f36417c4640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da7734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 -- 172.21.15.100:0/325035996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 msgr2=0x55d6da774700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da774700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 -- 172.21.15.100:0/325035996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 msgr2=0x55d6da7734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da7734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3632ffd640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 0x7f36280a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 -- 172.21.15.100:0/325035996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6da662a40 con 0x55d6da3a84d0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f36417c4640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da7734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f36427c6640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 0x7f36280a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3641fc5640 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f3638011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03a2a843494981c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.073+0000 7f3632ffd640 1 -- 172.21.15.100:0/2656961482 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f36340d0f80 con 0x7f363c1098d0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f3627fff640 1 -- 172.21.15.100:0/325035996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363801e070 con 0x55d6da3a84d0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f3627fff640 1 -- 172.21.15.100:0/325035996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3638019ae0 con 0x55d6da3a84d0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f3627fff640 1 -- 172.21.15.100:0/325035996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363800e9b0 con 0x55d6da3a84d0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f364b1bb740 1 -- 172.21.15.100:0/325035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 msgr2=0x55d6da773a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f364b1bb740 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f3638011810 comp rx=0 tx=0).stop 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f36427c6640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 0x7f36280a60c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f36340cea90 tx=0x7f363406fa40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f364b1bb740 1 -- 172.21.15.100:0/325035996 shutdown_connections 2024-04-30T23:13:31.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.074+0000 7f364b1bb740 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da774700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da773a70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 --2- 172.21.15.100:0/325035996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da7734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- 172.21.15.100:0/325035996 >> 172.21.15.100:0/325035996 conn(0x55d6da3c54e0 msgr2=0x55d6da76ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- 172.21.15.100:0/325035996 shutdown_connections 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- 172.21.15.100:0/325035996 wait complete. 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- start start 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 Processor -- start 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da77d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da784760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d6da65ed10 con 0x55d6da3a84d0 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6da6d3d40 con 0x55d6da3d1390 2024-04-30T23:13:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.075+0000 7f364b1bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d6da775210 con 0x55d6da3b06b0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f364b1bb740 10 client.0 _ll_register_callbacks cb 0x55d6da6e4d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35338/0 (socket says 172.21.15.100:35338) 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 -- 172.21.15.100:0/3660465170 learned_addr learned my addr 172.21.15.100:0/3660465170 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da77d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da784760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 -- 172.21.15.100:0/3660465170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 msgr2=0x55d6da77d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da77d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 -- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 msgr2=0x55d6da784760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da784760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 -- 172.21.15.100:0/3660465170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6da4b37d0 con 0x55d6da3a84d0 2024-04-30T23:13:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36417c4640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f362c005940 tx=0x7f362c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6ad4de5fd4f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36257fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c035040 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3638019ae0 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.076+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f362c0040c0 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f362c04f050 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6da3e93f0 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3638019ae0 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f362c047020 con 0x55d6da3a84d0 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 20 client.15714 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da38ff60 0x55d6da78ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 4 client.15714 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:13:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6da6e5990 con 0x55d6da38ff60 2024-04-30T23:13:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.077+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da38ff60 0x55d6da78ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.078+0000 7f36257fa640 10 client.15714 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.078+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da38ff60 0x55d6da78ab70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187f655545ae65ff server_cookie=5a8ac430ae832ca3 in_seq=0 out_seq=0 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.078+0000 7f36257fa640 1 -- 172.21.15.100:0/3660465170 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55d6da6e5990 con 0x55d6da38ff60 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.078+0000 7f36257fa640 10 client.15714 handle_command_reply: tid=0 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.078+0000 7f364b1bb740 1 client.15714 shutdown 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 msgr2=0x55d6da77d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f362c005940 tx=0x7f362c02a410 comp rx=0 tx=0).stop 2024-04-30T23:13:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 shutdown_connections 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da38ff60 0x55d6da78ab70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3d1390 0x55d6da784760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da77d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f36257fa640 0 client.15714 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3660465170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3a84d0 0x55d6da77d330 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 >> 172.21.15.100:0/3660465170 conn(0x55d6da3c54e0 msgr2=0x55d6da771c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 shutdown_connections 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 1 -- 172.21.15.100:0/3660465170 wait complete. 2024-04-30T23:13:31.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.079+0000 7f364b1bb740 20 client.15714 trim_cache size 0 max 16384 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.100+0000 7f364b1bb740 1 Processor -- start 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.100+0000 7f364b1bb740 1 -- start start 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da76ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 0x55d6da77cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1ac8a0 con 0x55d6da3b06b0 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1ae3e0 con 0x55d6da3a84d0 2024-04-30T23:13:31.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f364b1bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1acf70 con 0x55d6da3d1390 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35354/0 (socket says 172.21.15.100:35354) 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 -- 172.21.15.100:0/2398104661 learned_addr learned my addr 172.21.15.100:0/2398104661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f36417c4640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 0x55d6da77cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f36417c4640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da76ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 -- 172.21.15.100:0/2398104661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 msgr2=0x55d6da77cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 0x55d6da77cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 -- 172.21.15.100:0/2398104661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 msgr2=0x55d6da76ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da76ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 -- 172.21.15.100:0/2398104661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6da3a90f0 con 0x55d6da3b06b0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f36417c4640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 0x55d6da77cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f3641fc5640 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3638011d10 tx=0x7f3638009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d33953176422679 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.101+0000 7f36277fe640 1 -- 172.21.15.100:0/2398104661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363801e040 con 0x55d6da3b06b0 2024-04-30T23:13:31.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f36277fe640 1 -- 172.21.15.100:0/2398104661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3638019a30 con 0x55d6da3b06b0 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f36277fe640 1 -- 172.21.15.100:0/2398104661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638003c90 con 0x55d6da3b06b0 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 -- 172.21.15.100:0/2398104661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 msgr2=0x55d6da7846f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3638011d10 tx=0x7f3638009ba0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 -- 172.21.15.100:0/2398104661 shutdown_connections 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3d1390 0x55d6da77cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3b06b0 0x55d6da7846f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 --2- 172.21.15.100:0/2398104661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da76ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.102+0000 7f364b1bb740 1 -- 172.21.15.100:0/2398104661 >> 172.21.15.100:0/2398104661 conn(0x55d6da3c54e0 msgr2=0x55d6da76e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- 172.21.15.100:0/2398104661 shutdown_connections 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- 172.21.15.100:0/2398104661 wait complete. 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- start start 2024-04-30T23:13:31.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 Processor -- start 2024-04-30T23:13:31.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da781c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3d1390 0x55d6da7eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1add10 con 0x55d6da3d1390 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1ad640 con 0x55d6da3a84d0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1aa880 con 0x55d6da3b06b0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f364b1bb740 10 client.0 _ll_register_callbacks cb 0x7f36340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f36417c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3d1390 0x55d6da7eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f36417c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f36417c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:38326/0 (socket says 172.21.15.100:38326) 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.103+0000 7f36417c4640 1 -- 172.21.15.100:0/3122100682 learned_addr learned my addr 172.21.15.100:0/3122100682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da781c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 -- 172.21.15.100:0/3122100682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 msgr2=0x55d6da781c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da781c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 -- 172.21.15.100:0/3122100682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3d1390 msgr2=0x55d6da7eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3d1390 0x55d6da7eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 -- 172.21.15.100:0/3122100682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6da6984b0 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36417c4640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f362c031760 tx=0x7f362c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b70c3cbc302d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36257fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c035040 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3638019a30 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f362c005220 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f362c062050 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f364b1bb740 10 client.25280 fetch_fsmap learned FSMap version 28 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.104+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6da7f02a0 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3638019a30 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f362c047040 con 0x55d6da3a84d0 2024-04-30T23:13:31.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 10 client.25280 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 10 client.25280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 20 client.25280 populate_metadata read hostname 'smithi100' 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da3653a0 0x55d6da7f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 4 client.25280 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d6da6df800 con 0x55d6da3653a0 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.105+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da3653a0 0x55d6da7f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f36257fa640 10 client.25280 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f3641fc5640 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da3653a0 0x55d6da7f2c90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6e44c005107b17 server_cookie=e051930315d2c019 in_seq=0 out_seq=0 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f36257fa640 1 -- 172.21.15.100:0/3122100682 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55d6da6df800 con 0x55d6da3653a0 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f36257fa640 10 client.25280 handle_command_reply: tid=0 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 client.25280 shutdown 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 msgr2=0x55d6da781740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f362c031760 tx=0x7f362c000bc0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 shutdown_connections 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55d6da3653a0 0x55d6da7f2c90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6da3d1390 0x55d6da7eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f36257fa640 0 client.25280 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6da3b06b0 0x55d6da781c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 --2- 172.21.15.100:0/3122100682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6da3a84d0 0x55d6da781740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 >> 172.21.15.100:0/3122100682 conn(0x55d6da3c54e0 msgr2=0x55d6da771b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 shutdown_connections 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 1 -- 172.21.15.100:0/3122100682 wait complete. 2024-04-30T23:13:31.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.106+0000 7f364b1bb740 20 client.25280 trim_cache size 0 max 16384 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "fb7fb6d3-25b8-41a5-a60a-0d3e78232348", 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:13:31.114 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:13:31.115 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 msgr2=0x7f36280a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 0x7f36280a60c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f36340cea90 tx=0x7f363406fa40 comp rx=0 tx=0).stop 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 msgr2=0x7f363c1a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f363400eb40 tx=0x7f363400c2d0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 shutdown_connections 2024-04-30T23:13:31.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f36280a3bb0 0x7f36280a60c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f363c1098d0 0x7f363c1a1ae0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f363c106f70 0x7f363c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 --2- 172.21.15.100:0/2656961482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363c104610 0x7f363c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 >> 172.21.15.100:0/2656961482 conn(0x7f363c0fdc10 msgr2=0x7f363c104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 shutdown_connections 2024-04-30T23:13:31.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:13:31.107+0000 7f3644229640 1 -- 172.21.15.100:0/2656961482 wait complete. 2024-04-30T23:13:31.119 INFO:tasks.cephfs.filesystem:scrub status for tag:fb7fb6d3-25b8-41a5-a60a-0d3e78232348 - {'path': '/', 'tag': 'fb7fb6d3-25b8-41a5-a60a-0d3e78232348', 'options': 'recursive,force'} 2024-04-30T23:13:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:31 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:13:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:31 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:31 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:13:32.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:31 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:31 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:13:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:31 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:31 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:13:32.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:31 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:32.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:31 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:13:32.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:31 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:32.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:31 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:13:32.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:31 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:13:33.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:32 smithi104 ceph-mon[32987]: pgmap v371: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-30T23:13:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:32 smithi183 ceph-mon[33560]: pgmap v371: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-30T23:13:33.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:32 smithi100 ceph-mon[29745]: pgmap v371: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-30T23:13:34.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:33 smithi104 ceph-mon[32987]: pgmap v372: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-30T23:13:34.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:33 smithi183 ceph-mon[33560]: pgmap v372: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-30T23:13:34.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:33 smithi100 ceph-mon[29745]: pgmap v372: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-30T23:13:37.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:36 smithi104 ceph-mon[32987]: pgmap v373: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-30T23:13:37.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:36 smithi183 ceph-mon[33560]: pgmap v373: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-30T23:13:37.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:36 smithi100 ceph-mon[29745]: pgmap v373: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-30T23:13:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:38 smithi104 ceph-mon[32987]: pgmap v374: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-30T23:13:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:38 smithi183 ceph-mon[33560]: pgmap v374: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-30T23:13:39.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:38 smithi100 ceph-mon[29745]: pgmap v374: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-30T23:13:40.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:39 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:13:40.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:39 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:13:40.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:39 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:13:40.963 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:40 smithi100 ceph-mon[29745]: pgmap v375: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:41.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:40 smithi104 ceph-mon[32987]: pgmap v375: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:40 smithi183 ceph-mon[33560]: pgmap v375: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-30T23:13:42.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:42.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:13:42.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:13:42.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:13:42.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:13:42.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:13:42.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:13:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:44 smithi104 ceph-mon[32987]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:44 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:13:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:44 smithi183 ceph-mon[33560]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:44 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:13:45.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:44 smithi100 ceph-mon[29745]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-30T23:13:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:44 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:13:47.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:46 smithi104 ceph-mon[32987]: pgmap v378: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:46 smithi183 ceph-mon[33560]: pgmap v378: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:46 smithi100 ceph-mon[29745]: pgmap v378: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-04-30T23:13:49.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:48 smithi104 ceph-mon[32987]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-30T23:13:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:48 smithi183 ceph-mon[33560]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-30T23:13:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:48 smithi100 ceph-mon[29745]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-30T23:13:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:50 smithi104 ceph-mon[32987]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:50 smithi183 ceph-mon[33560]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:50 smithi100 ceph-mon[29745]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:53.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:52 smithi104 ceph-mon[32987]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:53.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:52 smithi183 ceph-mon[33560]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:52 smithi100 ceph-mon[29745]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:55.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:54 smithi104 ceph-mon[32987]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:55.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:54 smithi183 ceph-mon[33560]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:55.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:54 smithi100 ceph-mon[29745]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:13:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:56 smithi104 ceph-mon[32987]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:56 smithi183 ceph-mon[33560]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:56 smithi100 ceph-mon[29745]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:13:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:13:58 smithi104 ceph-mon[32987]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:13:58 smithi183 ceph-mon[33560]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:13:59.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:13:58 smithi100 ceph-mon[29745]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:00 smithi104 ceph-mon[32987]: pgmap v385: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:01.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:00 smithi183 ceph-mon[33560]: pgmap v385: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:01.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:00 smithi100 ceph-mon[29745]: pgmap v385: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:01.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:14:01.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:14:01.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 -- 172.21.15.100:0/2197627820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 msgr2=0x7ff46810be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 --2- 172.21.15.100:0/2197627820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff46810be80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff460009ca0 tx=0x7ff46002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 -- 172.21.15.100:0/2197627820 shutdown_connections 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 --2- 172.21.15.100:0/2197627820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff46810be80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 --2- 172.21.15.100:0/2197627820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff468105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 --2- 172.21.15.100:0/2197627820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 0x7ff468104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 -- 172.21.15.100:0/2197627820 >> 172.21.15.100:0/2197627820 conn(0x7ff4680fed10 msgr2=0x7ff4681011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 -- 172.21.15.100:0/2197627820 shutdown_connections 2024-04-30T23:14:01.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 -- 172.21.15.100:0/2197627820 wait complete. 2024-04-30T23:14:01.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.249+0000 7ff470301640 1 Processor -- start 2024-04-30T23:14:01.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 -- start start 2024-04-30T23:14:01.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 0x7ff46819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff46819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff46810f650 con 0x7ff468109a60 2024-04-30T23:14:01.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff46810f4d0 con 0x7ff468103b20 2024-04-30T23:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff470301640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff46810f7d0 con 0x7ff468104d60 2024-04-30T23:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46e89e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46e89e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47060/0 (socket says 172.21.15.100:47060) 2024-04-30T23:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46e89e640 1 -- 172.21.15.100:0/944496094 learned_addr learned my addr 172.21.15.100:0/944496094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff46819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46e09d640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 0x7ff46819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 -- 172.21.15.100:0/944496094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 msgr2=0x7ff46819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 0x7ff46819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 -- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 msgr2=0x7ff4681a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 -- 172.21.15.100:0/944496094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4681a1d60 con 0x7ff468104d60 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46e89e640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.250+0000 7ff46d89c640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff46819a760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e9f0 tx=0x7ff45800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.251+0000 7ff45f7fe640 1 -- 172.21.15.100:0/944496094 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ccc0 con 0x7ff468104d60 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.251+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4681a1ff0 con 0x7ff468104d60 2024-04-30T23:14:01.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.251+0000 7ff45f7fe640 1 -- 172.21.15.100:0/944496094 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff458005020 con 0x7ff468104d60 2024-04-30T23:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.251+0000 7ff45f7fe640 1 -- 172.21.15.100:0/944496094 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458004a00 con 0x7ff468104d60 2024-04-30T23:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.251+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4681a2490 con 0x7ff468104d60 2024-04-30T23:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.253+0000 7ff4771b7740 1 Processor -- start 2024-04-30T23:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 -- start start 2024-04-30T23:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbe4390 0x55ec8cf864f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf87700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ce9db10 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ceead80 con 0x55ec8cbe4390 2024-04-30T23:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff4771b7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec8cea48b0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff45f7fe640 1 -- 172.21.15.100:0/944496094 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff458004ba0 con 0x7ff468104d60 2024-04-30T23:14:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47070/0 (socket says 172.21.15.100:47070) 2024-04-30T23:14:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 -- 172.21.15.100:0/4051237869 learned_addr learned my addr 172.21.15.100:0/4051237869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e89e640 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbe4390 0x55ec8cf864f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46d89c640 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 -- 172.21.15.100:0/4051237869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbc36b0 msgr2=0x55ec8cf87700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf87700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 -- 172.21.15.100:0/4051237869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbe4390 msgr2=0x55ec8cf864f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbe4390 0x55ec8cf864f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.254+0000 7ff46e09d640 1 -- 172.21.15.100:0/4051237869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ce75a40 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff45f7fe640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 0x7ff4540a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff464009c60 tx=0x7ff464011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e0a9bdb7cf5904 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff46e89e640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 0x7ff4540a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff45f7fe640 1 -- 172.21.15.100:0/944496094 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff4580d06d0 con 0x7ff468104d60 2024-04-30T23:14:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff45cbfe640 1 -- 172.21.15.100:0/4051237869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464004220 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff45cbfe640 1 -- 172.21.15.100:0/4051237869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4640043c0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.255+0000 7ff45cbfe640 1 -- 172.21.15.100:0/4051237869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464004ce0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- 172.21.15.100:0/4051237869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 msgr2=0x55ec8cf86a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff464009c60 tx=0x7ff464011810 comp rx=0 tx=0).stop 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff46e89e640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 0x7ff4540a60c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4600094e0 tx=0x7ff460031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- 172.21.15.100:0/4051237869 shutdown_connections 2024-04-30T23:14:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf87700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf86a70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4051237869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbe4390 0x55ec8cf864f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- 172.21.15.100:0/4051237869 >> 172.21.15.100:0/4051237869 conn(0x55ec8cbd84e0 msgr2=0x55ec8cf81d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- 172.21.15.100:0/4051237869 shutdown_connections 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- 172.21.15.100:0/4051237869 wait complete. 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 -- start start 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.256+0000 7ff4771b7740 1 Processor -- start 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cf97750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ce71d10 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ec8cee6d40 con 0x55ec8cbc36b0 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec8cf88210 con 0x55ec8cbe4390 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff4771b7740 10 client.0 _ll_register_callbacks cb 0x55ec8cef7d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47086/0 (socket says 172.21.15.100:47086) 2024-04-30T23:14:01.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 -- 172.21.15.100:0/2158709746 learned_addr learned my addr 172.21.15.100:0/2158709746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46d89c640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e89e640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cf97750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 -- 172.21.15.100:0/2158709746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 msgr2=0x55ec8cf97750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cf97750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 -- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 msgr2=0x55ec8cf907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf907f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 -- 172.21.15.100:0/2158709746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8ccc67d0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff46e09d640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff464009c30 tx=0x7ff464019be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d104b725d6bfea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.257+0000 7ff451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:01.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464027030 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff464019dd0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4640043c0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff464034050 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:01.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec8cbfc3f0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4640043c0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff464023af0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 20 client.15732 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:01.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cba2f60 0x55ec8cf9da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 4 client.15732 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.258+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec8cef8990 con 0x55ec8cba2f60 2024-04-30T23:14:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.259+0000 7ff46d89c640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cba2f60 0x55ec8cf9da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.259+0000 7ff451ffb640 10 client.15732 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.259+0000 7ff46d89c640 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cba2f60 0x55ec8cf9da00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf11df0d60513395 server_cookie=d7aab4ba31d71b1f in_seq=0 out_seq=0 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff451ffb640 1 -- 172.21.15.100:0/2158709746 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55ec8cef8990 con 0x55ec8cba2f60 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff451ffb640 10 client.15732 handle_command_reply: tid=0 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 client.15732 shutdown 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 msgr2=0x55ec8cf902b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff464009c30 tx=0x7ff464019be0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 shutdown_connections 2024-04-30T23:14:01.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cba2f60 0x55ec8cf9da00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cf97750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff451ffb640 0 client.15732 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:01.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 --2- 172.21.15.100:0/2158709746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf902b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 >> 172.21.15.100:0/2158709746 conn(0x55ec8cbd84e0 msgr2=0x55ec8cf84c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 shutdown_connections 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 1 -- 172.21.15.100:0/2158709746 wait complete. 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.260+0000 7ff4771b7740 20 client.15732 trim_cache size 0 max 16384 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 Processor -- start 2024-04-30T23:14:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 -- start start 2024-04-30T23:14:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cfa31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cfa3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681ac930 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681ae470 con 0x55ec8cbc36b0 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff4771b7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681ad000 con 0x55ec8cbe4390 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47100/0 (socket says 172.21.15.100:47100) 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 -- 172.21.15.100:0/4048162111 learned_addr learned my addr 172.21.15.100:0/4048162111 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46d89c640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cfa31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e89e640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cfa3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 -- 172.21.15.100:0/4048162111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 msgr2=0x55ec8cfa3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cfa3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 -- 172.21.15.100:0/4048162111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 msgr2=0x55ec8cfa31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cfa31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 -- 172.21.15.100:0/4048162111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8cbbc0f0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e89e640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cfa3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.278+0000 7ff46e09d640 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff464023f40 tx=0x7ff4640099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ce86facac8381b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff453fff640 1 -- 172.21.15.100:0/4048162111 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464027070 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff453fff640 1 -- 172.21.15.100:0/4048162111 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff46402e0b0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff453fff640 1 -- 172.21.15.100:0/4048162111 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46401d040 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 -- 172.21.15.100:0/4048162111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 msgr2=0x55ec8cf8f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff464023f40 tx=0x7ff4640099b0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 -- 172.21.15.100:0/4048162111 shutdown_connections 2024-04-30T23:14:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8cfa3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbc36b0 0x55ec8cfa31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 --2- 172.21.15.100:0/4048162111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf8f270 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.279+0000 7ff4771b7740 1 -- 172.21.15.100:0/4048162111 >> 172.21.15.100:0/4048162111 conn(0x55ec8cbd84e0 msgr2=0x55ec8cf85530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- 172.21.15.100:0/4048162111 shutdown_connections 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- 172.21.15.100:0/4048162111 wait complete. 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- start start 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 Processor -- start 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf97030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8d001c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681adda0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681ad6d0 con 0x55ec8cbbb4d0 2024-04-30T23:14:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681aa910 con 0x55ec8cbe4390 2024-04-30T23:14:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff4771b7740 10 client.0 _ll_register_callbacks cb 0x7ff458005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff46d89c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff46d89c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47114/0 (socket says 172.21.15.100:47114) 2024-04-30T23:14:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff46d89c640 1 -- 172.21.15.100:0/3183808938 learned_addr learned my addr 172.21.15.100:0/3183808938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.280+0000 7ff46e09d640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf97030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 -- 172.21.15.100:0/3183808938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 msgr2=0x55ec8d001c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8d001c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 -- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbbb4d0 msgr2=0x55ec8cf97030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf97030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 -- 172.21.15.100:0/3183808938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8ceab4b0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff46d89c640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff4580cde70 tx=0x7ff4580096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a50e32b9fd8bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45801c040 con 0x55ec8cbc36b0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff4580cdf80 con 0x55ec8cbc36b0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff46402e0b0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4580b9070 con 0x55ec8cbc36b0 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 10 client.15738 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec8d003150 con 0x55ec8cbc36b0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff46402e0b0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff458098cc0 con 0x55ec8cbc36b0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 10 client.15738 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.281+0000 7ff4771b7740 20 client.15738 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cb783a0 0x55ec8d005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff4771b7740 4 client.15738 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec8cef2800 con 0x55ec8cb783a0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff46e09d640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cb783a0 0x55ec8d005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff451ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff46e09d640 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cb783a0 0x55ec8d005ac0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ff429cf0e25f3b server_cookie=a8fde128c39d89bd in_seq=0 out_seq=0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff451ffb640 1 -- 172.21.15.100:0/3183808938 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55ec8cef2800 con 0x55ec8cb783a0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff451ffb640 10 client.15738 handle_command_reply: tid=0 2024-04-30T23:14:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.282+0000 7ff4771b7740 1 client.15738 shutdown 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 msgr2=0x55ec8cf97570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff4580cde70 tx=0x7ff4580096e0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 shutdown_connections 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55ec8cb783a0 0x55ec8d005ac0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec8cbe4390 0x55ec8d001c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec8cbc36b0 0x55ec8cf97570 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff451ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 --2- 172.21.15.100:0/3183808938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ec8cbbb4d0 0x55ec8cf97030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 >> 172.21.15.100:0/3183808938 conn(0x55ec8cbd84e0 msgr2=0x55ec8cf85290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 shutdown_connections 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 1 -- 172.21.15.100:0/3183808938 wait complete. 2024-04-30T23:14:01.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff4771b7740 20 client.15738 trim_cache size 0 max 16384 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {}, 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:01.395 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:01.396 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:01.396 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:01.396 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 msgr2=0x7ff4540a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 0x7ff4540a60c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4600094e0 tx=0x7ff460031af0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 msgr2=0x7ff46819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff46819a760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e9f0 tx=0x7ff45800eeb0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 shutdown_connections 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff4540a3bb0 0x7ff4540a60c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff468109a60 0x7ff4681a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468104d60 0x7ff46819a760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 --2- 172.21.15.100:0/944496094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff468103b20 0x7ff46819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 >> 172.21.15.100:0/944496094 conn(0x7ff4680fed10 msgr2=0x7ff468105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 shutdown_connections 2024-04-30T23:14:01.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.283+0000 7ff470301640 1 -- 172.21.15.100:0/944496094 wait complete. 2024-04-30T23:14:01.398 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T23:14:01.398 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 -- 172.21.15.100:0/3923967912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c101ea0 msgr2=0x7f0f3c1022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/3923967912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c1022b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009900 tx=0x7f0f3002a410 comp rx=0 tx=0).stop 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 -- 172.21.15.100:0/3923967912 shutdown_connections 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/3923967912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c10bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/3923967912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c106c80 0x7f0f3c109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/3923967912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c1022b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 -- 172.21.15.100:0/3923967912 >> 172.21.15.100:0/3923967912 conn(0x7f0f3c0fd3d0 msgr2=0x7f0f3c0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 -- 172.21.15.100:0/3923967912 shutdown_connections 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 -- 172.21.15.100:0/3923967912 wait complete. 2024-04-30T23:14:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.510+0000 7f0f41a8b640 1 Processor -- start 2024-04-30T23:14:01.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 -- start start 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10f650 con 0x7f0f3c106c80 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10f4d0 con 0x7f0f3c1097f0 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f41a8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10f7d0 con 0x7f0f3c101ea0 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47134/0 (socket says 172.21.15.100:47134) 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 -- 172.21.15.100:0/874692649 learned_addr learned my addr 172.21.15.100:0/874692649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3bfff640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 -- 172.21.15.100:0/874692649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 msgr2=0x7f0f3c19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c19a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 -- 172.21.15.100:0/874692649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 msgr2=0x7f0f3c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.511+0000 7f0f3affd640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f3affd640 1 -- 172.21.15.100:0/874692649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c1a1d70 con 0x7f0f3c106c80 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f3b7fe640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f3bfff640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f3affd640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00cd80 con 0x7f0f3c106c80 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f2c0108e0 con 0x7f0f3c106c80 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c1a2060 con 0x7f0f3c106c80 2024-04-30T23:14:01.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c018980 con 0x7f0f3c106c80 2024-04-30T23:14:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.512+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c1a25b0 con 0x7f0f3c106c80 2024-04-30T23:14:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.513+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c0feef0 con 0x7f0f3c106c80 2024-04-30T23:14:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.515+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0f2c010430 con 0x7f0f3c106c80 2024-04-30T23:14:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.516+0000 7f0f38ff9640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 0x7f0f240a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.516+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0f2c0d0fe0 con 0x7f0f3c106c80 2024-04-30T23:14:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.516+0000 7f0f3b7fe640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 0x7f0f240a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.516+0000 7f0f3b7fe640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 0x7f0f240a60c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009230 tx=0x7f0f30031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.520+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0f2c09d660 con 0x7f0f3c106c80 2024-04-30T23:14:01.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.750+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f3c02db90 con 0x7f0f3c106c80 2024-04-30T23:14:01.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.751+0000 7f0f38ff9640 1 -- 172.21.15.100:0/874692649 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f0f2c09cf60 con 0x7f0f3c106c80 2024-04-30T23:14:01.751 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:14:01.751 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:13:23.708732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[24503,24496,24545,14664,24511]},"id":1}]} 2024-04-30T23:14:01.752 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-04-30T23:14:01.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 msgr2=0x7f0f240a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 0x7f0f240a60c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009230 tx=0x7f0f30031400 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 msgr2=0x7f0f3c19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 shutdown_connections 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0f240a3bb0 0x7f0f240a60c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c1097f0 0x7f0f3c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f3c106c80 0x7f0f3c19a770 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 --2- 172.21.15.100:0/874692649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c101ea0 0x7f0f3c19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 >> 172.21.15.100:0/874692649 conn(0x7f0f3c0fd3d0 msgr2=0x7f0f3c107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 shutdown_connections 2024-04-30T23:14:01.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.753+0000 7f0f41a8b640 1 -- 172.21.15.100:0/874692649 wait complete. 2024-04-30T23:14:01.765 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 -- 172.21.15.100:0/1702803831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f0102280 msgr2=0x7f55f010bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 --2- 172.21.15.100:0/1702803831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f0102280 0x7f55f010bce0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009900 tx=0x7f55ec02a410 comp rx=0 tx=0).stop 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 -- 172.21.15.100:0/1702803831 shutdown_connections 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 --2- 172.21.15.100:0/1702803831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f0102280 0x7f55f010bce0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 --2- 172.21.15.100:0/1702803831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 0x7f55f0101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 --2- 172.21.15.100:0/1702803831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f01050d0 0x7f55f01054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 -- 172.21.15.100:0/1702803831 >> 172.21.15.100:0/1702803831 conn(0x7f55f00fd380 msgr2=0x7f55f00ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 -- 172.21.15.100:0/1702803831 shutdown_connections 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.876+0000 7f55f87fa640 1 -- 172.21.15.100:0/1702803831 wait complete. 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 Processor -- start 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 -- start start 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 0x7f55f019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f0102280 0x7f55f019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55f010f640 con 0x7f55f01050d0 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55f010f4c0 con 0x7f55f0102280 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f87fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55f010f7c0 con 0x7f55f0101780 2024-04-30T23:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47150/0 (socket says 172.21.15.100:47150) 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 -- 172.21.15.100:0/50706560 learned_addr learned my addr 172.21.15.100:0/50706560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f5d95640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f0102280 0x7f55f019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6596640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 0x7f55f019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 -- 172.21.15.100:0/50706560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 msgr2=0x7f55f019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 0x7f55f019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 -- 172.21.15.100:0/50706560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f0102280 msgr2=0x7f55f019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f0102280 0x7f55f019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.877+0000 7f55f6d97640 1 -- 172.21.15.100:0/50706560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f01a1d20 con 0x7f55f01050d0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55f6d97640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009230 tx=0x7f55ec031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55e77fe640 1 -- 172.21.15.100:0/50706560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec03f030 con 0x7f55f01050d0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55e77fe640 1 -- 172.21.15.100:0/50706560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55ec003aa0 con 0x7f55f01050d0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f01a1fb0 con 0x7f55f01050d0 2024-04-30T23:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55e77fe640 1 -- 172.21.15.100:0/50706560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec035070 con 0x7f55f01050d0 2024-04-30T23:14:01.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.878+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f01a23c0 con 0x7f55f01050d0 2024-04-30T23:14:01.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.880+0000 7f55ff78a740 1 Processor -- start 2024-04-30T23:14:01.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.880+0000 7f55e77fe640 1 -- 172.21.15.100:0/50706560 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f55ec042030 con 0x7f55f01050d0 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 -- start start 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d845390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d84c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55885d7a9d80 con 0x55885d4a3390 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55885d763a20 con 0x55885d47a4d0 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55ff78a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55885d7a5d40 con 0x55885d4826b0 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47164/0 (socket says 172.21.15.100:47164) 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 -- 172.21.15.100:0/2843927973 learned_addr learned my addr 172.21.15.100:0/2843927973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55e77fe640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 0x7f55dc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f6596640 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d845390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d84c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f6d97640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 0x7f55dc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 -- 172.21.15.100:0/2843927973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 msgr2=0x55885d84c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d84c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 -- 172.21.15.100:0/2843927973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 msgr2=0x55885d845390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d845390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55f5d95640 1 -- 172.21.15.100:0/2843927973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885d747e00 con 0x55885d4a3390 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.881+0000 7f55e77fe640 1 -- 172.21.15.100:0/50706560 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f55ec0f1110 con 0x7f55f01050d0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.882+0000 7f55f5d95640 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55e0012840 tx=0x7f55e000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e25e10bd91cf484 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.882+0000 7f55e4ff9640 1 -- 172.21.15.100:0/2843927973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00120d0 con 0x55885d4a3390 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.882+0000 7f55f6d97640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 0x7f55dc0a60c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f55ec04b000 tx=0x7f55ec08c9c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.882+0000 7f55e4ff9640 1 -- 172.21.15.100:0/2843927973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0004c50 con 0x55885d4a3390 2024-04-30T23:14:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.882+0000 7f55e4ff9640 1 -- 172.21.15.100:0/2843927973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0005610 con 0x55885d4a3390 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- 172.21.15.100:0/2843927973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 msgr2=0x55885d844e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55e0012840 tx=0x7f55e000b8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- 172.21.15.100:0/2843927973 shutdown_connections 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d84c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d845390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 --2- 172.21.15.100:0/2843927973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d844e10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- 172.21.15.100:0/2843927973 >> 172.21.15.100:0/2843927973 conn(0x55885d4974e0 msgr2=0x55885d8407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- 172.21.15.100:0/2843927973 shutdown_connections 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- 172.21.15.100:0/2843927973 wait complete. 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 -- start start 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.883+0000 7f55ff78a740 1 Processor -- start 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d47a4d0 0x55885d84ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d855ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55885d84cc80 con 0x55885d4826b0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55885d730dc0 con 0x55885d4a3390 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55885d84ce00 con 0x55885d47a4d0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 10 client.0 _ll_register_callbacks cb 0x55885d74c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47168/0 (socket says 172.21.15.100:47168) 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 -- 172.21.15.100:0/699558309 learned_addr learned my addr 172.21.15.100:0/699558309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f5d95640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d47a4d0 0x55885d84ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f5d95640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d855ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 -- 172.21.15.100:0/699558309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d47a4d0 msgr2=0x55885d84ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d47a4d0 0x55885d84ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 -- 172.21.15.100:0/699558309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 msgr2=0x55885d855ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d855ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 -- 172.21.15.100:0/699558309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55885d76ec30 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f5d95640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d855ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55f6596640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013890 tx=0x7f55e8013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd20a813617665eb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8011e90 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f55e8003970 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.884+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e0004c50 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55e8003b70 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 10 client.15756 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55885d4bb3f0 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0004c50 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55e801a070 con 0x55885d4826b0 2024-04-30T23:14:01.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 10 client.15756 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 10 client.15756 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 20 client.15756 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d461f60 0x55885d85c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 4 client.15756 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55885d7a3810 con 0x55885d461f60 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55f5d95640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d461f60 0x55885d85c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55d9ffb640 10 client.15756 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.885+0000 7f55f5d95640 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d461f60 0x55885d85c7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f26816295571f2a server_cookie=d479d3bec2955ca6 in_seq=0 out_seq=0 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55d9ffb640 1 -- 172.21.15.100:0/699558309 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55885d7a3810 con 0x55885d461f60 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55d9ffb640 10 client.15756 handle_command_reply: tid=0 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 client.15756 shutdown 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 msgr2=0x55885d84ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013890 tx=0x7f55e8013d50 comp rx=0 tx=0).stop 2024-04-30T23:14:01.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 shutdown_connections 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d461f60 0x55885d85c7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d855ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55d9ffb640 0 client.15756 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4826b0 0x55885d84ef40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 --2- 172.21.15.100:0/699558309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d47a4d0 0x55885d84ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 >> 172.21.15.100:0/699558309 conn(0x55885d4974e0 msgr2=0x55885d83f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 shutdown_connections 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.886+0000 7f55ff78a740 1 -- 172.21.15.100:0/699558309 wait complete. 2024-04-30T23:14:01.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.887+0000 7f55ff78a740 20 client.15756 trim_cache size 0 max 16384 2024-04-30T23:14:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 Processor -- start 2024-04-30T23:14:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 -- start start 2024-04-30T23:14:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d843cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d8441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01ac8c0 con 0x55885d4a3390 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01ae400 con 0x55885d47a4d0 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55ff78a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01acf90 con 0x55885d4826b0 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47180/0 (socket says 172.21.15.100:47180) 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 -- 172.21.15.100:0/788096998 learned_addr learned my addr 172.21.15.100:0/788096998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f6596640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d8441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d843cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 -- 172.21.15.100:0/788096998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 msgr2=0x55885d8441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d8441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 -- 172.21.15.100:0/788096998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 msgr2=0x55885d843cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d843cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 -- 172.21.15.100:0/788096998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885d5857d0 con 0x55885d4a3390 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f6596640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d8441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.900+0000 7f55f5d95640 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f55e0012840 tx=0x7f55e000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe69f557c349aa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55dbfff640 1 -- 172.21.15.100:0/788096998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004870 con 0x55885d4a3390 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55dbfff640 1 -- 172.21.15.100:0/788096998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0004a10 con 0x55885d4a3390 2024-04-30T23:14:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55dbfff640 1 -- 172.21.15.100:0/788096998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0005600 con 0x55885d4a3390 2024-04-30T23:14:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 -- 172.21.15.100:0/788096998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 msgr2=0x55885d861fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f55e0012840 tx=0x7f55e000b410 comp rx=0 tx=0).stop 2024-04-30T23:14:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 -- 172.21.15.100:0/788096998 shutdown_connections 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d4a3390 0x55885d861fb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d8441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 --2- 172.21.15.100:0/788096998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d47a4d0 0x55885d843cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.901+0000 7f55ff78a740 1 -- 172.21.15.100:0/788096998 >> 172.21.15.100:0/788096998 conn(0x55885d4974e0 msgr2=0x55885d8435a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- 172.21.15.100:0/788096998 shutdown_connections 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- 172.21.15.100:0/788096998 wait complete. 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- start start 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 Processor -- start 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d853600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d8544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01add30 con 0x55885d47a4d0 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01ad660 con 0x55885d4a3390 2024-04-30T23:14:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01aa8a0 con 0x55885d4826b0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55ff78a740 10 client.0 _ll_register_callbacks cb 0x7f55e8009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47184/0 (socket says 172.21.15.100:47184) 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 -- 172.21.15.100:0/3686390638 learned_addr learned my addr 172.21.15.100:0/3686390638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d8544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f6596640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d853600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 -- 172.21.15.100:0/3686390638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 msgr2=0x55885d853600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d853600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 -- 172.21.15.100:0/3686390638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 msgr2=0x55885d8544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d8544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.902+0000 7f55f5d95640 1 -- 172.21.15.100:0/3686390638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55885d854aa0 con 0x55885d47a4d0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55f5d95640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f55e0015040 tx=0x7f55e0005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7eeb900f3b05adc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004220 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f55e00043c0 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e0004a10 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55e003f050 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 10 client.15762 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55885d8c2dd0 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0004a10 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55e002d5d0 con 0x55885d47a4d0 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 10 client.15762 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 10 client.15762 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 20 client.15762 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d4373a0 0x55885d8c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 4 client.15762 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55885d7b7990 con 0x55885d4373a0 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.903+0000 7f55f6596640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d4373a0 0x55885d8c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55d9ffb640 10 client.15762 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55f6596640 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d4373a0 0x55885d8c55c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cac201bfe2fd21f8 server_cookie=3734750f4d1180e8 in_seq=0 out_seq=0 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55d9ffb640 1 -- 172.21.15.100:0/3686390638 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55885d7b7990 con 0x55885d4373a0 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55d9ffb640 10 client.15762 handle_command_reply: tid=0 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 client.15762 shutdown 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 msgr2=0x55885d8530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f55e0015040 tx=0x7f55e0005bb0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 shutdown_connections 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55885d4373a0 0x55885d8c55c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55885d4a3390 0x55885d8544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55885d4826b0 0x55885d853600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55d9ffb640 0 client.15762 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 --2- 172.21.15.100:0/3686390638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55885d47a4d0 0x55885d8530c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 >> 172.21.15.100:0/3686390638 conn(0x55885d4974e0 msgr2=0x55885d843fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 shutdown_connections 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 1 -- 172.21.15.100:0/3686390638 wait complete. 2024-04-30T23:14:01.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.904+0000 7f55ff78a740 20 client.15762 trim_cache size 0 max 16384 2024-04-30T23:14:01.913 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 msgr2=0x7f55dc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 0x7f55dc0a60c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f55ec04b000 tx=0x7f55ec08c9c0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 msgr2=0x7f55f01a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009230 tx=0x7f55ec031a50 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 shutdown_connections 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f55dc0a3bb0 0x7f55dc0a60c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55f01050d0 0x7f55f01a16b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55f0102280 0x7f55f019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 --2- 172.21.15.100:0/50706560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55f0101780 0x7f55f019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 >> 172.21.15.100:0/50706560 conn(0x7f55f00fd380 msgr2=0x7f55f0107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 shutdown_connections 2024-04-30T23:14:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:01.905+0000 7f55f87fa640 1 -- 172.21.15.100:0/50706560 wait complete. 2024-04-30T23:14:01.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 -- 172.21.15.100:0/920974218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd81044c0 msgr2=0x7f7dd810ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 --2- 172.21.15.100:0/920974218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd81044c0 0x7f7dd810ac10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009ca0 tx=0x7f7dd002cad0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 -- 172.21.15.100:0/920974218 shutdown_connections 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 --2- 172.21.15.100:0/920974218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd81044c0 0x7f7dd810ac10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 --2- 172.21.15.100:0/920974218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 0x7f7dd8103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 --2- 172.21.15.100:0/920974218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd8102fc0 0x7f7dd81033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 -- 172.21.15.100:0/920974218 >> 172.21.15.100:0/920974218 conn(0x7f7dd80fd3c0 msgr2=0x7f7dd80ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 -- 172.21.15.100:0/920974218 shutdown_connections 2024-04-30T23:14:02.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.027+0000 7f7ddd849640 1 -- 172.21.15.100:0/920974218 wait complete. 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 Processor -- start 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 -- start start 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 0x7f7dd81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd81044c0 0x7f7dd819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd810d480 con 0x7f7dd8102fc0 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd810d300 con 0x7f7dd81039a0 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7ddd849640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd810d600 con 0x7f7dd81044c0 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47200/0 (socket says 172.21.15.100:47200) 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 -- 172.21.15.100:0/2558891785 learned_addr learned my addr 172.21.15.100:0/2558891785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 0x7f7dd81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd81044c0 0x7f7dd819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 -- 172.21.15.100:0/2558891785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd81044c0 msgr2=0x7f7dd819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd81044c0 0x7f7dd819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 -- 172.21.15.100:0/2558891785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 msgr2=0x7f7dd81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 0x7f7dd81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.028+0000 7f7dd6ffd640 1 -- 172.21.15.100:0/2558891785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd819faf0 con 0x7f7dd8102fc0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d770 tx=0x7f7dc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7ddc847640 1 -- 172.21.15.100:0/2558891785 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8017070 con 0x7f7dd8102fc0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd819fde0 con 0x7f7dd8102fc0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7ddc847640 1 -- 172.21.15.100:0/2558891785 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dc8009c30 con 0x7f7dd8102fc0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7ddc847640 1 -- 172.21.15.100:0/2558891785 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800f620 con 0x7f7dd8102fc0 2024-04-30T23:14:02.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.029+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd81a02a0 con 0x7f7dd8102fc0 2024-04-30T23:14:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.031+0000 7f7de47d1740 1 Processor -- start 2024-04-30T23:14:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 -- start start 2024-04-30T23:14:02.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7ddc847640 1 -- 172.21.15.100:0/2558891785 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7dc801a070 con 0x7f7dd8102fc0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ceca4d0 0x55893d295390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d29c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55893d1f9d80 con 0x55893cef3390 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55893d1b3a20 con 0x55893ced26b0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7de47d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55893d1f5d40 con 0x55893ceca4d0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47210/0 (socket says 172.21.15.100:47210) 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 -- 172.21.15.100:0/2255109358 learned_addr learned my addr 172.21.15.100:0/2255109358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ceca4d0 0x55893d295390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d29c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 -- 172.21.15.100:0/2255109358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ceca4d0 msgr2=0x55893d295390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ceca4d0 0x55893d295390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 -- 172.21.15.100:0/2255109358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 msgr2=0x55893d29c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d29c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 -- 172.21.15.100:0/2255109358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893d197e00 con 0x55893cef3390 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d29c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7ddc847640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 0x7f7dc00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.032+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0037000 tx=0x7f7dd0038ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccaa586c54bc376 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.033+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 0x7f7dc00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.033+0000 7f7dbdffb640 1 -- 172.21.15.100:0/2255109358 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0046020 con 0x55893cef3390 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.033+0000 7f7ddc847640 1 -- 172.21.15.100:0/2558891785 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7dc80d0210 con 0x7f7dd8102fc0 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.033+0000 7f7dbdffb640 1 -- 172.21.15.100:0/2255109358 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd0003cb0 con 0x55893cef3390 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.033+0000 7f7dbdffb640 1 -- 172.21.15.100:0/2255109358 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004480 con 0x55893cef3390 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- 172.21.15.100:0/2255109358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 msgr2=0x55893d294e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7dd6ffd640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 0x7f7dc00a60c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55893d2961f0 tx=0x7f7dc80d3cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0037000 tx=0x7f7dd0038ee0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- 172.21.15.100:0/2255109358 shutdown_connections 2024-04-30T23:14:02.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d29c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ceca4d0 0x55893d295390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 --2- 172.21.15.100:0/2255109358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893cef3390 0x55893d294e10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- 172.21.15.100:0/2255109358 >> 172.21.15.100:0/2255109358 conn(0x55893cee74e0 msgr2=0x55893d2907a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- 172.21.15.100:0/2255109358 shutdown_connections 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- 172.21.15.100:0/2255109358 wait complete. 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 -- start start 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.034+0000 7f7de47d1740 1 Processor -- start 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ced26b0 0x55893d29efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893cef3390 0x55893d2a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55893d29cc80 con 0x55893ceca4d0 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55893d180dc0 con 0x55893cef3390 2024-04-30T23:14:02.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55893d29ce00 con 0x55893ced26b0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 10 client.0 _ll_register_callbacks cb 0x55893d19c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47216/0 (socket says 172.21.15.100:47216) 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 -- 172.21.15.100:0/3800634964 learned_addr learned my addr 172.21.15.100:0/3800634964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ced26b0 0x55893d29efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893cef3390 0x55893d2a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 -- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ced26b0 msgr2=0x55893d29efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ced26b0 0x55893d29efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 -- 172.21.15.100:0/3800634964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893cef3390 msgr2=0x55893d2a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893cef3390 0x55893d2a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 -- 172.21.15.100:0/3800634964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893d1bec30 con 0x55893ceca4d0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0006010 tx=0x7f7dd0009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efd88e7325cc6f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0058060 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7dd0004680 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd0003cb0 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dd0046040 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 10 client.15774 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.035+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55893cf0b3f0 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd0003cb0 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7dd002e040 con 0x55893ceca4d0 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 10 client.15774 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 10 client.15774 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 20 client.15774 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ceb1f60 0x55893d2ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 4 client.15774 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55893d1f3810 con 0x55893ceb1f60 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.036+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ceb1f60 0x55893d2ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.037+0000 7f7db6ffd640 10 client.15774 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.037+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ceb1f60 0x55893d2ac350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3112970332a6e580 server_cookie=8854c18c478cedda in_seq=0 out_seq=0 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.037+0000 7f7db6ffd640 1 -- 172.21.15.100:0/3800634964 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55893d1f3810 con 0x55893ceb1f60 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.037+0000 7f7db6ffd640 10 client.15774 handle_command_reply: tid=0 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.037+0000 7f7de47d1740 1 client.15774 shutdown 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 msgr2=0x55893d29ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0006010 tx=0x7f7dd0009540 comp rx=0 tx=0).stop 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 shutdown_connections 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ceb1f60 0x55893d2ac350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893cef3390 0x55893d2a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893ced26b0 0x55893d29efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7db6ffd640 0 client.15774 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:02.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3800634964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d29ea60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 >> 172.21.15.100:0/3800634964 conn(0x55893cee74e0 msgr2=0x55893d28f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 shutdown_connections 2024-04-30T23:14:02.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 1 -- 172.21.15.100:0/3800634964 wait complete. 2024-04-30T23:14:02.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.038+0000 7f7de47d1740 20 client.15774 trim_cache size 0 max 16384 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 Processor -- start 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 -- start start 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 0x55893d29ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81aa730 con 0x55893ced26b0 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81ac270 con 0x55893ceca4d0 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7de47d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81aae00 con 0x55893cef3390 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7dd67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7dd67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47224/0 (socket says 172.21.15.100:47224) 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7dd67fc640 1 -- 172.21.15.100:0/3117426094 learned_addr learned my addr 172.21.15.100:0/3117426094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.051+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 0x55893d29ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 -- 172.21.15.100:0/3117426094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 msgr2=0x55893d2b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 -- 172.21.15.100:0/3117426094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 msgr2=0x55893d29ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 0x55893d29ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 -- 172.21.15.100:0/3117426094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893cfd57d0 con 0x55893ced26b0 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 0x55893d29ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55893d291530 tx=0x7f7dcc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff614e6c9d4f445 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dbd7fa640 1 -- 172.21.15.100:0/3117426094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003ca0 con 0x55893ced26b0 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dbd7fa640 1 -- 172.21.15.100:0/3117426094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dcc003e40 con 0x55893ced26b0 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.052+0000 7f7dbd7fa640 1 -- 172.21.15.100:0/3117426094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0200f0 con 0x55893ced26b0 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- 172.21.15.100:0/3117426094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 msgr2=0x55893d2b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55893d291530 tx=0x7f7dcc005f90 comp rx=0 tx=0).stop 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- 172.21.15.100:0/3117426094 shutdown_connections 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ced26b0 0x55893d2b0940 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- 172.21.15.100:0/3117426094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ceca4d0 0x55893d29ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- 172.21.15.100:0/3117426094 >> 172.21.15.100:0/3117426094 conn(0x55893cee74e0 msgr2=0x55893d29e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- 172.21.15.100:0/3117426094 shutdown_connections 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- 172.21.15.100:0/3117426094 wait complete. 2024-04-30T23:14:02.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- start start 2024-04-30T23:14:02.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 Processor -- start 2024-04-30T23:14:02.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d2a3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2a4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81abba0 con 0x55893ceca4d0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81ab4d0 con 0x55893ced26b0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.053+0000 7f7de47d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81a8710 con 0x55893cef3390 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7de47d1740 10 client.0 _ll_register_callbacks cb 0x7f7dc80d3bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47240/0 (socket says 172.21.15.100:47240) 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 -- 172.21.15.100:0/1331484358 learned_addr learned my addr 172.21.15.100:0/1331484358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d2a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 -- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 msgr2=0x55893d2a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 -- 172.21.15.100:0/1331484358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 msgr2=0x55893d2a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d2a3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 -- 172.21.15.100:0/1331484358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893d2a4ad0 con 0x55893ceca4d0 2024-04-30T23:14:02.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7dd77fe640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0002230 tx=0x7f7dd00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da71be74595a1bbc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0058050 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7dd0003cc0 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55893d207990 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dd0038c00 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7de47d1740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55893d3126a0 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.054+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55893d207990 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7dd0062030 con 0x55893ceca4d0 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 10 client.15780 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 20 client.15780 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ce873a0 0x55893d314f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 4 client.15780 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55893d201800 con 0x55893ce873a0 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ce873a0 0x55893d314f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7db6ffd640 10 client.15780 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7dd67fc640 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ce873a0 0x55893d314f30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d3b8fae55bdf6081 server_cookie=967c2f110bfdb3d1 in_seq=0 out_seq=0 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7db6ffd640 1 -- 172.21.15.100:0/1331484358 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55893d201800 con 0x55893ce873a0 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.055+0000 7f7db6ffd640 10 client.15780 handle_command_reply: tid=0 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 client.15780 shutdown 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 msgr2=0x55893d2a30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0002230 tx=0x7f7dd00043d0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 shutdown_connections 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55893ce873a0 0x55893d314f30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55893cef3390 0x55893d2a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55893ced26b0 0x55893d2a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7db6ffd640 0 client.15780 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 --2- 172.21.15.100:0/1331484358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55893ceca4d0 0x55893d2a30f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 >> 172.21.15.100:0/1331484358 conn(0x55893cee74e0 msgr2=0x55893d293650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 shutdown_connections 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 1 -- 172.21.15.100:0/1331484358 wait complete. 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7de47d1740 20 client.15780 trim_cache size 0 max 16384 2024-04-30T23:14:02.063 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 msgr2=0x7f7dc00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 0x7f7dc00a60c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55893d2961f0 tx=0x7f7dc80d3cf0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 msgr2=0x7f7dd8197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d770 tx=0x7f7dc800dc30 comp rx=0 tx=0).stop 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 shutdown_connections 2024-04-30T23:14:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7dc00a3bb0 0x7f7dc00a60c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dd81044c0 0x7f7dd819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7dd81039a0 0x7f7dd81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 --2- 172.21.15.100:0/2558891785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd8102fc0 0x7f7dd8197fb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.056+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 >> 172.21.15.100:0/2558891785 conn(0x7f7dd80fd3c0 msgr2=0x7f7dd8106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.057+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 shutdown_connections 2024-04-30T23:14:02.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.057+0000 7f7ddd849640 1 -- 172.21.15.100:0/2558891785 wait complete. 2024-04-30T23:14:02.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-30T23:14:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.178+0000 7f7662a9a640 1 -- 172.21.15.100:0/1506342318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 msgr2=0x7f765c103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.178+0000 7f7662a9a640 1 --2- 172.21.15.100:0/1506342318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c103720 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-04-30T23:14:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- 172.21.15.100:0/1506342318 shutdown_connections 2024-04-30T23:14:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- 172.21.15.100:0/1506342318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c108960 0x7f765c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- 172.21.15.100:0/1506342318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c103c60 0x7f765c104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- 172.21.15.100:0/1506342318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c103720 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- 172.21.15.100:0/1506342318 >> 172.21.15.100:0/1506342318 conn(0x7f765c0fdc10 msgr2=0x7f765c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- 172.21.15.100:0/1506342318 shutdown_connections 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- 172.21.15.100:0/1506342318 wait complete. 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 Processor -- start 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- start start 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c103c60 0x7f765c1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c108960 0x7f765c1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f765c10e520 con 0x7f765c102a20 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f765c10e3a0 con 0x7f765c103c60 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7662a9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f765c10e6a0 con 0x7f765c108960 2024-04-30T23:14:02.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.179+0000 7f7660836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47262/0 (socket says 172.21.15.100:47262) 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 -- 172.21.15.100:0/4187439979 learned_addr learned my addr 172.21.15.100:0/4187439979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7661037640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c108960 0x7f765c1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f765bfff640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c103c60 0x7f765c1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 -- 172.21.15.100:0/4187439979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c108960 msgr2=0x7f765c1a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c108960 0x7f765c1a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 -- 172.21.15.100:0/4187439979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c103c60 msgr2=0x7f765c1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c103c60 0x7f765c1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 -- 172.21.15.100:0/4187439979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c1a0ff0 con 0x7f765c102a20 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7660836640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7650006010 tx=0x7f7650004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7659ffb640 1 -- 172.21.15.100:0/4187439979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765003f030 con 0x7f765c102a20 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7659ffb640 1 -- 172.21.15.100:0/4187439979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7650003aa0 con 0x7f765c102a20 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c1a1280 con 0x7f765c102a20 2024-04-30T23:14:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7659ffb640 1 -- 172.21.15.100:0/4187439979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035070 con 0x7f765c102a20 2024-04-30T23:14:02.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.180+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c1a17c0 con 0x7f765c102a20 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7659ffb640 1 -- 172.21.15.100:0/4187439979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7650042030 con 0x7f765c102a20 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 Processor -- start 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 -- start start 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f0d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b486b0 0x562228f144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562228e6fd80 con 0x562228b404d0 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562228e29a20 con 0x562228b486b0 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7669a2a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562228e6bd40 con 0x562228b69390 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7660836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.183+0000 7f7660836640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47268/0 (socket says 172.21.15.100:47268) 2024-04-30T23:14:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 -- 172.21.15.100:0/1723449487 learned_addr learned my addr 172.21.15.100:0/1723449487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7659ffb640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 0x7f764c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7661037640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f0d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f765bfff640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b486b0 0x562228f144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7661037640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 0x7f764c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7659ffb640 1 -- 172.21.15.100:0/4187439979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f76500f0cc0 con 0x7f765c102a20 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 -- 172.21.15.100:0/1723449487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 msgr2=0x562228f0d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f0d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 -- 172.21.15.100:0/1723449487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b486b0 msgr2=0x562228f144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b486b0 0x562228f144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 -- 172.21.15.100:0/1723449487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562228e0de00 con 0x562228b404d0 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7661037640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f0d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7660836640 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f76500bc9f0 tx=0x7f76500b90c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bf6b553b4232aa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7646ffd640 1 -- 172.21.15.100:0/1723449487 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76500f2070 con 0x562228b404d0 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7661037640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 0x7f764c0a6140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x562228f0e1f0 tx=0x7f7654009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7646ffd640 1 -- 172.21.15.100:0/1723449487 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76500f43b0 con 0x562228b404d0 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.184+0000 7f7646ffd640 1 -- 172.21.15.100:0/1723449487 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650049070 con 0x562228b404d0 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 -- 172.21.15.100:0/1723449487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 msgr2=0x562228f0d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f76500bc9f0 tx=0x7f76500b90c0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 -- 172.21.15.100:0/1723449487 shutdown_connections 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b486b0 0x562228f144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b404d0 0x562228f0d5a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 --2- 172.21.15.100:0/1723449487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f0d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 -- 172.21.15.100:0/1723449487 >> 172.21.15.100:0/1723449487 conn(0x562228b5d4e0 msgr2=0x562228f089b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 -- 172.21.15.100:0/1723449487 shutdown_connections 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.185+0000 7f7669a2a740 1 -- 172.21.15.100:0/1723449487 wait complete. 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 -- start start 2024-04-30T23:14:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 Processor -- start 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f16eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562228e6fd80 con 0x562228b486b0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562228df6dc0 con 0x562228b404d0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562228f05fb0 con 0x562228b69390 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7669a2a740 10 client.0 _ll_register_callbacks cb 0x562228e12600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47270/0 (socket says 172.21.15.100:47270) 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f765bfff640 1 -- 172.21.15.100:0/2862649869 learned_addr learned my addr 172.21.15.100:0/2862649869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7660836640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f16eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.186+0000 7f7661037640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 -- 172.21.15.100:0/2862649869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 msgr2=0x562228f1ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f1ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 -- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 msgr2=0x562228f16eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f16eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 -- 172.21.15.100:0/2862649869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562228e34c30 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f7660836640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f16eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f765bfff640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7648009a30 tx=0x7f7648009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827652fb42acbeeb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f763bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648023060 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7648004050 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562228e69810 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f764802a050 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f7669a2a740 10 client.15792 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562228b813f0 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.187+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562228e69810 con 0x562228b486b0 2024-04-30T23:14:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f764801e400 con 0x562228b486b0 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 10 client.15792 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 10 client.15792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 20 client.15792 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228b27f60 0x562228f22560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 4 client.15792 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562228e7d990 con 0x562228b27f60 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7660836640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228b27f60 0x562228f22560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f763bfff640 10 client.15792 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.188+0000 7f7660836640 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228b27f60 0x562228f22560 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be325492bbd6ff2 server_cookie=b801cf2d1d8cb3f1 in_seq=0 out_seq=0 2024-04-30T23:14:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f763bfff640 1 -- 172.21.15.100:0/2862649869 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562228e7d990 con 0x562228b27f60 2024-04-30T23:14:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f763bfff640 10 client.15792 handle_command_reply: tid=0 2024-04-30T23:14:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 client.15792 shutdown 2024-04-30T23:14:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 msgr2=0x562228f19400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7648009a30 tx=0x7f7648009ef0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 shutdown_connections 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f19400 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228b27f60 0x562228f22560 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2862649869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f16eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f763bfff640 0 client.15792 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 >> 172.21.15.100:0/2862649869 conn(0x562228b5d4e0 msgr2=0x562228f0b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.189+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 shutdown_connections 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.190+0000 7f7669a2a740 1 -- 172.21.15.100:0/2862649869 wait complete. 2024-04-30T23:14:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.190+0000 7f7669a2a740 20 client.15792 trim_cache size 0 max 16384 2024-04-30T23:14:02.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 Processor -- start 2024-04-30T23:14:02.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 -- start start 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b404d0 0x562228f07d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 0x562228f0b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1aa730 con 0x562228b486b0 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1ac270 con 0x562228b69390 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7669a2a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1aae00 con 0x562228b404d0 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47276/0 (socket says 172.21.15.100:47276) 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f765bfff640 1 -- 172.21.15.100:0/3274909362 learned_addr learned my addr 172.21.15.100:0/3274909362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7660836640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b404d0 0x562228f07d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.203+0000 7f7661037640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 0x562228f0b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 -- 172.21.15.100:0/3274909362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b404d0 msgr2=0x562228f07d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b404d0 0x562228f07d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 -- 172.21.15.100:0/3274909362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 msgr2=0x562228f0b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 0x562228f0b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 -- 172.21.15.100:0/3274909362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562228c4b7d0 con 0x562228b486b0 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f7661037640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 0x562228f0b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f765bfff640 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f764801e7f0 tx=0x7f7648013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8abca33ca3aac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f76467fc640 1 -- 172.21.15.100:0/3274909362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648033070 con 0x562228b486b0 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f76467fc640 1 -- 172.21.15.100:0/3274909362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7648005570 con 0x562228b486b0 2024-04-30T23:14:02.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.204+0000 7f76467fc640 1 -- 172.21.15.100:0/3274909362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648003a10 con 0x562228b486b0 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- 172.21.15.100:0/3274909362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 msgr2=0x562228f08250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f764801e7f0 tx=0x7f7648013d50 comp rx=0 tx=0).stop 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- 172.21.15.100:0/3274909362 shutdown_connections 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b69390 0x562228f0b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f08250 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 --2- 172.21.15.100:0/3274909362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b404d0 0x562228f07d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- 172.21.15.100:0/3274909362 >> 172.21.15.100:0/3274909362 conn(0x562228b5d4e0 msgr2=0x562228f016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- 172.21.15.100:0/3274909362 shutdown_connections 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- 172.21.15.100:0/3274909362 wait complete. 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 -- start start 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 Processor -- start 2024-04-30T23:14:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.205+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f2eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f32310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1abba0 con 0x562228b486b0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1ab4d0 con 0x562228b404d0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1a8710 con 0x562228b69390 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 10 client.0 _ll_register_callbacks cb 0x7f76480137d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47282/0 (socket says 172.21.15.100:47282) 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 -- 172.21.15.100:0/2886869691 learned_addr learned my addr 172.21.15.100:0/2886869691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7660836640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f2eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7661037640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f32310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 -- 172.21.15.100:0/2886869691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 msgr2=0x562228f32310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f32310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 -- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 msgr2=0x562228f2eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f2eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 -- 172.21.15.100:0/2886869691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562228f328d0 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f765bfff640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7648021040 tx=0x7f764800e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a755a2b2b10517ee server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f763bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648033040 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f764801eb90 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7648005570 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7648042050 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 10 client.15798 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.206+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562228f33ac0 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7648005570 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7648036020 con 0x562228b486b0 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 10 client.15798 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 10 client.15798 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 20 client.15798 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228afd3a0 0x562228f8a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 4 client.15798 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562228e77800 con 0x562228afd3a0 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7660836640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228afd3a0 0x562228f8a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f763bfff640 10 client.15798 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.207+0000 7f7660836640 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228afd3a0 0x562228f8a730 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63890b8866859ba7 server_cookie=ca70ac6d2cd0fea6 in_seq=0 out_seq=0 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f763bfff640 1 -- 172.21.15.100:0/2886869691 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562228e77800 con 0x562228afd3a0 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f763bfff640 10 client.15798 handle_command_reply: tid=0 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 client.15798 shutdown 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 msgr2=0x562228f2f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7648021040 tx=0x7f764800e800 comp rx=0 tx=0).stop 2024-04-30T23:14:02.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 shutdown_connections 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562228b69390 0x562228f32310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562228b486b0 0x562228f2f420 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x562228afd3a0 0x562228f8a730 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 --2- 172.21.15.100:0/2886869691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562228b404d0 0x562228f2eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f763bfff640 0 client.15798 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 >> 172.21.15.100:0/2886869691 conn(0x562228b5d4e0 msgr2=0x562228f07d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 shutdown_connections 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 1 -- 172.21.15.100:0/2886869691 wait complete. 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.208+0000 7f7669a2a740 20 client.15798 trim_cache size 0 max 16384 2024-04-30T23:14:02.215 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:02.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 msgr2=0x7f764c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 0x7f764c0a6140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x562228f0e1f0 tx=0x7f7654009600 comp rx=0 tx=0).stop 2024-04-30T23:14:02.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 msgr2=0x7f765c1994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7650006010 tx=0x7f7650004270 comp rx=0 tx=0).stop 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 shutdown_connections 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f764c0a3c30 0x7f764c0a6140 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f765c108960 0x7f765c1a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f765c103c60 0x7f765c1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 --2- 172.21.15.100:0/4187439979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765c102a20 0x7f765c1994b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 >> 172.21.15.100:0/4187439979 conn(0x7f765c0fdc10 msgr2=0x7f765c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 shutdown_connections 2024-04-30T23:14:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.209+0000 7f7662a9a640 1 -- 172.21.15.100:0/4187439979 wait complete. 2024-04-30T23:14:02.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 -- 172.21.15.100:0/1406878455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 msgr2=0x7f1f741028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/1406878455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f741028a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009900 tx=0x7f1f6402a410 comp rx=0 tx=0).stop 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 -- 172.21.15.100:0/1406878455 shutdown_connections 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/1406878455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74108af0 0x7f1f7410af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/1406878455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74104450 0x7f1f74102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/1406878455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f741028a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 -- 172.21.15.100:0/1406878455 >> 172.21.15.100:0/1406878455 conn(0x7f1f740fd3c0 msgr2=0x7f1f740ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 -- 172.21.15.100:0/1406878455 shutdown_connections 2024-04-30T23:14:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.331+0000 7f1f79cf8640 1 -- 172.21.15.100:0/1406878455 wait complete. 2024-04-30T23:14:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 Processor -- start 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 -- start start 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 0x7f1f741996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74108af0 0x7f1f741a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410e560 con 0x7f1f74103fb0 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410e3e0 con 0x7f1f74104450 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f79cf8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410e6e0 con 0x7f1f74108af0 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47310/0 (socket says 172.21.15.100:47310) 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.332+0000 7f1f737fe640 1 -- 172.21.15.100:0/3701128664 learned_addr learned my addr 172.21.15.100:0/3701128664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 0x7f1f741996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f73fff640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74108af0 0x7f1f741a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 -- 172.21.15.100:0/3701128664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74108af0 msgr2=0x7f1f741a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74108af0 0x7f1f741a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 -- 172.21.15.100:0/3701128664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 msgr2=0x7f1f741996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 0x7f1f741996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 -- 172.21.15.100:0/3701128664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f741a0ca0 con 0x7f1f74103fb0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 0x7f1f741996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f737fe640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006010 tx=0x7f1f64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f70ff9640 1 -- 172.21.15.100:0/3701128664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6403f030 con 0x7f1f74103fb0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f70ff9640 1 -- 172.21.15.100:0/3701128664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f64031910 con 0x7f1f74103fb0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f741a0f30 con 0x7f1f74103fb0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f70ff9640 1 -- 172.21.15.100:0/3701128664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64035070 con 0x7f1f74103fb0 2024-04-30T23:14:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.333+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741a1340 con 0x7f1f74103fb0 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.335+0000 7f1f80ba8740 1 Processor -- start 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 -- start start 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f70ff9640 1 -- 172.21.15.100:0/3701128664 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1f64042030 con 0x7f1f74103fb0 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d34020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fa13c96d80 con 0x55fa1396f6b0 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa13c50a20 con 0x55fa13990390 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fa13c92d40 con 0x55fa139674d0 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47316/0 (socket says 172.21.15.100:47316) 2024-04-30T23:14:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 -- 172.21.15.100:0/3139126752 learned_addr learned my addr 172.21.15.100:0/3139126752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f737fe640 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f73fff640 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d34020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 -- 172.21.15.100:0/3139126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 msgr2=0x55fa13d345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d345a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 -- 172.21.15.100:0/3139126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 msgr2=0x55fa13d34020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d34020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f72ffd640 1 -- 172.21.15.100:0/3139126752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa13c34e00 con 0x55fa1396f6b0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f70ff9640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 0x7f1f5c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.336+0000 7f1f73fff640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 0x7f1f5c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.337+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009cd0 tx=0x7f1f680117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b31b5f38cadfb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.337+0000 7f1f70ff9640 1 -- 172.21.15.100:0/3701128664 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1f640f0bf0 con 0x7f1f74103fb0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.337+0000 7f1f59ffb640 1 -- 172.21.15.100:0/3139126752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68012450 con 0x55fa1396f6b0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.337+0000 7f1f59ffb640 1 -- 172.21.15.100:0/3139126752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f68012aa0 con 0x55fa1396f6b0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.337+0000 7f1f59ffb640 1 -- 172.21.15.100:0/3139126752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6800fb60 con 0x55fa1396f6b0 2024-04-30T23:14:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- 172.21.15.100:0/3139126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 msgr2=0x55fa13d3b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f73fff640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 0x7f1f5c0a60c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55fa13d351f0 tx=0x7f1f6c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009cd0 tx=0x7f1f680117b0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- 172.21.15.100:0/3139126752 shutdown_connections 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3b4a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/3139126752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- 172.21.15.100:0/3139126752 >> 172.21.15.100:0/3139126752 conn(0x55fa139844e0 msgr2=0x55fa13d2d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- 172.21.15.100:0/3139126752 shutdown_connections 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- 172.21.15.100:0/3139126752 wait complete. 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 -- start start 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 Processor -- start 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d3dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.338+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d45110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fa13d3bef0 con 0x55fa1396f6b0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa13c1ddc0 con 0x55fa13990390 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fa13d3c070 con 0x55fa139674d0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 10 client.0 _ll_register_callbacks cb 0x55fa13c39600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47326/0 (socket says 172.21.15.100:47326) 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 -- 172.21.15.100:0/1693815489 learned_addr learned my addr 172.21.15.100:0/1693815489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f73fff640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d45110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f737fe640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d3dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 -- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 msgr2=0x55fa13d3dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d3dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 -- 172.21.15.100:0/1693815489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 msgr2=0x55fa13d45110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d45110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 -- 172.21.15.100:0/1693815489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa13c5bc30 con 0x55fa1396f6b0 2024-04-30T23:14:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009840 tx=0x7f1f68009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87236fd232a161b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68029030 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1f68020040 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.339+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f68012aa0 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f68033050 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 10 client.15810 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa139a83f0 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f68012aa0 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1f680052a0 con 0x55fa1396f6b0 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 10 client.15810 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 10 client.15810 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 20 client.15810 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa1394ef60 0x55fa13d4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 4 client.15810 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa13c90810 con 0x55fa1394ef60 2024-04-30T23:14:02.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.340+0000 7f1f737fe640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa1394ef60 0x55fa13d4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.341+0000 7f1f52ffd640 10 client.15810 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.341+0000 7f1f737fe640 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa1394ef60 0x55fa13d4b6a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=993b5e312c5ef788 server_cookie=8393e1ffb56764dd in_seq=0 out_seq=0 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.341+0000 7f1f52ffd640 1 -- 172.21.15.100:0/1693815489 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55fa13c90810 con 0x55fa1394ef60 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.341+0000 7f1f52ffd640 10 client.15810 handle_command_reply: tid=0 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.341+0000 7f1f80ba8740 1 client.15810 shutdown 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 msgr2=0x55fa13d3e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009840 tx=0x7f1f68009870 comp rx=0 tx=0).stop 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 shutdown_connections 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa1394ef60 0x55fa13d4b6a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa13990390 0x55fa13d45110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d3e1b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f52ffd640 0 client.15810 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1693815489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa139674d0 0x55fa13d3dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 >> 172.21.15.100:0/1693815489 conn(0x55fa139844e0 msgr2=0x55fa13d2c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 shutdown_connections 2024-04-30T23:14:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1693815489 wait complete. 2024-04-30T23:14:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.342+0000 7f1f80ba8740 20 client.15810 trim_cache size 0 max 16384 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 Processor -- start 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 -- start start 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d2d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d2d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741aa6f0 con 0x55fa1396f6b0 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741ac230 con 0x55fa139674d0 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741aadc0 con 0x55fa1394ef60 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47336/0 (socket says 172.21.15.100:47336) 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.355+0000 7f1f73fff640 1 -- 172.21.15.100:0/1656033795 learned_addr learned my addr 172.21.15.100:0/1656033795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d2d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f737fe640 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d2d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 -- 172.21.15.100:0/1656033795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 msgr2=0x55fa13d2d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d2d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 -- 172.21.15.100:0/1656033795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 msgr2=0x55fa13d2d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d2d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 -- 172.21.15.100:0/1656033795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa13a727d0 con 0x55fa1396f6b0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f73fff640 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c012580 tx=0x7f1f6c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a7d4b5525fd3e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f597fa640 1 -- 172.21.15.100:0/1656033795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c02b070 con 0x55fa1396f6b0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f597fa640 1 -- 172.21.15.100:0/1656033795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f6c010c90 con 0x55fa1396f6b0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.356+0000 7f1f597fa640 1 -- 172.21.15.100:0/1656033795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c01bd60 con 0x55fa1396f6b0 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1656033795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 msgr2=0x55fa13d45030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c012580 tx=0x7f1f6c010000 comp rx=0 tx=0).stop 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1656033795 shutdown_connections 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d45030 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d2d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/1656033795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d2d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1656033795 >> 172.21.15.100:0/1656033795 conn(0x55fa139844e0 msgr2=0x55fa13d38160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1656033795 shutdown_connections 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- 172.21.15.100:0/1656033795 wait complete. 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 -- start start 2024-04-30T23:14:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.357+0000 7f1f80ba8740 1 Processor -- start 2024-04-30T23:14:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741abb60 con 0x55fa1396f6b0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741ab490 con 0x55fa139674d0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1f741a86d0 con 0x55fa1394ef60 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f80ba8740 10 client.0 _ll_register_callbacks cb 0x7f1f640f45a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47340/0 (socket says 172.21.15.100:47340) 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 -- 172.21.15.100:0/4182442065 learned_addr learned my addr 172.21.15.100:0/4182442065 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f72ffd640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f737fe640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 -- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 msgr2=0x55fa13d426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 -- 172.21.15.100:0/4182442065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 msgr2=0x55fa13d42c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d42c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 -- 172.21.15.100:0/4182442065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa13d440f0 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f73fff640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c013fd0 tx=0x7f1f6c01b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4c117e64f1ad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.358+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c02b040 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1f6c01baa0 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f6c010c90 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f6c03e050 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 10 client.15816 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa13d45370 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f6c010c90 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1f6c039030 con 0x55fa1396f6b0 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 10 client.15816 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:14:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 20 client.15816 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa13990390 0x55fa13db3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 4 client.15816 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa13ca4990 con 0x55fa13990390 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.359+0000 7f1f737fe640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa13990390 0x55fa13db3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f737fe640 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa13990390 0x55fa13db3f10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7249df5e56a9aa4b server_cookie=77c5512597916870 in_seq=0 out_seq=0 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f52ffd640 10 client.15816 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f52ffd640 1 -- 172.21.15.100:0/4182442065 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa13ca4990 con 0x55fa13990390 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f52ffd640 10 client.15816 handle_command_reply: tid=0 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 client.15816 shutdown 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 msgr2=0x55fa13d43b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c013fd0 tx=0x7f1f6c01b7c0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 shutdown_connections 2024-04-30T23:14:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55fa13990390 0x55fa13db3f10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa1396f6b0 0x55fa13d43b30 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa139674d0 0x55fa13d42c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f52ffd640 0 client.15816 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 --2- 172.21.15.100:0/4182442065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fa1394ef60 0x55fa13d426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 >> 172.21.15.100:0/4182442065 conn(0x55fa139844e0 msgr2=0x55fa13d305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 shutdown_connections 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 1 -- 172.21.15.100:0/4182442065 wait complete. 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.360+0000 7f1f80ba8740 20 client.15816 trim_cache size 0 max 16384 2024-04-30T23:14:02.367 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 msgr2=0x7f1f5c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 0x7f1f5c0a60c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55fa13d351f0 tx=0x7f1f6c009500 comp rx=0 tx=0).stop 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 msgr2=0x7f1f74199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006010 tx=0x7f1f64004270 comp rx=0 tx=0).stop 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 shutdown_connections 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1f5c0a3bb0 0x7f1f5c0a60c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f74108af0 0x7f1f741a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f74104450 0x7f1f741996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 --2- 172.21.15.100:0/3701128664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f74103fb0 0x7f1f74199160 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 >> 172.21.15.100:0/3701128664 conn(0x7f1f740fd3c0 msgr2=0x7f1f74104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 shutdown_connections 2024-04-30T23:14:02.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.361+0000 7f1f79cf8640 1 -- 172.21.15.100:0/3701128664 wait complete. 2024-04-30T23:14:02.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-30T23:14:02.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 -- 172.21.15.100:0/1233375421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c108960 msgr2=0x7f7a6c10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 --2- 172.21.15.100:0/1233375421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c108960 0x7f7a6c10ad80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009ca0 tx=0x7f7a6402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 -- 172.21.15.100:0/1233375421 shutdown_connections 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 --2- 172.21.15.100:0/1233375421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c108960 0x7f7a6c10ad80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 --2- 172.21.15.100:0/1233375421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c103c60 0x7f7a6c104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 --2- 172.21.15.100:0/1233375421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c102a20 0x7f7a6c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 -- 172.21.15.100:0/1233375421 >> 172.21.15.100:0/1233375421 conn(0x7f7a6c0fdc10 msgr2=0x7f7a6c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 -- 172.21.15.100:0/1233375421 shutdown_connections 2024-04-30T23:14:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.483+0000 7f7a74243640 1 -- 172.21.15.100:0/1233375421 wait complete. 2024-04-30T23:14:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 Processor -- start 2024-04-30T23:14:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 -- start start 2024-04-30T23:14:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c102a20 0x7f7a6c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c108960 0x7f7a6c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10f650 con 0x7f7a6c103c60 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10f4d0 con 0x7f7a6c102a20 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a74243640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c10f7d0 con 0x7f7a6c108960 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47344/0 (socket says 172.21.15.100:47344) 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 -- 172.21.15.100:0/81733052 learned_addr learned my addr 172.21.15.100:0/81733052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a727e0640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c108960 0x7f7a6c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c102a20 0x7f7a6c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 -- 172.21.15.100:0/81733052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c108960 msgr2=0x7f7a6c1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c108960 0x7f7a6c1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 -- 172.21.15.100:0/81733052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c102a20 msgr2=0x7f7a6c19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c102a20 0x7f7a6c19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 -- 172.21.15.100:0/81733052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c1a1df0 con 0x7f7a6c103c60 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.484+0000 7f7a717de640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00e9f0 tx=0x7f7a5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.485+0000 7f7a62ffd640 1 -- 172.21.15.100:0/81733052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00cd80 con 0x7f7a6c103c60 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.485+0000 7f7a62ffd640 1 -- 172.21.15.100:0/81733052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a5c0108e0 con 0x7f7a6c103c60 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.485+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c1a20e0 con 0x7f7a6c103c60 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.485+0000 7f7a62ffd640 1 -- 172.21.15.100:0/81733052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c018980 con 0x7f7a6c103c60 2024-04-30T23:14:02.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.485+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1a2630 con 0x7f7a6c103c60 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a62ffd640 1 -- 172.21.15.100:0/81733052 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7a5c010430 con 0x7f7a6c103c60 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 Processor -- start 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 -- start start 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca280de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca2815290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ca2772d80 con 0x556ca24434d0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ca272ca20 con 0x556ca244b6b0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.487+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ca276ed40 con 0x556ca246c390 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47346/0 (socket says 172.21.15.100:47346) 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 -- 172.21.15.100:0/1252513277 learned_addr learned my addr 172.21.15.100:0/1252513277 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a62ffd640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 0x7f7a580a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a727e0640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca280de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a717de640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca2815290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a727e0640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 0x7f7a580a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 -- 172.21.15.100:0/1252513277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 msgr2=0x556ca280de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca280de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 -- 172.21.15.100:0/1252513277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 msgr2=0x556ca2815290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca2815290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a62ffd640 1 -- 172.21.15.100:0/81733052 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7a5c0d0a30 con 0x7f7a6c103c60 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 -- 172.21.15.100:0/1252513277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca2710e00 con 0x556ca24434d0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a717de640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca2815290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800bc70 tx=0x7f7a680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3140c27864179f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a57fff640 1 -- 172.21.15.100:0/1252513277 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6801c680 con 0x556ca24434d0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a727e0640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 0x7f7a580a60c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a640094e0 tx=0x7f7a64009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a57fff640 1 -- 172.21.15.100:0/1252513277 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a6800be20 con 0x556ca24434d0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.488+0000 7f7a57fff640 1 -- 172.21.15.100:0/1252513277 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68011ac0 con 0x556ca24434d0 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1252513277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 msgr2=0x556ca280e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800bc70 tx=0x7f7a680107a0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1252513277 shutdown_connections 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca2815290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca24434d0 0x556ca280e390 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1252513277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca280de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1252513277 >> 172.21.15.100:0/1252513277 conn(0x556ca24604e0 msgr2=0x556ca28097a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1252513277 shutdown_connections 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.489+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1252513277 wait complete. 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 -- start start 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 Processor -- start 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca24434d0 0x556ca2817a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca281ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ca2815ce0 con 0x556ca244b6b0 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556ca26f9dc0 con 0x556ca24434d0 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ca2815e60 con 0x556ca246c390 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a7b1db740 10 client.0 _ll_register_callbacks cb 0x556ca2715600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47360/0 (socket says 172.21.15.100:47360) 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a717de640 1 -- 172.21.15.100:0/855284141 learned_addr learned my addr 172.21.15.100:0/855284141 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca24434d0 0x556ca2817a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.490+0000 7f7a727e0640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca281ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 -- 172.21.15.100:0/855284141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 msgr2=0x556ca281ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca281ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 -- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca24434d0 msgr2=0x556ca2817a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca24434d0 0x556ca2817a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 -- 172.21.15.100:0/855284141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca2737c30 con 0x556ca244b6b0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a717de640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c09c9f0 tx=0x7f7a5c01d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db15d8fd8272254 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c025170 con 0x556ca244b6b0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7a5c014d20 con 0x556ca244b6b0 2024-04-30T23:14:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6800be20 con 0x556ca244b6b0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a5c09ca60 con 0x556ca244b6b0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 10 client.15828 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ca24843f0 con 0x556ca244b6b0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a6800be20 con 0x556ca244b6b0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a5c09dce0 con 0x556ca244b6b0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 10 client.15828 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 20 client.15828 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca242af60 0x556ca28256b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 4 client.15828 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.491+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ca276c810 con 0x556ca242af60 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.492+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca242af60 0x556ca28256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.492+0000 7f7a557fa640 10 client.15828 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.492+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca242af60 0x556ca28256b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8116b1d9edcdf9e server_cookie=21ee699acef53c43 in_seq=0 out_seq=0 2024-04-30T23:14:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a557fa640 1 -- 172.21.15.100:0/855284141 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556ca276c810 con 0x556ca242af60 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a557fa640 10 client.15828 handle_command_reply: tid=0 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 client.15828 shutdown 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 msgr2=0x556ca2817fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c09c9f0 tx=0x7f7a5c01d9c0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 shutdown_connections 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca242af60 0x556ca28256b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca246c390 0x556ca281ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca2817fd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a557fa640 0 client.15828 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/855284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca24434d0 0x556ca2817a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 >> 172.21.15.100:0/855284141 conn(0x556ca24604e0 msgr2=0x556ca28089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 shutdown_connections 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 1 -- 172.21.15.100:0/855284141 wait complete. 2024-04-30T23:14:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.493+0000 7f7a7b1db740 20 client.15828 trim_cache size 0 max 16384 2024-04-30T23:14:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.506+0000 7f7a7b1db740 1 Processor -- start 2024-04-30T23:14:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.506+0000 7f7a7b1db740 1 -- start start 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca2816940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca281ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1ac980 con 0x556ca246c390 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1ae4c0 con 0x556ca244b6b0 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1ad050 con 0x556ca24434d0 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47376/0 (socket says 172.21.15.100:47376) 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 -- 172.21.15.100:0/323369426 learned_addr learned my addr 172.21.15.100:0/323369426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca2816940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a717de640 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca281ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 -- 172.21.15.100:0/323369426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 msgr2=0x556ca2816940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca2816940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 -- 172.21.15.100:0/323369426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 msgr2=0x556ca281ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca281ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 -- 172.21.15.100:0/323369426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca254e7d0 con 0x556ca246c390 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a727e0640 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009ca0 tx=0x7f7a64036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd9ede1b9bad23f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a577fe640 1 -- 172.21.15.100:0/323369426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64054070 con 0x556ca246c390 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a577fe640 1 -- 172.21.15.100:0/323369426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a64036070 con 0x556ca246c390 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.507+0000 7f7a577fe640 1 -- 172.21.15.100:0/323369426 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64004700 con 0x556ca246c390 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 -- 172.21.15.100:0/323369426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 msgr2=0x556ca2829e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009ca0 tx=0x7f7a64036000 comp rx=0 tx=0).stop 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 -- 172.21.15.100:0/323369426 shutdown_connections 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca246c390 0x556ca2829e30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca244b6b0 0x556ca281ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/323369426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca2816940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 -- 172.21.15.100:0/323369426 >> 172.21.15.100:0/323369426 conn(0x556ca24604e0 msgr2=0x556ca2816230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 -- 172.21.15.100:0/323369426 shutdown_connections 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.508+0000 7f7a7b1db740 1 -- 172.21.15.100:0/323369426 wait complete. 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 -- start start 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 Processor -- start 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca281c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 0x556ca281da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1addf0 con 0x556ca244b6b0 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1ad720 con 0x556ca246c390 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1aa960 con 0x556ca24434d0 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a7b1db740 10 client.0 _ll_register_callbacks cb 0x7f7a5c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47388/0 (socket says 172.21.15.100:47388) 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 -- 172.21.15.100:0/1069197248 learned_addr learned my addr 172.21.15.100:0/1069197248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a727e0640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 0x556ca281da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca281c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 -- 172.21.15.100:0/1069197248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 msgr2=0x556ca281c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca281c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 -- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 msgr2=0x556ca281da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 0x556ca281da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a717de640 1 -- 172.21.15.100:0/1069197248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca281e050 con 0x556ca244b6b0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.509+0000 7f7a727e0640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 0x556ca281da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a717de640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0a50f0 tx=0x7f7a5c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2f3efb7ee3a62e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c018b20 con 0x556ca244b6b0 2024-04-30T23:14:02.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7a5c0987b0 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a64036070 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a5c0a5620 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 10 client.15834 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ca288b8e0 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a64036070 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a5c09dce0 con 0x556ca244b6b0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 20 client.15834 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca24003a0 0x556ca288e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 4 client.15834 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.510+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ca2780990 con 0x556ca24003a0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca24003a0 0x556ca288e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a71fdf640 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca24003a0 0x556ca288e280 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec31e367ce076b6 server_cookie=165f8254574d4287 in_seq=0 out_seq=0 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a557fa640 10 client.15834 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a557fa640 1 -- 172.21.15.100:0/1069197248 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ca2780990 con 0x556ca24003a0 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a557fa640 10 client.15834 handle_command_reply: tid=0 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 client.15834 shutdown 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 msgr2=0x556ca281cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0a50f0 tx=0x7f7a5c00cf20 comp rx=0 tx=0).stop 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 shutdown_connections 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x556ca24003a0 0x556ca288e280 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556ca246c390 0x556ca281da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ca244b6b0 0x556ca281cb60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 --2- 172.21.15.100:0/1069197248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ca24434d0 0x556ca281c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a557fa640 0 client.15834 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:02.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 >> 172.21.15.100:0/1069197248 conn(0x556ca24604e0 msgr2=0x556ca280c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 shutdown_connections 2024-04-30T23:14:02.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.511+0000 7f7a7b1db740 1 -- 172.21.15.100:0/1069197248 wait complete. 2024-04-30T23:14:02.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a7b1db740 20 client.15834 trim_cache size 0 max 16384 2024-04-30T23:14:02.519 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 msgr2=0x7f7a580a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 0x7f7a580a60c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a640094e0 tx=0x7f7a64009360 comp rx=0 tx=0).stop 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 msgr2=0x7f7a6c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00e9f0 tx=0x7f7a5c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 shutdown_connections 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7a580a3bb0 0x7f7a580a60c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a6c108960 0x7f7a6c1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a6c103c60 0x7f7a6c19a7f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 --2- 172.21.15.100:0/81733052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a6c102a20 0x7f7a6c19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 >> 172.21.15.100:0/81733052 conn(0x7f7a6c0fdc10 msgr2=0x7f7a6c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 shutdown_connections 2024-04-30T23:14:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:02.512+0000 7f7a74243640 1 -- 172.21.15.100:0/81733052 wait complete. 2024-04-30T23:14:03.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:02 smithi104 ceph-mon[32987]: pgmap v386: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:03.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:02 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/874692649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:02 smithi183 ceph-mon[33560]: pgmap v386: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:02 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/874692649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:03.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:02 smithi100 ceph-mon[29745]: pgmap v386: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:03.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:02 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/874692649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:03.524 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:14:03.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:14:03.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:14:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.650+0000 7fa252061640 1 -- 172.21.15.100:0/135490789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 msgr2=0x7fa24c1054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.650+0000 7fa252061640 1 --2- 172.21.15.100:0/135490789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c1054e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009900 tx=0x7fa23c02a410 comp rx=0 tx=0).stop 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 -- 172.21.15.100:0/135490789 shutdown_connections 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 --2- 172.21.15.100:0/135490789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 0x7fa24c10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 --2- 172.21.15.100:0/135490789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 0x7fa24c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 --2- 172.21.15.100:0/135490789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c1054e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 -- 172.21.15.100:0/135490789 >> 172.21.15.100:0/135490789 conn(0x7fa24c0fd380 msgr2=0x7fa24c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 -- 172.21.15.100:0/135490789 shutdown_connections 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 -- 172.21.15.100:0/135490789 wait complete. 2024-04-30T23:14:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 Processor -- start 2024-04-30T23:14:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.651+0000 7fa252061640 1 -- start start 2024-04-30T23:14:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 0x7fa24c104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 0x7fa24c102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10f620 con 0x7fa24c1050d0 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10f4a0 con 0x7fa24c101780 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10f7a0 con 0x7fa24c102280 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49390/0 (socket says 172.21.15.100:49390) 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 -- 172.21.15.100:0/1499651731 learned_addr learned my addr 172.21.15.100:0/1499651731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24affd640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 0x7fa24c102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 0x7fa24c104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 -- 172.21.15.100:0/1499651731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 msgr2=0x7fa24c102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 0x7fa24c102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 -- 172.21.15.100:0/1499651731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 msgr2=0x7fa24c104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 0x7fa24c104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 -- 172.21.15.100:0/1499651731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c103500 con 0x7fa24c1050d0 2024-04-30T23:14:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa24bfff640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa24400cce0 tx=0x7fa24400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa248ff9640 1 -- 172.21.15.100:0/1499651731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24400f450 con 0x7fa24c1050d0 2024-04-30T23:14:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa248ff9640 1 -- 172.21.15.100:0/1499651731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24400faa0 con 0x7fa24c1050d0 2024-04-30T23:14:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa248ff9640 1 -- 172.21.15.100:0/1499651731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244018b70 con 0x7fa24c1050d0 2024-04-30T23:14:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.652+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c1a4380 con 0x7fa24c1050d0 2024-04-30T23:14:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.653+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c1a4790 con 0x7fa24c1050d0 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 Processor -- start 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa248ff9640 1 -- 172.21.15.100:0/1499651731 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa244018d10 con 0x7fa24c1050d0 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 -- start start 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d5c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556003cc0b00 con 0x556003999730 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556003c5c920 con 0x5560039ba410 2024-04-30T23:14:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa258ff8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556003cbcac0 con 0x556003991550 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa24affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa24affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49404/0 (socket says 172.21.15.100:49404) 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.655+0000 7fa24affd640 1 -- 172.21.15.100:0/2431012498 learned_addr learned my addr 172.21.15.100:0/2431012498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d5c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa248ff9640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 0x7fa2340a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 -- 172.21.15.100:0/2431012498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 msgr2=0x556003d5c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d5c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 -- 172.21.15.100:0/2431012498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 msgr2=0x556003d5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24bfff640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 0x7fa2340a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 -- 172.21.15.100:0/2431012498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556003a9a7e0 con 0x556003999730 2024-04-30T23:14:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa248ff9640 1 -- 172.21.15.100:0/1499651731 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa2440d0b30 con 0x7fa24c1050d0 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa24affd640 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa240009fd0 tx=0x7fa240004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6943865d7b4863bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa231ffb640 1 -- 172.21.15.100:0/2431012498 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240004030 con 0x556003999730 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa231ffb640 1 -- 172.21.15.100:0/2431012498 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24000f790 con 0x556003999730 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.656+0000 7fa231ffb640 1 -- 172.21.15.100:0/2431012498 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400038e0 con 0x556003999730 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa24bfff640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 0x7fa2340a6140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa244098f10 tx=0x7fa2440c7bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 -- 172.21.15.100:0/2431012498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 msgr2=0x556003d63110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa240009fd0 tx=0x7fa240004730 comp rx=0 tx=0).stop 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 -- 172.21.15.100:0/2431012498 shutdown_connections 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d63110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d5c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2431012498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.657+0000 7fa258ff8740 1 -- 172.21.15.100:0/2431012498 >> 172.21.15.100:0/2431012498 conn(0x5560039ae560 msgr2=0x556003d57620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- 172.21.15.100:0/2431012498 shutdown_connections 2024-04-30T23:14:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- 172.21.15.100:0/2431012498 wait complete. 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- start start 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 Processor -- start 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003999730 0x556003d65e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556003d63b60 con 0x5560039ba410 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556003c5a5d0 con 0x556003991550 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556003d63ce0 con 0x556003999730 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.658+0000 7fa258ff8740 10 client.0 _ll_register_callbacks cb 0x556003c69a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49412/0 (socket says 172.21.15.100:49412) 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 -- 172.21.15.100:0/462085290 learned_addr learned my addr 172.21.15.100:0/462085290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003999730 0x556003d65e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 -- 172.21.15.100:0/462085290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003999730 msgr2=0x556003d65e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003999730 0x556003d65e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 -- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 msgr2=0x556003d658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 -- 172.21.15.100:0/462085290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556003afaf70 con 0x5560039ba410 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa24affd640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa24001f5d0 tx=0x7fa2400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7b23736ac02cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa22affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240004030 con 0x5560039ba410 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa240019070 con 0x5560039ba410 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24000f790 con 0x5560039ba410 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa240033050 con 0x5560039ba410 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.659+0000 7fa258ff8740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556003992170 con 0x5560039ba410 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24000f790 con 0x5560039ba410 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa240003660 con 0x5560039ba410 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 20 client.15846 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5560039791f0 0x556003d72fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 4 client.15846 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556003cce710 con 0x5560039791f0 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.660+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5560039791f0 0x556003d72fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.661+0000 7fa22affd640 10 client.15846 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.661+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5560039791f0 0x556003d72fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913f5b95e8309be4 server_cookie=74db6007098f1722 in_seq=0 out_seq=0 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa22affd640 1 -- 172.21.15.100:0/462085290 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556003cce710 con 0x5560039791f0 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa22affd640 10 client.15846 handle_command_reply: tid=0 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 client.15846 shutdown 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 msgr2=0x556003d6cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa24001f5d0 tx=0x7fa2400046c0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 shutdown_connections 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5560039791f0 0x556003d72fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560039ba410 0x556003d6cd70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003999730 0x556003d65e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa22affd640 0 client.15846 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 --2- 172.21.15.100:0/462085290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 >> 172.21.15.100:0/462085290 conn(0x5560039ae560 msgr2=0x556003d565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 shutdown_connections 2024-04-30T23:14:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 1 -- 172.21.15.100:0/462085290 wait complete. 2024-04-30T23:14:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.662+0000 7fa258ff8740 20 client.15846 trim_cache size 0 max 16384 2024-04-30T23:14:03.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 Processor -- start 2024-04-30T23:14:03.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 -- start start 2024-04-30T23:14:03.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d64790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d6d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1aea00 con 0x556003999730 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1b0540 con 0x5560039ba410 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa258ff8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1af0d0 con 0x556003991550 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49426/0 (socket says 172.21.15.100:49426) 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 -- 172.21.15.100:0/1585411751 learned_addr learned my addr 172.21.15.100:0/1585411751 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24affd640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d64790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24affd640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d6d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 -- 172.21.15.100:0/1585411751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 msgr2=0x556003d64790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d64790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 -- 172.21.15.100:0/1585411751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 msgr2=0x556003d6d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d6d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24b7fe640 1 -- 172.21.15.100:0/1585411751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556003d664d0 con 0x556003999730 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.680+0000 7fa24affd640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d6d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6ea294496c20c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa2317fa640 1 -- 172.21.15.100:0/1585411751 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c035040 con 0x556003999730 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa2317fa640 1 -- 172.21.15.100:0/1585411751 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa23c049070 con 0x556003999730 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa2317fa640 1 -- 172.21.15.100:0/1585411751 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0442c0 con 0x556003999730 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 -- 172.21.15.100:0/1585411751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 msgr2=0x556003d6cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c031400 comp rx=0 tx=0).stop 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 -- 172.21.15.100:0/1585411751 shutdown_connections 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5560039ba410 0x556003d6d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6cc90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 --2- 172.21.15.100:0/1585411751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556003991550 0x556003d64790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.681+0000 7fa258ff8740 1 -- 172.21.15.100:0/1585411751 >> 172.21.15.100:0/1585411751 conn(0x5560039ae560 msgr2=0x556003d64080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- 172.21.15.100:0/1585411751 shutdown_connections 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- 172.21.15.100:0/1585411751 wait complete. 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- start start 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 Processor -- start 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d6a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 0x556003d6bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1afe70 con 0x556003999730 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1af7a0 con 0x556003991550 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c1ac9e0 con 0x5560039ba410 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa258ff8740 10 client.0 _ll_register_callbacks cb 0x7fa240009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49432/0 (socket says 172.21.15.100:49432) 2024-04-30T23:14:03.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.682+0000 7fa24b7fe640 1 -- 172.21.15.100:0/2513718679 learned_addr learned my addr 172.21.15.100:0/2513718679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24affd640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 0x556003d6bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24affd640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d6a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 -- 172.21.15.100:0/2513718679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 msgr2=0x556003d6bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 0x556003d6bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 -- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 msgr2=0x556003d6a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d6a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 -- 172.21.15.100:0/2513718679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556003d6c3a0 con 0x556003999730 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24affd640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 0x556003d6bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa24b7fe640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02a930 tx=0x7fa23c005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789bea3425ec54a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa22affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c052060 con 0x556003999730 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa23c032250 con 0x556003999730 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa23c049070 con 0x556003999730 2024-04-30T23:14:03.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa23c035030 con 0x556003999730 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa258ff8740 10 client.15852 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556003d6d600 con 0x556003999730 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.683+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa23c049070 con 0x556003999730 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa23c0037f0 con 0x556003999730 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 10 client.15852 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 20 client.15852 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55600394e630 0x556003ddb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 4 client.15852 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556003cc8580 con 0x55600394e630 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa24affd640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55600394e630 0x556003ddb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa24affd640 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55600394e630 0x556003ddb7d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f9267782b48dd9 server_cookie=819181816956c2bc in_seq=0 out_seq=0 2024-04-30T23:14:03.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.684+0000 7fa22affd640 10 client.15852 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa22affd640 1 -- 172.21.15.100:0/2513718679 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556003cc8580 con 0x55600394e630 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa22affd640 10 client.15852 handle_command_reply: tid=0 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 client.15852 shutdown 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 msgr2=0x556003d6aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02a930 tx=0x7fa23c005ed0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 shutdown_connections 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55600394e630 0x556003ddb7d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa22affd640 0 client.15852 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5560039ba410 0x556003d6bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556003999730 0x556003d6aeb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 --2- 172.21.15.100:0/2513718679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556003991550 0x556003d6a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 >> 172.21.15.100:0/2513718679 conn(0x5560039ae560 msgr2=0x556003d5a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 shutdown_connections 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.686+0000 7fa258ff8740 1 -- 172.21.15.100:0/2513718679 wait complete. 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa258ff8740 20 client.15852 trim_cache size 0 max 16384 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "54920341-8007-47f5-bc55-b82e8703fc8a", 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:14:03.693 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 msgr2=0x7fa2340a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 0x7fa2340a6140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa244098f10 tx=0x7fa2440c7bc0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 msgr2=0x7fa24c102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa24400cce0 tx=0x7fa24400a620 comp rx=0 tx=0).stop 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 shutdown_connections 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa2340a3c30 0x7fa2340a6140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c1050d0 0x7fa24c102e60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa24c102280 0x7fa24c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 --2- 172.21.15.100:0/1499651731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa24c101780 0x7fa24c104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 >> 172.21.15.100:0/1499651731 conn(0x7fa24c0fd380 msgr2=0x7fa24c105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 shutdown_connections 2024-04-30T23:14:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.687+0000 7fa252061640 1 -- 172.21.15.100:0/1499651731 wait complete. 2024-04-30T23:14:03.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:14:03.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:14:03.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 -- 172.21.15.100:0/1651798464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 msgr2=0x7f254c10bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 --2- 172.21.15.100:0/1651798464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c10bd00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ca0 tx=0x7f254402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 -- 172.21.15.100:0/1651798464 shutdown_connections 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 --2- 172.21.15.100:0/1651798464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c10bd00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 --2- 172.21.15.100:0/1651798464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1017a0 0x7f254c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 --2- 172.21.15.100:0/1651798464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1050f0 0x7f254c105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 -- 172.21.15.100:0/1651798464 >> 172.21.15.100:0/1651798464 conn(0x7f254c0fd3c0 msgr2=0x7f254c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 -- 172.21.15.100:0/1651798464 shutdown_connections 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.808+0000 7f2550809640 1 -- 172.21.15.100:0/1651798464 wait complete. 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 Processor -- start 2024-04-30T23:14:03.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 -- start start 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 0x7f254c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1050f0 0x7f254c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f254c10f660 con 0x7f254c1022a0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f254c10f4e0 con 0x7f254c1017a0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.809+0000 7f2550809640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f254c10f7e0 con 0x7f254c1050f0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49462/0 (socket says 172.21.15.100:49462) 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 -- 172.21.15.100:0/1796103083 learned_addr learned my addr 172.21.15.100:0/1796103083 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f254ad9d640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1050f0 0x7f254c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f254a59c640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 0x7f254c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 -- 172.21.15.100:0/1796103083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1050f0 msgr2=0x7f254c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1050f0 0x7f254c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 -- 172.21.15.100:0/1796103083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 msgr2=0x7f254c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 0x7f254c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 -- 172.21.15.100:0/1796103083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c1a1d50 con 0x7f254c1022a0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f254a59c640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 0x7f254c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f254000d950 tx=0x7f254000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f253b7fe640 1 -- 172.21.15.100:0/1796103083 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540017030 con 0x7f254c1022a0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f253b7fe640 1 -- 172.21.15.100:0/1796103083 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2540004020 con 0x7f254c1022a0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c1a1fe0 con 0x7f254c1022a0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f253b7fe640 1 -- 172.21.15.100:0/1796103083 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25400047a0 con 0x7f254c1022a0 2024-04-30T23:14:03.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.810+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c1a24d0 con 0x7f254c1022a0 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f253b7fe640 1 -- 172.21.15.100:0/1796103083 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2540009a30 con 0x7f254c1022a0 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 Processor -- start 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 -- start start 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c5788ebb10 con 0x55c5786116b0 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c578938d80 con 0x55c5786094d0 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2557795740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c5788f28b0 con 0x55c578632390 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f253b7fe640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 0x7f25340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.813+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49468/0 (socket says 172.21.15.100:49468) 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 -- 172.21.15.100:0/810359676 learned_addr learned my addr 172.21.15.100:0/810359676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f254ad9d640 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f254a59c640 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f254ad9d640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 0x7f25340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f253b7fe640 1 -- 172.21.15.100:0/1796103083 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f25400d0310 con 0x7f254c1022a0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 -- 172.21.15.100:0/810359676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 msgr2=0x55c5789d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 -- 172.21.15.100:0/810359676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 msgr2=0x55c5789d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789d4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 -- 172.21.15.100:0/810359676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5788c3a40 con 0x55c5786116b0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2549d9b640 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2540000c00 tx=0x7f2540098660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5e5ddd495298f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f254ad9d640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 0x7f25340a60c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c5789d5540 tx=0x7f25440095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2538ff9640 1 -- 172.21.15.100:0/810359676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254009c990 con 0x55c5786116b0 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2538ff9640 1 -- 172.21.15.100:0/810359676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254009c290 con 0x55c5786116b0 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.814+0000 7f2538ff9640 1 -- 172.21.15.100:0/810359676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25400041d0 con 0x55c5786116b0 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 -- 172.21.15.100:0/810359676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 msgr2=0x55c5789d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2540000c00 tx=0x7f2540098660 comp rx=0 tx=0).stop 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 -- 172.21.15.100:0/810359676 shutdown_connections 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789d5700 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789d4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 --2- 172.21.15.100:0/810359676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 -- 172.21.15.100:0/810359676 >> 172.21.15.100:0/810359676 conn(0x55c5786264e0 msgr2=0x55c5789cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 -- 172.21.15.100:0/810359676 shutdown_connections 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.815+0000 7f2557795740 1 -- 172.21.15.100:0/810359676 wait complete. 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 -- start start 2024-04-30T23:14:03.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 Processor -- start 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786094d0 0x55c5789de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c578632390 0x55c5789e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c5788bfd10 con 0x55c5786116b0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c578934d40 con 0x55c578632390 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c5789d6150 con 0x55c5786094d0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2557795740 10 client.0 _ll_register_callbacks cb 0x55c578945d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49484/0 (socket says 172.21.15.100:49484) 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 -- 172.21.15.100:0/3268018108 learned_addr learned my addr 172.21.15.100:0/3268018108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f254ad9d640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c578632390 0x55c5789e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f254a59c640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786094d0 0x55c5789de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 -- 172.21.15.100:0/3268018108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786094d0 msgr2=0x55c5789de3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786094d0 0x55c5789de3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 -- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c578632390 msgr2=0x55c5789e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c578632390 0x55c5789e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.816+0000 7f2549d9b640 1 -- 172.21.15.100:0/3268018108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5787147d0 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2549d9b640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2540075010 tx=0x7f254009bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d47476650267397 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25400a4f00 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2540098900 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254009c290 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f254009c990 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 10 client.15864 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c57864a3f0 con 0x55c5786116b0 2024-04-30T23:14:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254009c290 con 0x55c5786116b0 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25400a0170 con 0x55c5786116b0 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 10 client.15864 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 20 client.15864 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785f0f60 0x55c5789eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 4 client.15864 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.817+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c578946990 con 0x55c5785f0f60 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.818+0000 7f254a59c640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785f0f60 0x55c5789eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.818+0000 7f2531ffb640 10 client.15864 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.818+0000 7f254a59c640 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785f0f60 0x55c5789eb8c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71a7eac5c7d5a50 server_cookie=7efa5d6f5230db39 in_seq=0 out_seq=0 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2531ffb640 1 -- 172.21.15.100:0/3268018108 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55c578946990 con 0x55c5785f0f60 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2531ffb640 10 client.15864 handle_command_reply: tid=0 2024-04-30T23:14:03.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 client.15864 shutdown 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 msgr2=0x55c5789de910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2540075010 tx=0x7f254009bc70 comp rx=0 tx=0).stop 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 shutdown_connections 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785f0f60 0x55c5789eb8c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c578632390 0x55c5789e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2531ffb640 0 client.15864 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786116b0 0x55c5789de910 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 --2- 172.21.15.100:0/3268018108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786094d0 0x55c5789de3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 >> 172.21.15.100:0/3268018108 conn(0x55c5786264e0 msgr2=0x55c5789d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 shutdown_connections 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 1 -- 172.21.15.100:0/3268018108 wait complete. 2024-04-30T23:14:03.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.819+0000 7f2557795740 20 client.15864 trim_cache size 0 max 16384 2024-04-30T23:14:03.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.836+0000 7f2557795740 1 Processor -- start 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 -- start start 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786116b0 0x55c5789e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1ac970 con 0x55c578632390 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1ae4b0 con 0x55c5786094d0 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2557795740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1ad040 con 0x55c5786116b0 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49496/0 (socket says 172.21.15.100:49496) 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 -- 172.21.15.100:0/215742786 learned_addr learned my addr 172.21.15.100:0/215742786 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 -- 172.21.15.100:0/215742786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786116b0 msgr2=0x55c5789e5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2549d9b640 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786116b0 0x55c5789e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786116b0 0x55c5789e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 -- 172.21.15.100:0/215742786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 msgr2=0x55c5789dd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 -- 172.21.15.100:0/215742786 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57860a0f0 con 0x55c578632390 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f254ad9d640 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2544035000 tx=0x7f2544043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c28a132ee70a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2533fff640 1 -- 172.21.15.100:0/215742786 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544004040 con 0x55c578632390 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2533fff640 1 -- 172.21.15.100:0/215742786 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544036040 con 0x55c578632390 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.837+0000 7f2533fff640 1 -- 172.21.15.100:0/215742786 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254402fb90 con 0x55c578632390 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 -- 172.21.15.100:0/215742786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 msgr2=0x55c5789d92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2544035000 tx=0x7f2544043000 comp rx=0 tx=0).stop 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 -- 172.21.15.100:0/215742786 shutdown_connections 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c578632390 0x55c5789d92b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c5786116b0 0x55c5789e5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 --2- 172.21.15.100:0/215742786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786094d0 0x55c5789dd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 -- 172.21.15.100:0/215742786 >> 172.21.15.100:0/215742786 conn(0x55c5786264e0 msgr2=0x55c5789d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 -- 172.21.15.100:0/215742786 shutdown_connections 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.838+0000 7f2557795740 1 -- 172.21.15.100:0/215742786 wait complete. 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 -- start start 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 Processor -- start 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 0x55c5789e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1adde0 con 0x55c5786094d0 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1ad710 con 0x55c5786116b0 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1aa950 con 0x55c578632390 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2557795740 10 client.0 _ll_register_callbacks cb 0x7f253c009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:03.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49504/0 (socket says 172.21.15.100:49504) 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 -- 172.21.15.100:0/1178447749 learned_addr learned my addr 172.21.15.100:0/1178447749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 0x55c5789e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254ad9d640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 -- 172.21.15.100:0/1178447749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 msgr2=0x55c5789e3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789e3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 -- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 msgr2=0x55c5789e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 0x55c5789e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 -- 172.21.15.100:0/1178447749 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5788f94b0 con 0x55c5786094d0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 0x55c5789e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f254a59c640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f253c005d80 tx=0x7f253c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94b980d3eaba7a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.839+0000 7f2531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:03.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c01e070 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f253c01a6d0 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2544036040 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f253c02a050 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 10 client.15870 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c5789e5680 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544036040 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f253c00f040 con 0x55c5786094d0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 10 client.15870 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 20 client.15870 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785c63a0 0x55c578a53eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 4 client.15870 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c578940800 con 0x55c5785c63a0 2024-04-30T23:14:03.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.840+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785c63a0 0x55c578a53eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2531ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2549d9b640 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785c63a0 0x55c578a53eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cecf1189bdddb8d server_cookie=4571c91f4cd04dca in_seq=0 out_seq=0 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2531ffb640 1 -- 172.21.15.100:0/1178447749 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55c578940800 con 0x55c5785c63a0 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2531ffb640 10 client.15870 handle_command_reply: tid=0 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 client.15870 shutdown 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 msgr2=0x55c5789e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f253c005d80 tx=0x7f253c012820 comp rx=0 tx=0).stop 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 shutdown_connections 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55c5785c63a0 0x55c578a53eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c578632390 0x55c5789e3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c5786116b0 0x55c5789e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2531ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:03.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 --2- 172.21.15.100:0/1178447749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5786094d0 0x55c5789e2b10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 >> 172.21.15.100:0/1178447749 conn(0x55c5786264e0 msgr2=0x55c5789eff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 shutdown_connections 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 1 -- 172.21.15.100:0/1178447749 wait complete. 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.841+0000 7f2557795740 20 client.15870 trim_cache size 0 max 16384 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:14:03.850 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "54920341-8007-47f5-bc55-b82e8703fc8a", 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:03.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:03.852 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:03.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 msgr2=0x7f25340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 0x7f25340a60c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c5789d5540 tx=0x7f25440095c0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 msgr2=0x7f254c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f254000d950 tx=0x7f254000de10 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 shutdown_connections 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25340a3bb0 0x7f25340a60c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f254c1050f0 0x7f254c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f254c1022a0 0x7f254c19a750 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 --2- 172.21.15.100:0/1796103083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254c1017a0 0x7f254c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 >> 172.21.15.100:0/1796103083 conn(0x7f254c0fd3c0 msgr2=0x7f254c107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 shutdown_connections 2024-04-30T23:14:03.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:03.842+0000 7f2550809640 1 -- 172.21.15.100:0/1796103083 wait complete. 2024-04-30T23:14:03.855 INFO:tasks.cephfs.filesystem:scrub status for tag:54920341-8007-47f5-bc55-b82e8703fc8a - {'path': '/', 'tag': '54920341-8007-47f5-bc55-b82e8703fc8a', 'options': 'recursive,force'} 2024-04-30T23:14:05.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: pgmap v387: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:05.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:14:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:14:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:04 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:14:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: pgmap v387: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:14:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:14:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:04 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: pgmap v387: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:04 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:14:07.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:06 smithi104 ceph-mon[32987]: pgmap v388: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:07.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:06 smithi183 ceph-mon[33560]: pgmap v388: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:07.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:06 smithi100 ceph-mon[29745]: pgmap v388: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:09.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:08 smithi104 ceph-mon[32987]: pgmap v389: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:08 smithi183 ceph-mon[33560]: pgmap v389: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:08 smithi100 ceph-mon[29745]: pgmap v389: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:11.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:10 smithi104 ceph-mon[32987]: pgmap v390: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-30T23:14:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:10 smithi183 ceph-mon[33560]: pgmap v390: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-30T23:14:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:10 smithi100 ceph-mon[29745]: pgmap v390: 129 pgs: 129 active+clean; 656 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-30T23:14:13.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:12 smithi104 ceph-mon[32987]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:13.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:12 smithi183 ceph-mon[33560]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:13.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:12 smithi100 ceph-mon[29745]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:14 smithi104 ceph-mon[32987]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:14 smithi183 ceph-mon[33560]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:14 smithi100 ceph-mon[29745]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:17.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:16 smithi104 ceph-mon[32987]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:16 smithi183 ceph-mon[33560]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:16 smithi100 ceph-mon[29745]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-30T23:14:19.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:18 smithi104 ceph-mon[32987]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:19.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:18 smithi183 ceph-mon[33560]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:19.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:18 smithi100 ceph-mon[29745]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-04-30T23:14:21.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:20 smithi104 ceph-mon[32987]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-30T23:14:21.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:20 smithi183 ceph-mon[33560]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-30T23:14:21.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:20 smithi100 ceph-mon[29745]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-30T23:14:23.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:22 smithi104 ceph-mon[32987]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:14:23.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:22 smithi183 ceph-mon[33560]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:14:23.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:22 smithi100 ceph-mon[29745]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-30T23:14:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:24 smithi104 ceph-mon[32987]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:24 smithi183 ceph-mon[33560]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:25.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:24 smithi100 ceph-mon[29745]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:27.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:26 smithi104 ceph-mon[32987]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:26 smithi183 ceph-mon[33560]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:27.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:26 smithi100 ceph-mon[29745]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:28 smithi104 ceph-mon[32987]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:28 smithi183 ceph-mon[33560]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:29.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:28 smithi100 ceph-mon[29745]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:30 smithi104 ceph-mon[32987]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:30 smithi183 ceph-mon[33560]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:31.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:30 smithi100 ceph-mon[29745]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:33.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:32 smithi104 ceph-mon[32987]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:32 smithi183 ceph-mon[33560]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:33.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:32 smithi100 ceph-mon[29745]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:33.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:14:33.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:14:33.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.978+0000 7f345c7ee640 1 -- 172.21.15.100:0/3393362721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 msgr2=0x7f345410bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.978+0000 7f345c7ee640 1 --2- 172.21.15.100:0/3393362721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f345410bcf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f344c009ca0 tx=0x7f344c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 -- 172.21.15.100:0/3393362721 shutdown_connections 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 --2- 172.21.15.100:0/3393362721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f345410bcf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 --2- 172.21.15.100:0/3393362721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454106f70 0x7f3454109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 --2- 172.21.15.100:0/3393362721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454104610 0x7f3454106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 -- 172.21.15.100:0/3393362721 >> 172.21.15.100:0/3393362721 conn(0x7f34540fdc10 msgr2=0x7f34541000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 -- 172.21.15.100:0/3393362721 shutdown_connections 2024-04-30T23:14:33.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 -- 172.21.15.100:0/3393362721 wait complete. 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.979+0000 7f345c7ee640 1 Processor -- start 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 -- start start 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454104610 0x7f345419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454106f70 0x7f345419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f6a0 con 0x7f34541098d0 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f520 con 0x7f3454104610 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345c7ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f820 con 0x7f3454106f70 2024-04-30T23:14:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57912/0 (socket says 172.21.15.100:57912) 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 -- 172.21.15.100:0/446694038 learned_addr learned my addr 172.21.15.100:0/446694038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f3459d89640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454106f70 0x7f345419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345a58a640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454104610 0x7f345419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 -- 172.21.15.100:0/446694038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454106f70 msgr2=0x7f345419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454106f70 0x7f345419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 -- 172.21.15.100:0/446694038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454104610 msgr2=0x7f345419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454104610 0x7f345419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.980+0000 7f345ad8b640 1 -- 172.21.15.100:0/446694038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34541a20e0 con 0x7f34541098d0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f345ad8b640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f344c033040 tx=0x7f344c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f344b7fe640 1 -- 172.21.15.100:0/446694038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c003b70 con 0x7f34541098d0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f344b7fe640 1 -- 172.21.15.100:0/446694038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c003d10 con 0x7f34541098d0 2024-04-30T23:14:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34541a2370 con 0x7f34541098d0 2024-04-30T23:14:33.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f344b7fe640 1 -- 172.21.15.100:0/446694038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c02fb40 con 0x7f34541098d0 2024-04-30T23:14:33.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.981+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541a2910 con 0x7f34541098d0 2024-04-30T23:14:33.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.984+0000 7f344b7fe640 1 -- 172.21.15.100:0/446694038 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f344c004610 con 0x7f34541098d0 2024-04-30T23:14:33.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.984+0000 7f346377c740 1 Processor -- start 2024-04-30T23:14:33.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 -- start start 2024-04-30T23:14:33.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f344b7fe640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 0x7f34400a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f3459d89640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 0x7f34400a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f344b7fe640 1 -- 172.21.15.100:0/446694038 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344c0f1ad0 con 0x7f34541098d0 2024-04-30T23:14:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd897a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd898700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd7aeb10 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd7fbd80 con 0x55b6dd4f5390 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f346377c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd7b58b0 con 0x55b6dd4d46b0 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f345a58a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f345a58a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:35410/0 (socket says 172.21.15.100:35410) 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f3459d89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd897a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.985+0000 7f345a58a640 1 -- 172.21.15.100:0/3866089007 learned_addr learned my addr 172.21.15.100:0/3866089007 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f345ad8b640 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd898700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 -- 172.21.15.100:0/3866089007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 msgr2=0x55b6dd898700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd898700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 -- 172.21.15.100:0/3866089007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 msgr2=0x55b6dd8974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 -- 172.21.15.100:0/3866089007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6dd786a40 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 0x7f34400a6140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f345419b640 tx=0x7f3444011810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f345a58a640 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3459d89640 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd897a70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3444011d10 tx=0x7f344401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ab3dc2cc1c686a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3448ff9640 1 -- 172.21.15.100:0/3866089007 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444017040 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3448ff9640 1 -- 172.21.15.100:0/3866089007 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3444019050 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.986+0000 7f3448ff9640 1 -- 172.21.15.100:0/3866089007 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344400f9b0 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- 172.21.15.100:0/3866089007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 msgr2=0x55b6dd897a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd897a70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3444011d10 tx=0x7f344401e000 comp rx=0 tx=0).stop 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- 172.21.15.100:0/3866089007 shutdown_connections 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd898700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd897a70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 --2- 172.21.15.100:0/3866089007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd8974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- 172.21.15.100:0/3866089007 >> 172.21.15.100:0/3866089007 conn(0x55b6dd4e94e0 msgr2=0x55b6dd892d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- 172.21.15.100:0/3866089007 shutdown_connections 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- 172.21.15.100:0/3866089007 wait complete. 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.988+0000 7f346377c740 1 -- start start 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 Processor -- start 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd782d10 con 0x55b6dd4f5390 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57926/0 (socket says 172.21.15.100:57926) 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f345ad8b640 1 -- 172.21.15.100:0/1554925257 learned_addr learned my addr 172.21.15.100:0/1554925257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd7f7d40 con 0x55b6dd4d46b0 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f3459d89640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6dd8991b0 con 0x55b6dd4cc4d0 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.989+0000 7f345a58a640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f346377c740 10 client.0 _ll_register_callbacks cb 0x55b6dd808d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 -- 172.21.15.100:0/1554925257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 msgr2=0x55b6dd8a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 -- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 msgr2=0x55b6dd8a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6dd5d77d0 con 0x55b6dd4f5390 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f3459d89640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f345ad8b640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f344c006010 tx=0x7f344c0be210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f31010ed7d0ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f343dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f343dffb640 1 -- 172.21.15.100:0/1554925257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c0c66c0 con 0x55b6dd4f5390 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3444019050 con 0x55b6dd4f5390 2024-04-30T23:14:33.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.990+0000 7f343dffb640 1 -- 172.21.15.100:0/1554925257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344c0de070 con 0x55b6dd4f5390 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f343dffb640 1 -- 172.21.15.100:0/1554925257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f344c0ba0c0 con 0x55b6dd4f5390 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 10 client.15882 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b6dd50d3f0 con 0x55b6dd4f5390 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f343dffb640 1 -- 172.21.15.100:0/1554925257 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f344c02fce0 con 0x55b6dd4f5390 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 20 client.15882 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4b3f60 0x55b6dd8aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 4 client.15882 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.991+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3444019050 con 0x55b6dd4b3f60 2024-04-30T23:14:33.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.992+0000 7f345a58a640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4b3f60 0x55b6dd8aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.992+0000 7f345a58a640 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4b3f60 0x55b6dd8aea30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b6d5e6da4f0560e server_cookie=aba5a640e1f80f0c in_seq=0 out_seq=0 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.992+0000 7f343dffb640 10 client.15882 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f343dffb640 1 -- 172.21.15.100:0/1554925257 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7f3444019050 con 0x55b6dd4b3f60 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f343dffb640 10 client.15882 handle_command_reply: tid=0 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 client.15882 shutdown 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 msgr2=0x55b6dd8a8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f344c006010 tx=0x7f344c0be210 comp rx=0 tx=0).stop 2024-04-30T23:14:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 shutdown_connections 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4b3f60 0x55b6dd8aea30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f343dffb640 0 client.15882 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a8730 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 --2- 172.21.15.100:0/1554925257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 >> 172.21.15.100:0/1554925257 conn(0x55b6dd4e94e0 msgr2=0x55b6dd895c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 shutdown_connections 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.993+0000 7f346377c740 1 -- 172.21.15.100:0/1554925257 wait complete. 2024-04-30T23:14:33.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:33.994+0000 7f346377c740 20 client.15882 trim_cache size 0 max 16384 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.028+0000 7f346377c740 1 Processor -- start 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.028+0000 7f346377c740 1 -- start start 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.028+0000 7f346377c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd89f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.028+0000 7f346377c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57940/0 (socket says 172.21.15.100:57940) 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f346377c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd89fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f345a58a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd89f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f345a58a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd89f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:51800/0 (socket says 172.21.15.100:51800) 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 -- 172.21.15.100:0/3206238834 learned_addr learned my addr 172.21.15.100:0/3206238834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ac870 con 0x55b6dd4d46b0 2024-04-30T23:14:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ae3b0 con 0x55b6dd4f5390 2024-04-30T23:14:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34541acf40 con 0x55b6dd4cc4d0 2024-04-30T23:14:34.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f345ad8b640 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd89fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 -- 172.21.15.100:0/3206238834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 msgr2=0x55b6dd89f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd89f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 -- 172.21.15.100:0/3206238834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 msgr2=0x55b6dd89fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd89fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.029+0000 7f3459d89640 1 -- 172.21.15.100:0/3206238834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6dd8a1040 con 0x55b6dd4d46b0 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.030+0000 7f3459d89640 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3444011fd0 tx=0x7f3444011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757bf960e67479cb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.030+0000 7f343ffff640 1 -- 172.21.15.100:0/3206238834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444015050 con 0x55b6dd4d46b0 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.030+0000 7f343ffff640 1 -- 172.21.15.100:0/3206238834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34440054f0 con 0x55b6dd4d46b0 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.030+0000 7f343ffff640 1 -- 172.21.15.100:0/3206238834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444017040 con 0x55b6dd4d46b0 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.031+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 msgr2=0x55b6dd8a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.031+0000 7f346377c740 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3444011fd0 tx=0x7f3444011f60 comp rx=0 tx=0).stop 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.031+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 shutdown_connections 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4f5390 0x55b6dd89fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a8650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 --2- 172.21.15.100:0/3206238834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd89f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 >> 172.21.15.100:0/3206238834 conn(0x55b6dd4e94e0 msgr2=0x55b6dd89c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 shutdown_connections 2024-04-30T23:14:34.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 -- 172.21.15.100:0/3206238834 wait complete. 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 -- start start 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.032+0000 7f346377c740 1 Processor -- start 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f346377c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f346377c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f346377c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f345a58a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f345a58a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:35422/0 (socket says 172.21.15.100:35422) 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f3459d89640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f3459d89640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:51814/0 (socket says 172.21.15.100:51814) 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f345ad8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57946/0 (socket says 172.21.15.100:57946) 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f345a58a640 1 -- 172.21.15.100:0/3575916169 learned_addr learned my addr 172.21.15.100:0/3575916169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.033+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34541adce0 con 0x55b6dd4f5390 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ad610 con 0x55b6dd4cc4d0 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aa850 con 0x55b6dd4d46b0 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 -- 172.21.15.100:0/3575916169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 msgr2=0x55b6dd8a7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 -- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 msgr2=0x55b6dd8a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6dd4cd0f0 con 0x55b6dd4f5390 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f345ad8b640 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f344c0bd9e0 tx=0x7f344c0ef140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab01634f2464698 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f343dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:34.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.034+0000 7f343dffb640 1 -- 172.21.15.100:0/3575916169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c0cb060 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f343dffb640 1 -- 172.21.15.100:0/3575916169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344c0bd0b0 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 10 client.0 _ll_register_callbacks cb 0x7f344c0b9d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34440054f0 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f343dffb640 1 -- 172.21.15.100:0/3575916169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f344c0d2050 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b6dd7bc4b0 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f343dffb640 1 -- 172.21.15.100:0/3575916169 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f344c0b97a0 con 0x55b6dd4f5390 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 20 client.15888 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4893a0 0x55b6dd916160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 4 client.15888 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.035+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f34440054f0 con 0x55b6dd4893a0 2024-04-30T23:14:34.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f345a58a640 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4893a0 0x55b6dd916160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f343dffb640 10 client.15888 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f345a58a640 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4893a0 0x55b6dd916160 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5655adfecf8c43 server_cookie=825d7ceb85f5733 in_seq=0 out_seq=0 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f343dffb640 1 -- 172.21.15.100:0/3575916169 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7f34440054f0 con 0x55b6dd4893a0 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f343dffb640 10 client.15888 handle_command_reply: tid=0 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.036+0000 7f346377c740 1 client.15888 shutdown 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 msgr2=0x55b6dd8a7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f344c0bd9e0 tx=0x7f344c0ef140 comp rx=0 tx=0).stop 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 shutdown_connections 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b6dd4893a0 0x55b6dd916160 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b6dd4f5390 0x55b6dd8a7b40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f343dffb640 0 client.15888 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:34.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6dd4d46b0 0x55b6dd8a7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 --2- 172.21.15.100:0/3575916169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6dd4cc4d0 0x55b6dd8a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 >> 172.21.15.100:0/3575916169 conn(0x55b6dd4e94e0 msgr2=0x55b6dd89f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 shutdown_connections 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 1 -- 172.21.15.100:0/3575916169 wait complete. 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.037+0000 7f346377c740 20 client.15888 trim_cache size 0 max 16384 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-04-30T23:14:34.043 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {}, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:34.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:34.045 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:34.045 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:34.045 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:34.045 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:34.045 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 msgr2=0x7f34400a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 0x7f34400a6140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f345419b640 tx=0x7f3444011810 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 msgr2=0x7f34541a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f344c033040 tx=0x7f344c0316f0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 shutdown_connections 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3c30 0x7f34400a6140 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541098d0 0x7f34541a1a70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454106f70 0x7f345419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 --2- 172.21.15.100:0/446694038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454104610 0x7f345419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 >> 172.21.15.100:0/446694038 conn(0x7f34540fdc10 msgr2=0x7f3454105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 shutdown_connections 2024-04-30T23:14:34.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.038+0000 7f345c7ee640 1 -- 172.21.15.100:0/446694038 wait complete. 2024-04-30T23:14:34.054 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T23:14:34.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:14:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 -- 172.21.15.100:0/3975939375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141017b0 msgr2=0x7fee14101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 --2- 172.21.15.100:0/3975939375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141017b0 0x7fee14101c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fee08009860 tx=0x7fee0802a340 comp rx=0 tx=0).stop 2024-04-30T23:14:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 -- 172.21.15.100:0/3975939375 shutdown_connections 2024-04-30T23:14:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 --2- 172.21.15.100:0/3975939375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141022b0 0x7fee1410bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 --2- 172.21.15.100:0/3975939375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141017b0 0x7fee14101c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 --2- 172.21.15.100:0/3975939375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 0x7fee14105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 -- 172.21.15.100:0/3975939375 >> 172.21.15.100:0/3975939375 conn(0x7fee140fd3d0 msgr2=0x7fee140ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 -- 172.21.15.100:0/3975939375 shutdown_connections 2024-04-30T23:14:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.166+0000 7fee192a6640 1 -- 172.21.15.100:0/3975939375 wait complete. 2024-04-30T23:14:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.167+0000 7fee192a6640 1 Processor -- start 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.167+0000 7fee192a6640 1 -- start start 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141022b0 0x7fee1419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 0x7fee141a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee1410f670 con 0x7fee14105100 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fee1410f4f0 con 0x7fee141022b0 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee192a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fee1410f7f0 con 0x7fee141017b0 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee137fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 0x7fee141a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:51832/0 (socket says 172.21.15.100:51832) 2024-04-30T23:14:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 -- 172.21.15.100:0/2594113164 learned_addr learned my addr 172.21.15.100:0/2594113164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee127fc640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141022b0 0x7fee1419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 -- 172.21.15.100:0/2594113164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141022b0 msgr2=0x7fee1419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141022b0 0x7fee1419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 -- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 msgr2=0x7fee141a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 0x7fee141a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.168+0000 7fee12ffd640 1 -- 172.21.15.100:0/2594113164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee141a1d50 con 0x7fee141017b0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fee12ffd640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee0400e980 tx=0x7fee0400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0400cd80 con 0x7fee141017b0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee141a1fe0 con 0x7fee141017b0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee040108e0 con 0x7fee141017b0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee040188f0 con 0x7fee141017b0 2024-04-30T23:14:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.169+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee141a24f0 con 0x7fee141017b0 2024-04-30T23:14:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.170+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee14108a90 con 0x7fee141017b0 2024-04-30T23:14:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.172+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fee0401f020 con 0x7fee141017b0 2024-04-30T23:14:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.173+0000 7fedfbfff640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 0x7fedfc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.173+0000 7fee127fc640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 0x7fedfc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.173+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fee040d0b30 con 0x7fee141017b0 2024-04-30T23:14:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.174+0000 7fee127fc640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 0x7fedfc0a60c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee0802a930 tx=0x7fee08030470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.176+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fee0409d1b0 con 0x7fee141017b0 2024-04-30T23:14:34.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.402+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee1402db90 con 0x7fee141017b0 2024-04-30T23:14:34.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.403+0000 7fedfbfff640 1 -- 172.21.15.100:0/2594113164 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7fee0409cab0 con 0x7fee141017b0 2024-04-30T23:14:34.404 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:14:34.404 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:13:23.708732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[24503,24496,24545,14664,24511]},"id":1}]} 2024-04-30T23:14:34.404 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-04-30T23:14:34.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 msgr2=0x7fedfc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 0x7fedfc0a60c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee0802a930 tx=0x7fee08030470 comp rx=0 tx=0).stop 2024-04-30T23:14:34.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 msgr2=0x7fee1419a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee0400e980 tx=0x7fee0400ee40 comp rx=0 tx=0).stop 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 shutdown_connections 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fedfc0a3bb0 0x7fedfc0a60c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee14105100 0x7fee141a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee141022b0 0x7fee1419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 --2- 172.21.15.100:0/2594113164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee141017b0 0x7fee1419a210 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee0400e980 tx=0x7fee0400ee40 comp rx=0 tx=0).stop 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.405+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 >> 172.21.15.100:0/2594113164 conn(0x7fee140fd3d0 msgr2=0x7fee14105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.406+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 shutdown_connections 2024-04-30T23:14:34.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.406+0000 7fee192a6640 1 -- 172.21.15.100:0/2594113164 wait complete. 2024-04-30T23:14:34.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-30T23:14:34.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 -- 172.21.15.100:0/3007105028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098106c50 msgr2=0x7fa098109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 --2- 172.21.15.100:0/3007105028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098106c50 0x7fa098109130 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa084009900 tx=0x7fa08402a410 comp rx=0 tx=0).stop 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 -- 172.21.15.100:0/3007105028 shutdown_connections 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 --2- 172.21.15.100:0/3007105028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0981097c0 0x7fa09810bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 --2- 172.21.15.100:0/3007105028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098106c50 0x7fa098109130 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 --2- 172.21.15.100:0/3007105028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa098101e70 0x7fa098102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 -- 172.21.15.100:0/3007105028 >> 172.21.15.100:0/3007105028 conn(0x7fa0980fd380 msgr2=0x7fa0980ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 -- 172.21.15.100:0/3007105028 shutdown_connections 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.531+0000 7fa09eea6640 1 -- 172.21.15.100:0/3007105028 wait complete. 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 Processor -- start 2024-04-30T23:14:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 -- start start 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa098106c50 0x7fa09819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 0x7fa0981a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810f650 con 0x7fa098101e70 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810f4d0 con 0x7fa098106c50 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09eea6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa09810f7d0 con 0x7fa0981097c0 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57998/0 (socket says 172.21.15.100:57998) 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa09cc42640 1 -- 172.21.15.100:0/573393513 learned_addr learned my addr 172.21.15.100:0/573393513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.532+0000 7fa097fff640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa098106c50 0x7fa09819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09d443640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 0x7fa0981a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 -- 172.21.15.100:0/573393513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 msgr2=0x7fa0981a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 0x7fa0981a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 -- 172.21.15.100:0/573393513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa098106c50 msgr2=0x7fa09819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa098106c50 0x7fa09819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 -- 172.21.15.100:0/573393513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0981a1d70 con 0x7fa098101e70 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09d443640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 0x7fa0981a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09cc42640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9f0 tx=0x7fa08c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa095ffb640 1 -- 172.21.15.100:0/573393513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00ccc0 con 0x7fa098101e70 2024-04-30T23:14:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0981a2060 con 0x7fa098101e70 2024-04-30T23:14:34.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa095ffb640 1 -- 172.21.15.100:0/573393513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa08c0054d0 con 0x7fa098101e70 2024-04-30T23:14:34.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.533+0000 7fa095ffb640 1 -- 172.21.15.100:0/573393513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c010430 con 0x7fa098101e70 2024-04-30T23:14:34.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.534+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0981a2560 con 0x7fa098101e70 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.536+0000 7fa095ffb640 1 -- 172.21.15.100:0/573393513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa08c0046c0 con 0x7fa098101e70 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa095ffb640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 0x7fa0880a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa095ffb640 1 -- 172.21.15.100:0/573393513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa08c0d0b50 con 0x7fa098101e70 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa097fff640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 0x7fa0880a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa0a5e31740 1 Processor -- start 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa0a5e31740 1 -- start start 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa097fff640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 0x7fa0880a60c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa084009230 tx=0x7fa084031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e30390 0x55d8931d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.537+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d893136d80 con 0x55d892e0f6b0 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8930f0a20 con 0x55d892e30390 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d893132d40 con 0x55d892e074d0 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58012/0 (socket says 172.21.15.100:58012) 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 -- 172.21.15.100:0/3044761014 learned_addr learned my addr 172.21.15.100:0/3044761014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa097fff640 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09cc42640 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e30390 0x55d8931d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 -- 172.21.15.100:0/3044761014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 msgr2=0x55d8931d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 -- 172.21.15.100:0/3044761014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e30390 msgr2=0x55d8931d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e30390 0x55d8931d4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 -- 172.21.15.100:0/3044761014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8930d4e00 con 0x55d892e0f6b0 2024-04-30T23:14:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa09d443640 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa090009f90 tx=0x7fa09000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246af4e5423da88 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.538+0000 7fa082ffd640 1 -- 172.21.15.100:0/3044761014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090003b70 con 0x55d892e0f6b0 2024-04-30T23:14:34.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.539+0000 7fa082ffd640 1 -- 172.21.15.100:0/3044761014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa090003d10 con 0x55d892e0f6b0 2024-04-30T23:14:34.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.539+0000 7fa082ffd640 1 -- 172.21.15.100:0/3044761014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0900118f0 con 0x55d892e0f6b0 2024-04-30T23:14:34.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3044761014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 msgr2=0x55d8931d91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa090009f90 tx=0x7fa09000f7f0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3044761014 shutdown_connections 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e0f6b0 0x55d8931d91a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3044761014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e30390 0x55d8931d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3044761014 >> 172.21.15.100:0/3044761014 conn(0x55d892e244e0 msgr2=0x55d8931cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3044761014 shutdown_connections 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.540+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3044761014 wait complete. 2024-04-30T23:14:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.541+0000 7fa0a5e31740 1 -- start start 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.541+0000 7fa0a5e31740 1 Processor -- start 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.541+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e074d0 0x55d8931eca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e0f6b0 0x55d8931ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d8931eacd0 con 0x55d892e30390 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8930bddc0 con 0x55d892e074d0 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d8931eae50 con 0x55d892e0f6b0 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa0a5e31740 10 client.0 _ll_register_callbacks cb 0x55d8930d9600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58014/0 (socket says 172.21.15.100:58014) 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 -- 172.21.15.100:0/4229207785 learned_addr learned my addr 172.21.15.100:0/4229207785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09cc42640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e074d0 0x55d8931eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa097fff640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e0f6b0 0x55d8931ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 -- 172.21.15.100:0/4229207785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e0f6b0 msgr2=0x55d8931ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e0f6b0 0x55d8931ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 -- 172.21.15.100:0/4229207785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e074d0 msgr2=0x55d8931eca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e074d0 0x55d8931eca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 -- 172.21.15.100:0/4229207785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8930fbc30 con 0x55d892e30390 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa09d443640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa090003970 tx=0x7fa0900039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad863de1da92e03 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.542+0000 7fa077fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090003b40 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa090003d10 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa090004c50 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa090004e50 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa0a5e31740 10 client.15906 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d892e483f0 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.543+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa090003d10 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa090005040 con 0x55d892e30390 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 10 client.15906 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:14:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 20 client.15906 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892deef60 0x55d8931faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 4 client.15906 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d893130810 con 0x55d892deef60 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa09cc42640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892deef60 0x55d8931faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.544+0000 7fa077fff640 10 client.15906 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.545+0000 7fa09cc42640 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892deef60 0x55d8931faa20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae488b3980396b15 server_cookie=12a06053f3a7290a in_seq=0 out_seq=0 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.545+0000 7fa077fff640 1 -- 172.21.15.100:0/4229207785 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55d893130810 con 0x55d892deef60 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.545+0000 7fa077fff640 10 client.15906 handle_command_reply: tid=0 2024-04-30T23:14:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.545+0000 7fa0a5e31740 1 client.15906 shutdown 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 msgr2=0x55d8931f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa090003970 tx=0x7fa0900039a0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 shutdown_connections 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892deef60 0x55d8931faa20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e30390 0x55d8931f3ee0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa077fff640 0 client.15906 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e0f6b0 0x55d8931ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/4229207785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e074d0 0x55d8931eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 >> 172.21.15.100:0/4229207785 conn(0x55d892e244e0 msgr2=0x55d8931d73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 shutdown_connections 2024-04-30T23:14:34.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 1 -- 172.21.15.100:0/4229207785 wait complete. 2024-04-30T23:14:34.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.546+0000 7fa0a5e31740 20 client.15906 trim_cache size 0 max 16384 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 Processor -- start 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 -- start start 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892deef60 0x55d8931fa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa098074530 con 0x55d892e074d0 2024-04-30T23:14:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0981a3a30 con 0x55d892e0f6b0 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.572+0000 7fa0a5e31740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa098074c00 con 0x55d892deef60 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58026/0 (socket says 172.21.15.100:58026) 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 -- 172.21.15.100:0/2130833199 learned_addr learned my addr 172.21.15.100:0/2130833199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa09cc42640 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892deef60 0x55d8931fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa09d443640 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 -- 172.21.15.100:0/2130833199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892deef60 msgr2=0x55d8931fa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892deef60 0x55d8931fa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 -- 172.21.15.100:0/2130833199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 msgr2=0x55d8931cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 -- 172.21.15.100:0/2130833199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d892f127d0 con 0x55d892e074d0 2024-04-30T23:14:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa097fff640 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa084009900 tx=0x7fa08403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845b006953862ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.573+0000 7fa0827fc640 1 -- 172.21.15.100:0/2130833199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084035050 con 0x55d892e074d0 2024-04-30T23:14:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.574+0000 7fa0827fc640 1 -- 172.21.15.100:0/2130833199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0840043c0 con 0x55d892e074d0 2024-04-30T23:14:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.574+0000 7fa0827fc640 1 -- 172.21.15.100:0/2130833199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08403c850 con 0x55d892e074d0 2024-04-30T23:14:34.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- 172.21.15.100:0/2130833199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 msgr2=0x55d8931f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa084009900 tx=0x7fa08403e070 comp rx=0 tx=0).stop 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- 172.21.15.100:0/2130833199 shutdown_connections 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892e074d0 0x55d8931f3e00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/2130833199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892deef60 0x55d8931fa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- 172.21.15.100:0/2130833199 >> 172.21.15.100:0/2130833199 conn(0x55d892e244e0 msgr2=0x55d8931ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- 172.21.15.100:0/2130833199 shutdown_connections 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- 172.21.15.100:0/2130833199 wait complete. 2024-04-30T23:14:34.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.575+0000 7fa0a5e31740 1 -- start start 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 Processor -- start 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa09cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa09cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58040/0 (socket says 172.21.15.100:58040) 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa09cc42640 1 -- 172.21.15.100:0/3307529673 learned_addr learned my addr 172.21.15.100:0/3307529673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931f3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0981a3360 con 0x55d892deef60 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0981a2c90 con 0x55d892e0f6b0 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.576+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa098072510 con 0x55d892e074d0 2024-04-30T23:14:34.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa097fff640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa0a5e31740 10 client.0 _ll_register_callbacks cb 0x7fa090015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 -- 172.21.15.100:0/3307529673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 msgr2=0x55d8931f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 -- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 msgr2=0x55d8931f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09d443640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d89325ece0 con 0x55d892deef60 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa097fff640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:34.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09d443640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa09cc42640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9c0 tx=0x7fa08c0bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b000ff8563331de server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa077fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c09add0 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa08c099140 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.577+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0840043c0 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.578+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa08c0a52b0 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.578+0000 7fa0a5e31740 10 client.15912 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.578+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d89325fff0 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.578+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0840043c0 con 0x55d892deef60 2024-04-30T23:14:34.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.578+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa08c0b8070 con 0x55d892deef60 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 10 client.15912 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 10 client.15912 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 20 client.15912 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892e30390 0x55d893262990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 4 client.15912 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d893144990 con 0x55d892e30390 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa097fff640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892e30390 0x55d893262990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa097fff640 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892e30390 0x55d893262990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f6fdef1856c47612 server_cookie=e524f049a3a6ceed in_seq=0 out_seq=0 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.579+0000 7fa077fff640 10 client.15912 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:34.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa077fff640 1 -- 172.21.15.100:0/3307529673 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d893144990 con 0x55d892e30390 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa077fff640 10 client.15912 handle_command_reply: tid=0 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 client.15912 shutdown 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 msgr2=0x55d8931f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9c0 tx=0x7fa08c0bd040 comp rx=0 tx=0).stop 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 shutdown_connections 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d892e30390 0x55d893262990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d892e0f6b0 0x55d8931f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d892e074d0 0x55d8931f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 --2- 172.21.15.100:0/3307529673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d892deef60 0x55d8931f26e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa077fff640 0 client.15912 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 >> 172.21.15.100:0/3307529673 conn(0x55d892e244e0 msgr2=0x55d8931ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 shutdown_connections 2024-04-30T23:14:34.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 1 -- 172.21.15.100:0/3307529673 wait complete. 2024-04-30T23:14:34.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.580+0000 7fa0a5e31740 20 client.15912 trim_cache size 0 max 16384 2024-04-30T23:14:34.588 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:34.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 msgr2=0x7fa0880a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 0x7fa0880a60c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa084009230 tx=0x7fa084031400 comp rx=0 tx=0).stop 2024-04-30T23:14:34.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 msgr2=0x7fa09819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9f0 tx=0x7fa08c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 shutdown_connections 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa0880a3bb0 0x7fa0880a60c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0981097c0 0x7fa0981a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa098106c50 0x7fa09819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 --2- 172.21.15.100:0/573393513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa098101e70 0x7fa09819a230 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 >> 172.21.15.100:0/573393513 conn(0x7fa0980fd380 msgr2=0x7fa098108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 shutdown_connections 2024-04-30T23:14:34.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.581+0000 7fa09eea6640 1 -- 172.21.15.100:0/573393513 wait complete. 2024-04-30T23:14:34.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.706+0000 7f8fb584a640 1 -- 172.21.15.100:0/1069776388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0106f70 msgr2=0x7f8fb0109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.706+0000 7f8fb584a640 1 --2- 172.21.15.100:0/1069776388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0106f70 0x7f8fb0109390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009860 tx=0x7f8fa402a340 comp rx=0 tx=0).stop 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 -- 172.21.15.100:0/1069776388 shutdown_connections 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 --2- 172.21.15.100:0/1069776388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb01098d0 0x7f8fb010bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 --2- 172.21.15.100:0/1069776388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0106f70 0x7f8fb0109390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 --2- 172.21.15.100:0/1069776388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb0104610 0x7f8fb0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 -- 172.21.15.100:0/1069776388 >> 172.21.15.100:0/1069776388 conn(0x7f8fb00fdc10 msgr2=0x7f8fb01000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 -- 172.21.15.100:0/1069776388 shutdown_connections 2024-04-30T23:14:34.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 -- 172.21.15.100:0/1069776388 wait complete. 2024-04-30T23:14:34.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.707+0000 7f8fb584a640 1 Processor -- start 2024-04-30T23:14:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 -- start start 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 0x7f8fb019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb01098d0 0x7f8fb01a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010f650 con 0x7f8fb0106f70 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010f4d0 con 0x7f8fb0104610 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fb584a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010f7d0 con 0x7f8fb01098d0 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58060/0 (socket says 172.21.15.100:58060) 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8fae7fc640 1 -- 172.21.15.100:0/3059707929 learned_addr learned my addr 172.21.15.100:0/3059707929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 0x7f8fb019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb01098d0 0x7f8fb01a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.708+0000 7f8faeffd640 1 -- 172.21.15.100:0/3059707929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb01098d0 msgr2=0x7f8fb01a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb01098d0 0x7f8fb01a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8faeffd640 1 -- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 msgr2=0x7f8fb019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8faeffd640 1 -- 172.21.15.100:0/3059707929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb01020e0 con 0x7f8fb0104610 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 0x7f8fb019a590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000e9c0 tx=0x7f8fa000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fb4848640 1 -- 172.21.15.100:0/3059707929 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000ccc0 con 0x7f8fb0104610 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb01023d0 con 0x7f8fb0104610 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fb4848640 1 -- 172.21.15.100:0/3059707929 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa0005020 con 0x7f8fb0104610 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fb4848640 1 -- 172.21.15.100:0/3059707929 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004a00 con 0x7f8fb0104610 2024-04-30T23:14:34.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.709+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01028d0 con 0x7f8fb0104610 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.712+0000 7f8fb4848640 1 -- 172.21.15.100:0/3059707929 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8fa00051d0 con 0x7f8fb0104610 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.712+0000 7f8fb4848640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 0x7f8f980a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.712+0000 7f8fb4848640 1 -- 172.21.15.100:0/3059707929 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8fa00d06f0 con 0x7f8fb0104610 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 0x7f8f980a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 Processor -- start 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 -- start start 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x561448380e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x561448381390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5614482e5d80 con 0x561447fbe6b0 2024-04-30T23:14:34.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56144829fa20 con 0x561447fb64d0 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614482e1d40 con 0x561447fdf390 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58076/0 (socket says 172.21.15.100:58076) 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8faf7fe640 1 -- 172.21.15.100:0/1933111479 learned_addr learned my addr 172.21.15.100:0/1933111479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 0x7f8f980a60c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40303f0 tx=0x7f8fa4030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.713+0000 7f8faeffd640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x561448380e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x561448381390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 -- 172.21.15.100:0/1933111479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 msgr2=0x561448381390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x561448381390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 -- 172.21.15.100:0/1933111479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 msgr2=0x561448388290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 -- 172.21.15.100:0/1933111479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561448283e00 con 0x561447fdf390 2024-04-30T23:14:34.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8faeffd640 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x561448380e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c6a0 tx=0x7f8fa009c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550cc6679f39ae41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8f95ffb640 1 -- 172.21.15.100:0/1933111479 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa001c040 con 0x561447fdf390 2024-04-30T23:14:34.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8f95ffb640 1 -- 172.21.15.100:0/1933111479 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa00a52e0 con 0x561447fdf390 2024-04-30T23:14:34.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.714+0000 7f8f95ffb640 1 -- 172.21.15.100:0/1933111479 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0098ce0 con 0x561447fdf390 2024-04-30T23:14:34.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/1933111479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 msgr2=0x561448380e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x561448380e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c6a0 tx=0x7f8fa009c570 comp rx=0 tx=0).stop 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/1933111479 shutdown_connections 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x561448388290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x561448381390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/1933111479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x561448380e10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.715+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/1933111479 >> 172.21.15.100:0/1933111479 conn(0x561447fd34e0 msgr2=0x56144837c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.716+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/1933111479 shutdown_connections 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.716+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/1933111479 wait complete. 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.716+0000 7f8fbc7e2740 1 -- start start 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.716+0000 7f8fbc7e2740 1 Processor -- start 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 0x56144838aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 0x561448391f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58090/0 (socket says 172.21.15.100:58090) 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 0x56144838aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fae7fc640 1 -- 172.21.15.100:0/896577782 learned_addr learned my addr 172.21.15.100:0/896577782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561448388ce0 con 0x561447fbe6b0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56144826cdc0 con 0x561447fdf390 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561448388e60 con 0x561447fb64d0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 10 client.0 _ll_register_callbacks cb 0x561448288600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 0x561448391f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 -- 172.21.15.100:0/896577782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 msgr2=0x561448391f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 0x561448391f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 -- 172.21.15.100:0/896577782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 msgr2=0x56144838b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614482aac30 con 0x561447fb64d0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 0x561448391f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa00a52e0 con 0x561447fb64d0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8f8effd640 10 client.25456 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.717+0000 7f8faeffd640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 0x56144838aae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fa009f000 tx=0x7f8fa00a0b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd862f66730df6b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8f8effd640 1 -- 172.21.15.100:0/896577782 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0080060 con 0x561447fb64d0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8f8effd640 1 -- 172.21.15.100:0/896577782 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8fa00054f0 con 0x561447fb64d0 2024-04-30T23:14:34.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8f8effd640 1 -- 172.21.15.100:0/896577782 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fa001c040 con 0x561447fb64d0 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 10 client.25456 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561447ff73f0 con 0x561447fb64d0 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8f8effd640 1 -- 172.21.15.100:0/896577782 <== mon.1 v2:172.21.15.183:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fa00a4e50 con 0x561447fb64d0 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 10 client.25456 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 10 client.25456 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 20 client.25456 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f9df60 0x5614483982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 4 client.25456 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.718+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614482df810 con 0x561447f9df60 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.719+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f9df60 0x5614483982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.719+0000 7f8f8effd640 10 client.25456 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.719+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f9df60 0x5614483982f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=11bc210b654ac3ab server_cookie=8424271cb27936e in_seq=0 out_seq=0 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8f8effd640 1 -- 172.21.15.100:0/896577782 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5614482df810 con 0x561447f9df60 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8f8effd640 10 client.25456 handle_command_reply: tid=0 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 client.25456 shutdown 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 msgr2=0x56144838aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 0x56144838aae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fa009f000 tx=0x7f8fa00a0b70 comp rx=0 tx=0).stop 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 shutdown_connections 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f9df60 0x5614483982f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fdf390 0x561448391f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8f8effd640 0 client.25456 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/896577782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fb64d0 0x56144838aae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 >> 172.21.15.100:0/896577782 conn(0x561447fd34e0 msgr2=0x56144837b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 shutdown_connections 2024-04-30T23:14:34.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/896577782 wait complete. 2024-04-30T23:14:34.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.720+0000 7f8fbc7e2740 20 client.25456 trim_cache size 0 max 16384 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 Processor -- start 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 -- start start 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fbe6b0 0x56144838abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01aeb30 con 0x561447f9df60 2024-04-30T23:14:34.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01b0670 con 0x561447fb64d0 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01af200 con 0x561447fbe6b0 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58106/0 (socket says 172.21.15.100:58106) 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faeffd640 1 -- 172.21.15.100:0/3239485231 learned_addr learned my addr 172.21.15.100:0/3239485231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fbe6b0 0x56144838abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faeffd640 1 -- 172.21.15.100:0/3239485231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fbe6b0 msgr2=0x56144838abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.747+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fbe6b0 0x56144838abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8faeffd640 1 -- 172.21.15.100:0/3239485231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 msgr2=0x56144838a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8faeffd640 1 -- 172.21.15.100:0/3239485231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614480c17d0 con 0x561447f9df60 2024-04-30T23:14:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8faeffd640 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cdee0 tx=0x7f8fa00b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bb92e23a63165d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8f957fa640 1 -- 172.21.15.100:0/3239485231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0098910 con 0x561447f9df60 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8f957fa640 1 -- 172.21.15.100:0/3239485231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa00a52e0 con 0x561447f9df60 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.748+0000 7f8f957fa640 1 -- 172.21.15.100:0/3239485231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00bb320 con 0x561447f9df60 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/3239485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 msgr2=0x561448389910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cdee0 tx=0x7f8fa00b7000 comp rx=0 tx=0).stop 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/3239485231 shutdown_connections 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fbe6b0 0x56144838abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/3239485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447f9df60 0x561448389910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/3239485231 >> 172.21.15.100:0/3239485231 conn(0x561447fd34e0 msgr2=0x561448389200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/3239485231 shutdown_connections 2024-04-30T23:14:34.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.749+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/3239485231 wait complete. 2024-04-30T23:14:34.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 -- start start 2024-04-30T23:14:34.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 Processor -- start 2024-04-30T23:14:34.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x5614483fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58114/0 (socket says 172.21.15.100:58114) 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01affa0 con 0x561447fbe6b0 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fae7fc640 1 -- 172.21.15.100:0/964200144 learned_addr learned my addr 172.21.15.100:0/964200144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.750+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01af8d0 con 0x561447fb64d0 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01acb10 con 0x561447fdf390 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fbc7e2740 10 client.0 _ll_register_callbacks cb 0x7f8fa8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8faeffd640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x5614483fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 -- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 msgr2=0x5614483fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x5614483fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 -- 172.21.15.100:0/964200144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 msgr2=0x56144838e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614483fc8f0 con 0x561447fbe6b0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8faf7fe640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x5614483fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fae7fc640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4030a80 tx=0x7f8fa4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54d9b2a9ed860f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8f8effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa405b060 con 0x561447fbe6b0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8fa40338c0 con 0x561447fbe6b0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.751+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa00a52e0 con 0x561447fbe6b0 2024-04-30T23:14:34.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fa4062050 con 0x561447fbe6b0 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 10 client.15930 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5614483fdb40 con 0x561447fbe6b0 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa00a52e0 con 0x561447fbe6b0 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fa403d440 con 0x561447fbe6b0 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 10 client.15930 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 20 client.15930 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f733a0 0x561448400500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 4 client.15930 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.752+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614482f3990 con 0x561447f733a0 2024-04-30T23:14:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8faeffd640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f733a0 0x561448400500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8f8effd640 10 client.15930 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8faeffd640 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f733a0 0x561448400500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c8157ca4d500cde server_cookie=135da46484314811 in_seq=0 out_seq=0 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8f8effd640 1 -- 172.21.15.100:0/964200144 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614482f3990 con 0x561447f733a0 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8f8effd640 10 client.15930 handle_command_reply: tid=0 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.753+0000 7f8fbc7e2740 1 client.15930 shutdown 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 msgr2=0x56144838eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4030a80 tx=0x7f8fa4005f90 comp rx=0 tx=0).stop 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 shutdown_connections 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x561447f733a0 0x561448400500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561447fdf390 0x5614483fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561447fbe6b0 0x56144838eb40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8f8effd640 0 client.15930 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 --2- 172.21.15.100:0/964200144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561447fb64d0 0x56144838e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 >> 172.21.15.100:0/964200144 conn(0x561447fd34e0 msgr2=0x56144838a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 shutdown_connections 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 1 -- 172.21.15.100:0/964200144 wait complete. 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.754+0000 7f8fbc7e2740 20 client.15930 trim_cache size 0 max 16384 2024-04-30T23:14:34.762 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 msgr2=0x7f8f980a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 0x7f8f980a60c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40303f0 tx=0x7f8fa4030450 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 msgr2=0x7f8fb019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 0x7f8fb019a590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000e9c0 tx=0x7f8fa000ee80 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 shutdown_connections 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8f980a3bb0 0x7f8f980a60c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fb01098d0 0x7f8fb01a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb0106f70 0x7f8fb019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 --2- 172.21.15.100:0/3059707929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fb0104610 0x7f8fb019a590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 >> 172.21.15.100:0/3059707929 conn(0x7f8fb00fdc10 msgr2=0x7f8fb0105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 shutdown_connections 2024-04-30T23:14:34.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.755+0000 7f8fb584a640 1 -- 172.21.15.100:0/3059707929 wait complete. 2024-04-30T23:14:34.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 -- 172.21.15.100:0/3743198277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4090101790 msgr2=0x7f4090101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 --2- 172.21.15.100:0/3743198277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4090101790 0x7f4090101c00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4084009900 tx=0x7f408402a410 comp rx=0 tx=0).stop 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 -- 172.21.15.100:0/3743198277 shutdown_connections 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 --2- 172.21.15.100:0/3743198277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090102290 0x7f409010bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 --2- 172.21.15.100:0/3743198277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4090101790 0x7f4090101c00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 --2- 172.21.15.100:0/3743198277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40901050e0 0x7f40901054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 -- 172.21.15.100:0/3743198277 >> 172.21.15.100:0/3743198277 conn(0x7f40900fd390 msgr2=0x7f40900ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 -- 172.21.15.100:0/3743198277 shutdown_connections 2024-04-30T23:14:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 -- 172.21.15.100:0/3743198277 wait complete. 2024-04-30T23:14:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.885+0000 7f4096155640 1 Processor -- start 2024-04-30T23:14:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 -- start start 2024-04-30T23:14:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090101790 0x7f409019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 0x7f409019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f409010f6c0 con 0x7f40901050e0 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f409010f540 con 0x7f4090101790 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f4096155640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f409010f840 con 0x7f4090102290 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f408ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f408ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58132/0 (socket says 172.21.15.100:58132) 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f408ffff640 1 -- 172.21.15.100:0/2239381095 learned_addr learned my addr 172.21.15.100:0/2239381095 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.886+0000 7f408effd640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 0x7f409019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 -- 172.21.15.100:0/2239381095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090101790 msgr2=0x7f409019a0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408f7fe640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090101790 0x7f409019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090101790 0x7f409019a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 -- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 msgr2=0x7f40901a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 -- 172.21.15.100:0/2239381095 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40901a1be0 con 0x7f4090102290 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408ffff640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408effd640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 0x7f409019a5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4084009850 tx=0x7f4084003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408cff9640 1 -- 172.21.15.100:0/2239381095 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408403f070 con 0x7f4090102290 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f408cff9640 1 -- 172.21.15.100:0/2239381095 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084031d60 con 0x7f4090102290 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.887+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40901a1e70 con 0x7f4090102290 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.888+0000 7f408cff9640 1 -- 172.21.15.100:0/2239381095 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084035030 con 0x7f4090102290 2024-04-30T23:14:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.888+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a2220 con 0x7f4090102290 2024-04-30T23:14:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.890+0000 7f409d00c740 1 Processor -- start 2024-04-30T23:14:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 -- start start 2024-04-30T23:14:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9408390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff940f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aff936cd80 con 0x55aff903d4d0 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aff9326a20 con 0x55aff90456b0 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f409d00c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55aff9368d40 con 0x55aff9066390 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408cff9640 1 -- 172.21.15.100:0/2239381095 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4084042070 con 0x7f4090102290 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:51966/0 (socket says 172.21.15.100:51966) 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408ffff640 1 -- 172.21.15.100:0/1315544579 learned_addr learned my addr 172.21.15.100:0/1315544579 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408f7fe640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9408390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.891+0000 7f408effd640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff940f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 -- 172.21.15.100:0/1315544579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 msgr2=0x55aff940f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff940f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 -- 172.21.15.100:0/1315544579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 msgr2=0x55aff9408390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9408390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 -- 172.21.15.100:0/1315544579 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff930ae00 con 0x55aff9066390 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408effd640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff940f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408cff9640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 0x7f40780a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408cff9640 1 -- 172.21.15.100:0/2239381095 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f40840f1180 con 0x7f4090102290 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408ffff640 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40880117e0 tx=0x7f4088011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e95f9daf669265 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f4075ffb640 1 -- 172.21.15.100:0/1315544579 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408800fb40 con 0x55aff9066390 2024-04-30T23:14:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f4075ffb640 1 -- 172.21.15.100:0/1315544579 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f408800fce0 con 0x55aff9066390 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f4075ffb640 1 -- 172.21.15.100:0/1315544579 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40880126b0 con 0x55aff9066390 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.892+0000 7f408f7fe640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 0x7f40780a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 -- 172.21.15.100:0/1315544579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 msgr2=0x55aff9407e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f408f7fe640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 0x7f40780a6140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55aff94091f0 tx=0x7f4080005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40880117e0 tx=0x7f4088011ca0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 -- 172.21.15.100:0/1315544579 shutdown_connections 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff940f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9408390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 --2- 172.21.15.100:0/1315544579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff9407e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 -- 172.21.15.100:0/1315544579 >> 172.21.15.100:0/1315544579 conn(0x55aff905a4e0 msgr2=0x55aff94037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 -- 172.21.15.100:0/1315544579 shutdown_connections 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.893+0000 7f409d00c740 1 -- 172.21.15.100:0/1315544579 wait complete. 2024-04-30T23:14:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 -- start start 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 Processor -- start 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 0x55aff9415fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff94164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 0x55aff941d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aff9414090 con 0x55aff9066390 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aff92f3dc0 con 0x55aff903d4d0 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.894+0000 7f409d00c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55aff9414210 con 0x55aff90456b0 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f409d00c740 10 client.0 _ll_register_callbacks cb 0x55aff930f600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 0x55aff9415fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff94164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 0x55aff9415fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:35612/0 (socket says 172.21.15.100:35612) 2024-04-30T23:14:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408f7fe640 1 -- 172.21.15.100:0/4221982274 learned_addr learned my addr 172.21.15.100:0/4221982274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408ffff640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 0x55aff941d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 -- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 msgr2=0x55aff9415fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 0x55aff9415fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 -- 172.21.15.100:0/4221982274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 msgr2=0x55aff941d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 0x55aff941d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408effd640 1 -- 172.21.15.100:0/4221982274 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff9331c30 con 0x55aff90456b0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.895+0000 7f408ffff640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 0x55aff941d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f408effd640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff94164e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f40840ee970 tx=0x7f408402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20ae15d5877f3509 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f406effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084049050 con 0x55aff90456b0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f408800fce0 con 0x55aff90456b0 2024-04-30T23:14:34.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f408403b580 con 0x55aff90456b0 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40840bca60 con 0x55aff90456b0 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f409d00c740 10 client.25474 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aff907e3f0 con 0x55aff90456b0 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.896+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40840bd800 con 0x55aff90456b0 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f40840c1100 con 0x55aff90456b0 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 10 client.25474 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 10 client.25474 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 20 client.25474 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff9024f60 0x55aff9423b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 4 client.25474 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.897+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f408800fce0 con 0x55aff9024f60 2024-04-30T23:14:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.898+0000 7f408f7fe640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff9024f60 0x55aff9423b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.898+0000 7f406effd640 10 client.25474 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.898+0000 7f408f7fe640 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff9024f60 0x55aff9423b80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7fc4b53097cad07 server_cookie=8e298cd95b1860bd in_seq=0 out_seq=0 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f406effd640 1 -- 172.21.15.100:0/4221982274 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7f408800fce0 con 0x55aff9024f60 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f406effd640 10 client.25474 handle_command_reply: tid=0 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 client.25474 shutdown 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 msgr2=0x55aff94164e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff94164e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f40840ee970 tx=0x7f408402a410 comp rx=0 tx=0).stop 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 shutdown_connections 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff9066390 0x55aff941d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff94164e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff9024f60 0x55aff9423b80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 --2- 172.21.15.100:0/4221982274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff903d4d0 0x55aff9415fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f406effd640 0 client.25474 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:34.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 >> 172.21.15.100:0/4221982274 conn(0x55aff905a4e0 msgr2=0x55aff94029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 shutdown_connections 2024-04-30T23:14:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 1 -- 172.21.15.100:0/4221982274 wait complete. 2024-04-30T23:14:34.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.899+0000 7f409d00c740 20 client.25474 trim_cache size 0 max 16384 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 Processor -- start 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 -- start start 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff9403110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 0x55aff9403650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40901aa4b0 con 0x55aff903d4d0 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40901abff0 con 0x55aff9066390 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f409d00c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40901aab80 con 0x55aff90456b0 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58144/0 (socket says 172.21.15.100:58144) 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408f7fe640 1 -- 172.21.15.100:0/339843160 learned_addr learned my addr 172.21.15.100:0/339843160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408effd640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff9403110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408ffff640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 0x55aff9403650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408effd640 1 -- 172.21.15.100:0/339843160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 msgr2=0x55aff9403650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408effd640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 0x55aff9403650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.913+0000 7f408effd640 1 -- 172.21.15.100:0/339843160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 msgr2=0x55aff9414cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f408effd640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f408effd640 1 -- 172.21.15.100:0/339843160 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff91487d0 con 0x55aff90456b0 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f408ffff640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 0x55aff9403650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f408f7fe640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f408effd640 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff9403110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f408403b8d0 tx=0x7f40840095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c88d5f1650c312 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f40757fa640 1 -- 172.21.15.100:0/339843160 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084049070 con 0x55aff90456b0 2024-04-30T23:14:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f40757fa640 1 -- 172.21.15.100:0/339843160 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40840c5d70 con 0x55aff90456b0 2024-04-30T23:14:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.914+0000 7f40757fa640 1 -- 172.21.15.100:0/339843160 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40840c5ae0 con 0x55aff90456b0 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- 172.21.15.100:0/339843160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 msgr2=0x55aff9403110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff9403110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f408403b8d0 tx=0x7f40840095f0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- 172.21.15.100:0/339843160 shutdown_connections 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff9066390 0x55aff9403650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff90456b0 0x55aff9403110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 --2- 172.21.15.100:0/339843160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9414cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- 172.21.15.100:0/339843160 >> 172.21.15.100:0/339843160 conn(0x55aff905a4e0 msgr2=0x55aff94145a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- 172.21.15.100:0/339843160 shutdown_connections 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- 172.21.15.100:0/339843160 wait complete. 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.915+0000 7f409d00c740 1 -- start start 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 Processor -- start 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff94128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff941b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40901ab920 con 0x55aff903d4d0 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40901ab250 con 0x55aff90456b0 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40901a8490 con 0x55aff9066390 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f409d00c740 10 client.0 _ll_register_callbacks cb 0x7f4084005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:34.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58156/0 (socket says 172.21.15.100:58156) 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408f7fe640 1 -- 172.21.15.100:0/1876785388 learned_addr learned my addr 172.21.15.100:0/1876785388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff94128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408ffff640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff941b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 -- 172.21.15.100:0/1876785388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 msgr2=0x55aff941b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff941b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 -- 172.21.15.100:0/1876785388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 msgr2=0x55aff9412370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408effd640 1 -- 172.21.15.100:0/1876785388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff94131a0 con 0x55aff90456b0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.916+0000 7f408f7fe640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f408effd640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff94128b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40840bce00 tx=0x7f40840d1dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88d28527472996e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f406effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:14:34.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084049070 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f408403b580 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40840c5d70 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40840cf050 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f409d00c740 10 client.25475 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aff941c880 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.917+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40840bd800 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f40840b8e50 con 0x55aff90456b0 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 10 client.25475 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 10 client.25475 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 20 client.25475 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff8ffa3a0 0x55aff9490750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 4 client.25475 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:34.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f40840c5d70 con 0x55aff8ffa3a0 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.918+0000 7f408f7fe640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff8ffa3a0 0x55aff9490750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f406effd640 10 client.25475 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f408f7fe640 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff8ffa3a0 0x55aff9490750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aeedb1ec32c3f2d7 server_cookie=a9430c56bcb48f50 in_seq=0 out_seq=0 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f406effd640 1 -- 172.21.15.100:0/1876785388 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f40840c5d70 con 0x55aff8ffa3a0 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f406effd640 10 client.25475 handle_command_reply: tid=0 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 client.25475 shutdown 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 msgr2=0x55aff94128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff94128b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40840bce00 tx=0x7f40840d1dd0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 shutdown_connections 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aff9066390 0x55aff941b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55aff8ffa3a0 0x55aff9490750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aff90456b0 0x55aff94128b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f406effd640 0 client.25475 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 --2- 172.21.15.100:0/1876785388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aff903d4d0 0x55aff9412370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.919+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 >> 172.21.15.100:0/1876785388 conn(0x55aff905a4e0 msgr2=0x55aff9403070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 shutdown_connections 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f409d00c740 1 -- 172.21.15.100:0/1876785388 wait complete. 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f409d00c740 20 client.25475 trim_cache size 0 max 16384 2024-04-30T23:14:34.927 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 msgr2=0x7f40780a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 0x7f40780a6140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55aff94091f0 tx=0x7f4080005f90 comp rx=0 tx=0).stop 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 msgr2=0x7f409019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.920+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 0x7f409019a5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4084009850 tx=0x7f4084003f80 comp rx=0 tx=0).stop 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 shutdown_connections 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f40780a3c30 0x7f40780a6140 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40901050e0 0x7f40901a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4090102290 0x7f409019a5e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 --2- 172.21.15.100:0/2239381095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4090101790 0x7f409019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:34.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 >> 172.21.15.100:0/2239381095 conn(0x7f40900fd390 msgr2=0x7f40900ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:34.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 shutdown_connections 2024-04-30T23:14:34.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:34.921+0000 7f4096155640 1 -- 172.21.15.100:0/2239381095 wait complete. 2024-04-30T23:14:34.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-30T23:14:35.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:34 smithi104 ceph-mon[32987]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:35.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:34 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2594113164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:35.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:34 smithi183 ceph-mon[33560]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:35.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:34 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2594113164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 -- 172.21.15.100:0/494764710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3454101780 msgr2=0x7f3454101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 --2- 172.21.15.100:0/494764710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3454101780 0x7f3454101bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3448009900 tx=0x7f344802a410 comp rx=0 tx=0).stop 2024-04-30T23:14:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 -- 172.21.15.100:0/494764710 shutdown_connections 2024-04-30T23:14:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 --2- 172.21.15.100:0/494764710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 --2- 172.21.15.100:0/494764710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3454101780 0x7f3454101bf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 --2- 172.21.15.100:0/494764710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34541050d0 0x7f34541054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 -- 172.21.15.100:0/494764710 >> 172.21.15.100:0/494764710 conn(0x7f34540fd380 msgr2=0x7f34540ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 -- 172.21.15.100:0/494764710 shutdown_connections 2024-04-30T23:14:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.055+0000 7f345a135640 1 -- 172.21.15.100:0/494764710 wait complete. 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 Processor -- start 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 -- start start 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 0x7f345419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f660 con 0x7f34541050d0 2024-04-30T23:14:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f4e0 con 0x7f3454102280 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f345a135640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f345410f7e0 con 0x7f3454101780 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f3453fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f3453fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58170/0 (socket says 172.21.15.100:58170) 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.056+0000 7f3453fff640 1 -- 172.21.15.100:0/665364053 learned_addr learned my addr 172.21.15.100:0/665364053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f34537fe640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 0x7f345419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3452ffd640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 -- 172.21.15.100:0/665364053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 msgr2=0x7f345419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 0x7f345419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 -- 172.21.15.100:0/665364053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 msgr2=0x7f345419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 -- 172.21.15.100:0/665364053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34541a1de0 con 0x7f34541050d0 2024-04-30T23:14:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f34537fe640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 0x7f345419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3452ffd640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3453fff640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f344c00eb10 tx=0x7f344c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3450ff9640 1 -- 172.21.15.100:0/665364053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c004b20 con 0x7f34541050d0 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34541a20d0 con 0x7f34541050d0 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541a2620 con 0x7f34541050d0 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3450ff9640 1 -- 172.21.15.100:0/665364053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c004cc0 con 0x7f34541050d0 2024-04-30T23:14:35.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.057+0000 7f3450ff9640 1 -- 172.21.15.100:0/665364053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c010670 con 0x7f34541050d0 2024-04-30T23:14:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.060+0000 7f3460fe0740 1 Processor -- start 2024-04-30T23:14:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3450ff9640 1 -- 172.21.15.100:0/665364053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f344c0108f0 con 0x7f34541050d0 2024-04-30T23:14:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 -- start start 2024-04-30T23:14:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a41014390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c516b0 0x560a4101b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560a40f78d80 con 0x560a40c72390 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560a40f32a20 con 0x560a40c494d0 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.061+0000 7f3460fe0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560a40f74d40 con 0x560a40c516b0 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58178/0 (socket says 172.21.15.100:58178) 2024-04-30T23:14:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 -- 172.21.15.100:0/2554746602 learned_addr learned my addr 172.21.15.100:0/2554746602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f34537fe640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a41014390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c516b0 0x560a4101b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3450ff9640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 0x7f343c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 -- 172.21.15.100:0/2554746602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c516b0 msgr2=0x560a4101b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c516b0 0x560a4101b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 -- 172.21.15.100:0/2554746602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 msgr2=0x560a41014390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a41014390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 -- 172.21.15.100:0/2554746602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a40f16e00 con 0x560a40c72390 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f34537fe640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a41014390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3450ff9640 1 -- 172.21.15.100:0/665364053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344c0d0c80 con 0x7f34541050d0 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3452ffd640 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3448032fd0 tx=0x7f3448009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5b37961dd12b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.062+0000 7f3453fff640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 0x7f343c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.063+0000 7f3439ffb640 1 -- 172.21.15.100:0/2554746602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448035030 con 0x560a40c72390 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.063+0000 7f3439ffb640 1 -- 172.21.15.100:0/2554746602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34480035f0 con 0x560a40c72390 2024-04-30T23:14:35.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.063+0000 7f3439ffb640 1 -- 172.21.15.100:0/2554746602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344803c680 con 0x560a40c72390 2024-04-30T23:14:35.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 -- 172.21.15.100:0/2554746602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 msgr2=0x560a41013e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3453fff640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 0x7f343c0a6140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f344c09c900 tx=0x7f344c00cf70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3448032fd0 tx=0x7f3448009560 comp rx=0 tx=0).stop 2024-04-30T23:14:35.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 -- 172.21.15.100:0/2554746602 shutdown_connections 2024-04-30T23:14:35.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c516b0 0x560a4101b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a41014390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 --2- 172.21.15.100:0/2554746602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c72390 0x560a41013e10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 -- 172.21.15.100:0/2554746602 >> 172.21.15.100:0/2554746602 conn(0x560a40c664e0 msgr2=0x560a4100f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 -- 172.21.15.100:0/2554746602 shutdown_connections 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.064+0000 7f3460fe0740 1 -- 172.21.15.100:0/2554746602 wait complete. 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 -- start start 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 Processor -- start 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a4101db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 0x560a41024ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560a4101bc80 con 0x560a40c516b0 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560a40effdc0 con 0x560a40c494d0 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a4101db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58186/0 (socket says 172.21.15.100:58186) 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 -- 172.21.15.100:0/1663919938 learned_addr learned my addr 172.21.15.100:0/1663919938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.065+0000 7f3460fe0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560a4101be00 con 0x560a40c72390 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 -- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 msgr2=0x560a41024ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f3452ffd640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 0x560a41024ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 0x560a41024ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 -- 172.21.15.100:0/1663919938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 msgr2=0x560a4101db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a4101db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 -- 172.21.15.100:0/1663919938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a40f3dc30 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f3452ffd640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 0x560a41024ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f34537fe640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3444012960 tx=0x7f3444012e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed926204147c26fb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.066+0000 7f3432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3432ffd640 1 -- 172.21.15.100:0/1663919938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344400f9e0 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3432ffd640 1 -- 172.21.15.100:0/1663919938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344400fb80 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 10 client.0 _ll_register_callbacks cb 0x560a40f1b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34480035f0 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3432ffd640 1 -- 172.21.15.100:0/1663919938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3444025050 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560a40c8a3f0 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3432ffd640 1 -- 172.21.15.100:0/1663919938 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3444004030 con 0x560a40c516b0 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 10 client.15960 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:14:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 20 client.15960 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c30f60 0x560a4102b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 4 client.15960 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.067+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f34480035f0 con 0x560a40c30f60 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.068+0000 7f3452ffd640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c30f60 0x560a4102b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.068+0000 7f3432ffd640 10 client.15960 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:35.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.068+0000 7f3452ffd640 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c30f60 0x560a4102b620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=874a8918bfb580e6 server_cookie=b6e085974145ed12 in_seq=0 out_seq=0 2024-04-30T23:14:35.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.069+0000 7f3432ffd640 1 -- 172.21.15.100:0/1663919938 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7f34480035f0 con 0x560a40c30f60 2024-04-30T23:14:35.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.069+0000 7f3432ffd640 10 client.15960 handle_command_reply: tid=0 2024-04-30T23:14:35.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.069+0000 7f3460fe0740 1 client.15960 shutdown 2024-04-30T23:14:35.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.069+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 msgr2=0x560a4101e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.069+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3444012960 tx=0x7f3444012e20 comp rx=0 tx=0).stop 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 shutdown_connections 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c30f60 0x560a4102b620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c72390 0x560a41024ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3432ffd640 0 client.15960 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101e090 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 --2- 172.21.15.100:0/1663919938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c494d0 0x560a4101db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 >> 172.21.15.100:0/1663919938 conn(0x560a40c664e0 msgr2=0x560a4100e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 shutdown_connections 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 1 -- 172.21.15.100:0/1663919938 wait complete. 2024-04-30T23:14:35.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.070+0000 7f3460fe0740 20 client.15960 trim_cache size 0 max 16384 2024-04-30T23:14:35.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:34 smithi100 ceph-mon[29745]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:35.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:34 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2594113164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:14:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 Processor -- start 2024-04-30T23:14:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 -- start start 2024-04-30T23:14:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c30f60 0x560a4100f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a41024f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aa620 con 0x560a40c516b0 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ac160 con 0x560a40c30f60 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3460fe0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aacf0 con 0x560a40c494d0 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58200/0 (socket says 172.21.15.100:58200) 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.096+0000 7f3452ffd640 1 -- 172.21.15.100:0/126232985 learned_addr learned my addr 172.21.15.100:0/126232985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c30f60 0x560a4100f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f34537fe640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a41024f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 -- 172.21.15.100:0/126232985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 msgr2=0x560a41024f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a41024f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 -- 172.21.15.100:0/126232985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c30f60 msgr2=0x560a4100f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c30f60 0x560a4100f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 -- 172.21.15.100:0/126232985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a40d547d0 con 0x560a40c516b0 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f34537fe640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a41024f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f3452ffd640 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3448006010 tx=0x7f3448050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12923e7e3441a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f34397fa640 1 -- 172.21.15.100:0/126232985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448035040 con 0x560a40c516b0 2024-04-30T23:14:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f34397fa640 1 -- 172.21.15.100:0/126232985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3448003820 con 0x560a40c516b0 2024-04-30T23:14:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.097+0000 7f34397fa640 1 -- 172.21.15.100:0/126232985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344804ec10 con 0x560a40c516b0 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 -- 172.21.15.100:0/126232985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 msgr2=0x560a4101c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3448006010 tx=0x7f3448050040 comp rx=0 tx=0).stop 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 -- 172.21.15.100:0/126232985 shutdown_connections 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c516b0 0x560a4101c1d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a41024f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 --2- 172.21.15.100:0/126232985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c30f60 0x560a4100f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 -- 172.21.15.100:0/126232985 >> 172.21.15.100:0/126232985 conn(0x560a40c664e0 msgr2=0x560a4100f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 -- 172.21.15.100:0/126232985 shutdown_connections 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.098+0000 7f3460fe0740 1 -- 172.21.15.100:0/126232985 wait complete. 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 -- start start 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 Processor -- start 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a410230a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c516b0 0x560a41023fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aba90 con 0x560a40c30f60 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ab3c0 con 0x560a40c516b0 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34541a8600 con 0x560a40c494d0 2024-04-30T23:14:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3460fe0740 10 client.0 _ll_register_callbacks cb 0x7f3444009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3452ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58208/0 (socket says 172.21.15.100:58208) 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.099+0000 7f3452ffd640 1 -- 172.21.15.100:0/3798756559 learned_addr learned my addr 172.21.15.100:0/3798756559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a410230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 -- 172.21.15.100:0/3798756559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c516b0 msgr2=0x560a41023fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c516b0 0x560a41023fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 -- 172.21.15.100:0/3798756559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 msgr2=0x560a41022b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 -- 172.21.15.100:0/3798756559 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a41024590 con 0x560a40c494d0 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f3452ffd640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f34537fe640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a410230a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x560a41009e70 tx=0x7f34440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88cfc026db639681 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f3432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.100+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344402f070 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344401c870 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3448003820 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f344403b050 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 10 client.25495 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a4109a350 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3448003820 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3444010880 con 0x560a40c494d0 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 10 client.25495 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 10 client.25495 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 20 client.25495 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c72390 0x560a4109cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 4 client.25495 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.101+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a40f72810 con 0x560a40c72390 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3452ffd640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c72390 0x560a4109cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3432ffd640 10 client.25495 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3452ffd640 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c72390 0x560a4109cd70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8667ffa2121acc9 server_cookie=3a6d0af630220dfc in_seq=0 out_seq=0 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3432ffd640 1 -- 172.21.15.100:0/3798756559 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a40f72810 con 0x560a40c72390 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3432ffd640 10 client.25495 handle_command_reply: tid=0 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3460fe0740 1 client.25495 shutdown 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 msgr2=0x560a410230a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a410230a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x560a41009e70 tx=0x7f34440046c0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 shutdown_connections 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.102+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x560a40c72390 0x560a4109cd70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560a40c516b0 0x560a41023fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3432ffd640 0 client.25495 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560a40c494d0 0x560a410230a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 --2- 172.21.15.100:0/3798756559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560a40c30f60 0x560a41022b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 >> 172.21.15.100:0/3798756559 conn(0x560a40c664e0 msgr2=0x560a4101c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 shutdown_connections 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 1 -- 172.21.15.100:0/3798756559 wait complete. 2024-04-30T23:14:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f3460fe0740 20 client.25495 trim_cache size 0 max 16384 2024-04-30T23:14:35.111 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 msgr2=0x7f343c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 0x7f343c0a6140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f344c09c900 tx=0x7f344c00cf70 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 msgr2=0x7f34541a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f344c00eb10 tx=0x7f344c00c2d0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 shutdown_connections 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f343c0a3c30 0x7f343c0a6140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34541050d0 0x7f34541a1770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3454102280 0x7f345419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 --2- 172.21.15.100:0/665364053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3454101780 0x7f345419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.103+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 >> 172.21.15.100:0/665364053 conn(0x7f34540fd380 msgr2=0x7f3454105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.104+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 shutdown_connections 2024-04-30T23:14:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.104+0000 7f345a135640 1 -- 172.21.15.100:0/665364053 wait complete. 2024-04-30T23:14:35.115 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 -- 172.21.15.100:0/1456859794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c1097c0 msgr2=0x7fd61c10bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 --2- 172.21.15.100:0/1456859794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c1097c0 0x7fd61c10bcd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd614009ca0 tx=0x7fd61402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 -- 172.21.15.100:0/1456859794 shutdown_connections 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 --2- 172.21.15.100:0/1456859794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c1097c0 0x7fd61c10bcd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 --2- 172.21.15.100:0/1456859794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c106c50 0x7fd61c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 --2- 172.21.15.100:0/1456859794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c101e70 0x7fd61c102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.227+0000 7fd6231ea640 1 -- 172.21.15.100:0/1456859794 >> 172.21.15.100:0/1456859794 conn(0x7fd61c0fd380 msgr2=0x7fd61c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 -- 172.21.15.100:0/1456859794 shutdown_connections 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 -- 172.21.15.100:0/1456859794 wait complete. 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 Processor -- start 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 -- start start 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c101e70 0x7fd61c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.228+0000 7fd6231ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd6231ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c1097c0 0x7fd61c1a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd6231ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c111880 con 0x7fd61c106c50 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd6231ea640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c111700 con 0x7fd61c101e70 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd6231ea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c111a00 con 0x7fd61c1097c0 2024-04-30T23:14:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58226/0 (socket says 172.21.15.100:58226) 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 -- 172.21.15.100:0/3327823381 learned_addr learned my addr 172.21.15.100:0/3327823381 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd621787640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c1097c0 0x7fd61c1a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd620f86640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c101e70 0x7fd61c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 -- 172.21.15.100:0/3327823381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c1097c0 msgr2=0x7fd61c1a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c1097c0 0x7fd61c1a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 -- 172.21.15.100:0/3327823381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c101e70 msgr2=0x7fd61c19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c101e70 0x7fd61c19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 -- 172.21.15.100:0/3327823381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c1a3f00 con 0x7fd61c106c50 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd60800d950 tx=0x7fd60800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.229+0000 7fd619ffb640 1 -- 172.21.15.100:0/3327823381 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608017070 con 0x7fd61c106c50 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.230+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c1a41f0 con 0x7fd61c106c50 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.230+0000 7fd619ffb640 1 -- 172.21.15.100:0/3327823381 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd608009c30 con 0x7fd61c106c50 2024-04-30T23:14:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.230+0000 7fd619ffb640 1 -- 172.21.15.100:0/3327823381 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60800f620 con 0x7fd61c106c50 2024-04-30T23:14:35.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.230+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c1a4790 con 0x7fd61c106c50 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 Processor -- start 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 -- start start 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecef66b0 0x55f6ed2c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed21dd80 con 0x55f6ecf17390 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed1d7a20 con 0x55f6ecef66b0 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd62a178740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed219d40 con 0x55f6eceee4d0 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58238/0 (socket says 172.21.15.100:58238) 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 -- 172.21.15.100:0/2242943965 learned_addr learned my addr 172.21.15.100:0/2242943965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd620f86640 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 -- 172.21.15.100:0/2242943965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 msgr2=0x55f6ed2c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 -- 172.21.15.100:0/2242943965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecef66b0 msgr2=0x55f6ed2c8aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecef66b0 0x55f6ed2c8aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.233+0000 7fd621787640 1 -- 172.21.15.100:0/2242943965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ed1bbe00 con 0x55f6ecf17390 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd619ffb640 1 -- 172.21.15.100:0/3327823381 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd608010460 con 0x7fd61c106c50 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd621787640 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd61402f390 tx=0x7fd61402f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e56fea4a98b2dd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd606ffd640 1 -- 172.21.15.100:0/2242943965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614031650 con 0x55f6ecf17390 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd606ffd640 1 -- 172.21.15.100:0/2242943965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd614036040 con 0x55f6ecf17390 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd606ffd640 1 -- 172.21.15.100:0/2242943965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140046e0 con 0x55f6ecf17390 2024-04-30T23:14:35.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.234+0000 7fd619ffb640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 0x7fd60c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd620f86640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 0x7fd60c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd619ffb640 1 -- 172.21.15.100:0/3327823381 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd6080d0350 con 0x7fd61c106c50 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 -- 172.21.15.100:0/2242943965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 msgr2=0x55f6ed2c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd61402f390 tx=0x7fd61402f3c0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd620f86640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 0x7fd60c0a6140 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55f6ed2c2a00 tx=0x7fd610005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 -- 172.21.15.100:0/2242943965 shutdown_connections 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecef66b0 0x55f6ed2c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 --2- 172.21.15.100:0/2242943965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecf17390 0x55f6ed2c1620 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 -- 172.21.15.100:0/2242943965 >> 172.21.15.100:0/2242943965 conn(0x55f6ecf0b4e0 msgr2=0x55f6ed2bcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 -- 172.21.15.100:0/2242943965 shutdown_connections 2024-04-30T23:14:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.235+0000 7fd62a178740 1 -- 172.21.15.100:0/2242943965 wait complete. 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 -- start start 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 Processor -- start 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed2c9490 con 0x55f6ecef66b0 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed1a4dc0 con 0x55f6ecf17390 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f6ed2c9610 con 0x55f6eceee4d0 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.236+0000 7fd62a178740 10 client.0 _ll_register_callbacks cb 0x55f6ed1c0600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:35.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58252/0 (socket says 172.21.15.100:58252) 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 -- 172.21.15.100:0/3829343695 learned_addr learned my addr 172.21.15.100:0/3829343695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd620f86640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd621787640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 -- 172.21.15.100:0/3829343695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 msgr2=0x55f6ed2cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 -- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 msgr2=0x55f6ed2d28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 -- 172.21.15.100:0/3829343695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ed1e2c30 con 0x55f6ecef66b0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd61bfff640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6080a49b0 tx=0x7fd60809ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef09c54d1908736 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd5fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608020040 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd6080a0120 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.237+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd614036040 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6080a0620 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 10 client.15978 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f6ecf2f3f0 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd614036040 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6080980e0 con 0x55f6ecef66b0 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 20 client.15978 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6eced5f60 0x55f6ed2d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 4 client.15978 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.238+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6ed217810 con 0x55f6eced5f60 2024-04-30T23:14:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.239+0000 7fd620f86640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6eced5f60 0x55f6ed2d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.239+0000 7fd5fbfff640 10 client.15978 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.239+0000 7fd620f86640 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6eced5f60 0x55f6ed2d9140 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21e5aeb85509510 server_cookie=4034156b36053a62 in_seq=0 out_seq=0 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd5fbfff640 1 -- 172.21.15.100:0/3829343695 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55f6ed217810 con 0x55f6eced5f60 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd5fbfff640 10 client.15978 handle_command_reply: tid=0 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 client.15978 shutdown 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 msgr2=0x55f6ed2cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6080a49b0 tx=0x7fd60809ca30 comp rx=0 tx=0).stop 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 shutdown_connections 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6eced5f60 0x55f6ed2d9140 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ecef66b0 0x55f6ed2cb980 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 --2- 172.21.15.100:0/3829343695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceee4d0 0x55f6ed2cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 >> 172.21.15.100:0/3829343695 conn(0x55f6ecf0b4e0 msgr2=0x55f6ed2bfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd5fbfff640 0 client.15978 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 shutdown_connections 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.240+0000 7fd62a178740 1 -- 172.21.15.100:0/3829343695 wait complete. 2024-04-30T23:14:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.241+0000 7fd62a178740 20 client.15978 trim_cache size 0 max 16384 2024-04-30T23:14:35.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 Processor -- start 2024-04-30T23:14:35.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 -- start start 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 0x55f6ed2c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1aa710 con 0x55f6eceee4d0 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1ac250 con 0x55f6eceab3a0 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd62a178740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1aade0 con 0x55f6ecf17390 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58266/0 (socket says 172.21.15.100:58266) 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 -- 172.21.15.100:0/2934126013 learned_addr learned my addr 172.21.15.100:0/2934126013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd621787640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 0x55f6ed2c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd61bfff640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 -- 172.21.15.100:0/2934126013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 msgr2=0x55f6ed2d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 -- 172.21.15.100:0/2934126013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 msgr2=0x55f6ed2c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 0x55f6ed2c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd620f86640 1 -- 172.21.15.100:0/2934126013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ecff97d0 con 0x55f6eceee4d0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd61bfff640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.267+0000 7fd621787640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 0x55f6ed2c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.268+0000 7fd620f86640 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55f6ed2bdd40 tx=0x7fd61001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d1e16be1072c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.268+0000 7fd6067fc640 1 -- 172.21.15.100:0/2934126013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610030070 con 0x55f6eceee4d0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.268+0000 7fd6067fc640 1 -- 172.21.15.100:0/2934126013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd610003d00 con 0x55f6eceee4d0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.268+0000 7fd6067fc640 1 -- 172.21.15.100:0/2934126013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61001fa70 con 0x55f6eceee4d0 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- 172.21.15.100:0/2934126013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 msgr2=0x55f6ed2c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55f6ed2bdd40 tx=0x7fd61001b000 comp rx=0 tx=0).stop 2024-04-30T23:14:35.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- 172.21.15.100:0/2934126013 shutdown_connections 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6eceab3a0 0x55f6ed2c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6ecf17390 0x55f6ed2d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 --2- 172.21.15.100:0/2934126013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6eceee4d0 0x55f6ed2c99e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- 172.21.15.100:0/2934126013 >> 172.21.15.100:0/2934126013 conn(0x55f6ecf0b4e0 msgr2=0x55f6ed2c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- 172.21.15.100:0/2934126013 shutdown_connections 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- 172.21.15.100:0/2934126013 wait complete. 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 -- start start 2024-04-30T23:14:35.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.269+0000 7fd62a178740 1 Processor -- start 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceab3a0 0x55f6ed2cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1abb80 con 0x55f6ed2d1390 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1ab4b0 con 0x55f6ecf17390 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1a86f0 con 0x55f6eceab3a0 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd62a178740 10 client.0 _ll_register_callbacks cb 0x7fd60800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58276/0 (socket says 172.21.15.100:58276) 2024-04-30T23:14:35.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 -- 172.21.15.100:0/2414750877 learned_addr learned my addr 172.21.15.100:0/2414750877 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd620f86640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceab3a0 0x55f6ed2cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd61bfff640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 -- 172.21.15.100:0/2414750877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceab3a0 msgr2=0x55f6ed2cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceab3a0 0x55f6ed2cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 -- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 msgr2=0x55f6ed2d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 -- 172.21.15.100:0/2414750877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ed2d1d60 con 0x55f6ed2d1390 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd621787640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd61402f430 tx=0x7fd6140314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d05b44f8ef58fb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.270+0000 7fd5fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61404a040 con 0x55f6ed2d1390 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd614003970 con 0x55f6ed2d1390 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd610003d00 con 0x55f6ed2d1390 2024-04-30T23:14:35.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd614003b70 con 0x55f6ed2d1390 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 10 client.15984 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f6ed33f400 con 0x55f6ed2d1390 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd614036040 con 0x55f6ed2d1390 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd61404d070 con 0x55f6ed2d1390 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 10 client.15984 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 20 client.15984 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6ed33f9c0 0x55f6ed341de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 4 client.15984 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.271+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd610003d00 con 0x55f6ed33f9c0 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.272+0000 7fd620f86640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6ed33f9c0 0x55f6ed341de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.272+0000 7fd5fbfff640 10 client.15984 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd620f86640 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6ed33f9c0 0x55f6ed341de0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7bcde3922532751 server_cookie=c5d567b1e3c32939 in_seq=0 out_seq=0 2024-04-30T23:14:35.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd5fbfff640 1 -- 172.21.15.100:0/2414750877 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd610003d00 con 0x55f6ed33f9c0 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd5fbfff640 10 client.15984 handle_command_reply: tid=0 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd62a178740 1 client.15984 shutdown 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 msgr2=0x55f6ed2d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd61402f430 tx=0x7fd6140314e0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 shutdown_connections 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.273+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f6ed33f9c0 0x55f6ed341de0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6ed2d1390 0x55f6ed2d17a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd5fbfff640 0 client.15984 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f6ecf17390 0x55f6ed2d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 --2- 172.21.15.100:0/2414750877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f6eceab3a0 0x55f6ed2cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 >> 172.21.15.100:0/2414750877 conn(0x55f6ecf0b4e0 msgr2=0x55f6ed2c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 shutdown_connections 2024-04-30T23:14:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 1 -- 172.21.15.100:0/2414750877 wait complete. 2024-04-30T23:14:35.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.274+0000 7fd62a178740 20 client.15984 trim_cache size 0 max 16384 2024-04-30T23:14:35.280 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 msgr2=0x7fd60c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 0x7fd60c0a6140 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55f6ed2c2a00 tx=0x7fd610005f90 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 msgr2=0x7fd61c19c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd60800d950 tx=0x7fd60800de10 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 shutdown_connections 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd60c0a3c30 0x7fd60c0a6140 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61c1097c0 0x7fd61c1a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61c106c50 0x7fd61c19c900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 --2- 172.21.15.100:0/3327823381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61c101e70 0x7fd61c19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 >> 172.21.15.100:0/3327823381 conn(0x7fd61c0fd380 msgr2=0x7fd61c1077e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 shutdown_connections 2024-04-30T23:14:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:35.275+0000 7fd6231ea640 1 -- 172.21.15.100:0/3327823381 wait complete. 2024-04-30T23:14:36.293 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:14:36.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:14:36.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:14:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 -- 172.21.15.100:0/1835274859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270108960 msgr2=0x7fb27010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 --2- 172.21.15.100:0/1835274859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270108960 0x7fb27010ad80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb268009ca0 tx=0x7fb26802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 -- 172.21.15.100:0/1835274859 shutdown_connections 2024-04-30T23:14:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 --2- 172.21.15.100:0/1835274859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270108960 0x7fb27010ad80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 --2- 172.21.15.100:0/1835274859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270103c60 0x7fb270104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 --2- 172.21.15.100:0/1835274859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb270103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 -- 172.21.15.100:0/1835274859 >> 172.21.15.100:0/1835274859 conn(0x7fb2700fdc10 msgr2=0x7fb2701000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 -- 172.21.15.100:0/1835274859 shutdown_connections 2024-04-30T23:14:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.470+0000 7fb275ac4640 1 -- 172.21.15.100:0/1835274859 wait complete. 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.471+0000 7fb275ac4640 1 Processor -- start 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 -- start start 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb2701982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 0x7fb27019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb27010d480 con 0x7fb270103c60 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb27010d300 con 0x7fb270108960 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb275ac4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb27010d600 con 0x7fb270102a20 2024-04-30T23:14:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb26effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb26effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58298/0 (socket says 172.21.15.100:58298) 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb26f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb2701982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb26effd640 1 -- 172.21.15.100:0/3566967727 learned_addr learned my addr 172.21.15.100:0/3566967727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.472+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 0x7fb27019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 -- 172.21.15.100:0/3566967727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 msgr2=0x7fb2701982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb2701982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 -- 172.21.15.100:0/3566967727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 msgr2=0x7fb27019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 0x7fb27019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 -- 172.21.15.100:0/3566967727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27019fe30 con 0x7fb270103c60 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb2701982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 0x7fb27019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26effd640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb264009be0 tx=0x7fb2640071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26cff9640 1 -- 172.21.15.100:0/3566967727 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264007e00 con 0x7fb270103c60 2024-04-30T23:14:36.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb26cff9640 1 -- 172.21.15.100:0/3566967727 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb26401e070 con 0x7fb270103c60 2024-04-30T23:14:36.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2701a0120 con 0x7fb270103c60 2024-04-30T23:14:36.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.473+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2701a06c0 con 0x7fb270103c60 2024-04-30T23:14:36.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.475+0000 7fb26cff9640 1 -- 172.21.15.100:0/3566967727 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264018730 con 0x7fb270103c60 2024-04-30T23:14:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 Processor -- start 2024-04-30T23:14:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 -- start start 2024-04-30T23:14:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddd5410 0x55fe4e176c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e17e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e0dbb00 con 0x55fe4ddac550 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e077920 con 0x55fe4ddb4730 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb27c97d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e0d7ac0 con 0x55fe4ddd5410 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb26f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb26f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58308/0 (socket says 172.21.15.100:58308) 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb26f7fe640 1 -- 172.21.15.100:0/315223806 learned_addr learned my addr 172.21.15.100:0/315223806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.477+0000 7fb26ffff640 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddd5410 0x55fe4e176c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 -- 172.21.15.100:0/315223806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddd5410 msgr2=0x55fe4e176c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddd5410 0x55fe4e176c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 -- 172.21.15.100:0/315223806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 msgr2=0x55fe4e17e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-30T23:14:36.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e17e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26cff9640 1 -- 172.21.15.100:0/3566967727 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fb2640193f0 con 0x7fb270103c60 2024-04-30T23:14:36.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 -- 172.21.15.100:0/315223806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4deb57e0 con 0x55fe4ddac550 2024-04-30T23:14:36.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb26000a380 tx=0x7fb26000b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3b1485909811e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb255ffb640 1 -- 172.21.15.100:0/315223806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260019030 con 0x55fe4ddac550 2024-04-30T23:14:36.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb255ffb640 1 -- 172.21.15.100:0/315223806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2600054d0 con 0x55fe4ddac550 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.478+0000 7fb255ffb640 1 -- 172.21.15.100:0/315223806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260015930 con 0x55fe4ddac550 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.479+0000 7fb26cff9640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 0x7fb2580a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.479+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 0x7fb2580a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- 172.21.15.100:0/315223806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 msgr2=0x55fe4e177210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb26000a380 tx=0x7fb26000b470 comp rx=0 tx=0).stop 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb26cff9640 1 -- 172.21.15.100:0/3566967727 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb2640d4110 con 0x7fb270103c60 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 0x7fb2580a6140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb268031a90 tx=0x7fb268031a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- 172.21.15.100:0/315223806 shutdown_connections 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e17e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddac550 0x55fe4e177210 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 --2- 172.21.15.100:0/315223806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddd5410 0x55fe4e176c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- 172.21.15.100:0/315223806 >> 172.21.15.100:0/315223806 conn(0x55fe4ddc9560 msgr2=0x55fe4e172620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- 172.21.15.100:0/315223806 shutdown_connections 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- 172.21.15.100:0/315223806 wait complete. 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.480+0000 7fb27c97d740 1 -- start start 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 Processor -- start 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddac550 0x55fe4e180780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddb4730 0x55fe4e180cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e17eb60 con 0x55fe4ddd5410 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e0755d0 con 0x55fe4ddac550 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb27c97d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fe4e17ece0 con 0x55fe4ddb4730 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58324/0 (socket says 172.21.15.100:58324) 2024-04-30T23:14:36.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.481+0000 7fb26ffff640 1 -- 172.21.15.100:0/3930814733 learned_addr learned my addr 172.21.15.100:0/3930814733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddac550 0x55fe4e180780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26effd640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddb4730 0x55fe4e180cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb27c97d740 10 client.0 _ll_register_callbacks cb 0x55fe4e084a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 -- 172.21.15.100:0/3930814733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddb4730 msgr2=0x55fe4e180cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddb4730 0x55fe4e180cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 -- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddac550 msgr2=0x55fe4e180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddac550 0x55fe4e180780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 -- 172.21.15.100:0/3930814733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4df15f70 con 0x55fe4ddd5410 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb26ffff640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb268035000 tx=0x7fb26802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6674e81170c832c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb24effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268004250 con 0x55fe4ddd5410 2024-04-30T23:14:36.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb2680043f0 con 0x55fe4ddd5410 2024-04-30T23:14:36.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.482+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2600054d0 con 0x55fe4ddd5410 2024-04-30T23:14:36.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.483+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2680045f0 con 0x55fe4ddd5410 2024-04-30T23:14:36.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.483+0000 7fb27c97d740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:36.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.483+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe4ddad170 con 0x55fe4ddd5410 2024-04-30T23:14:36.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.483+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268036040 con 0x55fe4ddd5410 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb268051070 con 0x55fe4ddd5410 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 20 client.15996 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd941f0 0x55fe4e18e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 4 client.15996 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.484+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb2600054d0 con 0x55fe4dd941f0 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.485+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd941f0 0x55fe4e18e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.485+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd941f0 0x55fe4e18e3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b2bd87e8ab2d6c server_cookie=3c84f7bb89355013 in_seq=0 out_seq=0 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.485+0000 7fb24effd640 10 client.15996 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb24effd640 1 -- 172.21.15.100:0/3930814733 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7fb2600054d0 con 0x55fe4dd941f0 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb24effd640 10 client.15996 handle_command_reply: tid=0 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb27c97d740 1 client.15996 shutdown 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 msgr2=0x55fe4e187c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb268035000 tx=0x7fb26802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 shutdown_connections 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.486+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd941f0 0x55fe4e18e3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e187c20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddb4730 0x55fe4e180cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 --2- 172.21.15.100:0/3930814733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddac550 0x55fe4e180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 >> 172.21.15.100:0/3930814733 conn(0x55fe4ddc9560 msgr2=0x55fe4e175530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb24effd640 0 client.15996 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 shutdown_connections 2024-04-30T23:14:36.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 1 -- 172.21.15.100:0/3930814733 wait complete. 2024-04-30T23:14:36.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.487+0000 7fb27c97d740 20 client.15996 trim_cache size 0 max 16384 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 Processor -- start 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 -- start start 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e171cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e187b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c00fad0 con 0x55fe4ddd5410 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c011610 con 0x55fe4ddb4730 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.522+0000 7fb27c97d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0101a0 con 0x55fe4ddac550 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58328/0 (socket says 172.21.15.100:58328) 2024-04-30T23:14:36.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 -- 172.21.15.100:0/923726188 learned_addr learned my addr 172.21.15.100:0/923726188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26effd640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e187b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e171cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 -- 172.21.15.100:0/923726188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 msgr2=0x55fe4e171cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e171cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 -- 172.21.15.100:0/923726188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 msgr2=0x55fe4e187b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e187b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 -- 172.21.15.100:0/923726188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4e17a650 con 0x55fe4ddd5410 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26effd640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e187b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb26ffff640 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2680305e0 tx=0x7fb2680094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d974bde59cc21c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.523+0000 7fb2557fa640 1 -- 172.21.15.100:0/923726188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268004250 con 0x55fe4ddd5410 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.524+0000 7fb2557fa640 1 -- 172.21.15.100:0/923726188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2680043f0 con 0x55fe4ddd5410 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.524+0000 7fb2557fa640 1 -- 172.21.15.100:0/923726188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268061440 con 0x55fe4ddd5410 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- 172.21.15.100:0/923726188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 msgr2=0x55fe4e172200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2680305e0 tx=0x7fb2680094a0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- 172.21.15.100:0/923726188 shutdown_connections 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e172200 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e187b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 --2- 172.21.15.100:0/923726188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e171cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- 172.21.15.100:0/923726188 >> 172.21.15.100:0/923726188 conn(0x55fe4ddc9560 msgr2=0x55fe4e17ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- 172.21.15.100:0/923726188 shutdown_connections 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- 172.21.15.100:0/923726188 wait complete. 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.525+0000 7fb27c97d740 1 -- start start 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 Processor -- start 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e185220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e186690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c010f40 con 0x55fe4ddd5410 2024-04-30T23:14:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c010870 con 0x55fe4ddb4730 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb27c97d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c00dab0 con 0x55fe4ddac550 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb26effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb26effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:35776/0 (socket says 172.21.15.100:35776) 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb26effd640 1 -- 172.21.15.100:0/698480504 learned_addr learned my addr 172.21.15.100:0/698480504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e185220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.526+0000 7fb26ffff640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e186690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb27c97d740 10 client.0 _ll_register_callbacks cb 0x7fb268009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 -- 172.21.15.100:0/698480504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 msgr2=0x55fe4e185220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e185220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 -- 172.21.15.100:0/698480504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 msgr2=0x55fe4e186690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e186690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 -- 172.21.15.100:0/698480504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4e186c50 con 0x55fe4ddb4730 2024-04-30T23:14:36.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb26effd640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb264000c00 tx=0x7fb2640a08d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b94ef248f6e222d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb24effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2640a40d0 con 0x55fe4ddb4730 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb2640b4b30 con 0x55fe4ddb4730 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.527+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2680043f0 con 0x55fe4ddb4730 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.528+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2640b4d30 con 0x55fe4ddb4730 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.528+0000 7fb27c97d740 10 client.25520 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.528+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe4e1f4640 con 0x55fe4ddb4730 2024-04-30T23:14:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.528+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2680043f0 con 0x55fe4ddb4730 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.529+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb2640b9260 con 0x55fe4ddb4730 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.529+0000 7fb27c97d740 10 client.25520 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.529+0000 7fb27c97d740 10 client.25520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.529+0000 7fb27c97d740 20 client.25520 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.529+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd69630 0x55fe4e1f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.530+0000 7fb27c97d740 4 client.25520 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.530+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fe4e18e990 con 0x55fe4dd69630 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.530+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd69630 0x55fe4e1f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.530+0000 7fb24effd640 10 client.25520 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.530+0000 7fb26f7fe640 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd69630 0x55fe4e1f6e70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74702d308f8ea133 server_cookie=18a2b668e260d046 in_seq=0 out_seq=0 2024-04-30T23:14:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.533+0000 7fb24effd640 1 -- 172.21.15.100:0/698480504 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fe4e18e990 con 0x55fe4dd69630 2024-04-30T23:14:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.533+0000 7fb24effd640 10 client.25520 handle_command_reply: tid=0 2024-04-30T23:14:36.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.533+0000 7fb27c97d740 1 client.25520 shutdown 2024-04-30T23:14:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 msgr2=0x55fe4e185760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb264000c00 tx=0x7fb2640a08d0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 shutdown_connections 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55fe4dd69630 0x55fe4e1f6e70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe4ddd5410 0x55fe4e186690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb24effd640 0 client.25520 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fe4ddb4730 0x55fe4e185760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 --2- 172.21.15.100:0/698480504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fe4ddac550 0x55fe4e185220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.534+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 >> 172.21.15.100:0/698480504 conn(0x55fe4ddc9560 msgr2=0x55fe4e170bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.535+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 shutdown_connections 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.535+0000 7fb27c97d740 1 -- 172.21.15.100:0/698480504 wait complete. 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.535+0000 7fb27c97d740 20 client.25520 trim_cache size 0 max 16384 2024-04-30T23:14:36.537 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:36.538 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:14:36.538 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "d5625cc7-aaf4-4537-be59-f57f7bae4dab", 2024-04-30T23:14:36.538 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:14:36.538 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 msgr2=0x7fb2580a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 0x7fb2580a6140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb268031a90 tx=0x7fb268031a20 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 msgr2=0x7fb270198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb264009be0 tx=0x7fb2640071c0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 shutdown_connections 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb2580a3c30 0x7fb2580a6140 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb270108960 0x7fb27019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb270103c60 0x7fb270198830 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 --2- 172.21.15.100:0/3566967727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb270102a20 0x7fb2701982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 >> 172.21.15.100:0/3566967727 conn(0x7fb2700fdc10 msgr2=0x7fb270104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 shutdown_connections 2024-04-30T23:14:36.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.536+0000 7fb275ac4640 1 -- 172.21.15.100:0/3566967727 wait complete. 2024-04-30T23:14:36.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:14:36.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:14:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 -- 172.21.15.100:0/1045428507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc106f70 msgr2=0x7f86fc109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 --2- 172.21.15.100:0/1045428507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc106f70 0x7f86fc109390 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009900 tx=0x7f86f002a410 comp rx=0 tx=0).stop 2024-04-30T23:14:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 -- 172.21.15.100:0/1045428507 shutdown_connections 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 --2- 172.21.15.100:0/1045428507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc1098d0 0x7f86fc10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 --2- 172.21.15.100:0/1045428507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc106f70 0x7f86fc109390 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 --2- 172.21.15.100:0/1045428507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 -- 172.21.15.100:0/1045428507 >> 172.21.15.100:0/1045428507 conn(0x7f86fc0fdc10 msgr2=0x7f86fc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 -- 172.21.15.100:0/1045428507 shutdown_connections 2024-04-30T23:14:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.669+0000 7f870221e640 1 -- 172.21.15.100:0/1045428507 wait complete. 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.670+0000 7f870221e640 1 Processor -- start 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.670+0000 7f870221e640 1 -- start start 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.670+0000 7f870221e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.670+0000 7f870221e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f870221e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 0x7f86fc1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f870221e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10f630 con 0x7f86fc1098d0 2024-04-30T23:14:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f870221e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10f4b0 con 0x7f86fc104610 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f870221e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10f7b0 con 0x7f86fc106f70 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86faffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86faffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:52182/0 (socket says 172.21.15.100:52182) 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86faffd640 1 -- 172.21.15.100:0/708617250 learned_addr learned my addr 172.21.15.100:0/708617250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 0x7f86fc1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 -- 172.21.15.100:0/708617250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 msgr2=0x7f86fc19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 -- 172.21.15.100:0/708617250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 msgr2=0x7f86fc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 -- 172.21.15.100:0/708617250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc1a20d0 con 0x7f86fc1098d0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86faffd640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.671+0000 7f86fbfff640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 0x7f86fc1a1a60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.672+0000 7f86f8ff9640 1 -- 172.21.15.100:0/708617250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4004d20 con 0x7f86fc1098d0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.672+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc102040 con 0x7f86fc1098d0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.672+0000 7f86f8ff9640 1 -- 172.21.15.100:0/708617250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f4005020 con 0x7f86fc1098d0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.672+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc102590 con 0x7f86fc1098d0 2024-04-30T23:14:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.672+0000 7f86f8ff9640 1 -- 172.21.15.100:0/708617250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40116b0 con 0x7f86fc1098d0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.675+0000 7f86f8ff9640 1 -- 172.21.15.100:0/708617250 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f86f40054d0 con 0x7f86fc1098d0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.675+0000 7f86f8ff9640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 0x7f86e40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 0x7f86e40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86f8ff9640 1 -- 172.21.15.100:0/708617250 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f86f40d0810 con 0x7f86fc1098d0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 Processor -- start 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 -- start start 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba453e390 0x55bba48e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 0x55bba48e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bba47f7b10 con 0x55bba45154d0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bba4844d80 con 0x55bba451d6b0 2024-04-30T23:14:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f87091aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bba47fe8b0 con 0x55bba453e390 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 0x7f86e40a60c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a8f0 tx=0x7f86ec012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58364/0 (socket says 172.21.15.100:58364) 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.676+0000 7f86faffd640 1 -- 172.21.15.100:0/3439597532 learned_addr learned my addr 172.21.15.100:0/3439597532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba453e390 0x55bba48e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86fbfff640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 0x55bba48e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 -- 172.21.15.100:0/3439597532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba453e390 msgr2=0x55bba48e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba453e390 0x55bba48e8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 -- 172.21.15.100:0/3439597532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 msgr2=0x55bba48e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 0x55bba48e9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 -- 172.21.15.100:0/3439597532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba47cfa40 con 0x55bba45154d0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86fbfff640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 0x55bba48e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86faffd640 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000c00 tx=0x7f86f00315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6baaf30d9a14b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86e1ffb640 1 -- 172.21.15.100:0/3439597532 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0035070 con 0x55bba45154d0 2024-04-30T23:14:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.677+0000 7f86e1ffb640 1 -- 172.21.15.100:0/3439597532 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f00035f0 con 0x55bba45154d0 2024-04-30T23:14:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.678+0000 7f86e1ffb640 1 -- 172.21.15.100:0/3439597532 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f003c6a0 con 0x55bba45154d0 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.678+0000 7f87091aa740 1 -- 172.21.15.100:0/3439597532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 msgr2=0x55bba48e9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.678+0000 7f87091aa740 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000c00 tx=0x7f86f00315a0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 -- 172.21.15.100:0/3439597532 shutdown_connections 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba451d6b0 0x55bba48e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba48e9280 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 --2- 172.21.15.100:0/3439597532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba453e390 0x55bba48e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 -- 172.21.15.100:0/3439597532 >> 172.21.15.100:0/3439597532 conn(0x55bba45324e0 msgr2=0x55bba48dbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 -- 172.21.15.100:0/3439597532 shutdown_connections 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 -- 172.21.15.100:0/3439597532 wait complete. 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.679+0000 7f87091aa740 1 -- start start 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 Processor -- start 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba48f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bba47cbd10 con 0x55bba451d6b0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bba4840d40 con 0x55bba453e390 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f87091aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bba48eaa60 con 0x55bba45154d0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f86fbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba48f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58372/0 (socket says 172.21.15.100:58372) 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f86faffd640 1 -- 172.21.15.100:0/2263493469 learned_addr learned my addr 172.21.15.100:0/2263493469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.680+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f87091aa740 10 client.0 _ll_register_callbacks cb 0x55bba4851d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 -- 172.21.15.100:0/2263493469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 msgr2=0x55bba48f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 -- 172.21.15.100:0/2263493469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 msgr2=0x55bba48f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 -- 172.21.15.100:0/2263493469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba46207d0 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f00035f0 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86faffd640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86fbfff640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba48f9f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86f40cdfb0 tx=0x7f86f409c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8068bcd2b71adec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86daffd640 10 client.25532 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86daffd640 1 -- 172.21.15.100:0/2263493469 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f401f040 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86daffd640 1 -- 172.21.15.100:0/2263493469 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f86f40870b0 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.681+0000 7f86daffd640 1 -- 172.21.15.100:0/2263493469 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86f40a5400 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 10 client.25532 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bba45563f0 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f86daffd640 1 -- 172.21.15.100:0/2263493469 <== mon.2 v2:172.21.15.104:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86f400f040 con 0x55bba453e390 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 10 client.25532 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:36.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 20 client.25532 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44fcf60 0x55bba4900300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 4 client.25532 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.682+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bba4852990 con 0x55bba44fcf60 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.683+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44fcf60 0x55bba4900300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.683+0000 7f86daffd640 10 client.25532 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.683+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44fcf60 0x55bba4900300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=578e027dfa5492d4 server_cookie=bc83641c3a38544c in_seq=0 out_seq=0 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f86daffd640 1 -- 172.21.15.100:0/2263493469 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55bba4852990 con 0x55bba44fcf60 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f86daffd640 10 client.25532 handle_command_reply: tid=0 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 client.25532 shutdown 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 msgr2=0x55bba48f9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba48f9f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86f40cdfb0 tx=0x7f86f409c480 comp rx=0 tx=0).stop 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 shutdown_connections 2024-04-30T23:14:36.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44fcf60 0x55bba4900300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba48f9f30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 --2- 172.21.15.100:0/2263493469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 >> 172.21.15.100:0/2263493469 conn(0x55bba45324e0 msgr2=0x55bba48dec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f86daffd640 0 client.25532 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 shutdown_connections 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 1 -- 172.21.15.100:0/2263493469 wait complete. 2024-04-30T23:14:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.684+0000 7f87091aa740 20 client.25532 trim_cache size 0 max 16384 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 Processor -- start 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 -- start start 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba451d6b0 0x55bba48f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba4904ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1aa580 con 0x55bba45154d0 2024-04-30T23:14:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ac0c0 con 0x55bba453e390 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f87091aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1aac50 con 0x55bba451d6b0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58376/0 (socket says 172.21.15.100:58376) 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f86fb7fe640 1 -- 172.21.15.100:0/1114926015 learned_addr learned my addr 172.21.15.100:0/1114926015 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.719+0000 7f86faffd640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba451d6b0 0x55bba48f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fbfff640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba4904ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 -- 172.21.15.100:0/1114926015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba451d6b0 msgr2=0x55bba48f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba451d6b0 0x55bba48f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 -- 172.21.15.100:0/1114926015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 msgr2=0x55bba4904ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba4904ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 -- 172.21.15.100:0/1114926015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba45160f0 con 0x55bba45154d0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fbfff640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba4904ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f86ec010290 tx=0x7f86ec00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7996f7b46666bca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86e17fa640 1 -- 172.21.15.100:0/1114926015 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec033070 con 0x55bba45154d0 2024-04-30T23:14:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86e17fa640 1 -- 172.21.15.100:0/1114926015 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86ec02d610 con 0x55bba45154d0 2024-04-30T23:14:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.720+0000 7f86e17fa640 1 -- 172.21.15.100:0/1114926015 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00bab0 con 0x55bba45154d0 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 -- 172.21.15.100:0/1114926015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 msgr2=0x55bba4904ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f86ec010290 tx=0x7f86ec00e000 comp rx=0 tx=0).stop 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 -- 172.21.15.100:0/1114926015 shutdown_connections 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba4904ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba451d6b0 0x55bba48f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 --2- 172.21.15.100:0/1114926015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba45154d0 0x55bba4904ab0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 -- 172.21.15.100:0/1114926015 >> 172.21.15.100:0/1114926015 conn(0x55bba45324e0 msgr2=0x55bba48f2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 -- 172.21.15.100:0/1114926015 shutdown_connections 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.721+0000 7f87091aa740 1 -- 172.21.15.100:0/1114926015 wait complete. 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 -- start start 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 Processor -- start 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba49645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ab9f0 con 0x55bba451d6b0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ab320 con 0x55bba453e390 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1a8560 con 0x55bba45154d0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f87091aa740 10 client.0 _ll_register_callbacks cb 0x7f86f4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f86faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58382/0 (socket says 172.21.15.100:58382) 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.722+0000 7f86faffd640 1 -- 172.21.15.100:0/3217923059 learned_addr learned my addr 172.21.15.100:0/3217923059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86fbfff640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba49645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 -- 172.21.15.100:0/3217923059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 msgr2=0x55bba48f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 -- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 msgr2=0x55bba49645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:14:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba49645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 -- 172.21.15.100:0/3217923059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba48054b0 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86faffd640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f86f0003d90 tx=0x7f86f00318f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45e9173e7c7e245 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86daffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0035040 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f86f00039a0 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.723+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ec02d610 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.724+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86f0060050 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.724+0000 7f87091aa740 10 client.16020 fetch_fsmap learned FSMap version 28 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.724+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bba4965c70 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.724+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86ec02d610 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86f0051690 con 0x55bba451d6b0 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 10 client.16020 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:14:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 20 client.16020 populate_metadata read hostname 'smithi100' 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44d23a0 0x55bba49681f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 4 client.16020 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bba484c800 con 0x55bba44d23a0 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.725+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44d23a0 0x55bba49681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f86daffd640 10 client.16020 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f86fb7fe640 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44d23a0 0x55bba49681f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6afaff09dd118cdf server_cookie=6452430c1818349e in_seq=0 out_seq=0 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f86daffd640 1 -- 172.21.15.100:0/3217923059 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55bba484c800 con 0x55bba44d23a0 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f86daffd640 10 client.16020 handle_command_reply: tid=0 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 client.16020 shutdown 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 msgr2=0x55bba48f95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f86f0003d90 tx=0x7f86f00318f0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 shutdown_connections 2024-04-30T23:14:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55bba44d23a0 0x55bba49681f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bba453e390 0x55bba49645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f86daffd640 0 client.16020 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bba451d6b0 0x55bba48f95c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 --2- 172.21.15.100:0/3217923059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bba45154d0 0x55bba48f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 >> 172.21.15.100:0/3217923059 conn(0x55bba45324e0 msgr2=0x55bba48deb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 shutdown_connections 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.726+0000 7f87091aa740 1 -- 172.21.15.100:0/3217923059 wait complete. 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f87091aa740 20 client.16020 trim_cache size 0 max 16384 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:14:36.732 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "d5625cc7-aaf4-4537-be59-f57f7bae4dab", 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:36.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:14:36.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:14:36.735 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:14:36.735 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:14:36.735 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:36.735 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:14:36.735 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 msgr2=0x7f86e40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 0x7f86e40a60c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06a8f0 tx=0x7f86ec012040 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 msgr2=0x7f86fc1a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 0x7f86fc1a1a60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f400edd0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 shutdown_connections 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f86e40a3bb0 0x7f86e40a60c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86fc1098d0 0x7f86fc1a1a60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86fc106f70 0x7f86fc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 --2- 172.21.15.100:0/708617250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86fc104610 0x7f86fc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 >> 172.21.15.100:0/708617250 conn(0x7f86fc0fdc10 msgr2=0x7f86fc105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 shutdown_connections 2024-04-30T23:14:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:14:36.727+0000 7f870221e640 1 -- 172.21.15.100:0/708617250 wait complete. 2024-04-30T23:14:36.743 INFO:tasks.cephfs.filesystem:scrub status for tag:d5625cc7-aaf4-4537-be59-f57f7bae4dab - {'path': '/', 'tag': 'd5625cc7-aaf4-4537-be59-f57f7bae4dab', 'options': 'recursive,force'} 2024-04-30T23:14:37.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:36 smithi104 ceph-mon[32987]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:37.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:36 smithi183 ceph-mon[33560]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:37.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:36 smithi100 ceph-mon[29745]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:38.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:37 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:14:38.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:37 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:38.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:37 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:14:38.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:37 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:37 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:14:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:37 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:37 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:14:38.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:37 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:38.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:37 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:14:38.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:37 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:38.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:37 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:14:38.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:37 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:14:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:38 smithi104 ceph-mon[32987]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:38 smithi183 ceph-mon[33560]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:39.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:38 smithi100 ceph-mon[29745]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:40.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:39 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:14:40.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:39 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:14:40.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:39 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:14:41.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:40 smithi104 ceph-mon[32987]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:41.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:40 smithi183 ceph-mon[33560]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:41.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:40 smithi100 ceph-mon[29745]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:42 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:14:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:42 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:14:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:42 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:44.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:14:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:14:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:14:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:14:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:14:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:14:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:14:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:44 smithi104 ceph-mon[32987]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:14:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:44 smithi183 ceph-mon[33560]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:14:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:44 smithi100 ceph-mon[29745]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-30T23:14:47.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:46 smithi104 ceph-mon[32987]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:46 smithi183 ceph-mon[33560]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:46 smithi100 ceph-mon[29745]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-30T23:14:48.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:47 smithi104 ceph-mon[32987]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:48.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:47 smithi183 ceph-mon[33560]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:47 smithi100 ceph-mon[29745]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:51.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:50 smithi104 ceph-mon[32987]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:50 smithi183 ceph-mon[33560]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:50 smithi100 ceph-mon[29745]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-30T23:14:53.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:52 smithi104 ceph-mon[32987]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:53.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:52 smithi183 ceph-mon[33560]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:52 smithi100 ceph-mon[29745]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-30T23:14:55.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:54 smithi104 ceph-mon[32987]: pgmap v412: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:55.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:54 smithi183 ceph-mon[33560]: pgmap v412: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:55.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:54 smithi100 ceph-mon[29745]: pgmap v412: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to '8505bf412a33fc9b7838e91f3a227044bc06f5ed'. 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-04-30T23:14:55.582 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-04-30T23:14:55.583 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at 8505bf412a3 Merge PR #44359 into wip-mchangir-testing-20240429.064231-main-debug 2024-04-30T23:14:55.588 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-30T23:14:55.683 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-30T23:14:55.685 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-30T23:14:55.685 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-30T23:14:56.336 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-30T23:14:56.392 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-30T23:14:56.432 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-30T23:14:56.434 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-30T23:14:56.434 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-30T23:14:56.472 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-30T23:14:56.475 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:14:56.475 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-30T23:14:56.491 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-30T23:14:56.492 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-30T23:14:56.492 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8505bf412a33fc9b7838e91f3a227044bc06f5ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-30T23:14:56.551 INFO:tasks.workunit.client.0.smithi100.stderr:+ mkdir -p fsstress 2024-04-30T23:14:56.553 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd fsstress 2024-04-30T23:14:56.553 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-30T23:14:56.553 INFO:tasks.workunit.client.0.smithi100.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-30T23:14:57.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:56 smithi104 ceph-mon[32987]: pgmap v413: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:56 smithi183 ceph-mon[33560]: pgmap v413: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:56 smithi100 ceph-mon[29745]: pgmap v413: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:14:57.204 INFO:tasks.workunit.client.0.smithi100.stderr:+ tar xzf ltp-full.tgz 2024-04-30T23:14:59.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:14:58 smithi104 ceph-mon[32987]: pgmap v414: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:59.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:14:58 smithi183 ceph-mon[33560]: pgmap v414: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:14:59.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:14:58 smithi100 ceph-mon[29745]: pgmap v414: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-30T23:15:01.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:00 smithi104 ceph-mon[32987]: pgmap v415: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-30T23:15:01.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:00 smithi183 ceph-mon[33560]: pgmap v415: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-30T23:15:01.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:00 smithi100 ceph-mon[29745]: pgmap v415: 129 pgs: 129 active+clean; 661 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-30T23:15:03.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:02 smithi104 ceph-mon[32987]: pgmap v416: 129 pgs: 129 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 12 op/s 2024-04-30T23:15:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:02 smithi183 ceph-mon[33560]: pgmap v416: 129 pgs: 129 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 12 op/s 2024-04-30T23:15:03.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:02 smithi100 ceph-mon[29745]: pgmap v416: 129 pgs: 129 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 12 op/s 2024-04-30T23:15:05.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:04 smithi104 ceph-mon[32987]: pgmap v417: 129 pgs: 129 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 415 KiB/s wr, 31 op/s 2024-04-30T23:15:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:04 smithi183 ceph-mon[33560]: pgmap v417: 129 pgs: 129 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 415 KiB/s wr, 31 op/s 2024-04-30T23:15:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:04 smithi100 ceph-mon[29745]: pgmap v417: 129 pgs: 129 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 415 KiB/s wr, 31 op/s 2024-04-30T23:15:06.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:15:06.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:15:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 -- 172.21.15.100:0/3870183858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc104d70 msgr2=0x7f18fc105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 --2- 172.21.15.100:0/3870183858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc104d70 0x7f18fc105180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009900 tx=0x7f18ec02a410 comp rx=0 tx=0).stop 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 -- 172.21.15.100:0/3870183858 shutdown_connections 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 --2- 172.21.15.100:0/3870183858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc109a70 0x7f18fc10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 --2- 172.21.15.100:0/3870183858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc104d70 0x7f18fc105180 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 --2- 172.21.15.100:0/3870183858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc103b30 0x7f18fc104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 -- 172.21.15.100:0/3870183858 >> 172.21.15.100:0/3870183858 conn(0x7f18fc0fed20 msgr2=0x7f18fc1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 -- 172.21.15.100:0/3870183858 shutdown_connections 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.868+0000 7f19042e0640 1 -- 172.21.15.100:0/3870183858 wait complete. 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 Processor -- start 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 -- start start 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc103b30 0x7f18fc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc104d70 0x7f18fc19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10f650 con 0x7f18fc109a70 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10f4d0 con 0x7f18fc103b30 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f19042e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10f7d0 con 0x7f18fc104d70 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41060/0 (socket says 172.21.15.100:41060) 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 -- 172.21.15.100:0/3496928461 learned_addr learned my addr 172.21.15.100:0/3496928461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190207c640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc103b30 0x7f18fc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190187b640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc104d70 0x7f18fc19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 -- 172.21.15.100:0/3496928461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc104d70 msgr2=0x7f18fc19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc104d70 0x7f18fc19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 -- 172.21.15.100:0/3496928461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc103b30 msgr2=0x7f18fc19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc103b30 0x7f18fc19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.869+0000 7f190287d640 1 -- 172.21.15.100:0/3496928461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18fc1a1db0 con 0x7f18fc109a70 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f190287d640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f18f400e970 tx=0x7f18f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f18f37fe640 1 -- 172.21.15.100:0/3496928461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f400ccc0 con 0x7f18fc109a70 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f18f37fe640 1 -- 172.21.15.100:0/3496928461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18f400ce60 con 0x7f18fc109a70 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18fc1a20a0 con 0x7f18fc109a70 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f18f37fe640 1 -- 172.21.15.100:0/3496928461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4010430 con 0x7f18fc109a70 2024-04-30T23:15:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.870+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18fc1a25a0 con 0x7f18fc109a70 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 Processor -- start 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f18f37fe640 1 -- 172.21.15.100:0/3496928461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f18f40105d0 con 0x7f18fc109a70 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 -- start start 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9867c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9867ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cb98593b10 con 0x55cb982b96b0 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb985e0d80 con 0x55cb982da390 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190b19a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cb9859a8b0 con 0x55cb982b14d0 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190187b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190187b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41064/0 (socket says 172.21.15.100:41064) 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190187b640 1 -- 172.21.15.100:0/3467788960 learned_addr learned my addr 172.21.15.100:0/3467788960 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f18f37fe640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 0x7f18e80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190187b640 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9867c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.873+0000 7f190207c640 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9867ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190287d640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 0x7f18e80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f18f37fe640 1 -- 172.21.15.100:0/3496928461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f18f40d0ba0 con 0x7f18fc109a70 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 -- 172.21.15.100:0/3467788960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 msgr2=0x55cb9867ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9867ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 -- 172.21.15.100:0/3467788960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 msgr2=0x55cb9867c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9867c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 -- 172.21.15.100:0/3467788960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9856ba40 con 0x55cb982b96b0 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190187b640 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0096c0 tx=0x7f18ec005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b45fe5873638f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f190287d640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 0x7f18e80a60c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18f409c820 tx=0x7f18f4067610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f18f0bfe640 1 -- 172.21.15.100:0/3467788960 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec035040 con 0x55cb982b96b0 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f18f0bfe640 1 -- 172.21.15.100:0/3467788960 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ec005020 con 0x55cb982b96b0 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.874+0000 7f18f0bfe640 1 -- 172.21.15.100:0/3467788960 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0044e0 con 0x55cb982b96b0 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 -- 172.21.15.100:0/3467788960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 msgr2=0x55cb9867d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0096c0 tx=0x7f18ec005a20 comp rx=0 tx=0).stop 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 -- 172.21.15.100:0/3467788960 shutdown_connections 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9867d700 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9867ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 --2- 172.21.15.100:0/3467788960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9867c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 -- 172.21.15.100:0/3467788960 >> 172.21.15.100:0/3467788960 conn(0x55cb982ce4e0 msgr2=0x55cb98677d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 -- 172.21.15.100:0/3467788960 shutdown_connections 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.875+0000 7f190b19a740 1 -- 172.21.15.100:0/3467788960 wait complete. 2024-04-30T23:15:06.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 -- start start 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 Processor -- start 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982b14d0 0x55cb98686290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b96b0 0x55cb986867d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cb98567d10 con 0x55cb982da390 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb985dcd40 con 0x55cb982b14d0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cb9867e1b0 con 0x55cb982b96b0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190b19a740 10 client.0 _ll_register_callbacks cb 0x55cb985edd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41080/0 (socket says 172.21.15.100:41080) 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 -- 172.21.15.100:0/335245472 learned_addr learned my addr 172.21.15.100:0/335245472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982b14d0 0x55cb98686290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190207c640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b96b0 0x55cb986867d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 -- 172.21.15.100:0/335245472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b96b0 msgr2=0x55cb986867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b96b0 0x55cb986867d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 -- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982b14d0 msgr2=0x55cb98686290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982b14d0 0x55cb98686290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.876+0000 7f190187b640 1 -- 172.21.15.100:0/335245472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb983bc7d0 con 0x55cb982da390 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190187b640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005e60 tx=0x7f18ec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4806b2d23fa6c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec035030 con 0x55cb982da390 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f18ec004050 con 0x55cb982da390 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ec005020 con 0x55cb982da390 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18ec059050 con 0x55cb982da390 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb982f23f0 con 0x55cb982da390 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ec005020 con 0x55cb982da390 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18ec03a040 con 0x55cb982da390 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 20 client.16032 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb98298f60 0x55cb986937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 4 client.16032 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.877+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb985ee990 con 0x55cb98298f60 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.878+0000 7f190207c640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb98298f60 0x55cb986937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.878+0000 7f18e5ffb640 10 client.16032 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.878+0000 7f190207c640 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb98298f60 0x55cb986937f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5da7a971de6207f server_cookie=79f3bca6f9ffc29c in_seq=0 out_seq=0 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f18e5ffb640 1 -- 172.21.15.100:0/335245472 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55cb985ee990 con 0x55cb98298f60 2024-04-30T23:15:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f18e5ffb640 10 client.16032 handle_command_reply: tid=0 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 client.16032 shutdown 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 msgr2=0x55cb9868d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005e60 tx=0x7f18ec02a410 comp rx=0 tx=0).stop 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 shutdown_connections 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb98298f60 0x55cb986937f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982da390 0x55cb9868d730 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b96b0 0x55cb986867d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 --2- 172.21.15.100:0/335245472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982b14d0 0x55cb98686290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f18e5ffb640 0 client.16032 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 >> 172.21.15.100:0/335245472 conn(0x55cb982ce4e0 msgr2=0x55cb9867ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 shutdown_connections 2024-04-30T23:15:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 1 -- 172.21.15.100:0/335245472 wait complete. 2024-04-30T23:15:06.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.879+0000 7f190b19a740 20 client.16032 trim_cache size 0 max 16384 2024-04-30T23:15:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 Processor -- start 2024-04-30T23:15:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 -- start start 2024-04-30T23:15:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb98677730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb98677c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1ac910 con 0x55cb982b96b0 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1ae450 con 0x55cb982da390 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190b19a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1acfe0 con 0x55cb982b14d0 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41096/0 (socket says 172.21.15.100:41096) 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 -- 172.21.15.100:0/4100103832 learned_addr learned my addr 172.21.15.100:0/4100103832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190187b640 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb98677730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 -- 172.21.15.100:0/4100103832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 msgr2=0x55cb98677730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb98677730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 -- 172.21.15.100:0/4100103832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 msgr2=0x55cb98677c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb98677c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 -- 172.21.15.100:0/4100103832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb982b20f0 con 0x55cb982b96b0 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190187b640 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb98677730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.897+0000 7f190207c640 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f18fc104730 tx=0x7f18f8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd93e070f89b8350 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f18e7fff640 1 -- 172.21.15.100:0/4100103832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8023070 con 0x55cb982b96b0 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f18e7fff640 1 -- 172.21.15.100:0/4100103832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18f8010e40 con 0x55cb982b96b0 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f18e7fff640 1 -- 172.21.15.100:0/4100103832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f801e9b0 con 0x55cb982b96b0 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 -- 172.21.15.100:0/4100103832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 msgr2=0x55cb9868d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f18fc104730 tx=0x7f18f8009500 comp rx=0 tx=0).stop 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 -- 172.21.15.100:0/4100103832 shutdown_connections 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb98677c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868d650 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 --2- 172.21.15.100:0/4100103832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb98677730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 -- 172.21.15.100:0/4100103832 >> 172.21.15.100:0/4100103832 conn(0x55cb982ce4e0 msgr2=0x55cb986848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 -- 172.21.15.100:0/4100103832 shutdown_connections 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.898+0000 7f190b19a740 1 -- 172.21.15.100:0/4100103832 wait complete. 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 -- start start 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 Processor -- start 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9868acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9868c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1add80 con 0x55cb982b96b0 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1ad6b0 con 0x55cb982da390 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1aa8f0 con 0x55cb982b14d0 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190b19a740 10 client.0 _ll_register_callbacks cb 0x7f18f80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41100/0 (socket says 172.21.15.100:41100) 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 -- 172.21.15.100:0/4271407467 learned_addr learned my addr 172.21.15.100:0/4271407467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190187b640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9868c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190187b640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9868acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 -- 172.21.15.100:0/4271407467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 msgr2=0x55cb9868acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9868acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 -- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 msgr2=0x55cb9868c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9868c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 -- 172.21.15.100:0/4271407467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb985a14b0 con 0x55cb982b96b0 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190187b640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9868acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f190207c640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f18f80106a0 tx=0x7f18f8010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eb7d724546ef54 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.899+0000 7f18e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f802f060 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f18f801e050 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb985e8800 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18f8036050 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb9868d750 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cb985e8800 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18f8005030 con 0x55cb982b96b0 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 20 client.16038 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb9826e3a0 0x55cb986fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 4 client.16038 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb985634a0 con 0x55cb9826e3a0 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.900+0000 7f190187b640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb9826e3a0 0x55cb986fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f18e5ffb640 10 client.16038 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190187b640 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb9826e3a0 0x55cb986fbdd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39ff022441fd6ea server_cookie=abad1a4e348241d5 in_seq=0 out_seq=0 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f18e5ffb640 1 -- 172.21.15.100:0/4271407467 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55cb985634a0 con 0x55cb9826e3a0 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f18e5ffb640 10 client.16038 handle_command_reply: tid=0 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 client.16038 shutdown 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 msgr2=0x55cb9868b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f18f80106a0 tx=0x7f18f8010c40 comp rx=0 tx=0).stop 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 shutdown_connections 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cb9826e3a0 0x55cb986fbdd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb982da390 0x55cb9868c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f18e5ffb640 0 client.16038 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb982b96b0 0x55cb9868b200 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 --2- 172.21.15.100:0/4271407467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb982b14d0 0x55cb9868acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 >> 172.21.15.100:0/4271407467 conn(0x55cb982ce4e0 msgr2=0x55cb98684480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 shutdown_connections 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 1 -- 172.21.15.100:0/4271407467 wait complete. 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.901+0000 7f190b19a740 20 client.16038 trim_cache size 0 max 16384 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-04-30T23:15:06.911 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {}, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:06.912 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:06.913 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 msgr2=0x7f18e80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 0x7f18e80a60c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18f409c820 tx=0x7f18f4067610 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 msgr2=0x7f18fc1a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f18f400e970 tx=0x7f18f400ed70 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 shutdown_connections 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f18e80a3bb0 0x7f18e80a60c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18fc109a70 0x7f18fc1a1740 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18fc104d70 0x7f18fc19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 --2- 172.21.15.100:0/3496928461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18fc103b30 0x7f18fc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 >> 172.21.15.100:0/3496928461 conn(0x7f18fc0fed20 msgr2=0x7f18fc105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 shutdown_connections 2024-04-30T23:15:06.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:06.902+0000 7f19042e0640 1 -- 172.21.15.100:0/3496928461 wait complete. 2024-04-30T23:15:06.916 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T23:15:06.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:15:07.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 -- 172.21.15.100:0/2041808458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a4102290 msgr2=0x7f03a410bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 --2- 172.21.15.100:0/2041808458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a4102290 0x7f03a410bcf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f039c009ca0 tx=0x7f039c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 -- 172.21.15.100:0/2041808458 shutdown_connections 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 --2- 172.21.15.100:0/2041808458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a4102290 0x7f03a410bcf0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 --2- 172.21.15.100:0/2041808458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4101790 0x7f03a4101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 --2- 172.21.15.100:0/2041808458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a41050e0 0x7f03a41054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.022+0000 7f03ab267640 1 -- 172.21.15.100:0/2041808458 >> 172.21.15.100:0/2041808458 conn(0x7f03a40fd3b0 msgr2=0x7f03a40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- 172.21.15.100:0/2041808458 shutdown_connections 2024-04-30T23:15:07.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- 172.21.15.100:0/2041808458 wait complete. 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 Processor -- start 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- start start 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a4101790 0x7f03a419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4102290 0x7f03a419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410f670 con 0x7f03a41050e0 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410f4f0 con 0x7f03a4102290 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.023+0000 7f03ab267640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410f7f0 con 0x7f03a4101790 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41108/0 (socket says 172.21.15.100:41108) 2024-04-30T23:15:07.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 -- 172.21.15.100:0/637497114 learned_addr learned my addr 172.21.15.100:0/637497114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a8802640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4102290 0x7f03a419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9003640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a4101790 0x7f03a419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 -- 172.21.15.100:0/637497114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a4101790 msgr2=0x7f03a419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a4101790 0x7f03a419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 -- 172.21.15.100:0/637497114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4102290 msgr2=0x7f03a419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4102290 0x7f03a419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 -- 172.21.15.100:0/637497114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a41a1cf0 con 0x7f03a41050e0 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03a9804640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f039c004af0 tx=0x7f039c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c003b70 con 0x7f03a41050e0 2024-04-30T23:15:07.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f039c003d10 con 0x7f03a41050e0 2024-04-30T23:15:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a41a1f80 con 0x7f03a41050e0 2024-04-30T23:15:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c02fb20 con 0x7f03a41050e0 2024-04-30T23:15:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.024+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41a23e0 con 0x7f03a41050e0 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.025+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a406a1d0 con 0x7f03a41050e0 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.026+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f039c02fcc0 con 0x7f03a41050e0 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.027+0000 7f039a7fc640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 0x7f03900a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.027+0000 7f03a9003640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 0x7f03900a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.027+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f039c0f1d00 con 0x7f03a41050e0 2024-04-30T23:15:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.028+0000 7f03a9003640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 0x7f03900a60c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f03a406b360 tx=0x7f0394005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.032+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f039c0be380 con 0x7f03a41050e0 2024-04-30T23:15:07.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:06 smithi104 ceph-mon[32987]: pgmap v418: 129 pgs: 129 active+clean; 17 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.4 MiB/s wr, 92 op/s 2024-04-30T23:15:07.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:06 smithi183 ceph-mon[33560]: pgmap v418: 129 pgs: 129 active+clean; 17 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.4 MiB/s wr, 92 op/s 2024-04-30T23:15:07.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:06 smithi100 ceph-mon[29745]: pgmap v418: 129 pgs: 129 active+clean; 17 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.4 MiB/s wr, 92 op/s 2024-04-30T23:15:07.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.247+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03a410aa80 con 0x7f03a41050e0 2024-04-30T23:15:07.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.248+0000 7f039a7fc640 1 -- 172.21.15.100:0/637497114 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f039c0bdc80 con 0x7f03a41050e0 2024-04-30T23:15:07.250 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:15:07.250 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:13:23.708732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[24503,24496,24545,14664,24511]},"id":1}]} 2024-04-30T23:15:07.250 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 msgr2=0x7f03900a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 0x7f03900a60c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f03a406b360 tx=0x7f0394005f90 comp rx=0 tx=0).stop 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 msgr2=0x7f03a41a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f039c004af0 tx=0x7f039c031700 comp rx=0 tx=0).stop 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 shutdown_connections 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03900a3bb0 0x7f03900a60c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03a41050e0 0x7f03a41a1680 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a4102290 0x7f03a419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 --2- 172.21.15.100:0/637497114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03a4101790 0x7f03a419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 >> 172.21.15.100:0/637497114 conn(0x7f03a40fd3b0 msgr2=0x7f03a4107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 shutdown_connections 2024-04-30T23:15:07.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.250+0000 7f03ab267640 1 -- 172.21.15.100:0/637497114 wait complete. 2024-04-30T23:15:07.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-30T23:15:07.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 -- 172.21.15.100:0/407605006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414106f80 msgr2=0x7fc4141093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/407605006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414106f80 0x7fc4141093a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc404009900 tx=0x7fc40402a410 comp rx=0 tx=0).stop 2024-04-30T23:15:07.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 -- 172.21.15.100:0/407605006 shutdown_connections 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/407605006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4141098e0 0x7fc41410bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/407605006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414106f80 0x7fc4141093a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/407605006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc414104620 0x7fc414106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 -- 172.21.15.100:0/407605006 >> 172.21.15.100:0/407605006 conn(0x7fc4140fdc00 msgr2=0x7fc4141000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 -- 172.21.15.100:0/407605006 shutdown_connections 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.370+0000 7fc41b8d9640 1 -- 172.21.15.100:0/407605006 wait complete. 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 Processor -- start 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 -- start start 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc414106f80 0x7fc41419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4141098e0 0x7fc4141a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc41410f660 con 0x7fc414104620 2024-04-30T23:15:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc41410f4e0 con 0x7fc4141098e0 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc41b8d9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc41410f7e0 con 0x7fc414106f80 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41138/0 (socket says 172.21.15.100:41138) 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 -- 172.21.15.100:0/3382887845 learned_addr learned my addr 172.21.15.100:0/3382887845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc418e74640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc414106f80 0x7fc41419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419e76640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4141098e0 0x7fc4141a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 -- 172.21.15.100:0/3382887845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc414106f80 msgr2=0x7fc41419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc414106f80 0x7fc41419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 -- 172.21.15.100:0/3382887845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4141098e0 msgr2=0x7fc4141a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.371+0000 7fc419675640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4141098e0 0x7fc4141a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc419675640 1 -- 172.21.15.100:0/3382887845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4141a1dd0 con 0x7fc414104620 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc419675640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc41000d770 tx=0x7fc41000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc40a7fc640 1 -- 172.21.15.100:0/3382887845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410017070 con 0x7fc414104620 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc40a7fc640 1 -- 172.21.15.100:0/3382887845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc410009c30 con 0x7fc414104620 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4141a20c0 con 0x7fc414104620 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc40a7fc640 1 -- 172.21.15.100:0/3382887845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41000f620 con 0x7fc414104620 2024-04-30T23:15:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.372+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a2610 con 0x7fc414104620 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.374+0000 7fc40a7fc640 1 -- 172.21.15.100:0/3382887845 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc41001a070 con 0x7fc414104620 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.374+0000 7fc42278c740 1 Processor -- start 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.374+0000 7fc42278c740 1 -- start start 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d84261d390 0x55d8429bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d842923d80 con 0x55d8425f44d0 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8428dda20 con 0x55d8425fc6b0 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc42278c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d84291fd40 con 0x55d84261d390 2024-04-30T23:15:07.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41140/0 (socket says 172.21.15.100:41140) 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 -- 172.21.15.100:0/2002672456 learned_addr learned my addr 172.21.15.100:0/2002672456 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419e76640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d84261d390 0x55d8429bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc418e74640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc40a7fc640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 0x7fc4000a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 -- 172.21.15.100:0/2002672456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d84261d390 msgr2=0x55d8429bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d84261d390 0x55d8429bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 -- 172.21.15.100:0/2002672456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 msgr2=0x55d8429c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 -- 172.21.15.100:0/2002672456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8428c1e00 con 0x55d8425f44d0 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc418e74640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419e76640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 0x7fc4000a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc419675640 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b2d70 tx=0x7fc4100b0920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429482573da61ac server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc40a7fc640 1 -- 172.21.15.100:0/3382887845 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc4100d02c0 con 0x7fc414104620 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.375+0000 7fc3ff7fe640 1 -- 172.21.15.100:0/2002672456 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410021070 con 0x55d8425f44d0 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc3ff7fe640 1 -- 172.21.15.100:0/2002672456 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4100b15e0 con 0x55d8425f44d0 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc3ff7fe640 1 -- 172.21.15.100:0/2002672456 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41009c010 con 0x55d8425f44d0 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 -- 172.21.15.100:0/2002672456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 msgr2=0x55d8429bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc419e76640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 0x7fc4000a60c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d8429bffe0 tx=0x7fc40c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b2d70 tx=0x7fc4100b0920 comp rx=0 tx=0).stop 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 -- 172.21.15.100:0/2002672456 shutdown_connections 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425f44d0 0x55d8429bf390 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 --2- 172.21.15.100:0/2002672456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d84261d390 0x55d8429bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 -- 172.21.15.100:0/2002672456 >> 172.21.15.100:0/2002672456 conn(0x55d8426114e0 msgr2=0x55d8429ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.376+0000 7fc42278c740 1 -- 172.21.15.100:0/2002672456 shutdown_connections 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 -- 172.21.15.100:0/2002672456 wait complete. 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 -- start start 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 Processor -- start 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d8429c6ce0 con 0x55d84261d390 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8428aadc0 con 0x55d8425fc6b0 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d8429c6e60 con 0x55d8425f44d0 2024-04-30T23:15:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc42278c740 10 client.0 _ll_register_callbacks cb 0x55d8428c6600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.377+0000 7fc419e76640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41142/0 (socket says 172.21.15.100:41142) 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 -- 172.21.15.100:0/215140374 learned_addr learned my addr 172.21.15.100:0/215140374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc418e74640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419675640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 -- 172.21.15.100:0/215140374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 msgr2=0x55d8429c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 -- 172.21.15.100:0/215140374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 msgr2=0x55d8429c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 -- 172.21.15.100:0/215140374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8428e8c30 con 0x55d84261d390 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc419e76640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc40c003e50 tx=0x7fc40c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b154121747abeae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc3fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c010960 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc40c010b00 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d84291d810 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc40c030050 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc42278c740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.378+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8426353f0 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d84291d810 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc40c01e420 con 0x55d84261d390 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 10 client.16056 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 20 client.16056 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425dbf60 0x55d8429d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 4 client.16056 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d842931990 con 0x55d8425dbf60 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc419675640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425dbf60 0x55d8429d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc3fcff9640 10 client.16056 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.379+0000 7fc419675640 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425dbf60 0x55d8429d6850 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=35dd948ff5135c2d server_cookie=23624b700704c5f8 in_seq=0 out_seq=0 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc3fcff9640 1 -- 172.21.15.100:0/215140374 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55d842931990 con 0x55d8425dbf60 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc3fcff9640 10 client.16056 handle_command_reply: tid=0 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 client.16056 shutdown 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 msgr2=0x55d8429cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc40c003e50 tx=0x7fc40c004ab0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 shutdown_connections 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425dbf60 0x55d8429d6850 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429cff20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425fc6b0 0x55d8429c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc3fcff9640 0 client.16056 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 --2- 172.21.15.100:0/215140374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 >> 172.21.15.100:0/215140374 conn(0x55d8426114e0 msgr2=0x55d8429b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 shutdown_connections 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 1 -- 172.21.15.100:0/215140374 wait complete. 2024-04-30T23:15:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.380+0000 7fc42278c740 20 client.16056 trim_cache size 0 max 16384 2024-04-30T23:15:07.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 Processor -- start 2024-04-30T23:15:07.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 -- start start 2024-04-30T23:15:07.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425f44d0 0x55d8429c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425fc6b0 0x55d8429c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141aca20 con 0x55d84261d390 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141ae560 con 0x55d8425f44d0 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc42278c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141ad0f0 con 0x55d8425fc6b0 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41158/0 (socket says 172.21.15.100:41158) 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 -- 172.21.15.100:0/1687550196 learned_addr learned my addr 172.21.15.100:0/1687550196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419675640 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425f44d0 0x55d8429c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc418e74640 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425fc6b0 0x55d8429c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 -- 172.21.15.100:0/1687550196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425fc6b0 msgr2=0x55d8429c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425fc6b0 0x55d8429c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 -- 172.21.15.100:0/1687550196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425f44d0 msgr2=0x55d8429c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425f44d0 0x55d8429c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 -- 172.21.15.100:0/1687550196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8426ff7d0 con 0x55d84261d390 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc419e76640 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc40c003e20 tx=0x7fc40c014ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f236b1e800de37f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc3feffd640 1 -- 172.21.15.100:0/1687550196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c038070 con 0x55d84261d390 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc3feffd640 1 -- 172.21.15.100:0/1687550196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c02d040 con 0x55d84261d390 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.394+0000 7fc3feffd640 1 -- 172.21.15.100:0/1687550196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c011440 con 0x55d84261d390 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 -- 172.21.15.100:0/1687550196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 msgr2=0x55d8429db000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc40c003e20 tx=0x7fc40c014ec0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 -- 172.21.15.100:0/1687550196 shutdown_connections 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84261d390 0x55d8429db000 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425fc6b0 0x55d8429c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 --2- 172.21.15.100:0/1687550196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8425f44d0 0x55d8429c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 -- 172.21.15.100:0/1687550196 >> 172.21.15.100:0/1687550196 conn(0x55d8426114e0 msgr2=0x55d8429c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 -- 172.21.15.100:0/1687550196 shutdown_connections 2024-04-30T23:15:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.395+0000 7fc42278c740 1 -- 172.21.15.100:0/1687550196 wait complete. 2024-04-30T23:15:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 -- start start 2024-04-30T23:15:07.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 Processor -- start 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d84261d390 0x55d8429cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141ade90 con 0x55d8425fc6b0 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141ad7c0 con 0x55d84261d390 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141aaa00 con 0x55d8425f44d0 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc42278c740 10 client.0 _ll_register_callbacks cb 0x7fc40c009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41162/0 (socket says 172.21.15.100:41162) 2024-04-30T23:15:07.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 -- 172.21.15.100:0/122073901 learned_addr learned my addr 172.21.15.100:0/122073901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc419e76640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d84261d390 0x55d8429cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc419675640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 -- 172.21.15.100:0/122073901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 msgr2=0x55d8429ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 -- 172.21.15.100:0/122073901 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d84261d390 msgr2=0x55d8429cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d84261d390 0x55d8429cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.396+0000 7fc418e74640 1 -- 172.21.15.100:0/122073901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8429ce530 con 0x55d8425fc6b0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc418e74640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc404009900 tx=0x7fc404031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5b68cfd70f1df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40404a060 con 0x55d8425fc6b0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc404004240 con 0x55d8425fc6b0 2024-04-30T23:15:07.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c02d040 con 0x55d8425fc6b0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc404051050 con 0x55d8425fc6b0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 10 client.16062 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8429cf850 con 0x55d8425fc6b0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c02d040 con 0x55d8425fc6b0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc40403b430 con 0x55d8425fc6b0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 10 client.16062 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 10 client.16062 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 20 client.16062 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425b13a0 0x55d842a3f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 4 client.16062 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.397+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d84292b800 con 0x55d8425b13a0 2024-04-30T23:15:07.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc419675640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425b13a0 0x55d842a3f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc3fcff9640 10 client.16062 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc419675640 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425b13a0 0x55d842a3f300 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=68d0e63932336b3c server_cookie=c3530ccaf590ec86 in_seq=0 out_seq=0 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc3fcff9640 1 -- 172.21.15.100:0/122073901 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d84292b800 con 0x55d8425b13a0 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc3fcff9640 10 client.16062 handle_command_reply: tid=0 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 client.16062 shutdown 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 msgr2=0x55d8429cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc404009900 tx=0x7fc404031ee0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 shutdown_connections 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55d8425b13a0 0x55d842a3f300 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d84261d390 0x55d8429cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d8425fc6b0 0x55d8429cd040 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc3fcff9640 0 client.16062 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 --2- 172.21.15.100:0/122073901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d8425f44d0 0x55d8429ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 >> 172.21.15.100:0/122073901 conn(0x55d8426114e0 msgr2=0x55d8429c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.398+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 shutdown_connections 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc42278c740 1 -- 172.21.15.100:0/122073901 wait complete. 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc42278c740 20 client.16062 trim_cache size 0 max 16384 2024-04-30T23:15:07.408 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 msgr2=0x7fc4000a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 0x7fc4000a60c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d8429bffe0 tx=0x7fc40c004a40 comp rx=0 tx=0).stop 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 msgr2=0x7fc41419a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc41000d770 tx=0x7fc41000dc30 comp rx=0 tx=0).stop 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 shutdown_connections 2024-04-30T23:15:07.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc4000a3bb0 0x7fc4000a60c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4141098e0 0x7fc4141a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc414106f80 0x7fc41419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 --2- 172.21.15.100:0/3382887845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc414104620 0x7fc41419a290 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 >> 172.21.15.100:0/3382887845 conn(0x7fc4140fdc00 msgr2=0x7fc414105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 shutdown_connections 2024-04-30T23:15:07.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.399+0000 7fc41b8d9640 1 -- 172.21.15.100:0/3382887845 wait complete. 2024-04-30T23:15:07.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-30T23:15:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 -- 172.21.15.100:0/1802260163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec103b30 msgr2=0x7f10ec104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 --2- 172.21.15.100:0/1802260163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec103b30 0x7f10ec104830 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009900 tx=0x7f10e002a410 comp rx=0 tx=0).stop 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 -- 172.21.15.100:0/1802260163 shutdown_connections 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 --2- 172.21.15.100:0/1802260163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec109a70 0x7f10ec10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 --2- 172.21.15.100:0/1802260163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 0x7f10ec105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 --2- 172.21.15.100:0/1802260163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec103b30 0x7f10ec104830 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 -- 172.21.15.100:0/1802260163 >> 172.21.15.100:0/1802260163 conn(0x7f10ec0fed20 msgr2=0x7f10ec1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 -- 172.21.15.100:0/1802260163 shutdown_connections 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.519+0000 7f10f3613640 1 -- 172.21.15.100:0/1802260163 wait complete. 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 Processor -- start 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 -- start start 2024-04-30T23:15:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 0x7f10ec19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 0x7f10ec19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec10f630 con 0x7f10ec109a70 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec10f4b0 con 0x7f10ec103b30 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f3613640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec10f7b0 con 0x7f10ec104d70 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41182/0 (socket says 172.21.15.100:41182) 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 -- 172.21.15.100:0/3407701958 learned_addr learned my addr 172.21.15.100:0/3407701958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f13af640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 0x7f10ec19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f0bae640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 0x7f10ec19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 -- 172.21.15.100:0/3407701958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 msgr2=0x7f10ec19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 0x7f10ec19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 -- 172.21.15.100:0/3407701958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 msgr2=0x7f10ec19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 0x7f10ec19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f1bb0640 1 -- 172.21.15.100:0/3407701958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ec1a1dd0 con 0x7f10ec109a70 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.520+0000 7f10f13af640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 0x7f10ec19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10f1bb0640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f10e400eaa0 tx=0x7f10e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10de7fc640 1 -- 172.21.15.100:0/3407701958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e400cdb0 con 0x7f10ec109a70 2024-04-30T23:15:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ec1a20c0 con 0x7f10ec109a70 2024-04-30T23:15:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10de7fc640 1 -- 172.21.15.100:0/3407701958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e4005020 con 0x7f10ec109a70 2024-04-30T23:15:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10de7fc640 1 -- 172.21.15.100:0/3407701958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40116d0 con 0x7f10ec109a70 2024-04-30T23:15:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.521+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ec1a2610 con 0x7f10ec109a70 2024-04-30T23:15:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.523+0000 7f10de7fc640 1 -- 172.21.15.100:0/3407701958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f10e40051d0 con 0x7f10ec109a70 2024-04-30T23:15:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.523+0000 7f10fa59f740 1 Processor -- start 2024-04-30T23:15:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 -- start start 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b608390 0x55a65b9a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5df4d0 0x55a65b9aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a65b90ed80 con 0x55a65b5e76b0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a65b8c8a20 con 0x55a65b608390 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10fa59f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a65b90ad40 con 0x55a65b5df4d0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41186/0 (socket says 172.21.15.100:41186) 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 -- 172.21.15.100:0/1370296803 learned_addr learned my addr 172.21.15.100:0/1370296803 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10de7fc640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 0x7f10d80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f13af640 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5df4d0 0x55a65b9aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b608390 0x55a65b9a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f1bb0640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 0x7f10d80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 -- 172.21.15.100:0/1370296803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5df4d0 msgr2=0x55a65b9aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5df4d0 0x55a65b9aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 -- 172.21.15.100:0/1370296803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b608390 msgr2=0x55a65b9a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b608390 0x55a65b9a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 -- 172.21.15.100:0/1370296803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b8ace00 con 0x55a65b5e76b0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10de7fc640 1 -- 172.21.15.100:0/3407701958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f10e40d0970 con 0x7f10ec109a70 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.524+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10e8012570 tx=0x7f10e800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f4352051c90d1e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10d77fe640 1 -- 172.21.15.100:0/1370296803 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004250 con 0x55a65b5e76b0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10f1bb0640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 0x7f10d80a60c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10e40ce480 tx=0x7f10e4097300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10d77fe640 1 -- 172.21.15.100:0/1370296803 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e80043f0 con 0x55a65b5e76b0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10d77fe640 1 -- 172.21.15.100:0/1370296803 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004d90 con 0x55a65b5e76b0 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10fa59f740 1 -- 172.21.15.100:0/1370296803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 msgr2=0x55a65b9b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.525+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10e8012570 tx=0x7f10e800b870 comp rx=0 tx=0).stop 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- 172.21.15.100:0/1370296803 shutdown_connections 2024-04-30T23:15:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5e76b0 0x55a65b9b1290 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5df4d0 0x55a65b9aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1370296803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b608390 0x55a65b9a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- 172.21.15.100:0/1370296803 >> 172.21.15.100:0/1370296803 conn(0x55a65b5fc4e0 msgr2=0x55a65b9a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- 172.21.15.100:0/1370296803 shutdown_connections 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- 172.21.15.100:0/1370296803 wait complete. 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- start start 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 Processor -- start 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5df4d0 0x55a65b9b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5e76b0 0x55a65b9b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a65b9b1ce0 con 0x55a65b608390 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a65b895dc0 con 0x55a65b5df4d0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.526+0000 7f10fa59f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a65b9b1e60 con 0x55a65b5e76b0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10fa59f740 10 client.0 _ll_register_callbacks cb 0x55a65b8b1600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41198/0 (socket says 172.21.15.100:41198) 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 -- 172.21.15.100:0/3672833022 learned_addr learned my addr 172.21.15.100:0/3672833022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f13af640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5e76b0 0x55a65b9b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5df4d0 0x55a65b9b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 -- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5e76b0 msgr2=0x55a65b9b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5e76b0 0x55a65b9b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 -- 172.21.15.100:0/3672833022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5df4d0 msgr2=0x55a65b9b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5df4d0 0x55a65b9b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 -- 172.21.15.100:0/3672833022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65b8d3c30 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10f0bae640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f10e800b3f0 tx=0x7f10e8021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18b2d9caa959bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005050 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f10e80051f0 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e80043f0 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f10e80053f0 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10fa59f740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.527+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a65b6203f0 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e80043f0 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f10e801c030 con 0x55a65b608390 2024-04-30T23:15:07.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 10 client.16074 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 20 client.16074 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b5c6f60 0x55a65b9c1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 4 client.16074 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a65b908810 con 0x55a65b5c6f60 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.528+0000 7f10f13af640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b5c6f60 0x55a65b9c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.529+0000 7f10d4ff9640 10 client.16074 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.529+0000 7f10f13af640 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b5c6f60 0x55a65b9c1470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fcf231c20d7cbf52 server_cookie=c7a93aea501422ee in_seq=0 out_seq=0 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.529+0000 7f10d4ff9640 1 -- 172.21.15.100:0/3672833022 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55a65b908810 con 0x55a65b5c6f60 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.529+0000 7f10d4ff9640 10 client.16074 handle_command_reply: tid=0 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.529+0000 7f10fa59f740 1 client.16074 shutdown 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 msgr2=0x55a65b9baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f10e800b3f0 tx=0x7f10e8021040 comp rx=0 tx=0).stop 2024-04-30T23:15:07.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 shutdown_connections 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b5c6f60 0x55a65b9c1470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b608390 0x55a65b9baf80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b5e76b0 0x55a65b9b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 --2- 172.21.15.100:0/3672833022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5df4d0 0x55a65b9b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10d4ff9640 0 client.16074 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 >> 172.21.15.100:0/3672833022 conn(0x55a65b5fc4e0 msgr2=0x55a65b9a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 shutdown_connections 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 1 -- 172.21.15.100:0/3672833022 wait complete. 2024-04-30T23:15:07.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.530+0000 7f10fa59f740 20 client.16074 trim_cache size 0 max 16384 2024-04-30T23:15:07.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 Processor -- start 2024-04-30T23:15:07.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 -- start start 2024-04-30T23:15:07.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ac9b0 con 0x55a65b5df4d0 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ae4f0 con 0x55a65b5e76b0 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.543+0000 7f10fa59f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ad080 con 0x55a65b608390 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41204/0 (socket says 172.21.15.100:41204) 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 -- 172.21.15.100:0/1481874526 learned_addr learned my addr 172.21.15.100:0/1481874526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f13af640 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 -- 172.21.15.100:0/1481874526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 msgr2=0x55a65b9b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 -- 172.21.15.100:0/1481874526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 msgr2=0x55a65b9b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 -- 172.21.15.100:0/1481874526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b6ea7d0 con 0x55a65b5df4d0 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f13af640 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10f0bae640 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10e8004df0 tx=0x7f10e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc0fc7a6efd13ba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10d6ffd640 1 -- 172.21.15.100:0/1481874526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005590 con 0x55a65b5df4d0 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10d6ffd640 1 -- 172.21.15.100:0/1481874526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e8004800 con 0x55a65b5df4d0 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.544+0000 7f10d6ffd640 1 -- 172.21.15.100:0/1481874526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8012320 con 0x55a65b5df4d0 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- 172.21.15.100:0/1481874526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 msgr2=0x55a65b9ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10e8004df0 tx=0x7f10e8004600 comp rx=0 tx=0).stop 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- 172.21.15.100:0/1481874526 shutdown_connections 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 --2- 172.21.15.100:0/1481874526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9ad590 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- 172.21.15.100:0/1481874526 >> 172.21.15.100:0/1481874526 conn(0x55a65b5fc4e0 msgr2=0x55a65b9ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- 172.21.15.100:0/1481874526 shutdown_connections 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- 172.21.15.100:0/1481874526 wait complete. 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 -- start start 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.545+0000 7f10fa59f740 1 Processor -- start 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ade20 con 0x55a65b5df4d0 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ad750 con 0x55a65b5e76b0 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1aa990 con 0x55a65b608390 2024-04-30T23:15:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 10 client.0 _ll_register_callbacks cb 0x7f10e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41218/0 (socket says 172.21.15.100:41218) 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 -- 172.21.15.100:0/771340919 learned_addr learned my addr 172.21.15.100:0/771340919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 -- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 msgr2=0x55a65b9b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 -- 172.21.15.100:0/771340919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 msgr2=0x55a65b9b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f13af640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 -- 172.21.15.100:0/771340919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65b9b9290 con 0x55a65b5df4d0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f13af640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10f0bae640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f10e8015040 tx=0x7f10e8005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a99e2f5afd1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8012260 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e8004800 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.546+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f10e802e9d0 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f10e802e7b0 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a65b9ba480 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e8004800 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f10e8036070 con 0x55a65b5df4d0 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 10 client.16080 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 20 client.16080 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b59c3a0 0x55a65ba29810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 4 client.16080 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a65b91c990 con 0x55a65b59c3a0 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.547+0000 7f10f13af640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b59c3a0 0x55a65ba29810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10d4ff9640 10 client.16080 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10f13af640 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b59c3a0 0x55a65ba29810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=429e295b30e2d03c server_cookie=89c1f657132212ff in_seq=0 out_seq=0 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10d4ff9640 1 -- 172.21.15.100:0/771340919 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a65b91c990 con 0x55a65b59c3a0 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10d4ff9640 10 client.16080 handle_command_reply: tid=0 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 client.16080 shutdown 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 msgr2=0x55a65b9b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f10e8015040 tx=0x7f10e8005fb0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 shutdown_connections 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55a65b59c3a0 0x55a65ba29810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a65b608390 0x55a65b9b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10d4ff9640 0 client.16080 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a65b5e76b0 0x55a65b9b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 --2- 172.21.15.100:0/771340919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a65b5df4d0 0x55a65b9b78b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 >> 172.21.15.100:0/771340919 conn(0x55a65b5fc4e0 msgr2=0x55a65b9b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 shutdown_connections 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 1 -- 172.21.15.100:0/771340919 wait complete. 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.548+0000 7f10fa59f740 20 client.16080 trim_cache size 0 max 16384 2024-04-30T23:15:07.558 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 msgr2=0x7f10d80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 0x7f10d80a60c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10e40ce480 tx=0x7f10e4097300 comp rx=0 tx=0).stop 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 msgr2=0x7f10ec1a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f10e400eaa0 tx=0x7f10e400ef60 comp rx=0 tx=0).stop 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 shutdown_connections 2024-04-30T23:15:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f10d80a3bb0 0x7f10d80a60c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10ec109a70 0x7f10ec1a1760 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ec104d70 0x7f10ec19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 --2- 172.21.15.100:0/3407701958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10ec103b30 0x7f10ec19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 >> 172.21.15.100:0/3407701958 conn(0x7f10ec0fed20 msgr2=0x7f10ec105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 shutdown_connections 2024-04-30T23:15:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.549+0000 7f10f3613640 1 -- 172.21.15.100:0/3407701958 wait complete. 2024-04-30T23:15:07.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 -- 172.21.15.100:0/217417628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c109a70 msgr2=0x7f610c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 --2- 172.21.15.100:0/217417628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c109a70 0x7f610c10be90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ca0 tx=0x7f60fc02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 -- 172.21.15.100:0/217417628 shutdown_connections 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 --2- 172.21.15.100:0/217417628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c109a70 0x7f610c10be90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 --2- 172.21.15.100:0/217417628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 0x7f610c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 --2- 172.21.15.100:0/217417628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c103b30 0x7f610c104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 -- 172.21.15.100:0/217417628 >> 172.21.15.100:0/217417628 conn(0x7f610c0fed20 msgr2=0x7f610c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 -- 172.21.15.100:0/217417628 shutdown_connections 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.669+0000 7f6111667640 1 -- 172.21.15.100:0/217417628 wait complete. 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 Processor -- start 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 -- start start 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 0x7f610c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c109a70 0x7f610c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10f640 con 0x7f610c103b30 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10f4c0 con 0x7f610c109a70 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f6111667640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10f7c0 con 0x7f610c104d70 2024-04-30T23:15:07.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41248/0 (socket says 172.21.15.100:41248) 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 -- 172.21.15.100:0/691893349 learned_addr learned my addr 172.21.15.100:0/691893349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610a7fc640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 0x7f610c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610b7fe640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c109a70 0x7f610c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 -- 172.21.15.100:0/691893349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 msgr2=0x7f610c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 0x7f610c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 -- 172.21.15.100:0/691893349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c109a70 msgr2=0x7f610c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c109a70 0x7f610c1a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 -- 172.21.15.100:0/691893349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c1a1bf0 con 0x7f610c103b30 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.670+0000 7f610affd640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f610400c970 tx=0x7f610400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.671+0000 7f60f3fff640 1 -- 172.21.15.100:0/691893349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104007c70 con 0x7f610c103b30 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.671+0000 7f60f3fff640 1 -- 172.21.15.100:0/691893349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104007e10 con 0x7f610c103b30 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.671+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c1a1ee0 con 0x7f610c103b30 2024-04-30T23:15:07.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.671+0000 7f60f3fff640 1 -- 172.21.15.100:0/691893349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61040187b0 con 0x7f610c103b30 2024-04-30T23:15:07.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.671+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c1a2340 con 0x7f610c103b30 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 Processor -- start 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 -- start start 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f60f3fff640 1 -- 172.21.15.100:0/691893349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f610400fab0 con 0x7f610c103b30 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c2444d0 0x55b17c60f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 0x55b17c616290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b17c573d80 con 0x55b17c26d390 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b17c52da20 con 0x55b17c2444d0 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f61185ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b17c56fd40 con 0x55b17c24c6b0 2024-04-30T23:15:07.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41254/0 (socket says 172.21.15.100:41254) 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 -- 172.21.15.100:0/1469321810 learned_addr learned my addr 172.21.15.100:0/1469321810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610affd640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c2444d0 0x55b17c60f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610a7fc640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 0x55b17c616290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 -- 172.21.15.100:0/1469321810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 msgr2=0x55b17c616290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 0x55b17c616290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 -- 172.21.15.100:0/1469321810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c2444d0 msgr2=0x55b17c60f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c2444d0 0x55b17c60f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610b7fe640 1 -- 172.21.15.100:0/1469321810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17c511e00 con 0x55b17c26d390 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f610a7fc640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 0x55b17c616290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.674+0000 7f60f3fff640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 0x7f60f40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f610b7fe640 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009dc0 tx=0x7f60fc0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6129aa7ee84baff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f610affd640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 0x7f60f40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f60f3fff640 1 -- 172.21.15.100:0/691893349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f61040d08d0 con 0x7f610c103b30 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f60f17fa640 1 -- 172.21.15.100:0/1469321810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc031790 con 0x55b17c26d390 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f60f17fa640 1 -- 172.21.15.100:0/1469321810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60fc036070 con 0x55b17c26d390 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.675+0000 7f60f17fa640 1 -- 172.21.15.100:0/1469321810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc02f660 con 0x55b17c26d390 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- 172.21.15.100:0/1469321810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 msgr2=0x55b17c60ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f610affd640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 0x7f60f40a60c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b17c6101f0 tx=0x7f61040d6550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009dc0 tx=0x7f60fc0098b0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- 172.21.15.100:0/1469321810 shutdown_connections 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c24c6b0 0x55b17c616290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c2444d0 0x55b17c60f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- 172.21.15.100:0/1469321810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c26d390 0x55b17c60ee10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- 172.21.15.100:0/1469321810 >> 172.21.15.100:0/1469321810 conn(0x55b17c2614e0 msgr2=0x55b17c60a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- 172.21.15.100:0/1469321810 shutdown_connections 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- 172.21.15.100:0/1469321810 wait complete. 2024-04-30T23:15:07.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- start start 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 Processor -- start 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c618a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c61ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b17c616c80 con 0x55b17c24c6b0 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b17c4fadc0 con 0x55b17c26d390 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b17c616e00 con 0x55b17c2444d0 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.676+0000 7f61185ff740 10 client.0 _ll_register_callbacks cb 0x55b17c516600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41258/0 (socket says 172.21.15.100:41258) 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 -- 172.21.15.100:0/160556379 learned_addr learned my addr 172.21.15.100:0/160556379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610b7fe640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c618a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610b7fe640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c61ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 -- 172.21.15.100:0/160556379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 msgr2=0x55b17c618a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c618a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 -- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 msgr2=0x55b17c61ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c61ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 -- 172.21.15.100:0/160556379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17c538c30 con 0x55b17c24c6b0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610b7fe640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c618a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f610a7fc640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f610000f430 tx=0x7f610000f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca9e8c6fb3be00c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f60eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100004220 con 0x55b17c24c6b0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f61000043c0 con 0x55b17c24c6b0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60fc036070 con 0x55b17c24c6b0 2024-04-30T23:15:07.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6100022050 con 0x55b17c24c6b0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f61185ff740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.677+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b17c2853f0 con 0x55b17c24c6b0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60fc036070 con 0x55b17c24c6b0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6100003a50 con 0x55b17c24c6b0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 20 client.16092 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c22bf60 0x55b17c6267b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 4 client.16092 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b17c56d810 con 0x55b17c22bf60 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.678+0000 7f610b7fe640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c22bf60 0x55b17c6267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f610b7fe640 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c22bf60 0x55b17c6267b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6681dffd972b292b server_cookie=8ab8f263bd815519 in_seq=0 out_seq=0 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f60eeff5640 10 client.16092 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:07.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f60eeff5640 1 -- 172.21.15.100:0/160556379 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55b17c56d810 con 0x55b17c22bf60 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f60eeff5640 10 client.16092 handle_command_reply: tid=0 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 client.16092 shutdown 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 msgr2=0x55b17c618fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f610000f430 tx=0x7f610000f8f0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 shutdown_connections 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c22bf60 0x55b17c6267b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c61ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c618fa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f60eeff5640 0 client.16092 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 --2- 172.21.15.100:0/160556379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c618a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 >> 172.21.15.100:0/160556379 conn(0x55b17c2614e0 msgr2=0x55b17c6099c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.679+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 shutdown_connections 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.680+0000 7f61185ff740 1 -- 172.21.15.100:0/160556379 wait complete. 2024-04-30T23:15:07.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.680+0000 7f61185ff740 20 client.16092 trim_cache size 0 max 16384 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 Processor -- start 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 -- start start 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c62af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c62b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1ac720 con 0x55b17c24c6b0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1ae260 con 0x55b17c26d390 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f61185ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1acdf0 con 0x55b17c2444d0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f610a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f610a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41268/0 (socket says 172.21.15.100:41268) 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f610a7fc640 1 -- 172.21.15.100:0/2211886475 learned_addr learned my addr 172.21.15.100:0/2211886475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c62b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.693+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c62af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 -- 172.21.15.100:0/2211886475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 msgr2=0x55b17c62af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c62af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 -- 172.21.15.100:0/2211886475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 msgr2=0x55b17c62b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c62b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 -- 172.21.15.100:0/2211886475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17c34f7d0 con 0x55b17c24c6b0 2024-04-30T23:15:07.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c62b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f610000a9a0 tx=0x7f610000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddab385cb194d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f60f0ff9640 1 -- 172.21.15.100:0/2211886475 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610001f040 con 0x55b17c24c6b0 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f60f0ff9640 1 -- 172.21.15.100:0/2211886475 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f610002b030 con 0x55b17c24c6b0 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f60f0ff9640 1 -- 172.21.15.100:0/2211886475 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100003850 con 0x55b17c24c6b0 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f61185ff740 1 -- 172.21.15.100:0/2211886475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 msgr2=0x55b17c61fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.694+0000 7f61185ff740 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f610000a9a0 tx=0x7f610000a660 comp rx=0 tx=0).stop 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- 172.21.15.100:0/2211886475 shutdown_connections 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c26d390 0x55b17c62b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c24c6b0 0x55b17c61fe20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- 172.21.15.100:0/2211886475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c2444d0 0x55b17c62af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- 172.21.15.100:0/2211886475 >> 172.21.15.100:0/2211886475 conn(0x55b17c2614e0 msgr2=0x55b17c612ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- 172.21.15.100:0/2211886475 shutdown_connections 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- 172.21.15.100:0/2211886475 wait complete. 2024-04-30T23:15:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- start start 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 Processor -- start 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c24c6b0 0x55b17c61d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c26d390 0x55b17c61e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1adb90 con 0x55b17c2444d0 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1ad4c0 con 0x55b17c24c6b0 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1aa700 con 0x55b17c26d390 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f61185ff740 10 client.0 _ll_register_callbacks cb 0x7f610000a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41282/0 (socket says 172.21.15.100:41282) 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f610b7fe640 1 -- 172.21.15.100:0/2721144124 learned_addr learned my addr 172.21.15.100:0/2721144124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c24c6b0 0x55b17c61d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.695+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c26d390 0x55b17c61e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 -- 172.21.15.100:0/2721144124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c26d390 msgr2=0x55b17c61e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c26d390 0x55b17c61e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 -- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c24c6b0 msgr2=0x55b17c61d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c24c6b0 0x55b17c61d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 -- 172.21.15.100:0/2721144124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17c61ede0 con 0x55b17c2444d0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f610b7fe640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ca0 tx=0x7f610000a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c607815d157c02f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc049040 con 0x55b17c2444d0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f60fc003d00 con 0x55b17c2444d0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f610002b030 con 0x55b17c2444d0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f60fc062050 con 0x55b17c2444d0 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b17c6200c0 con 0x55b17c2444d0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f610002b030 con 0x55b17c2444d0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f60fc04f070 con 0x55b17c2444d0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 20 client.16098 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c2013a0 0x55b17c68eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 4 client.16098 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.696+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b17c581990 con 0x55b17c2013a0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c2013a0 0x55b17c68eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f60eeff5640 10 client.16098 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f610a7fc640 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c2013a0 0x55b17c68eb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=746cb99eca6bc4a1 server_cookie=aa1572d623f96f83 in_seq=0 out_seq=0 2024-04-30T23:15:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f60eeff5640 1 -- 172.21.15.100:0/2721144124 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b17c581990 con 0x55b17c2013a0 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f60eeff5640 10 client.16098 handle_command_reply: tid=0 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 client.16098 shutdown 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 msgr2=0x55b17c61d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ca0 tx=0x7f610000a9d0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 shutdown_connections 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b17c26d390 0x55b17c61e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x55b17c2013a0 0x55b17c68eb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b17c24c6b0 0x55b17c61d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 --2- 172.21.15.100:0/2721144124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b17c2444d0 0x55b17c61d3b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 >> 172.21.15.100:0/2721144124 conn(0x55b17c2614e0 msgr2=0x55b17c60d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.697+0000 7f60eeff5640 0 client.16098 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 shutdown_connections 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f61185ff740 1 -- 172.21.15.100:0/2721144124 wait complete. 2024-04-30T23:15:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f61185ff740 20 client.16098 trim_cache size 0 max 16384 2024-04-30T23:15:07.707 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 msgr2=0x7f60f40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 0x7f60f40a60c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b17c6101f0 tx=0x7f61040d6550 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 msgr2=0x7f610c19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f610400c970 tx=0x7f610400ce30 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 shutdown_connections 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60f40a3bb0 0x7f60f40a60c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c109a70 0x7f610c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f610c104d70 0x7f610c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 --2- 172.21.15.100:0/691893349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f610c103b30 0x7f610c19a160 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 >> 172.21.15.100:0/691893349 conn(0x7f610c0fed20 msgr2=0x7f610c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 shutdown_connections 2024-04-30T23:15:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.698+0000 7f6111667640 1 -- 172.21.15.100:0/691893349 wait complete. 2024-04-30T23:15:07.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.819+0000 7f2426f9d640 1 -- 172.21.15.100:0/3755617290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420108960 msgr2=0x7f242010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.819+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3755617290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420108960 0x7f242010ad80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2418009ca0 tx=0x7f241802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- 172.21.15.100:0/3755617290 shutdown_connections 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3755617290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420108960 0x7f242010ad80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3755617290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420103c60 0x7f2420104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3755617290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420102a20 0x7f2420103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- 172.21.15.100:0/3755617290 >> 172.21.15.100:0/3755617290 conn(0x7f24200fdc10 msgr2=0x7f24201000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- 172.21.15.100:0/3755617290 shutdown_connections 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- 172.21.15.100:0/3755617290 wait complete. 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 Processor -- start 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- start start 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420103c60 0x7f242019f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420108960 0x7f24201a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f242010e530 con 0x7f2420102a20 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f242010e3b0 con 0x7f2420108960 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.820+0000 7f2426f9d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f242010e6b0 con 0x7f2420103c60 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41306/0 (socket says 172.21.15.100:41306) 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 -- 172.21.15.100:0/3069325909 learned_addr learned my addr 172.21.15.100:0/3069325909 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 -- 172.21.15.100:0/3069325909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420103c60 msgr2=0x7f242019f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f241ffff640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420103c60 0x7f242019f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420103c60 0x7f242019f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 -- 172.21.15.100:0/3069325909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420108960 msgr2=0x7f24201a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f242553a640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420108960 0x7f24201a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420108960 0x7f24201a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 -- 172.21.15.100:0/3069325909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24201a1d20 con 0x7f2420102a20 2024-04-30T23:15:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2424d39640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f241000c970 tx=0x7f241000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:07 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/637497114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f241dffb640 1 -- 172.21.15.100:0/3069325909 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410007c70 con 0x7f2420102a20 2024-04-30T23:15:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f241dffb640 1 -- 172.21.15.100:0/3069325909 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410007e10 con 0x7f2420102a20 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f241dffb640 1 -- 172.21.15.100:0/3069325909 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24100187b0 con 0x7f2420102a20 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.821+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24201a1fb0 con 0x7f2420102a20 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.822+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24201a2470 con 0x7f2420102a20 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f241dffb640 1 -- 172.21.15.100:0/3069325909 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f241000fab0 con 0x7f2420102a20 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 Processor -- start 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 -- start start 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca2be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556c3c990d80 con 0x556c3c6696b0 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c3c94aa20 con 0x556c3c68a390 2024-04-30T23:15:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242de51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556c3c98cd40 con 0x556c3c6614d0 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41320/0 (socket says 172.21.15.100:41320) 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f241ffff640 1 -- 172.21.15.100:0/2263348318 learned_addr learned my addr 172.21.15.100:0/2263348318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f242553a640 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca2be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.824+0000 7f2424d39640 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241dffb640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 0x7f24080a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 -- 172.21.15.100:0/2263348318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 msgr2=0x556c3ca2c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 -- 172.21.15.100:0/2263348318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 msgr2=0x556c3ca2be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca2be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 -- 172.21.15.100:0/2263348318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c3c92ee00 con 0x556c3c6696b0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f242553a640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 0x7f24080a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241dffb640 1 -- 172.21.15.100:0/3069325909 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f24100d08f0 con 0x7f2420102a20 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f241ffff640 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f241400ba90 tx=0x7f241400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dade58a70e455f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f2406ffd640 1 -- 172.21.15.100:0/2263348318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414017420 con 0x556c3c6696b0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f2406ffd640 1 -- 172.21.15.100:0/2263348318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2414017a70 con 0x556c3c6696b0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.825+0000 7f2406ffd640 1 -- 172.21.15.100:0/2263348318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241400fa30 con 0x556c3c6696b0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- 172.21.15.100:0/2263348318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 msgr2=0x556c3ca33290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242553a640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 0x7f24080a60c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2418031b50 tx=0x7f241802a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f241400ba90 tx=0x7f241400bf50 comp rx=0 tx=0).stop 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- 172.21.15.100:0/2263348318 shutdown_connections 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca33290 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 --2- 172.21.15.100:0/2263348318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca2be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- 172.21.15.100:0/2263348318 >> 172.21.15.100:0/2263348318 conn(0x556c3c67e4e0 msgr2=0x556c3ca277a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- 172.21.15.100:0/2263348318 shutdown_connections 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- 172.21.15.100:0/2263348318 wait complete. 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 -- start start 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.826+0000 7f242de51740 1 Processor -- start 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca35a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556c3ca33ce0 con 0x556c3c6696b0 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c3c917dc0 con 0x556c3c6614d0 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556c3ca33e60 con 0x556c3c68a390 2024-04-30T23:15:07.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242de51740 10 client.0 _ll_register_callbacks cb 0x556c3c933600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41324/0 (socket says 172.21.15.100:41324) 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 -- 172.21.15.100:0/2327954244 learned_addr learned my addr 172.21.15.100:0/2327954244 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f242553a640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f2424d39640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca35a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 -- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 msgr2=0x556c3ca3cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 -- 172.21.15.100:0/2327954244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 msgr2=0x556c3ca35a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca35a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 -- 172.21.15.100:0/2327954244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c3c955c30 con 0x556c3c6696b0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f241ffff640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2414005bd0 tx=0x7f241400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49c31ec02b4e842 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.827+0000 7f23fffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414025070 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2414005040 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2414017a70 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2414031050 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c3c6a23f0 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2414017a70 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24140046c0 con 0x556c3c6696b0 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 10 client.16110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 20 client.16110 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c648f60 0x556c3ca434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 4 client.16110 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c3c98a810 con 0x556c3c648f60 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.828+0000 7f2424d39640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c648f60 0x556c3ca434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.829+0000 7f23fffff640 10 client.16110 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.829+0000 7f2424d39640 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c648f60 0x556c3ca434b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c7f01e9fab31396 server_cookie=9cdeb4cbcee7136c in_seq=0 out_seq=0 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f23fffff640 1 -- 172.21.15.100:0/2327954244 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x556c3c98a810 con 0x556c3c648f60 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f23fffff640 10 client.16110 handle_command_reply: tid=0 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 client.16110 shutdown 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 msgr2=0x556c3ca35fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2414005bd0 tx=0x7f241400b6f0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 shutdown_connections 2024-04-30T23:15:07.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c648f60 0x556c3ca434b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca35fc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 --2- 172.21.15.100:0/2327954244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca35a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f23fffff640 0 client.16110 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 >> 172.21.15.100:0/2327954244 conn(0x556c3c67e4e0 msgr2=0x556c3ca269c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 shutdown_connections 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 1 -- 172.21.15.100:0/2327954244 wait complete. 2024-04-30T23:15:07.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.830+0000 7f242de51740 20 client.16110 trim_cache size 0 max 16384 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 Processor -- start 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 -- start start 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca48c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24201ac880 con 0x556c3c6696b0 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f24201ae3c0 con 0x556c3c68a390 2024-04-30T23:15:07.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.843+0000 7f242de51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f24201acf50 con 0x556c3c6614d0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41334/0 (socket says 172.21.15.100:41334) 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 -- 172.21.15.100:0/79160064 learned_addr learned my addr 172.21.15.100:0/79160064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f2424d39640 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f242553a640 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca48c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 -- 172.21.15.100:0/79160064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 msgr2=0x556c3ca2ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 -- 172.21.15.100:0/79160064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 msgr2=0x556c3ca48c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca48c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 -- 172.21.15.100:0/79160064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c3c76c7d0 con 0x556c3c6696b0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f241ffff640 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2414004c50 tx=0x7f2414005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac385f1520f5f8ea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f24067fc640 1 -- 172.21.15.100:0/79160064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414025040 con 0x556c3c6696b0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f24067fc640 1 -- 172.21.15.100:0/79160064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f241402e070 con 0x556c3c6696b0 2024-04-30T23:15:07.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.844+0000 7f24067fc640 1 -- 172.21.15.100:0/79160064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241400fcb0 con 0x556c3c6696b0 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- 172.21.15.100:0/79160064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 msgr2=0x556c3ca3ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2414004c50 tx=0x7f2414005ce0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- 172.21.15.100:0/79160064 shutdown_connections 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c68a390 0x556c3ca48c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3ce40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 --2- 172.21.15.100:0/79160064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c6614d0 0x556c3ca2ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- 172.21.15.100:0/79160064 >> 172.21.15.100:0/79160064 conn(0x556c3c67e4e0 msgr2=0x556c3ca2afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- 172.21.15.100:0/79160064 shutdown_connections 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- 172.21.15.100:0/79160064 wait complete. 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 -- start start 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.845+0000 7f242de51740 1 Processor -- start 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca3a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24201adcf0 con 0x556c3c6696b0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f24201ad620 con 0x556c3c6614d0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f24201aa860 con 0x556c3c68a390 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 10 client.0 _ll_register_callbacks cb 0x7f2418009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41350/0 (socket says 172.21.15.100:41350) 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 -- 172.21.15.100:0/4049451598 learned_addr learned my addr 172.21.15.100:0/4049451598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242553a640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f2424d39640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca3a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 -- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 msgr2=0x556c3ca3bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 -- 172.21.15.100:0/4049451598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 msgr2=0x556c3ca3a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca3a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 -- 172.21.15.100:0/4049451598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c3ca3c3a0 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f241ffff640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f241400d7d0 tx=0x7f241400f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478d45fcf9a80220 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f23fffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414044060 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f241400fa30 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.846+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f241402e070 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f241404b050 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 10 client.16116 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c3caa9800 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f241402e070 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2414004fd0 con 0x556c3c6696b0 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:15:07.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 20 client.16116 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c61e3a0 0x556c3caac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 4 client.16116 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c3c99e990 con 0x556c3c61e3a0 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.847+0000 7f2424d39640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c61e3a0 0x556c3caac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f23fffff640 10 client.16116 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f2424d39640 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c61e3a0 0x556c3caac1c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb14ee966a275bce server_cookie=611f4fb898da20b3 in_seq=0 out_seq=0 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f23fffff640 1 -- 172.21.15.100:0/4049451598 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c3c99e990 con 0x556c3c61e3a0 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f23fffff640 10 client.16116 handle_command_reply: tid=0 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 client.16116 shutdown 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 msgr2=0x556c3ca3aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f241400d7d0 tx=0x7f241400f530 comp rx=0 tx=0).stop 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 shutdown_connections 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x556c3c61e3a0 0x556c3caac1c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c3c68a390 0x556c3ca3bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c3c6696b0 0x556c3ca3aeb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f23fffff640 0 client.16116 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 --2- 172.21.15.100:0/4049451598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c3c6614d0 0x556c3ca3a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 >> 172.21.15.100:0/4049451598 conn(0x556c3c67e4e0 msgr2=0x556c3ca2afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 shutdown_connections 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 1 -- 172.21.15.100:0/4049451598 wait complete. 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.848+0000 7f242de51740 20 client.16116 trim_cache size 0 max 16384 2024-04-30T23:15:07.857 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 msgr2=0x7f24080a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 0x7f24080a60c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2418031b50 tx=0x7f241802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 msgr2=0x7f2420075880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f241000c970 tx=0x7f241000ce30 comp rx=0 tx=0).stop 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 shutdown_connections 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24080a3bb0 0x7f24080a60c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2420108960 0x7f24201a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2420103c60 0x7f242019f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 --2- 172.21.15.100:0/3069325909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2420102a20 0x7f2420075880 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 >> 172.21.15.100:0/3069325909 conn(0x7f24200fdc10 msgr2=0x7f2420104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 shutdown_connections 2024-04-30T23:15:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.849+0000 7f2426f9d640 1 -- 172.21.15.100:0/3069325909 wait complete. 2024-04-30T23:15:07.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 -- 172.21.15.100:0/3675156437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280108970 msgr2=0x7f328010ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 --2- 172.21.15.100:0/3675156437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280108970 0x7f328010ad90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3278009ca0 tx=0x7f327802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 -- 172.21.15.100:0/3675156437 shutdown_connections 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 --2- 172.21.15.100:0/3675156437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280108970 0x7f328010ad90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 --2- 172.21.15.100:0/3675156437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280103c70 0x7f3280104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 --2- 172.21.15.100:0/3675156437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280102a30 0x7f3280103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 -- 172.21.15.100:0/3675156437 >> 172.21.15.100:0/3675156437 conn(0x7f32800fdc00 msgr2=0x7f32801000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 -- 172.21.15.100:0/3675156437 shutdown_connections 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.970+0000 7f3286e1b640 1 -- 172.21.15.100:0/3675156437 wait complete. 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 Processor -- start 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 -- start start 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280102a30 0x7f3280199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 0x7f32801a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e560 con 0x7f3280103c70 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e3e0 con 0x7f3280108970 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3286e1b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e6e0 con 0x7f3280102a30 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f327ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f327ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41364/0 (socket says 172.21.15.100:41364) 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f327ffff640 1 -- 172.21.15.100:0/874665974 learned_addr learned my addr 172.21.15.100:0/874665974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.971+0000 7f3284bb7640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280102a30 0x7f3280199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f32853b8640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 0x7f32801a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 -- 172.21.15.100:0/874665974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280102a30 msgr2=0x7f3280199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280102a30 0x7f3280199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 -- 172.21.15.100:0/874665974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 msgr2=0x7f32801a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 0x7f32801a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 -- 172.21.15.100:0/874665974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32801a0c40 con 0x7f3280103c70 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f32853b8640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 0x7f32801a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327ffff640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f326c00e9f0 tx=0x7f326c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327dffb640 1 -- 172.21.15.100:0/874665974 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c00cd80 con 0x7f3280103c70 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32801a0f30 con 0x7f3280103c70 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327dffb640 1 -- 172.21.15.100:0/874665974 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f326c0054d0 con 0x7f3280103c70 2024-04-30T23:15:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f327dffb640 1 -- 172.21.15.100:0/874665974 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c010690 con 0x7f3280103c70 2024-04-30T23:15:07.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.972+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a1390 con 0x7f3280103c70 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f327dffb640 1 -- 172.21.15.100:0/874665974 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f326c004e90 con 0x7f3280103c70 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 Processor -- start 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 -- start start 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bce4d0 0x560d53f99390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bd66b0 0x560d53fa0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d53efdd80 con 0x560d53bf7390 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d53eb7a20 con 0x560d53bd66b0 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.975+0000 7f328dda8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560d53ef9d40 con 0x560d53bce4d0 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f327dffb640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 0x7f32700a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41370/0 (socket says 172.21.15.100:41370) 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 -- 172.21.15.100:0/246423215 learned_addr learned my addr 172.21.15.100:0/246423215 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 0x7f32700a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f327dffb640 1 -- 172.21.15.100:0/874665974 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f326c0d0cb0 con 0x7f3280103c70 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f3284bb7640 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bce4d0 0x560d53f99390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f327ffff640 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bd66b0 0x560d53fa0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 -- 172.21.15.100:0/246423215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bce4d0 msgr2=0x560d53f99390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bce4d0 0x560d53f99390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 -- 172.21.15.100:0/246423215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bd66b0 msgr2=0x560d53fa0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bd66b0 0x560d53fa0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 -- 172.21.15.100:0/246423215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d53e9be00 con 0x560d53bf7390 2024-04-30T23:15:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f32780094e0 tx=0x7f3278031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7222e467d8f8fb62 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f32853b8640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 0x7f32700a60c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f32780314c0 tx=0x7f3278042000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.976+0000 7f326affd640 1 -- 172.21.15.100:0/246423215 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327804e070 con 0x560d53bf7390 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f326affd640 1 -- 172.21.15.100:0/246423215 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3278036050 con 0x560d53bf7390 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f326affd640 1 -- 172.21.15.100:0/246423215 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278004750 con 0x560d53bf7390 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 -- 172.21.15.100:0/246423215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 msgr2=0x560d53f98e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f32780094e0 tx=0x7f3278031450 comp rx=0 tx=0).stop 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 -- 172.21.15.100:0/246423215 shutdown_connections 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bd66b0 0x560d53fa0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bce4d0 0x560d53f99390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 --2- 172.21.15.100:0/246423215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53f98e10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 -- 172.21.15.100:0/246423215 >> 172.21.15.100:0/246423215 conn(0x560d53beb4e0 msgr2=0x560d53f947a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 -- 172.21.15.100:0/246423215 shutdown_connections 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.977+0000 7f328dda8740 1 -- 172.21.15.100:0/246423215 wait complete. 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 -- start start 2024-04-30T23:15:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 Processor -- start 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d53fa0c80 con 0x560d53bf7390 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d53e84dc0 con 0x560d53bce4d0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560d53fa0e00 con 0x560d53bd66b0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f328dda8740 10 client.0 _ll_register_callbacks cb 0x560d53ea0600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41386/0 (socket says 172.21.15.100:41386) 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.978+0000 7f32853b8640 1 -- 172.21.15.100:0/2599223432 learned_addr learned my addr 172.21.15.100:0/2599223432 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f327ffff640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f3284bb7640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 -- 172.21.15.100:0/2599223432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 msgr2=0x560d53fa30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 -- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 msgr2=0x560d53fa2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 -- 172.21.15.100:0/2599223432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d53ec2c30 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f3284bb7640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f32853b8640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3278009ca0 tx=0x7f327802f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb41e2de58263d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278057070 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f3278004040 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3278036050 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3278063050 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f328dda8740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d53c0f3f0 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.979+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3278036050 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f32780305c0 con 0x560d53bf7390 2024-04-30T23:15:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 20 client.16128 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53bb5f60 0x560d53fb03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 4 client.16128 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d53ef7810 con 0x560d53bb5f60 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f3284bb7640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53bb5f60 0x560d53fb03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f3284bb7640 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53bb5f60 0x560d53fb03f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53efc523f531c51a server_cookie=65c0948c75b086bb in_seq=0 out_seq=0 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.980+0000 7f325ffff640 10 client.16128 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f325ffff640 1 -- 172.21.15.100:0/2599223432 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x560d53ef7810 con 0x560d53bb5f60 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f325ffff640 10 client.16128 handle_command_reply: tid=0 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 client.16128 shutdown 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 msgr2=0x560d53fa9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3278009ca0 tx=0x7f327802f930 comp rx=0 tx=0).stop 2024-04-30T23:15:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 shutdown_connections 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53bb5f60 0x560d53fb03f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa9fa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f325ffff640 0 client.16128 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 --2- 172.21.15.100:0/2599223432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 >> 172.21.15.100:0/2599223432 conn(0x560d53beb4e0 msgr2=0x560d53f939c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 shutdown_connections 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 1 -- 172.21.15.100:0/2599223432 wait complete. 2024-04-30T23:15:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.981+0000 7f328dda8740 20 client.16128 trim_cache size 0 max 16384 2024-04-30T23:15:08.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 Processor -- start 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 -- start start 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bf7390 0x560d53f97cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ab7b0 con 0x560d53bd66b0 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ad2f0 con 0x560d53bce4d0 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f328dda8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32801abe80 con 0x560d53bf7390 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f327ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f327ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41388/0 (socket says 172.21.15.100:41388) 2024-04-30T23:15:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.995+0000 7f327ffff640 1 -- 172.21.15.100:0/986039034 learned_addr learned my addr 172.21.15.100:0/986039034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f3284bb7640 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 -- 172.21.15.100:0/986039034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bf7390 msgr2=0x560d53f97cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bf7390 0x560d53f97cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 -- 172.21.15.100:0/986039034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 msgr2=0x560d53fa1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 -- 172.21.15.100:0/986039034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d53cd97d0 con 0x560d53bd66b0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f3284bb7640 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f327ffff640 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c6a0 tx=0x7f326c09c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbb1d918e39a7ec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f326a7fc640 1 -- 172.21.15.100:0/986039034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c005180 con 0x560d53bd66b0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f326a7fc640 1 -- 172.21.15.100:0/986039034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f326c09d330 con 0x560d53bd66b0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.996+0000 7f326a7fc640 1 -- 172.21.15.100:0/986039034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c0a49d0 con 0x560d53bd66b0 2024-04-30T23:15:08.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- 172.21.15.100:0/986039034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 msgr2=0x560d53fa9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c6a0 tx=0x7f326c09c830 comp rx=0 tx=0).stop 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- 172.21.15.100:0/986039034 shutdown_connections 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bf7390 0x560d53f97cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bd66b0 0x560d53fa9ec0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- 172.21.15.100:0/986039034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- 172.21.15.100:0/986039034 >> 172.21.15.100:0/986039034 conn(0x560d53beb4e0 msgr2=0x560d53f975a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- 172.21.15.100:0/986039034 shutdown_connections 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- 172.21.15.100:0/986039034 wait complete. 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- start start 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 Processor -- start 2024-04-30T23:15:08.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32801acc20 con 0x560d53bf7390 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ac550 con 0x560d53bce4d0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32801a9790 con 0x560d53bd66b0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.997+0000 7f328dda8740 10 client.0 _ll_register_callbacks cb 0x7f326c004990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41394/0 (socket says 172.21.15.100:41394) 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 -- 172.21.15.100:0/1011977366 learned_addr learned my addr 172.21.15.100:0/1011977366 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f3284bb7640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f327ffff640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 -- 172.21.15.100:0/1011977366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 msgr2=0x560d53fa7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 -- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 msgr2=0x560d53fa7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 -- 172.21.15.100:0/1011977366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d53fa9200 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f327ffff640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f32853b8640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3278030b30 tx=0x7f3278031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fd92b6076349af server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278060020 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f32780305c0 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f326c09d330 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f327806e050 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f328dda8740 10 client.16134 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.998+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d540165d0 con 0x560d53bf7390 2024-04-30T23:15:08.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f326c09d330 con 0x560d53bf7390 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f32780044f0 con 0x560d53bf7390 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 10 client.16134 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 20 client.16134 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53b8b3a0 0x560d54018ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 4 client.16134 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d53f0b990 con 0x560d53b8b3a0 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f3284bb7640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53b8b3a0 0x560d54018ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f3284bb7640 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53b8b3a0 0x560d54018ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a7953843ccf4e9c server_cookie=4329735c2004b815 in_seq=0 out_seq=0 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:07.999+0000 7f325ffff640 10 client.16134 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f325ffff640 1 -- 172.21.15.100:0/1011977366 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d53f0b990 con 0x560d53b8b3a0 2024-04-30T23:15:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f325ffff640 10 client.16134 handle_command_reply: tid=0 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 client.16134 shutdown 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 msgr2=0x560d53fa8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3278030b30 tx=0x7f3278031570 comp rx=0 tx=0).stop 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 shutdown_connections 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560d53b8b3a0 0x560d54018ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d53bf7390 0x560d53fa8c40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d53bd66b0 0x560d53fa7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 --2- 172.21.15.100:0/1011977366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d53bce4d0 0x560d53fa7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 >> 172.21.15.100:0/1011977366 conn(0x560d53beb4e0 msgr2=0x560d53f97fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f325ffff640 0 client.16134 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 shutdown_connections 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 1 -- 172.21.15.100:0/1011977366 wait complete. 2024-04-30T23:15:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f328dda8740 20 client.16134 trim_cache size 0 max 16384 2024-04-30T23:15:08.010 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 msgr2=0x7f32700a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 0x7f32700a60c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f32780314c0 tx=0x7f3278042000 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 msgr2=0x7f32801996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f326c00e9f0 tx=0x7f326c00edf0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 shutdown_connections 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f32700a3bb0 0x7f32700a60c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.000+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3280108970 0x7f32801a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.001+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3280103c70 0x7f32801996b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.001+0000 7f3286e1b640 1 --2- 172.21.15.100:0/874665974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3280102a30 0x7f3280199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.001+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 >> 172.21.15.100:0/874665974 conn(0x7f32800fdc00 msgr2=0x7f3280104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:08.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.001+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 shutdown_connections 2024-04-30T23:15:08.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:08.001+0000 7f3286e1b640 1 -- 172.21.15.100:0/874665974 wait complete. 2024-04-30T23:15:08.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:07 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/637497114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:08.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:07 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/637497114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:09.014 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:15:09.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:15:09.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:15:09.040 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:08 smithi100 ceph-mon[29745]: pgmap v419: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-04-30T23:15:09.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:08 smithi104 ceph-mon[32987]: pgmap v419: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-04-30T23:15:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:08 smithi183 ceph-mon[33560]: pgmap v419: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-04-30T23:15:09.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1986894432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 msgr2=0x7f9b58103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1986894432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b58103720 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009900 tx=0x7f9b4802a410 comp rx=0 tx=0).stop 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1986894432 shutdown_connections 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1986894432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 0x7f9b5810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1986894432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 0x7f9b58104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1986894432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b58103720 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1986894432 >> 172.21.15.100:0/1986894432 conn(0x7f9b580fdc10 msgr2=0x7f9b581000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1986894432 shutdown_connections 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.145+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1986894432 wait complete. 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 Processor -- start 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 -- start start 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 0x7f9b5819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 0x7f9b581a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810e500 con 0x7f9b58102a20 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810e380 con 0x7f9b58108960 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5cad1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810e680 con 0x7f9b58103c60 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41398/0 (socket says 172.21.15.100:41398) 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.146+0000 7f9b5659c640 1 -- 172.21.15.100:0/1938800466 learned_addr learned my addr 172.21.15.100:0/1938800466 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 0x7f9b581a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 0x7f9b5819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 -- 172.21.15.100:0/1938800466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 msgr2=0x7f9b5819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 0x7f9b5819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 -- 172.21.15.100:0/1938800466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 msgr2=0x7f9b581a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 0x7f9b581a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 -- 172.21.15.100:0/1938800466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b581a2080 con 0x7f9b58102a20 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5659c640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006010 tx=0x7f9b48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b4f7fe640 1 -- 172.21.15.100:0/1938800466 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4803f030 con 0x7f9b58102a20 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b581a2310 con 0x7f9b58102a20 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b4f7fe640 1 -- 172.21.15.100:0/1938800466 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b48003aa0 con 0x7f9b58102a20 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b4f7fe640 1 -- 172.21.15.100:0/1938800466 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48035070 con 0x7f9b58102a20 2024-04-30T23:15:09.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.147+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581a2800 con 0x7f9b58102a20 2024-04-30T23:15:09.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.149+0000 7f9b4f7fe640 1 -- 172.21.15.100:0/1938800466 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9b48042030 con 0x7f9b58102a20 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 Processor -- start 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 -- start start 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f8510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f851620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c3f7b1b00 con 0x555c3f48a730 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555c3f74d920 con 0x555c3f482550 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b63985740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555c3f7adac0 con 0x555c3f4ab410 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b4f7fe640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 0x7f9b440a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b5659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f851620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 0x7f9b440a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41414/0 (socket says 172.21.15.100:41414) 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b4ffff640 1 -- 172.21.15.100:0/512654739 learned_addr learned my addr 172.21.15.100:0/512654739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.150+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f8510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4f7fe640 1 -- 172.21.15.100:0/1938800466 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9b480f0bf0 con 0x7f9b58102a20 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 -- 172.21.15.100:0/512654739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 msgr2=0x555c3f8510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f8510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 -- 172.21.15.100:0/512654739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 msgr2=0x555c3f851620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f851620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 -- 172.21.15.100:0/512654739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3f58b7e0 con 0x555c3f48a730 2024-04-30T23:15:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 0x7f9b440a60c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9b50005fd0 tx=0x7f9b50009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009b90 tx=0x7f9b4000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c1e55fda6dc836 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4cff9640 1 -- 172.21.15.100:0/512654739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40016070 con 0x555c3f48a730 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4cff9640 1 -- 172.21.15.100:0/512654739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b40011920 con 0x555c3f48a730 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.151+0000 7f9b4cff9640 1 -- 172.21.15.100:0/512654739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400106c0 con 0x555c3f48a730 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- 172.21.15.100:0/512654739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 msgr2=0x555c3f858520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009b90 tx=0x7f9b4000e6c0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- 172.21.15.100:0/512654739 shutdown_connections 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f858520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f851620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 --2- 172.21.15.100:0/512654739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f8510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- 172.21.15.100:0/512654739 >> 172.21.15.100:0/512654739 conn(0x555c3f49f560 msgr2=0x555c3f848620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- 172.21.15.100:0/512654739 shutdown_connections 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- 172.21.15.100:0/512654739 wait complete. 2024-04-30T23:15:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.152+0000 7f9b63985740 1 -- start start 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 Processor -- start 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f862160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c3f858f70 con 0x555c3f482550 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555c3f74b5d0 con 0x555c3f48a730 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555c3f8590f0 con 0x555c3f4ab410 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b63985740 10 client.0 _ll_register_callbacks cb 0x555c3f75aa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41422/0 (socket says 172.21.15.100:41422) 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 -- 172.21.15.100:0/3402785180 learned_addr learned my addr 172.21.15.100:0/3402785180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f862160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 -- 172.21.15.100:0/3402785180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 msgr2=0x555c3f862160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f862160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 -- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 msgr2=0x555c3f85b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 -- 172.21.15.100:0/3402785180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3f5ebf70 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.153+0000 7f9b5659c640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b480ee700 tx=0x7f9b4808c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd5dc1c057cea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48049050 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9b480dd0b0 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b40011920 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b480c57e0 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c3f483170 con 0x555c3f482550 2024-04-30T23:15:09.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b40011920 con 0x555c3f482550 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b480bcdd0 con 0x555c3f482550 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 20 client.16146 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f46a1f0 0x555c3f868520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 4 client.16146 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c3f7bf710 con 0x555c3f46a1f0 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.154+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f46a1f0 0x555c3f868520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.155+0000 7f9b3dffb640 10 client.16146 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.155+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f46a1f0 0x555c3f868520 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439c9a9e2e64d79f server_cookie=ed4ae32669e6222b in_seq=0 out_seq=0 2024-04-30T23:15:09.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.156+0000 7f9b3dffb640 1 -- 172.21.15.100:0/3402785180 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x555c3f7bf710 con 0x555c3f46a1f0 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.156+0000 7f9b3dffb640 10 client.16146 handle_command_reply: tid=0 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.156+0000 7f9b63985740 1 client.16146 shutdown 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 msgr2=0x555c3f85acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b480ee700 tx=0x7f9b4808c4a0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 shutdown_connections 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f46a1f0 0x555c3f868520 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f862160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b3dffb640 0 client.16146 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 --2- 172.21.15.100:0/3402785180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f482550 0x555c3f85acc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 >> 172.21.15.100:0/3402785180 conn(0x555c3f49f560 msgr2=0x555c3f8475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 shutdown_connections 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 1 -- 172.21.15.100:0/3402785180 wait complete. 2024-04-30T23:15:09.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.157+0000 7f9b63985740 20 client.16146 trim_cache size 0 max 16384 2024-04-30T23:15:09.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 Processor -- start 2024-04-30T23:15:09.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 -- start start 2024-04-30T23:15:09.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f86cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f86d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581aa790 con 0x555c3f48a730 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581ac2d0 con 0x555c3f482550 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b63985740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581aae60 con 0x555c3f4ab410 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41428/0 (socket says 172.21.15.100:41428) 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 -- 172.21.15.100:0/1133868376 learned_addr learned my addr 172.21.15.100:0/1133868376 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b5659c640 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f86cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f86d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 -- 172.21.15.100:0/1133868376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 msgr2=0x555c3f86d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f86d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 -- 172.21.15.100:0/1133868376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 msgr2=0x555c3f86cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f86cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 -- 172.21.15.100:0/1133868376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3f8591f0 con 0x555c3f48a730 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.175+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x555c3f8493b0 tx=0x7f9b4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c92edb9f21f44ba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b3ffff640 1 -- 172.21.15.100:0/1133868376 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4002e020 con 0x555c3f48a730 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b3ffff640 1 -- 172.21.15.100:0/1133868376 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b40005850 con 0x555c3f48a730 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b3ffff640 1 -- 172.21.15.100:0/1133868376 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40016040 con 0x555c3f48a730 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 -- 172.21.15.100:0/1133868376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 msgr2=0x555c3f86d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x555c3f8493b0 tx=0x7f9b4000ef60 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 -- 172.21.15.100:0/1133868376 shutdown_connections 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f4ab410 0x555c3f86d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f48a730 0x555c3f86d220 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 --2- 172.21.15.100:0/1133868376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f482550 0x555c3f86cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 -- 172.21.15.100:0/1133868376 >> 172.21.15.100:0/1133868376 conn(0x555c3f49f560 msgr2=0x555c3f84be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 -- 172.21.15.100:0/1133868376 shutdown_connections 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.176+0000 7f9b63985740 1 -- 172.21.15.100:0/1133868376 wait complete. 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 -- start start 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 Processor -- start 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f482550 0x555c3f85f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581abc00 con 0x555c3f4ab410 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581ab530 con 0x555c3f48a730 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581a8770 con 0x555c3f482550 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b63985740 10 client.0 _ll_register_callbacks cb 0x7f9b48009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41438/0 (socket says 172.21.15.100:41438) 2024-04-30T23:15:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 -- 172.21.15.100:0/2138388132 learned_addr learned my addr 172.21.15.100:0/2138388132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b5659c640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f482550 0x555c3f85f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 -- 172.21.15.100:0/2138388132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f482550 msgr2=0x555c3f85f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f482550 0x555c3f85f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 -- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 msgr2=0x555c3f85f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b56d9d640 1 -- 172.21.15.100:0/2138388132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3f860de0 con 0x555c3f4ab410 2024-04-30T23:15:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.177+0000 7f9b4ffff640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b56d9d640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003a60 tx=0x7f9b50009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2106ad0ef67d16dd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50004800 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9b5001a070 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b40005850 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b50037050 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c3f8cebf0 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b40005850 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b500294a0 con 0x555c3f4ab410 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 20 client.16152 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f43f630 0x555c3f8d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 4 client.16152 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:15:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.178+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555c3f7b9580 con 0x555c3f43f630 2024-04-30T23:15:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.179+0000 7f9b5659c640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f43f630 0x555c3f8d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.179+0000 7f9b3dffb640 10 client.16152 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.179+0000 7f9b5659c640 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f43f630 0x555c3f8d1690 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e80e3f7c63b7a server_cookie=8cdccc29b44e9c87 in_seq=0 out_seq=0 2024-04-30T23:15:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b3dffb640 1 -- 172.21.15.100:0/2138388132 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c3f7b9580 con 0x555c3f43f630 2024-04-30T23:15:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b3dffb640 10 client.16152 handle_command_reply: tid=0 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 client.16152 shutdown 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 msgr2=0x555c3f860820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9b50003a60 tx=0x7f9b50009500 comp rx=0 tx=0).stop 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 shutdown_connections 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555c3f43f630 0x555c3f8d1690 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c3f4ab410 0x555c3f860820 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b3dffb640 0 client.16152 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555c3f48a730 0x555c3f85f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 --2- 172.21.15.100:0/2138388132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c3f482550 0x555c3f85f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 >> 172.21.15.100:0/2138388132 conn(0x555c3f49f560 msgr2=0x555c3f84bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 shutdown_connections 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 1 -- 172.21.15.100:0/2138388132 wait complete. 2024-04-30T23:15:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.201+0000 7f9b63985740 20 client.16152 trim_cache size 0 max 16384 2024-04-30T23:15:09.205 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:15:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "c14be86f-5996-4cf9-8d37-56709dfaa780", 2024-04-30T23:15:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:15:09.205 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 msgr2=0x7f9b440a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 0x7f9b440a60c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9b50005fd0 tx=0x7f9b50009f00 comp rx=0 tx=0).stop 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 msgr2=0x7f9b5806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006010 tx=0x7f9b48004270 comp rx=0 tx=0).stop 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 shutdown_connections 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9b440a3bb0 0x7f9b440a60c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b58108960 0x7f9b581a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b58103c60 0x7f9b5819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 --2- 172.21.15.100:0/1938800466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b58102a20 0x7f9b5806a960 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 >> 172.21.15.100:0/1938800466 conn(0x7f9b580fdc10 msgr2=0x7f9b58104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 shutdown_connections 2024-04-30T23:15:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.202+0000 7f9b5cad1640 1 -- 172.21.15.100:0/1938800466 wait complete. 2024-04-30T23:15:09.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:15:09.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 -- 172.21.15.100:0/2160923109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064109a70 msgr2=0x7f606410be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 --2- 172.21.15.100:0/2160923109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064109a70 0x7f606410be90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f605c009ca0 tx=0x7f605c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 -- 172.21.15.100:0/2160923109 shutdown_connections 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 --2- 172.21.15.100:0/2160923109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064109a70 0x7f606410be90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 --2- 172.21.15.100:0/2160923109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064104d70 0x7f6064105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 --2- 172.21.15.100:0/2160923109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064103b30 0x7f6064104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.372+0000 7f6068dc7640 1 -- 172.21.15.100:0/2160923109 >> 172.21.15.100:0/2160923109 conn(0x7f60640fed20 msgr2=0x7f60641011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.373+0000 7f6068dc7640 1 -- 172.21.15.100:0/2160923109 shutdown_connections 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.373+0000 7f6068dc7640 1 -- 172.21.15.100:0/2160923109 wait complete. 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.373+0000 7f6068dc7640 1 Processor -- start 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.373+0000 7f6068dc7640 1 -- start start 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064103b30 0x7f60640779a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064109a70 0x7f6064076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f606410f660 con 0x7f6064104d70 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f606410f4e0 con 0x7f6064103b30 2024-04-30T23:15:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f606410f7e0 con 0x7f6064109a70 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41448/0 (socket says 172.21.15.100:41448) 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 -- 172.21.15.100:0/108527964 learned_addr learned my addr 172.21.15.100:0/108527964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f606259c640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064103b30 0x7f60640779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6062d9d640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064109a70 0x7f6064076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 -- 172.21.15.100:0/108527964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064109a70 msgr2=0x7f6064076580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064109a70 0x7f6064076580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 -- 172.21.15.100:0/108527964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064103b30 msgr2=0x7f60640779a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064103b30 0x7f60640779a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 -- 172.21.15.100:0/108527964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6064076cb0 con 0x7f6064104d70 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605bfff640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f604c00e9f0 tx=0x7f604c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605b7fe640 1 -- 172.21.15.100:0/108527964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c00cd80 con 0x7f6064104d70 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605b7fe640 1 -- 172.21.15.100:0/108527964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f604c0108e0 con 0x7f6064104d70 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641a4300 con 0x7f6064104d70 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f605b7fe640 1 -- 172.21.15.100:0/108527964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c018980 con 0x7f6064104d70 2024-04-30T23:15:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.374+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a47c0 con 0x7f6064104d70 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f605b7fe640 1 -- 172.21.15.100:0/108527964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f604c010430 con 0x7f6064104d70 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 Processor -- start 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 -- start start 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f605b7fe640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 0x7f60500a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b1f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5605b8a35b10 con 0x5605b875b6b0 2024-04-30T23:15:09.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605b8a82d80 con 0x5605b87534d0 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.377+0000 7f606fc74740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5605b8a3c8b0 con 0x5605b877c390 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6062d9d640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 0x7f60500a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:59496/0 (socket says 172.21.15.100:59496) 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f605bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 -- 172.21.15.100:0/2683582645 learned_addr learned my addr 172.21.15.100:0/2683582645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6062d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b1f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f605b7fe640 1 -- 172.21.15.100:0/108527964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f604c0d0a30 con 0x7f6064104d70 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 -- 172.21.15.100:0/2683582645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 msgr2=0x5605b8b1ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b1ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 -- 172.21.15.100:0/2683582645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 msgr2=0x5605b8b1f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b1f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 -- 172.21.15.100:0/2683582645 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b8a0da40 con 0x5605b877c390 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f605bfff640 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b1ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f606259c640 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c60 tx=0x7f6054011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e7529e6a276199 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6062d9d640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 0x7f60500a60c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f605c004af0 tx=0x7f605c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6058ff9640 1 -- 172.21.15.100:0/2683582645 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054004220 con 0x5605b877c390 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6058ff9640 1 -- 172.21.15.100:0/2683582645 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60540043c0 con 0x5605b877c390 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.378+0000 7f6058ff9640 1 -- 172.21.15.100:0/2683582645 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60540197a0 con 0x5605b877c390 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 -- 172.21.15.100:0/2683582645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 msgr2=0x5605b8b1e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c60 tx=0x7f6054011810 comp rx=0 tx=0).stop 2024-04-30T23:15:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 -- 172.21.15.100:0/2683582645 shutdown_connections 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b1f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b1ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 --2- 172.21.15.100:0/2683582645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b1e4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 -- 172.21.15.100:0/2683582645 >> 172.21.15.100:0/2683582645 conn(0x5605b87704e0 msgr2=0x5605b8b19d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 -- 172.21.15.100:0/2683582645 shutdown_connections 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.379+0000 7f606fc74740 1 -- 172.21.15.100:0/2683582645 wait complete. 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 -- start start 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 Processor -- start 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b875b6b0 0x5605b8b28830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b877c390 0x5605b8b2f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5605b8a09d10 con 0x5605b87534d0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605b8a7ed40 con 0x5605b877c390 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5605b8b20210 con 0x5605b875b6b0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606fc74740 10 client.0 _ll_register_callbacks cb 0x5605b8a8fd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41476/0 (socket says 172.21.15.100:41476) 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f606259c640 1 -- 172.21.15.100:0/3759567816 learned_addr learned my addr 172.21.15.100:0/3759567816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f6062d9d640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b877c390 0x5605b8b2f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.380+0000 7f605bfff640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b875b6b0 0x5605b8b28830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 -- 172.21.15.100:0/3759567816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b875b6b0 msgr2=0x5605b8b28830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b875b6b0 0x5605b8b28830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 -- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b877c390 msgr2=0x5605b8b2f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b877c390 0x5605b8b2f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 -- 172.21.15.100:0/3759567816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b885e7d0 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606259c640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6054005890 tx=0x7f60540052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997d15f960696f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054028070 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f60540035f0 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60540043c0 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6054034050 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606fc74740 10 client.16164 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605b87943f0 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60540043c0 con 0x5605b87534d0 2024-04-30T23:15:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.381+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6054004a90 con 0x5605b87534d0 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 10 client.16164 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 20 client.16164 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b873af60 0x5605b8b35970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 4 client.16164 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605b8a90990 con 0x5605b873af60 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f605bfff640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b873af60 0x5605b8b35970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f6049ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.382+0000 7f605bfff640 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b873af60 0x5605b8b35970 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a07a5016fa595bcd server_cookie=fef209230ca7a669 in_seq=0 out_seq=0 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f6049ffb640 1 -- 172.21.15.100:0/3759567816 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5605b8a90990 con 0x5605b873af60 2024-04-30T23:15:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f6049ffb640 10 client.16164 handle_command_reply: tid=0 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f606fc74740 1 client.16164 shutdown 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 msgr2=0x5605b8b282f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6054005890 tx=0x7f60540052f0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 shutdown_connections 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.385+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b873af60 0x5605b8b35970 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b877c390 0x5605b8b2f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f6049ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b875b6b0 0x5605b8b28830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 --2- 172.21.15.100:0/3759567816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b87534d0 0x5605b8b282f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 >> 172.21.15.100:0/3759567816 conn(0x5605b87704e0 msgr2=0x5605b8b18ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 shutdown_connections 2024-04-30T23:15:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 1 -- 172.21.15.100:0/3759567816 wait complete. 2024-04-30T23:15:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.386+0000 7f606fc74740 20 client.16164 trim_cache size 0 max 16384 2024-04-30T23:15:09.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 Processor -- start 2024-04-30T23:15:09.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 -- start start 2024-04-30T23:15:09.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b27020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60641aeb60 con 0x5605b875b6b0 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b06a0 con 0x5605b87534d0 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606fc74740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f60641af230 con 0x5605b877c390 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41478/0 (socket says 172.21.15.100:41478) 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f605bfff640 1 -- 172.21.15.100:0/2886825520 learned_addr learned my addr 172.21.15.100:0/2886825520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.405+0000 7f606259c640 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b27020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f6062d9d640 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 -- 172.21.15.100:0/2886825520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 msgr2=0x5605b8b2fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 -- 172.21.15.100:0/2886825520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 msgr2=0x5605b8b27020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b27020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 -- 172.21.15.100:0/2886825520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b87540f0 con 0x5605b875b6b0 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f605bfff640 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f604c0ce1d0 tx=0x7f604c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6683da8a1af37b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f604bfff640 1 -- 172.21.15.100:0/2886825520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c026040 con 0x5605b875b6b0 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f604bfff640 1 -- 172.21.15.100:0/2886825520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f604c0a0d60 con 0x5605b875b6b0 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.406+0000 7f604bfff640 1 -- 172.21.15.100:0/2886825520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c0990d0 con 0x5605b875b6b0 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- 172.21.15.100:0/2886825520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 msgr2=0x5605b8b2f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f604c0ce1d0 tx=0x7f604c01f000 comp rx=0 tx=0).stop 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- 172.21.15.100:0/2886825520 shutdown_connections 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2f640 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- 172.21.15.100:0/2886825520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b27020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- 172.21.15.100:0/2886825520 >> 172.21.15.100:0/2886825520 conn(0x5605b87704e0 msgr2=0x5605b8b26910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- 172.21.15.100:0/2886825520 shutdown_connections 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- 172.21.15.100:0/2886825520 wait complete. 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- start start 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 Processor -- start 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b2ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60641affd0 con 0x5605b875b6b0 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f60641af900 con 0x5605b87534d0 2024-04-30T23:15:09.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f60641acb40 con 0x5605b877c390 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f606fc74740 10 client.0 _ll_register_callbacks cb 0x7f6054005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.407+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41486/0 (socket says 172.21.15.100:41486) 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 -- 172.21.15.100:0/4018386625 learned_addr learned my addr 172.21.15.100:0/4018386625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f606259c640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b2ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6062d9d640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 -- 172.21.15.100:0/4018386625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 msgr2=0x5605b8b2d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 -- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 msgr2=0x5605b8b2ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b2ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 -- 172.21.15.100:0/4018386625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b8a434b0 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6062d9d640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f605bfff640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f604c09c9f0 tx=0x7f604c09ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dbb7f2a2a80ed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6049ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c0990d0 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f604c0bbb70 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604c0a0d60 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f604c099270 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f606fc74740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605b8b9ac50 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.408+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f604c0a0d60 con 0x5605b875b6b0 2024-04-30T23:15:09.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f604c0be080 con 0x5605b875b6b0 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 20 client.16170 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b87103a0 0x5605b8b9d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 4 client.16170 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605b8a8a800 con 0x5605b87103a0 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606259c640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b87103a0 0x5605b8b9d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f6049ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.409+0000 7f606259c640 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b87103a0 0x5605b8b9d530 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2830db209e41a56b server_cookie=e643ace8b10eb309 in_seq=0 out_seq=0 2024-04-30T23:15:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6049ffb640 1 -- 172.21.15.100:0/4018386625 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1430 (crc 0 0 0) 0x5605b8a8a800 con 0x5605b87103a0 2024-04-30T23:15:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6049ffb640 10 client.16170 handle_command_reply: tid=0 2024-04-30T23:15:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 client.16170 shutdown 2024-04-30T23:15:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 msgr2=0x5605b8b2cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f604c09c9f0 tx=0x7f604c09ab00 comp rx=0 tx=0).stop 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 shutdown_connections 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5605b87103a0 0x5605b8b9d530 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5605b877c390 0x5605b8b2d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6049ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605b875b6b0 0x5605b8b2cab0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 --2- 172.21.15.100:0/4018386625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605b87534d0 0x5605b8b2ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 >> 172.21.15.100:0/4018386625 conn(0x5605b87704e0 msgr2=0x5605b8b28630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 shutdown_connections 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 1 -- 172.21.15.100:0/4018386625 wait complete. 2024-04-30T23:15:09.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f606fc74740 20 client.16170 trim_cache size 0 max 16384 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "scrub active (305 inodes in the stack)", 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "c14be86f-5996-4cf9-8d37-56709dfaa780", 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:15:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:09.426 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 msgr2=0x7f60500a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 0x7f60500a60c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f605c004af0 tx=0x7f605c004a40 comp rx=0 tx=0).stop 2024-04-30T23:15:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 msgr2=0x7f6064076040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f604c00e9f0 tx=0x7f604c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 shutdown_connections 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f60500a3bb0 0x7f60500a60c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6064109a70 0x7f6064076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6064104d70 0x7f6064076040 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 --2- 172.21.15.100:0/108527964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6064103b30 0x7f60640779a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 >> 172.21.15.100:0/108527964 conn(0x7f60640fed20 msgr2=0x7f6064105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 shutdown_connections 2024-04-30T23:15:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:09.414+0000 7f6068dc7640 1 -- 172.21.15.100:0/108527964 wait complete. 2024-04-30T23:15:09.428 INFO:tasks.cephfs.filesystem:scrub status for tag:c14be86f-5996-4cf9-8d37-56709dfaa780 - {'path': '/', 'tag': 'c14be86f-5996-4cf9-8d37-56709dfaa780', 'options': 'recursive,force'} 2024-04-30T23:15:11.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:10 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:15:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:10 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:10 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:10 smithi104 ceph-mon[32987]: pgmap v420: 129 pgs: 129 active+clean; 23 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.0 MiB/s wr, 128 op/s 2024-04-30T23:15:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:10 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:10 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:15:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:10 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:10 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:10 smithi183 ceph-mon[33560]: pgmap v420: 129 pgs: 129 active+clean; 23 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.0 MiB/s wr, 128 op/s 2024-04-30T23:15:11.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:10 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:10 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:15:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:10 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:10 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:10 smithi100 ceph-mon[29745]: pgmap v420: 129 pgs: 129 active+clean; 23 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.0 MiB/s wr, 128 op/s 2024-04-30T23:15:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:10 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:12.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:11 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:12.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:12.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:12.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:11 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:12.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:12.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:11 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:13.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:12 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:13.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:12 smithi104 ceph-mon[32987]: pgmap v421: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.0 MiB/s wr, 133 op/s 2024-04-30T23:15:13.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:12 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:13.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:12 smithi183 ceph-mon[33560]: pgmap v421: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.0 MiB/s wr, 133 op/s 2024-04-30T23:15:13.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:12 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:13.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:12 smithi100 ceph-mon[29745]: pgmap v421: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.0 MiB/s wr, 133 op/s 2024-04-30T23:15:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:14 smithi104 ceph-mon[32987]: pgmap v422: 129 pgs: 129 active+clean; 28 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-04-30T23:15:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:14 smithi183 ceph-mon[33560]: pgmap v422: 129 pgs: 129 active+clean; 28 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-04-30T23:15:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:14 smithi100 ceph-mon[29745]: pgmap v422: 129 pgs: 129 active+clean; 28 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-04-30T23:15:16.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:15 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:16.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:15 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:15 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:17.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:16 smithi104 ceph-mon[32987]: pgmap v423: 129 pgs: 129 active+clean; 31 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 232 op/s 2024-04-30T23:15:17.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:16 smithi183 ceph-mon[33560]: pgmap v423: 129 pgs: 129 active+clean; 31 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 232 op/s 2024-04-30T23:15:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:16 smithi100 ceph-mon[29745]: pgmap v423: 129 pgs: 129 active+clean; 31 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 232 op/s 2024-04-30T23:15:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: pgmap v424: 129 pgs: 129 active+clean; 32 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:19.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: pgmap v424: 129 pgs: 129 active+clean; 32 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:19.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: pgmap v424: 129 pgs: 129 active+clean; 32 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-04-30T23:15:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:19 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:19 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:20.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:20.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:19 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: pgmap v425: 129 pgs: 129 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-30T23:15:21.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: pgmap v425: 129 pgs: 129 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.056 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.057 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.058 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.059 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.060 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.074 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.075 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.076 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.076 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.076 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:20 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.079 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.080 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.081 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:20 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: pgmap v425: 129 pgs: 129 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.094 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.095 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.096 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.097 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.098 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.099 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.100 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.101 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.102 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.103 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.104 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.105 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.106 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.106 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:21.106 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:21.106 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:20 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.063 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.064 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.065 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.066 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.067 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.068 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.069 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.070 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.071 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.072 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.073 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:21 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:22.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.082 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.083 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.084 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.085 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.086 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.087 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.088 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.089 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.090 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.091 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.092 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.093 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.094 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.095 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.096 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.097 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.098 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.099 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.100 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.101 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.102 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.103 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.107 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.107 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:21 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:22.107 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.107 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.108 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.109 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.111 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.112 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.113 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.114 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.115 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.116 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.117 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.118 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.119 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.120 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.121 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.122 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.124 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:22.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:22.125 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:21 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: pgmap v426: 129 pgs: 129 active+clean; 44 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 308 op/s 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.053 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.054 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.055 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.056 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.057 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.058 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.059 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.060 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.061 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.062 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:22 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:23.063 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.063 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.063 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: pgmap v426: 129 pgs: 129 active+clean; 44 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 308 op/s 2024-04-30T23:15:23.063 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.063 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.064 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.065 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.066 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.067 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.068 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.071 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.072 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.073 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.074 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.075 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.076 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.077 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.078 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:22 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: pgmap v426: 129 pgs: 129 active+clean; 44 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 308 op/s 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.090 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.091 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.092 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:23.093 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:22 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.049 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.050 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:23 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.055 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:23 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:24.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:24.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:23 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:25.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:24 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:25.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:24 smithi104 ceph-mon[32987]: pgmap v427: 129 pgs: 129 active+clean; 45 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-04-30T23:15:25.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:24 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:25.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:24 smithi183 ceph-mon[33560]: pgmap v427: 129 pgs: 129 active+clean; 45 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-04-30T23:15:25.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:24 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:25.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:24 smithi100 ceph-mon[29745]: pgmap v427: 129 pgs: 129 active+clean; 45 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-04-30T23:15:26.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:25 smithi104 ceph-mon[32987]: pgmap v428: 129 pgs: 129 active+clean; 51 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 365 op/s 2024-04-30T23:15:26.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:25 smithi183 ceph-mon[33560]: pgmap v428: 129 pgs: 129 active+clean; 51 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 365 op/s 2024-04-30T23:15:26.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:25 smithi100 ceph-mon[29745]: pgmap v428: 129 pgs: 129 active+clean; 51 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 365 op/s 2024-04-30T23:15:29.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:28 smithi104 ceph-mon[32987]: pgmap v429: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 314 op/s 2024-04-30T23:15:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:28 smithi183 ceph-mon[33560]: pgmap v429: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 314 op/s 2024-04-30T23:15:29.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:28 smithi100 ceph-mon[29745]: pgmap v429: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 314 op/s 2024-04-30T23:15:31.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:30 smithi104 ceph-mon[32987]: pgmap v430: 129 pgs: 129 active+clean; 56 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-04-30T23:15:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:30 smithi183 ceph-mon[33560]: pgmap v430: 129 pgs: 129 active+clean; 56 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-04-30T23:15:31.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:30 smithi100 ceph-mon[29745]: pgmap v430: 129 pgs: 129 active+clean; 56 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-04-30T23:15:33.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:32 smithi104 ceph-mon[32987]: pgmap v431: 129 pgs: 129 active+clean; 64 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 398 op/s 2024-04-30T23:15:33.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:32 smithi183 ceph-mon[33560]: pgmap v431: 129 pgs: 129 active+clean; 64 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 398 op/s 2024-04-30T23:15:33.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:32 smithi100 ceph-mon[29745]: pgmap v431: 129 pgs: 129 active+clean; 64 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 398 op/s 2024-04-30T23:15:35.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:34 smithi104 ceph-mon[32987]: pgmap v432: 129 pgs: 129 active+clean; 78 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 405 op/s 2024-04-30T23:15:35.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:34 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:15:35.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:34 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:15:35.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:34 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:15:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:34 smithi183 ceph-mon[33560]: pgmap v432: 129 pgs: 129 active+clean; 78 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 405 op/s 2024-04-30T23:15:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:34 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:15:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:34 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:15:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:34 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:15:35.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:34 smithi100 ceph-mon[29745]: pgmap v432: 129 pgs: 129 active+clean; 78 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 405 op/s 2024-04-30T23:15:35.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:34 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:15:35.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:34 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:15:35.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:34 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:15:36.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:35 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:15:36.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:35 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:15:36.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:35 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:15:37.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:36 smithi104 ceph-mon[32987]: pgmap v433: 129 pgs: 129 active+clean; 82 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2024-04-30T23:15:37.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:36 smithi183 ceph-mon[33560]: pgmap v433: 129 pgs: 129 active+clean; 82 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2024-04-30T23:15:37.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:36 smithi100 ceph-mon[29745]: pgmap v433: 129 pgs: 129 active+clean; 82 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2024-04-30T23:15:37.326 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-30T23:15:37.326 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-30T23:15:37.327 INFO:tasks.workunit.client.0.smithi100.stderr:+ make 2024-04-30T23:15:37.471 INFO:tasks.workunit.client.0.smithi100.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-30T23:15:37.700 INFO:tasks.workunit.client.0.smithi100.stderr:++ readlink -f fsstress 2024-04-30T23:15:37.700 INFO:tasks.workunit.client.0.smithi100.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-30T23:15:37.701 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2024-04-30T23:15:37.701 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-30T23:15:37.701 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2024-04-30T23:15:37.701 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-30T23:15:37.702 INFO:tasks.workunit.client.0.smithi100.stderr:++ mktemp -d -p . 2024-04-30T23:15:37.703 INFO:tasks.workunit.client.0.smithi100.stderr:+ T=./tmp.kNdu7RDsyW 2024-04-30T23:15:37.703 INFO:tasks.workunit.client.0.smithi100.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kNdu7RDsyW -l 1 -n 1000 -p 10 -v 2024-04-30T23:15:37.704 INFO:tasks.workunit.client.0.smithi100.stdout:seed = 1715190325 2024-04-30T23:15:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:1/0: fdatasync - no filename 2024-04-30T23:15:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/0: symlink l0 0 2024-04-30T23:15:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/1: chown l0 18084748 1 2024-04-30T23:15:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/2: write - no filename 2024-04-30T23:15:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/3: dwrite - no filename 2024-04-30T23:15:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/0: truncate - no filename 2024-04-30T23:15:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/1: truncate - no filename 2024-04-30T23:15:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/2: fdatasync - no filename 2024-04-30T23:15:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/3: truncate - no filename 2024-04-30T23:15:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/1: creat f0 x:0 0 0 2024-04-30T23:15:37.710 INFO:tasks.workunit.client.0.smithi100.stdout:0/4: mkdir d1 0 2024-04-30T23:15:37.710 INFO:tasks.workunit.client.0.smithi100.stdout:3/0: chown . 21950 1 2024-04-30T23:15:37.710 INFO:tasks.workunit.client.0.smithi100.stdout:3/1: dread - no filename 2024-04-30T23:15:37.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/2: chown . 189144 1 2024-04-30T23:15:37.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/3: dwrite - no filename 2024-04-30T23:15:37.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/4: dread - no filename 2024-04-30T23:15:37.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/5: dread - no filename 2024-04-30T23:15:37.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/4: symlink l0 0 2024-04-30T23:15:37.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/2: mkdir d1 0 2024-04-30T23:15:37.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/3: readlink - no filename 2024-04-30T23:15:37.713 INFO:tasks.workunit.client.0.smithi100.stdout:0/5: rmdir d1 0 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:4/0: unlink - no file 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:4/1: rmdir - no directory 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:4/2: rename - no filename 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:4/3: readlink - no filename 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:3/6: mknod c0 0 2024-04-30T23:15:37.714 INFO:tasks.workunit.client.0.smithi100.stdout:3/7: readlink - no filename 2024-04-30T23:15:37.715 INFO:tasks.workunit.client.0.smithi100.stdout:2/5: unlink l0 0 2024-04-30T23:15:37.715 INFO:tasks.workunit.client.0.smithi100.stdout:2/6: chown . 3 1 2024-04-30T23:15:37.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/4: rmdir d1 0 2024-04-30T23:15:37.716 INFO:tasks.workunit.client.0.smithi100.stdout:0/6: mkdir d2 0 2024-04-30T23:15:37.716 INFO:tasks.workunit.client.0.smithi100.stdout:0/7: dwrite - no filename 2024-04-30T23:15:37.717 INFO:tasks.workunit.client.0.smithi100.stdout:4/4: mknod c0 0 2024-04-30T23:15:37.718 INFO:tasks.workunit.client.0.smithi100.stdout:3/8: mkdir d1 0 2024-04-30T23:15:37.719 INFO:tasks.workunit.client.0.smithi100.stdout:2/7: creat f1 x:0 0 0 2024-04-30T23:15:37.719 INFO:tasks.workunit.client.0.smithi100.stdout:1/5: creat f2 x:0 0 0 2024-04-30T23:15:37.720 INFO:tasks.workunit.client.0.smithi100.stdout:0/8: creat d2/f3 x:0 0 0 2024-04-30T23:15:37.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/0: link - no file 2024-04-30T23:15:37.722 INFO:tasks.workunit.client.0.smithi100.stdout:5/0: creat f0 x:0 0 0 2024-04-30T23:15:37.722 INFO:tasks.workunit.client.0.smithi100.stdout:5/1: write f0 [44768,103422] 0 2024-04-30T23:15:37.722 INFO:tasks.workunit.client.0.smithi100.stdout:5/2: write f0 [41436,117940] 0 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/5: link c0 c1 0 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/6: readlink - no filename 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/7: write - no filename 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/8: dread - no filename 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/9: fsync - no filename 2024-04-30T23:15:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/10: dread - no filename 2024-04-30T23:15:37.724 INFO:tasks.workunit.client.0.smithi100.stdout:3/9: unlink c0 0 2024-04-30T23:15:37.725 INFO:tasks.workunit.client.0.smithi100.stdout:1/6: mkdir d3 0 2024-04-30T23:15:37.726 INFO:tasks.workunit.client.0.smithi100.stdout:0/9: creat d2/f4 x:0 0 0 2024-04-30T23:15:37.726 INFO:tasks.workunit.client.0.smithi100.stdout:0/10: write d2/f3 [90213,56398] 0 2024-04-30T23:15:37.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/0: stat - no entries 2024-04-30T23:15:37.727 INFO:tasks.workunit.client.0.smithi100.stdout:6/1: mknod c0 0 2024-04-30T23:15:37.727 INFO:tasks.workunit.client.0.smithi100.stdout:6/2: read - no filename 2024-04-30T23:15:37.727 INFO:tasks.workunit.client.0.smithi100.stdout:4/11: mknod c2 0 2024-04-30T23:15:37.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/11: rmdir d2 39 2024-04-30T23:15:37.728 INFO:tasks.workunit.client.0.smithi100.stdout:8/0: rmdir - no directory 2024-04-30T23:15:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/1: mkdir d0 0 2024-04-30T23:15:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/2: fdatasync - no filename 2024-04-30T23:15:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/3: chown d0 3264964 1 2024-04-30T23:15:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/4: read - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/5: dread - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/6: write - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/7: dread - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/8: readlink - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/9: unlink - no file 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/10: write - no filename 2024-04-30T23:15:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/11: dwrite - no filename 2024-04-30T23:15:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/12: creat f3 x:0 0 0 2024-04-30T23:15:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/13: dread - f3 zero size 2024-04-30T23:15:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/14: dread - f3 zero size 2024-04-30T23:15:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/15: chown c0 4828 1 2024-04-30T23:15:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:9/0: dread - no filename 2024-04-30T23:15:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:8/1: creat f0 x:0 0 0 2024-04-30T23:15:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:8/2: chown f0 33887 1 2024-04-30T23:15:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/12: mknod d0/c1 0 2024-04-30T23:15:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/13: write - no filename 2024-04-30T23:15:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/14: truncate - no filename 2024-04-30T23:15:37.734 INFO:tasks.workunit.client.0.smithi100.stdout:4/16: mknod c4 0 2024-04-30T23:15:37.734 INFO:tasks.workunit.client.0.smithi100.stdout:4/17: truncate f3 547461 0 2024-04-30T23:15:37.737 INFO:tasks.workunit.client.0.smithi100.stdout:8/3: symlink l1 0 2024-04-30T23:15:37.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/15: creat d0/f2 x:0 0 0 2024-04-30T23:15:37.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/16: truncate d0/f2 12415 0 2024-04-30T23:15:37.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/4: mkdir d2 0 2024-04-30T23:15:37.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/5: dread - f0 zero size 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/3: getdents . 0 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/4: write - no filename 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/5: fsync - no filename 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/6: dread - no filename 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/7: dread - no filename 2024-04-30T23:15:37.769 INFO:tasks.workunit.client.0.smithi100.stdout:6/8: readlink - no filename 2024-04-30T23:15:37.770 INFO:tasks.workunit.client.0.smithi100.stdout:6/9: write - no filename 2024-04-30T23:15:37.770 INFO:tasks.workunit.client.0.smithi100.stdout:6/10: chown c0 207203280 1 2024-04-30T23:15:37.770 INFO:tasks.workunit.client.0.smithi100.stdout:6/11: read - no filename 2024-04-30T23:15:37.770 INFO:tasks.workunit.client.0.smithi100.stdout:6/12: fdatasync - no filename 2024-04-30T23:15:37.773 INFO:tasks.workunit.client.0.smithi100.stdout:6/13: mknod c1 0 2024-04-30T23:15:37.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/14: symlink l2 0 2024-04-30T23:15:37.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/15: dwrite - no filename 2024-04-30T23:15:37.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/16: dwrite - no filename 2024-04-30T23:15:37.779 INFO:tasks.workunit.client.0.smithi100.stdout:6/17: symlink l3 0 2024-04-30T23:15:37.781 INFO:tasks.workunit.client.0.smithi100.stdout:6/18: mknod c4 0 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/19: fdatasync - no filename 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/20: fsync - no filename 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/21: dwrite - no filename 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/22: read - no filename 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/23: chown c1 16927121 1 2024-04-30T23:15:37.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/24: dread - no filename 2024-04-30T23:15:37.783 INFO:tasks.workunit.client.0.smithi100.stdout:6/25: creat f5 x:0 0 0 2024-04-30T23:15:37.784 INFO:tasks.workunit.client.0.smithi100.stdout:6/26: symlink l6 0 2024-04-30T23:15:37.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/27: dread - f5 zero size 2024-04-30T23:15:37.789 INFO:tasks.workunit.client.0.smithi100.stdout:6/28: mkdir d7 0 2024-04-30T23:15:37.792 INFO:tasks.workunit.client.0.smithi100.stdout:6/29: symlink d7/l8 0 2024-04-30T23:15:37.792 INFO:tasks.workunit.client.0.smithi100.stdout:6/30: dread - f5 zero size 2024-04-30T23:15:37.840 INFO:tasks.workunit.client.0.smithi100.stdout:6/31: fsync f5 0 2024-04-30T23:15:37.879 INFO:tasks.workunit.client.0.smithi100.stdout:1/7: dwrite f2 [0,4194304] 0 2024-04-30T23:15:37.904 INFO:tasks.workunit.client.0.smithi100.stdout:1/8: rename f0 to d3/f4 0 2024-04-30T23:15:37.991 INFO:tasks.workunit.client.0.smithi100.stdout:2/8: dwrite f1 [0,4194304] 0 2024-04-30T23:15:38.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/12: dwrite d2/f4 [0,4194304] 0 2024-04-30T23:15:38.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/13: write d2/f3 [571816,56749] 0 2024-04-30T23:15:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:1/9: dread f2 [0,4194304] 0 2024-04-30T23:15:38.084 INFO:tasks.workunit.client.0.smithi100.stdout:1/10: write f2 [607463,93470] 0 2024-04-30T23:15:38.084 INFO:tasks.workunit.client.0.smithi100.stdout:1/11: truncate d3/f4 509196 0 2024-04-30T23:15:38.138 INFO:tasks.workunit.client.0.smithi100.stdout:1/12: dread f2 [0,4194304] 0 2024-04-30T23:15:38.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/13: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:38.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/3: dwrite f0 [0,4194304] 0 2024-04-30T23:15:38.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/4: chown f0 428 1 2024-04-30T23:15:38.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/5: stat f0 0 2024-04-30T23:15:38.244 INFO:tasks.workunit.client.0.smithi100.stdout:8/6: dwrite f0 [0,4194304] 0 2024-04-30T23:15:38.245 INFO:tasks.workunit.client.0.smithi100.stdout:8/7: stat d2 0 2024-04-30T23:15:38.286 INFO:tasks.workunit.client.0.smithi100.stdout:2/9: mknod c2 0 2024-04-30T23:15:38.362 INFO:tasks.workunit.client.0.smithi100.stdout:8/8: read f0 [2420926,37370] 0 2024-04-30T23:15:38.362 INFO:tasks.workunit.client.0.smithi100.stdout:7/17: dwrite d0/f2 [0,4194304] 0 2024-04-30T23:15:38.362 INFO:tasks.workunit.client.0.smithi100.stdout:7/18: readlink - no filename 2024-04-30T23:15:38.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/14: creat d2/f5 x:0 0 0 2024-04-30T23:15:38.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/15: dwrite d2/f4 [0,4194304] 0 2024-04-30T23:15:39.007 INFO:tasks.workunit.client.0.smithi100.stdout:1/14: creat d3/f5 x:0 0 0 2024-04-30T23:15:39.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/15: write f2 [506793,98585] 0 2024-04-30T23:15:39.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/16: chown f2 61150033 1 2024-04-30T23:15:39.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/17: chown d3/f5 12379 1 2024-04-30T23:15:39.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/18: rename d3 to d3/d6 22 2024-04-30T23:15:39.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:38 smithi104 ceph-mon[32987]: pgmap v434: 129 pgs: 129 active+clean; 86 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-04-30T23:15:39.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:38 smithi183 ceph-mon[33560]: pgmap v434: 129 pgs: 129 active+clean; 86 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-04-30T23:15:39.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:38 smithi100 ceph-mon[29745]: pgmap v434: 129 pgs: 129 active+clean; 86 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-04-30T23:15:39.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:15:39.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:15:39.495 INFO:tasks.workunit.client.0.smithi100.stdout:2/10: creat f3 x:0 0 0 2024-04-30T23:15:39.551 INFO:tasks.workunit.client.0.smithi100.stdout:5/6: dwrite f0 [4194304,4194304] 0 2024-04-30T23:15:39.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 -- 172.21.15.100:0/1662897163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 msgr2=0x7fabe8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 --2- 172.21.15.100:0/1662897163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe8104080 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009900 tx=0x7fabd002a410 comp rx=0 tx=0).stop 2024-04-30T23:15:39.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 -- 172.21.15.100:0/1662897163 shutdown_connections 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 --2- 172.21.15.100:0/1662897163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 0x7fabe810ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 --2- 172.21.15.100:0/1662897163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe8104080 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 --2- 172.21.15.100:0/1662897163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe8103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 -- 172.21.15.100:0/1662897163 >> 172.21.15.100:0/1662897163 conn(0x7fabe80fdc40 msgr2=0x7fabe81000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 -- 172.21.15.100:0/1662897163 shutdown_connections 2024-04-30T23:15:39.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.550+0000 7fabec808640 1 -- 172.21.15.100:0/1662897163 wait complete. 2024-04-30T23:15:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.551+0000 7fabec808640 1 Processor -- start 2024-04-30T23:15:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.551+0000 7fabec808640 1 -- start start 2024-04-30T23:15:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.551+0000 7fabec808640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabec808640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabec808640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 0x7fabe81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabec808640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabe810e560 con 0x7fabe8103c70 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabec808640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabe810e3e0 con 0x7fabe8102a30 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabec808640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabe810e6e0 con 0x7fabe8108970 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57532/0 (socket says 172.21.15.100:57532) 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabddd9b640 1 -- 172.21.15.100:0/1657007088 learned_addr learned my addr 172.21.15.100:0/1657007088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 0x7fabe81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 -- 172.21.15.100:0/1657007088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 msgr2=0x7fabe81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 0x7fabe81a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 -- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 msgr2=0x7fabe81996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 -- 172.21.15.100:0/1657007088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe81a0c70 con 0x7fabe8102a30 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabe659c640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe81991a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabe8102300 tx=0x7fabd800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.552+0000 7fabdffff640 1 -- 172.21.15.100:0/1657007088 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd800cc40 con 0x7fabe8102a30 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.553+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe81a0f60 con 0x7fabe8102a30 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.553+0000 7fabdffff640 1 -- 172.21.15.100:0/1657007088 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd800cde0 con 0x7fabe8102a30 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.553+0000 7fabdffff640 1 -- 172.21.15.100:0/1657007088 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8010430 con 0x7fabe8102a30 2024-04-30T23:15:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.553+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe81a1420 con 0x7fabe8102a30 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 Processor -- start 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 -- start start 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabdffff640 1 -- 172.21.15.100:0/1657007088 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fabd80105d0 con 0x7fabe8102a30 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a365700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a366910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563a0a27ab10 con 0x563a09f984d0 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a0a2c7d80 con 0x563a09fa06b0 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabf3796740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563a0a2818b0 con 0x563a09fc1390 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabe659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabe659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57534/0 (socket says 172.21.15.100:57534) 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabe659c640 1 -- 172.21.15.100:0/3867422520 learned_addr learned my addr 172.21.15.100:0/3867422520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabddd9b640 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a366910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.555+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a365700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 -- 172.21.15.100:0/3867422520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 msgr2=0x563a0a365700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a365700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 -- 172.21.15.100:0/3867422520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 msgr2=0x563a0a366910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a366910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 -- 172.21.15.100:0/3867422520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a0a252a40 con 0x563a09f984d0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabdffff640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 0x7fabd40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe659c640 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabd80d4ba0 tx=0x7fabd80d9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd2509032065219 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 0x7fabd40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabdcd99640 1 -- 172.21.15.100:0/3867422520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8098db0 con 0x563a09f984d0 2024-04-30T23:15:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabdffff640 1 -- 172.21.15.100:0/1657007088 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fabd80d0b90 con 0x7fabe8102a30 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabdcd99640 1 -- 172.21.15.100:0/3867422520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd809ee50 con 0x563a09f984d0 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.556+0000 7fabdcd99640 1 -- 172.21.15.100:0/3867422520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd80ae8e0 con 0x563a09f984d0 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 -- 172.21.15.100:0/3867422520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 msgr2=0x563a0a365c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 0x7fabd40a60c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x563a0a366750 tx=0x7fabe0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabd80d4ba0 tx=0x7fabd80d9660 comp rx=0 tx=0).stop 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 -- 172.21.15.100:0/3867422520 shutdown_connections 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a366910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a365c80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 --2- 172.21.15.100:0/3867422520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a365700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 -- 172.21.15.100:0/3867422520 >> 172.21.15.100:0/3867422520 conn(0x563a09fb54e0 msgr2=0x563a0a35ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 -- 172.21.15.100:0/3867422520 shutdown_connections 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.557+0000 7fabf3796740 1 -- 172.21.15.100:0/3867422520 wait complete. 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 -- start start 2024-04-30T23:15:39.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 Processor -- start 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09f984d0 0x563a0a36f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 0x563a0a36f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563a0a24ed10 con 0x563a09fc1390 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a0a2c3d40 con 0x563a09f984d0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563a0a367420 con 0x563a09fa06b0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabf3796740 10 client.0 _ll_register_callbacks cb 0x563a0a2d4d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57540/0 (socket says 172.21.15.100:57540) 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 -- 172.21.15.100:0/4198003053 learned_addr learned my addr 172.21.15.100:0/4198003053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe659c640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09f984d0 0x563a0a36f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabddd9b640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 0x563a0a36f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 -- 172.21.15.100:0/4198003053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 msgr2=0x563a0a36f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 0x563a0a36f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 -- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09f984d0 msgr2=0x563a0a36f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09f984d0 0x563a0a36f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabe6d9d640 1 -- 172.21.15.100:0/4198003053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0a0a37d0 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.558+0000 7fabddd9b640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 0x563a0a36f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009cd0 tx=0x7fabe0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc91a463493be200 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe000f830 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fabe000f9d0 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabd809ee50 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fabe000fbd0 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 10 client.16182 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a09fd93f0 con 0x563a09fc1390 2024-04-30T23:15:39.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd809ee50 con 0x563a09fc1390 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fabe0026070 con 0x563a09fc1390 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 10 client.16182 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 20 client.16182 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f7ff60 0x563a0a37cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 4 client.16182 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.559+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a0a2d5990 con 0x563a09f7ff60 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.560+0000 7fabe659c640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f7ff60 0x563a0a37cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.560+0000 7fabcdffb640 10 client.16182 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:39.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.560+0000 7fabe659c640 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f7ff60 0x563a0a37cf80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4b357cca1cdc38 server_cookie=f3acab1ccb7d1978 in_seq=0 out_seq=0 2024-04-30T23:15:39.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabcdffb640 1 -- 172.21.15.100:0/4198003053 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x563a0a2d5990 con 0x563a09f7ff60 2024-04-30T23:15:39.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabcdffb640 10 client.16182 handle_command_reply: tid=0 2024-04-30T23:15:39.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 client.16182 shutdown 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 msgr2=0x563a0a376940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009cd0 tx=0x7fabe0004ab0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 shutdown_connections 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f7ff60 0x563a0a37cf80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fc1390 0x563a0a376940 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fa06b0 0x563a0a36f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 --2- 172.21.15.100:0/4198003053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09f984d0 0x563a0a36f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 >> 172.21.15.100:0/4198003053 conn(0x563a09fb54e0 msgr2=0x563a0a361c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabcdffb640 0 client.16182 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 shutdown_connections 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 1 -- 172.21.15.100:0/4198003053 wait complete. 2024-04-30T23:15:39.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.563+0000 7fabf3796740 20 client.16182 trim_cache size 0 max 16384 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.580+0000 7fabf3796740 1 Processor -- start 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.580+0000 7fabf3796740 1 -- start start 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09f984d0 0x563a0a36a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fc1390 0x563a0a376c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81aa770 con 0x563a09fa06b0 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81ac370 con 0x563a09fc1390 2024-04-30T23:15:39.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabf3796740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81aae40 con 0x563a09f984d0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57556/0 (socket says 172.21.15.100:57556) 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 -- 172.21.15.100:0/1893532814 learned_addr learned my addr 172.21.15.100:0/1893532814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fc1390 0x563a0a376c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabe659c640 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09f984d0 0x563a0a36a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 -- 172.21.15.100:0/1893532814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09f984d0 msgr2=0x563a0a36a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09f984d0 0x563a0a36a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 -- 172.21.15.100:0/1893532814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fc1390 msgr2=0x563a0a376c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fc1390 0x563a0a376c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 -- 172.21.15.100:0/1893532814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a09f990f0 con 0x563a09fa06b0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fabd0006010 tx=0x7fabd0031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aa0463cd68400f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabcffff640 1 -- 172.21.15.100:0/1893532814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0035040 con 0x563a09fa06b0 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabcffff640 1 -- 172.21.15.100:0/1893532814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd0031880 con 0x563a09fa06b0 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.581+0000 7fabcffff640 1 -- 172.21.15.100:0/1893532814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd003c440 con 0x563a09fa06b0 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- 172.21.15.100:0/1893532814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 msgr2=0x563a0a35ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fabd0006010 tx=0x7fabd0031650 comp rx=0 tx=0).stop 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- 172.21.15.100:0/1893532814 shutdown_connections 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fc1390 0x563a0a376c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09fa06b0 0x563a0a35ed70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 --2- 172.21.15.100:0/1893532814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09f984d0 0x563a0a36a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- 172.21.15.100:0/1893532814 >> 172.21.15.100:0/1893532814 conn(0x563a09fb54e0 msgr2=0x563a0a35e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- 172.21.15.100:0/1893532814 shutdown_connections 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- 172.21.15.100:0/1893532814 wait complete. 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 -- start start 2024-04-30T23:15:39.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.582+0000 7fabf3796740 1 Processor -- start 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a376020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a376560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81abbe0 con 0x563a09f984d0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81ab510 con 0x563a09fa06b0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81a8750 con 0x563a09fc1390 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 10 client.0 _ll_register_callbacks cb 0x7fabe0009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57568/0 (socket says 172.21.15.100:57568) 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 -- 172.21.15.100:0/1069720199 learned_addr learned my addr 172.21.15.100:0/1069720199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a376020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe6d9d640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a376560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 -- 172.21.15.100:0/1069720199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 msgr2=0x563a0a376560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a376560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 -- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 msgr2=0x563a0a376020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a376020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 -- 172.21.15.100:0/1069720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0a2884b0 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a376020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabe659c640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ce6a0 tx=0x7fabd8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf27bf3ff8973aa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd80af560 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fabd809abb0 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.583+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabd0031880 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fabd80af770 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 10 client.16188 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a0a3e43c0 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd0031880 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fabd80d4c90 con 0x563a09f984d0 2024-04-30T23:15:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 10 client.16188 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 20 client.16188 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f553a0 0x563a0a3e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 4 client.16188 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a0a2cf800 con 0x563a09f553a0 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f553a0 0x563a0a3e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabcdffb640 10 client.16188 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.584+0000 7fabddd9b640 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f553a0 0x563a0a3e6a00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d710afefb4de1878 server_cookie=8e20e87eec7e8f0b in_seq=0 out_seq=0 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabcdffb640 1 -- 172.21.15.100:0/1069720199 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x563a0a2cf800 con 0x563a09f553a0 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabcdffb640 10 client.16188 handle_command_reply: tid=0 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 client.16188 shutdown 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 msgr2=0x563a0a375ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ce6a0 tx=0x7fabd8009310 comp rx=0 tx=0).stop 2024-04-30T23:15:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 shutdown_connections 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x563a09f553a0 0x563a0a3e6a00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563a09fc1390 0x563a0a376560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabcdffb640 0 client.16188 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a09fa06b0 0x563a0a376020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 --2- 172.21.15.100:0/1069720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563a09f984d0 0x563a0a375ae0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 >> 172.21.15.100:0/1069720199 conn(0x563a09fb54e0 msgr2=0x563a0a36e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 shutdown_connections 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 1 -- 172.21.15.100:0/1069720199 wait complete. 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.587+0000 7fabf3796740 20 client.16188 trim_cache size 0 max 16384 2024-04-30T23:15:39.594 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {}, 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:15:39.595 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:39.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:39.597 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 msgr2=0x7fabd40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 0x7fabd40a60c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x563a0a366750 tx=0x7fabe0009500 comp rx=0 tx=0).stop 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 msgr2=0x7fabe81991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe81991a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabe8102300 tx=0x7fabd800ee50 comp rx=0 tx=0).stop 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 shutdown_connections 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fabd40a3bb0 0x7fabd40a60c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe8108970 0x7fabe81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe8103c70 0x7fabe81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 --2- 172.21.15.100:0/1657007088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabe8102a30 0x7fabe81991a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 >> 172.21.15.100:0/1657007088 conn(0x7fabe80fdc40 msgr2=0x7fabe8104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 shutdown_connections 2024-04-30T23:15:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.588+0000 7fabec808640 1 -- 172.21.15.100:0/1657007088 wait complete. 2024-04-30T23:15:39.600 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T23:15:39.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:15:39.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.709+0000 7ff8ebe29640 1 -- 172.21.15.100:0/4247058294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4108940 msgr2=0x7ff8e410ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.709+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/4247058294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4108940 0x7ff8e410ad60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009ca0 tx=0x7ff8dc02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- 172.21.15.100:0/4247058294 shutdown_connections 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/4247058294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4108940 0x7ff8e410ad60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/4247058294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4103c40 0x7ff8e4104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/4247058294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 0x7ff8e4103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- 172.21.15.100:0/4247058294 >> 172.21.15.100:0/4247058294 conn(0x7ff8e40fdc10 msgr2=0x7ff8e41000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- 172.21.15.100:0/4247058294 shutdown_connections 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- 172.21.15.100:0/4247058294 wait complete. 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 Processor -- start 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- start start 2024-04-30T23:15:39.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 0x7ff8e41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4108940 0x7ff8e41a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e410e510 con 0x7ff8e4103c40 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e410e390 con 0x7ff8e4108940 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.710+0000 7ff8ebe29640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e410e690 con 0x7ff8e4102a00 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57592/0 (socket says 172.21.15.100:57592) 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 -- 172.21.15.100:0/1136605114 learned_addr learned my addr 172.21.15.100:0/1136605114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8ea3c6640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4108940 0x7ff8e41a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e9bc5640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 0x7ff8e41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 -- 172.21.15.100:0/1136605114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 msgr2=0x7ff8e41990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 0x7ff8e41990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 -- 172.21.15.100:0/1136605114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4108940 msgr2=0x7ff8e41a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4108940 0x7ff8e41a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 -- 172.21.15.100:0/1136605114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e41a0c30 con 0x7ff8e4103c40 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8e93c4640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400e9f0 tx=0x7ff8d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400cd80 con 0x7ff8e4103c40 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d40108e0 con 0x7ff8e4103c40 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e41a0f20 con 0x7ff8e4103c40 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4018980 con 0x7ff8e4103c40 2024-04-30T23:15:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.711+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e41a13e0 con 0x7ff8e4103c40 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.712+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e4107750 con 0x7ff8e4103c40 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.714+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff8d4010430 con 0x7ff8e4103c40 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.714+0000 7ff8daffd640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 0x7ff8d00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.714+0000 7ff8e9bc5640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 0x7ff8d00a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.714+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff8d40d0ea0 con 0x7ff8e4103c40 2024-04-30T23:15:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.715+0000 7ff8e9bc5640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 0x7ff8d00a6140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4103600 tx=0x7ff8e000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.718+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff8d409ced0 con 0x7ff8e4103c40 2024-04-30T23:15:39.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/9: creat d2/f3 x:0 0 0 2024-04-30T23:15:39.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/10: dread - d2/f3 zero size 2024-04-30T23:15:39.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/11: fdatasync d2/f3 0 2024-04-30T23:15:39.803 INFO:tasks.workunit.client.0.smithi100.stdout:8/12: chown d2/f3 798081 1 2024-04-30T23:15:39.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/19: creat d0/f3 x:0 0 0 2024-04-30T23:15:39.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/20: fdatasync d0/f2 0 2024-04-30T23:15:39.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.951+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8e402db90 con 0x7ff8e4103c40 2024-04-30T23:15:39.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.952+0000 7ff8daffd640 1 -- 172.21.15.100:0/1136605114 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11963 (secure 0 0 0) 0x7ff8d40a11d0 con 0x7ff8e4103c40 2024-04-30T23:15:39.954 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:15:39.954 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:15:18.986989+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:15:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 31 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 msgr2=0x7ff8d00a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 0x7ff8d00a6140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4103600 tx=0x7ff8e000b390 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 msgr2=0x7ff8e4199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400e9f0 tx=0x7ff8d400eeb0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 shutdown_connections 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff8d00a3c30 0x7ff8d00a6140 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8e4108940 0x7ff8e41a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.954+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e4103c40 0x7ff8e4199630 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.955+0000 7ff8ebe29640 1 --2- 172.21.15.100:0/1136605114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8e4102a00 0x7ff8e41990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.955+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 >> 172.21.15.100:0/1136605114 conn(0x7ff8e40fdc10 msgr2=0x7ff8e4104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.955+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 shutdown_connections 2024-04-30T23:15:39.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:39.955+0000 7ff8ebe29640 1 -- 172.21.15.100:0/1136605114 wait complete. 2024-04-30T23:15:39.968 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-30T23:15:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 -- 172.21.15.100:0/1813308804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 msgr2=0x7f2ae810a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 --2- 172.21.15.100:0/1813308804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae810a510 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009ca0 tx=0x7f2ae002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 -- 172.21.15.100:0/1813308804 shutdown_connections 2024-04-30T23:15:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 --2- 172.21.15.100:0/1813308804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae810a510 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 --2- 172.21.15.100:0/1813308804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81033f0 0x7f2ae8103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 --2- 172.21.15.100:0/1813308804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81021b0 0x7f2ae8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 -- 172.21.15.100:0/1813308804 >> 172.21.15.100:0/1813308804 conn(0x7f2ae80fd380 msgr2=0x7f2ae80ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 -- 172.21.15.100:0/1813308804 shutdown_connections 2024-04-30T23:15:40.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 -- 172.21.15.100:0/1813308804 wait complete. 2024-04-30T23:15:40.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.080+0000 7f2aee043640 1 Processor -- start 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 -- start start 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81021b0 0x7f2ae819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 0x7f2ae819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae810d440 con 0x7f2ae81080f0 2024-04-30T23:15:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae810d2c0 con 0x7f2ae81033f0 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2aee043640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae810d5c0 con 0x7f2ae81021b0 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57616/0 (socket says 172.21.15.100:57616) 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 -- 172.21.15.100:0/1661834125 learned_addr learned my addr 172.21.15.100:0/1661834125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 0x7f2ae819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81021b0 0x7f2ae819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 -- 172.21.15.100:0/1661834125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81021b0 msgr2=0x7f2ae819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81021b0 0x7f2ae819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 -- 172.21.15.100:0/1661834125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 msgr2=0x7f2ae819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 0x7f2ae819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae7fff640 1 -- 172.21.15.100:0/1661834125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae81a1d40 con 0x7f2ae81080f0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.081+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 0x7f2ae819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2ae7fff640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00097b0 tx=0x7f2ae0031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2ae4ff9640 1 -- 172.21.15.100:0/1661834125 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0003bf0 con 0x7f2ae81080f0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2ae4ff9640 1 -- 172.21.15.100:0/1661834125 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae0003d90 con 0x7f2ae81080f0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2ae4ff9640 1 -- 172.21.15.100:0/1661834125 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae002fc30 con 0x7f2ae81080f0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae81a1fd0 con 0x7f2ae81080f0 2024-04-30T23:15:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.082+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae81a2490 con 0x7f2ae81080f0 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.084+0000 7f2ae4ff9640 1 -- 172.21.15.100:0/1661834125 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2ae0004040 con 0x7f2ae81080f0 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.084+0000 7f2af4fcf740 1 Processor -- start 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.084+0000 7f2af4fcf740 1 -- start start 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2184390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af218b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562af20e8d80 con 0x562af1de2390 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562af20a2a20 con 0x562af1db94d0 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562af20e4d40 con 0x562af1dc16b0 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae4ff9640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 0x7f2ad40a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57622/0 (socket says 172.21.15.100:57622) 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/3599426554 learned_addr learned my addr 172.21.15.100:0/3599426554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae7fff640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 0x7f2ad40a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2184390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af218b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae4ff9640 1 -- 172.21.15.100:0/1661834125 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2ae00f1d00 con 0x7f2ae81080f0 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/3599426554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 msgr2=0x562af218b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af218b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/3599426554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 msgr2=0x562af2184390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2184390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/3599426554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af2086e00 con 0x562af1de2390 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2184390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000eb30 tx=0x7f2ad000bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af90611fa17b6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2ae7fff640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 0x7f2ad40a6140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00ba0e0 tx=0x7f2ae00e8d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2addffb640 1 -- 172.21.15.100:0/3599426554 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000dd40 con 0x562af1de2390 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.085+0000 7f2addffb640 1 -- 172.21.15.100:0/3599426554 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad0012030 con 0x562af1de2390 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2addffb640 1 -- 172.21.15.100:0/3599426554 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0003d80 con 0x562af1de2390 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 -- 172.21.15.100:0/3599426554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 msgr2=0x562af2183e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000eb30 tx=0x7f2ad000bd10 comp rx=0 tx=0).stop 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 -- 172.21.15.100:0/3599426554 shutdown_connections 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af218b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2184390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/3599426554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2183e10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 -- 172.21.15.100:0/3599426554 >> 172.21.15.100:0/3599426554 conn(0x562af1dd64e0 msgr2=0x562af217f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 -- 172.21.15.100:0/3599426554 shutdown_connections 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.086+0000 7f2af4fcf740 1 -- 172.21.15.100:0/3599426554 wait complete. 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 -- start start 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 Processor -- start 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af218db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af2194f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562af218bce0 con 0x562af1dc16b0 2024-04-30T23:15:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562af206fdc0 con 0x562af1db94d0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562af218be60 con 0x562af1de2390 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2ae77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2af4fcf740 10 client.0 _ll_register_callbacks cb 0x562af208b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2ae77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57626/0 (socket says 172.21.15.100:57626) 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2ae77fe640 1 -- 172.21.15.100:0/809707994 learned_addr learned my addr 172.21.15.100:0/809707994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.087+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af218db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af2194f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 -- 172.21.15.100:0/809707994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 msgr2=0x562af2194f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af2194f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 -- 172.21.15.100:0/809707994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 msgr2=0x562af218db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af218db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 -- 172.21.15.100:0/809707994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af20adc30 con 0x562af1dc16b0 2024-04-30T23:15:40.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af218db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8012700 tx=0x7f2ad8012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cd6bacdf7dc2cc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8004030 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2ad80041d0 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad0012030 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ad8025050 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2af4fcf740 10 client.16206 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562af1dfa3f0 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.088+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad0012030 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f2ad8003950 con 0x562af1dc16b0 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 10 client.16206 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 10 client.16206 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 20 client.16206 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1da0f60 0x562af219b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 4 client.16206 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562af20e2810 con 0x562af1da0f60 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1da0f60 0x562af219b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2ac6ffd640 10 client.16206 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.089+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1da0f60 0x562af219b830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a7f11c756d4513ec server_cookie=22c4dfad4b5ed5f8 in_seq=0 out_seq=0 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/809707994 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562af20e2810 con 0x562af1da0f60 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2ac6ffd640 10 client.16206 handle_command_reply: tid=0 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 client.16206 shutdown 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 msgr2=0x562af218e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8012700 tx=0x7f2ad8012bc0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 shutdown_connections 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1da0f60 0x562af219b830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af2194f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1dc16b0 0x562af218e050 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/809707994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af218db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2ac6ffd640 0 client.16206 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 >> 172.21.15.100:0/809707994 conn(0x562af1dd64e0 msgr2=0x562af217e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 shutdown_connections 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 1 -- 172.21.15.100:0/809707994 wait complete. 2024-04-30T23:15:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.090+0000 7f2af4fcf740 20 client.16206 trim_cache size 0 max 16384 2024-04-30T23:15:40.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 Processor -- start 2024-04-30T23:15:40.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 -- start start 2024-04-30T23:15:40.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1dc16b0 0x562af2194e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af21a0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ac930 con 0x562af1db94d0 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ae530 con 0x562af1dc16b0 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ad000 con 0x562af1de2390 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57642/0 (socket says 172.21.15.100:57642) 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/240066168 learned_addr learned my addr 172.21.15.100:0/240066168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1dc16b0 0x562af2194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af21a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/240066168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 msgr2=0x562af21a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af21a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/240066168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1dc16b0 msgr2=0x562af2194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1dc16b0 0x562af2194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.104+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/240066168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af1ec47d0 con 0x562af1db94d0 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.105+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000d8d0 tx=0x7f2ad000b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ec87a3a9ca87c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.105+0000 7f2add7fa640 1 -- 172.21.15.100:0/240066168 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0026040 con 0x562af1db94d0 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.105+0000 7f2add7fa640 1 -- 172.21.15.100:0/240066168 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad0012070 con 0x562af1db94d0 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.105+0000 7f2add7fa640 1 -- 172.21.15.100:0/240066168 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0004660 con 0x562af1db94d0 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- 172.21.15.100:0/240066168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 msgr2=0x562af219ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000d8d0 tx=0x7f2ad000b490 comp rx=0 tx=0).stop 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- 172.21.15.100:0/240066168 shutdown_connections 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1de2390 0x562af21a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1dc16b0 0x562af2194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/240066168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1db94d0 0x562af219ffe0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- 172.21.15.100:0/240066168 >> 172.21.15.100:0/240066168 conn(0x562af1dd64e0 msgr2=0x562af2187f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- 172.21.15.100:0/240066168 shutdown_connections 2024-04-30T23:15:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- 172.21.15.100:0/240066168 wait complete. 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 -- start start 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 Processor -- start 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2192010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af2192550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.106+0000 7f2af4fcf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81adda0 con 0x562af1de2390 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ad6d0 con 0x562af1db94d0 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81aa910 con 0x562af1dc16b0 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 10 client.0 _ll_register_callbacks cb 0x7f2ad8009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57654/0 (socket says 172.21.15.100:57654) 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/996779563 learned_addr learned my addr 172.21.15.100:0/996779563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2192010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af2192550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/996779563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 msgr2=0x562af2192550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af2192550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/996779563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 msgr2=0x562af2192010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2192010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 -- 172.21.15.100:0/996779563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af21939f0 con 0x562af1de2390 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ae6ffd640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000bea0 tx=0x7f2ad000e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec22fee82acbde5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0005740 con 0x562af1de2390 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2ad001d480 con 0x562af1de2390 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad0012070 con 0x562af1de2390 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ad001d680 con 0x562af1de2390 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 10 client.16212 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.107+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562af2194c50 con 0x562af1de2390 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ad0012070 con 0x562af1de2390 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f2ad0029070 con 0x562af1de2390 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 10 client.16212 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 10 client.16212 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 20 client.16212 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1d763a0 0x562af2203aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 4 client.16212 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562af20f6990 con 0x562af1d763a0 2024-04-30T23:15:40.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1d763a0 0x562af2203aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.108+0000 7f2ac6ffd640 10 client.16212 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2ae77fe640 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1d763a0 0x562af2203aa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=214a3e1d1d3f70d4 server_cookie=7eb3106341277178 in_seq=0 out_seq=0 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2ac6ffd640 1 -- 172.21.15.100:0/996779563 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562af20f6990 con 0x562af1d763a0 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2ac6ffd640 10 client.16212 handle_command_reply: tid=0 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 client.16212 shutdown 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 msgr2=0x562af2193430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000bea0 tx=0x7f2ad000e950 comp rx=0 tx=0).stop 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 shutdown_connections 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x562af1d763a0 0x562af2203aa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562af1de2390 0x562af2193430 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2ac6ffd640 0 client.16212 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562af1dc16b0 0x562af2192550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 --2- 172.21.15.100:0/996779563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562af1db94d0 0x562af2192010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 >> 172.21.15.100:0/996779563 conn(0x562af1dd64e0 msgr2=0x562af21825a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 shutdown_connections 2024-04-30T23:15:40.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 1 -- 172.21.15.100:0/996779563 wait complete. 2024-04-30T23:15:40.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.109+0000 7f2af4fcf740 20 client.16212 trim_cache size 0 max 16384 2024-04-30T23:15:40.119 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 msgr2=0x7f2ad40a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 0x7f2ad40a6140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00ba0e0 tx=0x7f2ae00e8d90 comp rx=0 tx=0).stop 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 msgr2=0x7f2ae81a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00097b0 tx=0x7f2ae0031840 comp rx=0 tx=0).stop 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 shutdown_connections 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2ad40a3c30 0x7f2ad40a6140 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae81080f0 0x7f2ae81a16d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ae81033f0 0x7f2ae819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 --2- 172.21.15.100:0/1661834125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ae81021b0 0x7f2ae819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 >> 172.21.15.100:0/1661834125 conn(0x7f2ae80fd380 msgr2=0x7f2ae8109c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 shutdown_connections 2024-04-30T23:15:40.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.110+0000 7f2aee043640 1 -- 172.21.15.100:0/1661834125 wait complete. 2024-04-30T23:15:40.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-30T23:15:40.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- 172.21.15.100:0/1892625566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 msgr2=0x7ff51c105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 --2- 172.21.15.100:0/1892625566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c105190 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff508009900 tx=0x7ff50802a410 comp rx=0 tx=0).stop 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- 172.21.15.100:0/1892625566 shutdown_connections 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 --2- 172.21.15.100:0/1892625566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 0x7ff51c10bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 --2- 172.21.15.100:0/1892625566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c105190 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 --2- 172.21.15.100:0/1892625566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 0x7ff51c104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- 172.21.15.100:0/1892625566 >> 172.21.15.100:0/1892625566 conn(0x7ff51c0fed50 msgr2=0x7ff51c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- 172.21.15.100:0/1892625566 shutdown_connections 2024-04-30T23:15:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- 172.21.15.100:0/1892625566 wait complete. 2024-04-30T23:15:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 Processor -- start 2024-04-30T23:15:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.231+0000 7ff5231e3640 1 -- start start 2024-04-30T23:15:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 0x7ff51c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 0x7ff51c1a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10f660 con 0x7ff51c104d80 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10f4e0 con 0x7ff51c109a80 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10f7e0 con 0x7ff51c103b40 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57668/0 (socket says 172.21.15.100:57668) 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 -- 172.21.15.100:0/77167481 learned_addr learned my addr 172.21.15.100:0/77167481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff521780640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 0x7ff51c1a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff520f7f640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 0x7ff51c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 -- 172.21.15.100:0/77167481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 msgr2=0x7ff51c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 0x7ff51c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 -- 172.21.15.100:0/77167481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 msgr2=0x7ff51c1a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 0x7ff51c1a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 -- 172.21.15.100:0/77167481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c1a1e00 con 0x7ff51c104d80 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff51bfff640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff508006010 tx=0x7ff5080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff519ffb640 1 -- 172.21.15.100:0/77167481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50803f030 con 0x7ff51c104d80 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff519ffb640 1 -- 172.21.15.100:0/77167481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff508031910 con 0x7ff51c104d80 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c1a2090 con 0x7ff51c104d80 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.232+0000 7ff519ffb640 1 -- 172.21.15.100:0/77167481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508035070 con 0x7ff51c104d80 2024-04-30T23:15:40.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.233+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1a2580 con 0x7ff51c104d80 2024-04-30T23:15:40.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.235+0000 7ff52a172740 1 Processor -- start 2024-04-30T23:15:40.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 -- start start 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff519ffb640 1 -- 172.21.15.100:0/77167481 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff508042030 con 0x7ff51c104d80 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3ac390 0x56172e74de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e74e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56172e6b2d80 con 0x56172e38b6b0 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56172e66ca20 con 0x56172e3834d0 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff52a172740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56172e6aed40 con 0x56172e3ac390 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57670/0 (socket says 172.21.15.100:57670) 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff51bfff640 1 -- 172.21.15.100:0/202087813 learned_addr learned my addr 172.21.15.100:0/202087813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e74e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff521780640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3ac390 0x56172e74de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff519ffb640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 0x7ff50c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 -- 172.21.15.100:0/202087813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3ac390 msgr2=0x56172e74de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3ac390 0x56172e74de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 -- 172.21.15.100:0/202087813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 msgr2=0x56172e755290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff520f7f640 1 -- 172.21.15.100:0/202087813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56172e650e00 con 0x56172e3834d0 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff51bfff640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff521780640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 0x7ff50c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.236+0000 7ff519ffb640 1 -- 172.21.15.100:0/77167481 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff5080f0c70 con 0x7ff51c104d80 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.237+0000 7ff520f7f640 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e74e390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff51c103410 tx=0x7ff5100113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b043e22f30603094 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.237+0000 7ff506ffd640 1 -- 172.21.15.100:0/202087813 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510011de0 con 0x56172e3834d0 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.237+0000 7ff506ffd640 1 -- 172.21.15.100:0/202087813 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff510012900 con 0x56172e3834d0 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.237+0000 7ff506ffd640 1 -- 172.21.15.100:0/202087813 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51000f940 con 0x56172e3834d0 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff521780640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 0x7ff50c0a60c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff514009fd0 tx=0x7ff514004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- 172.21.15.100:0/202087813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 msgr2=0x56172e74e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e74e390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff51c103410 tx=0x7ff5100113e0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- 172.21.15.100:0/202087813 shutdown_connections 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e755290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e74e390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- 172.21.15.100:0/202087813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3ac390 0x56172e74de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- 172.21.15.100:0/202087813 >> 172.21.15.100:0/202087813 conn(0x56172e3a04e0 msgr2=0x56172e7497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- 172.21.15.100:0/202087813 shutdown_connections 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- 172.21.15.100:0/202087813 wait complete. 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 -- start start 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 Processor -- start 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e757a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.238+0000 7ff52a172740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 0x56172e757f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56172e755ce0 con 0x56172e3ac390 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56172e639dc0 con 0x56172e38b6b0 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56172e755e60 con 0x56172e3834d0 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 10 client.0 _ll_register_callbacks cb 0x56172e655600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57682/0 (socket says 172.21.15.100:57682) 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 0x56172e757f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 -- 172.21.15.100:0/639841260 learned_addr learned my addr 172.21.15.100:0/639841260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff520f7f640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e757a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 -- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 msgr2=0x56172e757a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e757a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 -- 172.21.15.100:0/639841260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 msgr2=0x56172e757f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 0x56172e757f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 -- 172.21.15.100:0/639841260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56172e677c30 con 0x56172e3ac390 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff51bfff640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 0x56172e757f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff521780640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff51400fb90 tx=0x7ff514004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b435c03f9905b6d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff4fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51401eac0 con 0x56172e3ac390 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff51401ec60 con 0x56172e3ac390 2024-04-30T23:15:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff510012900 con 0x56172e3ac390 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff51401ee60 con 0x56172e3ac390 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 10 client.16224 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.239+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56172e3c43f0 con 0x56172e3ac390 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff510012900 con 0x56172e3ac390 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ff514028420 con 0x56172e3ac390 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 10 client.16224 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 10 client.16224 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 20 client.16224 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e36af60 0x56172e7658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 4 client.16224 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56172e6ac810 con 0x56172e36af60 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.240+0000 7ff520f7f640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e36af60 0x56172e7658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.241+0000 7ff4fbfff640 10 client.16224 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.241+0000 7ff520f7f640 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e36af60 0x56172e7658c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd29d9eed8a1bf6f server_cookie=9b746cf1836b074 in_seq=0 out_seq=0 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.241+0000 7ff4fbfff640 1 -- 172.21.15.100:0/639841260 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x56172e6ac810 con 0x56172e36af60 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.241+0000 7ff4fbfff640 10 client.16224 handle_command_reply: tid=0 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.241+0000 7ff52a172740 1 client.16224 shutdown 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 msgr2=0x56172e75eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff51400fb90 tx=0x7ff514004ab0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 shutdown_connections 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e36af60 0x56172e7658c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e75eef0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e38b6b0 0x56172e757f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 --2- 172.21.15.100:0/639841260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e757a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff4fbfff640 0 client.16224 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 >> 172.21.15.100:0/639841260 conn(0x56172e3a04e0 msgr2=0x56172e7489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 shutdown_connections 2024-04-30T23:15:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 1 -- 172.21.15.100:0/639841260 wait complete. 2024-04-30T23:15:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.242+0000 7ff52a172740 20 client.16224 trim_cache size 0 max 16384 2024-04-30T23:15:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 Processor -- start 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 -- start start 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e7448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 0x56172e75ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1ac960 con 0x56172e3ac390 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1ae560 con 0x56172e3834d0 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff52a172740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1ad030 con 0x56172e38b6b0 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff521780640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff521780640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57698/0 (socket says 172.21.15.100:57698) 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff521780640 1 -- 172.21.15.100:0/4042303160 learned_addr learned my addr 172.21.15.100:0/4042303160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.255+0000 7ff520f7f640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e7448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff51bfff640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 0x56172e75ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 -- 172.21.15.100:0/4042303160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 msgr2=0x56172e75ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 0x56172e75ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 -- 172.21.15.100:0/4042303160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 msgr2=0x56172e7448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e7448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 -- 172.21.15.100:0/4042303160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56172e48e7d0 con 0x56172e3ac390 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff51bfff640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 0x56172e75ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff521780640 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff514010ec0 tx=0x7ff51400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea0e8ad31977f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff5067fc640 1 -- 172.21.15.100:0/4042303160 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51401eac0 con 0x56172e3ac390 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff5067fc640 1 -- 172.21.15.100:0/4042303160 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51401ec60 con 0x56172e3ac390 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.256+0000 7ff5067fc640 1 -- 172.21.15.100:0/4042303160 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140369a0 con 0x56172e3ac390 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- 172.21.15.100:0/4042303160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 msgr2=0x56172e76a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff514010ec0 tx=0x7ff51400ff90 comp rx=0 tx=0).stop 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- 172.21.15.100:0/4042303160 shutdown_connections 2024-04-30T23:15:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e3ac390 0x56172e76a070 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e38b6b0 0x56172e75ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 --2- 172.21.15.100:0/4042303160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3834d0 0x56172e7448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- 172.21.15.100:0/4042303160 >> 172.21.15.100:0/4042303160 conn(0x56172e3a04e0 msgr2=0x56172e756200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- 172.21.15.100:0/4042303160 shutdown_connections 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- 172.21.15.100:0/4042303160 wait complete. 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 -- start start 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.257+0000 7ff52a172740 1 Processor -- start 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e75c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3ac390 0x56172e75da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1addd0 con 0x56172e38b6b0 2024-04-30T23:15:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1ad700 con 0x56172e3ac390 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1aa940 con 0x56172e3834d0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff52a172740 10 client.0 _ll_register_callbacks cb 0x7ff514009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57704/0 (socket says 172.21.15.100:57704) 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 -- 172.21.15.100:0/762324462 learned_addr learned my addr 172.21.15.100:0/762324462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff520f7f640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e75c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff521780640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3ac390 0x56172e75da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 -- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 msgr2=0x56172e75c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e75c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 -- 172.21.15.100:0/762324462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3ac390 msgr2=0x56172e75da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3ac390 0x56172e75da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 -- 172.21.15.100:0/762324462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56172e75e020 con 0x56172e38b6b0 2024-04-30T23:15:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff51bfff640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff508031440 tx=0x7ff5080045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace1485341241f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff4fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508049040 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.258+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff5080dd0b0 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51401ec60 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff5080bc550 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 10 client.16230 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56172e75f280 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51401ec60 con 0x56172e38b6b0 2024-04-30T23:15:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ff5080f8040 con 0x56172e38b6b0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 10 client.16230 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 10 client.16230 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 20 client.16230 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e3403a0 0x56172e7ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 4 client.16230 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56172e6c0990 con 0x56172e3403a0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.259+0000 7ff520f7f640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e3403a0 0x56172e7ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff520f7f640 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e3403a0 0x56172e7ce240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e0b59289de831bc server_cookie=559a562238b1ebe1 in_seq=0 out_seq=0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff4fbfff640 10 client.16230 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff4fbfff640 1 -- 172.21.15.100:0/762324462 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56172e6c0990 con 0x56172e3403a0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff4fbfff640 10 client.16230 handle_command_reply: tid=0 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 client.16230 shutdown 2024-04-30T23:15:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 msgr2=0x56172e75cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff508031440 tx=0x7ff5080045b0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 shutdown_connections 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x56172e3403a0 0x56172e7ce240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56172e3ac390 0x56172e75da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56172e38b6b0 0x56172e75cb30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff4fbfff640 0 client.16230 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 --2- 172.21.15.100:0/762324462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56172e3834d0 0x56172e75c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 >> 172.21.15.100:0/762324462 conn(0x56172e3a04e0 msgr2=0x56172e74c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 shutdown_connections 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 1 -- 172.21.15.100:0/762324462 wait complete. 2024-04-30T23:15:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.260+0000 7ff52a172740 20 client.16230 trim_cache size 0 max 16384 2024-04-30T23:15:40.271 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 msgr2=0x7ff50c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 0x7ff50c0a60c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff514009fd0 tx=0x7ff514004a40 comp rx=0 tx=0).stop 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 msgr2=0x7ff51c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff508006010 tx=0x7ff5080042f0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 shutdown_connections 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff50c0a3bb0 0x7ff50c0a60c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff51c109a80 0x7ff51c1a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff51c104d80 0x7ff51c19a870 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 --2- 172.21.15.100:0/77167481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c103b40 0x7ff51c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 >> 172.21.15.100:0/77167481 conn(0x7ff51c0fed50 msgr2=0x7ff51c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 shutdown_connections 2024-04-30T23:15:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.261+0000 7ff5231e3640 1 -- 172.21.15.100:0/77167481 wait complete. 2024-04-30T23:15:40.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 -- 172.21.15.100:0/1303751441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 msgr2=0x7f51a4103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 --2- 172.21.15.100:0/1303751441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a4103730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5194009900 tx=0x7f519402a410 comp rx=0 tx=0).stop 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 -- 172.21.15.100:0/1303751441 shutdown_connections 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 --2- 172.21.15.100:0/1303751441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4108970 0x7f51a410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 --2- 172.21.15.100:0/1303751441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4103c70 0x7f51a4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 --2- 172.21.15.100:0/1303751441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a4103730 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 -- 172.21.15.100:0/1303751441 >> 172.21.15.100:0/1303751441 conn(0x7f51a40fdc20 msgr2=0x7f51a41000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 -- 172.21.15.100:0/1303751441 shutdown_connections 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.387+0000 7f51ab231640 1 -- 172.21.15.100:0/1303751441 wait complete. 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 Processor -- start 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 -- start start 2024-04-30T23:15:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4103c70 0x7f51a419f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 0x7f51a41a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51a410e530 con 0x7f51a4102a30 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f51a410e3b0 con 0x7f51a4103c70 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51ab231640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51a410e6b0 con 0x7f51a4108970 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57718/0 (socket says 172.21.15.100:57718) 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 -- 172.21.15.100:0/2373854031 learned_addr learned my addr 172.21.15.100:0/2373854031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4103c70 0x7f51a419f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 0x7f51a41a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 -- 172.21.15.100:0/2373854031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 msgr2=0x7f51a41a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 0x7f51a41a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 -- 172.21.15.100:0/2373854031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4103c70 msgr2=0x7f51a419f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4103c70 0x7f51a419f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a8fcd640 1 -- 172.21.15.100:0/2373854031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a41a1e40 con 0x7f51a4102a30 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.388+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 0x7f51a41a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51a8fcd640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5194006010 tx=0x7f5194004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51a1ffb640 1 -- 172.21.15.100:0/2373854031 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519403f030 con 0x7f51a4102a30 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a41a20d0 con 0x7f51a4102a30 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51a1ffb640 1 -- 172.21.15.100:0/2373854031 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5194031910 con 0x7f51a4102a30 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51a1ffb640 1 -- 172.21.15.100:0/2373854031 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194035070 con 0x7f51a4102a30 2024-04-30T23:15:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.389+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41a25c0 con 0x7f51a4102a30 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 Processor -- start 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 -- start start 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079edfe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea376b0 0x56079ee056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56079ed5ed80 con 0x56079ea58390 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56079ed18a20 con 0x56079ea2f4d0 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51b21bd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56079ed5ad40 con 0x56079ea376b0 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51a97ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51a97ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57728/0 (socket says 172.21.15.100:57728) 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51a97ce640 1 -- 172.21.15.100:0/302040396 learned_addr learned my addr 172.21.15.100:0/302040396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51a1ffb640 1 -- 172.21.15.100:0/2373854031 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5194042030 con 0x7f51a4102a30 2024-04-30T23:15:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.392+0000 7f51a3fff640 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea376b0 0x56079ee056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 -- 172.21.15.100:0/302040396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea376b0 msgr2=0x56079ee056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea376b0 0x56079ee056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 -- 172.21.15.100:0/302040396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 msgr2=0x56079edfe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079edfe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 -- 172.21.15.100:0/302040396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079ecfce00 con 0x56079ea58390 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a97ce640 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f519c009fd0 tx=0x7f519c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8b142be98a2091 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f518affd640 1 -- 172.21.15.100:0/302040396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c011760 con 0x56079ea58390 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a1ffb640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 0x7f518c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f518affd640 1 -- 172.21.15.100:0/302040396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c011db0 con 0x56079ea58390 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f518affd640 1 -- 172.21.15.100:0/302040396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00e3c0 con 0x56079ea58390 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a8fcd640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 0x7f518c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.393+0000 7f51a1ffb640 1 -- 172.21.15.100:0/2373854031 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f51940f0b00 con 0x7f51a4102a30 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- 172.21.15.100:0/302040396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 msgr2=0x56079edfe220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f519c009fd0 tx=0x7f519c0108e0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51a8fcd640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 0x7f518c0a60c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f51940c51c0 tx=0x7f51940dd040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- 172.21.15.100:0/302040396 shutdown_connections 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea376b0 0x56079ee056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079edfe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 --2- 172.21.15.100:0/302040396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea58390 0x56079edfe220 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- 172.21.15.100:0/302040396 >> 172.21.15.100:0/302040396 conn(0x56079ea4c4e0 msgr2=0x56079edf57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- 172.21.15.100:0/302040396 shutdown_connections 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- 172.21.15.100:0/302040396 wait complete. 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 -- start start 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.394+0000 7f51b21bd740 1 Processor -- start 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea376b0 0x56079ee083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56079ee06090 con 0x56079ea2f4d0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56079ece5dc0 con 0x56079ea376b0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56079ee06210 con 0x56079ea58390 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51b21bd740 10 client.0 _ll_register_callbacks cb 0x56079ed01600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57740/0 (socket says 172.21.15.100:57740) 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 -- 172.21.15.100:0/2007999276 learned_addr learned my addr 172.21.15.100:0/2007999276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 -- 172.21.15.100:0/2007999276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 msgr2=0x56079ee0f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 -- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea376b0 msgr2=0x56079ee083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea376b0 0x56079ee083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.395+0000 7f51a97ce640 1 -- 172.21.15.100:0/2007999276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079ed23c30 con 0x56079ea2f4d0 2024-04-30T23:15:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f519c005cc0 tx=0x7f519c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b762e0809b91cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c011af0 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f519c005040 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f519c011db0 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f519c005240 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 10 client.16242 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56079ea703f0 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c011db0 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f519c029020 con 0x56079ea2f4d0 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 10 client.16242 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 10 client.16242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 20 client.16242 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079ea16f60 0x56079ee15890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 4 client.16242 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.396+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56079ed58810 con 0x56079ea16f60 2024-04-30T23:15:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.397+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079ea16f60 0x56079ee15890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.399+0000 7f5183fff640 10 client.16242 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.399+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079ea16f60 0x56079ee15890 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9fc04da39553ccd1 server_cookie=32759ac4c4324301 in_seq=0 out_seq=0 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.401+0000 7f5183fff640 1 -- 172.21.15.100:0/2007999276 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x56079ed58810 con 0x56079ea16f60 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.401+0000 7f5183fff640 10 client.16242 handle_command_reply: tid=0 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.401+0000 7f51b21bd740 1 client.16242 shutdown 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 msgr2=0x56079ee07e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f519c005cc0 tx=0x7f519c009bb0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 shutdown_connections 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079ea16f60 0x56079ee15890 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea376b0 0x56079ee083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2007999276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea2f4d0 0x56079ee07e90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f5183fff640 0 client.16242 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 >> 172.21.15.100:0/2007999276 conn(0x56079ea4c4e0 msgr2=0x56079edf49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 shutdown_connections 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 1 -- 172.21.15.100:0/2007999276 wait complete. 2024-04-30T23:15:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.402+0000 7f51b21bd740 20 client.16242 trim_cache size 0 max 16384 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 Processor -- start 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 -- start start 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee08170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee19fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41aa820 con 0x56079ea376b0 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41ac420 con 0x56079ea2f4d0 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51b21bd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41aaef0 con 0x56079ea58390 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57752/0 (socket says 172.21.15.100:57752) 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 -- 172.21.15.100:0/806898780 learned_addr learned my addr 172.21.15.100:0/806898780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a97ce640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee08170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a97ce640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 -- 172.21.15.100:0/806898780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 msgr2=0x56079ee19fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee19fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 -- 172.21.15.100:0/806898780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 msgr2=0x56079ee08170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee08170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 -- 172.21.15.100:0/806898780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079eb3a7d0 con 0x56079ea376b0 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a97ce640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee19fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.416+0000 7f51a3fff640 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x56079edf6530 tx=0x7f5198010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744ece8ff280fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.417+0000 7f518a7fc640 1 -- 172.21.15.100:0/806898780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198020030 con 0x56079ea376b0 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.417+0000 7f518a7fc640 1 -- 172.21.15.100:0/806898780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51980054d0 con 0x56079ea376b0 2024-04-30T23:15:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.417+0000 7f518a7fc640 1 -- 172.21.15.100:0/806898780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198004a00 con 0x56079ea376b0 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.417+0000 7f51b21bd740 1 -- 172.21.15.100:0/806898780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 msgr2=0x56079ee0f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.417+0000 7f51b21bd740 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x56079edf6530 tx=0x7f5198010800 comp rx=0 tx=0).stop 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- 172.21.15.100:0/806898780 shutdown_connections 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee19fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0f2c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- 172.21.15.100:0/806898780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee08170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- 172.21.15.100:0/806898780 >> 172.21.15.100:0/806898780 conn(0x56079ea4c4e0 msgr2=0x56079ee07a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- 172.21.15.100:0/806898780 shutdown_connections 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- 172.21.15.100:0/806898780 wait complete. 2024-04-30T23:15:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- start start 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 Processor -- start 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee0f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41abc90 con 0x56079ea376b0 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41ab5c0 con 0x56079ea2f4d0 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41a8800 con 0x56079ea58390 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51b21bd740 10 client.0 _ll_register_callbacks cb 0x7f519c009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.418+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57756/0 (socket says 172.21.15.100:57756) 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 -- 172.21.15.100:0/2805900851 learned_addr learned my addr 172.21.15.100:0/2805900851 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee0f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 -- 172.21.15.100:0/2805900851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 msgr2=0x56079ee0c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 -- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 msgr2=0x56079ee0f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee0f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 -- 172.21.15.100:0/2805900851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079ee79ae0 con 0x56079ea376b0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee0f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51a3fff640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5198010fd0 tx=0x7f5198009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c29403e7fcd4e93 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f5183fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198025640 con 0x56079ea376b0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f51980257e0 con 0x56079ea376b0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51980054d0 con 0x56079ea376b0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f519801c5c0 con 0x56079ea376b0 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51b21bd740 10 client.16248 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56079ee7ad70 con 0x56079ea376b0 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.419+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51980054d0 con 0x56079ea376b0 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f519802db20 con 0x56079ea376b0 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 10 client.16248 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 10 client.16248 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 20 client.16248 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079e9ec3a0 0x56079ee7d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 4 client.16248 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56079ed6c990 con 0x56079e9ec3a0 2024-04-30T23:15:40.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079e9ec3a0 0x56079ee7d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f51a97ce640 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079e9ec3a0 0x56079ee7d6d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16590b37867afd1e server_cookie=d357d62b09ff52b4 in_seq=0 out_seq=0 2024-04-30T23:15:40.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.420+0000 7f5183fff640 10 client.16248 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f5183fff640 1 -- 172.21.15.100:0/2805900851 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56079ed6c990 con 0x56079e9ec3a0 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f5183fff640 10 client.16248 handle_command_reply: tid=0 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 client.16248 shutdown 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 msgr2=0x56079ee0bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5198010fd0 tx=0x7f5198009d60 comp rx=0 tx=0).stop 2024-04-30T23:15:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 shutdown_connections 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56079ea58390 0x56079ee0c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56079ea376b0 0x56079ee0bea0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x56079e9ec3a0 0x56079ee7d6d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 --2- 172.21.15.100:0/2805900851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56079ea2f4d0 0x56079ee0f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f5183fff640 0 client.16248 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 >> 172.21.15.100:0/2805900851 conn(0x56079ea4c4e0 msgr2=0x56079edf85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 shutdown_connections 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 1 -- 172.21.15.100:0/2805900851 wait complete. 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.422+0000 7f51b21bd740 20 client.16248 trim_cache size 0 max 16384 2024-04-30T23:15:40.431 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 msgr2=0x7f518c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 0x7f518c0a60c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f51940c51c0 tx=0x7f51940dd040 comp rx=0 tx=0).stop 2024-04-30T23:15:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 msgr2=0x7f51a406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5194006010 tx=0x7f5194004270 comp rx=0 tx=0).stop 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 shutdown_connections 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f518c0a3bb0 0x7f518c0a60c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a4108970 0x7f51a41a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51a4103c70 0x7f51a419f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 --2- 172.21.15.100:0/2373854031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51a4102a30 0x7f51a406bd80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 >> 172.21.15.100:0/2373854031 conn(0x7f51a40fdc20 msgr2=0x7f51a4104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 shutdown_connections 2024-04-30T23:15:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.423+0000 7f51ab231640 1 -- 172.21.15.100:0/2373854031 wait complete. 2024-04-30T23:15:40.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/16: symlink d2/l6 0 2024-04-30T23:15:40.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-30T23:15:40.450 INFO:tasks.workunit.client.0.smithi100.stdout:0/17: write d2/f4 [2755880,89039] 0 2024-04-30T23:15:40.450 INFO:tasks.workunit.client.0.smithi100.stdout:0/18: chown d2 7219 1 2024-04-30T23:15:40.450 INFO:tasks.workunit.client.0.smithi100.stdout:0/19: chown d2/l6 140 1 2024-04-30T23:15:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 -- 172.21.15.100:0/2058257101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64981050e0 msgr2=0x7f64981054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 --2- 172.21.15.100:0/2058257101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64981050e0 0x7f64981054f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6490009ca0 tx=0x7f649002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 -- 172.21.15.100:0/2058257101 shutdown_connections 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 --2- 172.21.15.100:0/2058257101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6498102290 0x7f649810bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 --2- 172.21.15.100:0/2058257101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 0x7f6498101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 --2- 172.21.15.100:0/2058257101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64981050e0 0x7f64981054f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 -- 172.21.15.100:0/2058257101 >> 172.21.15.100:0/2058257101 conn(0x7f64980fd390 msgr2=0x7f64980ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 -- 172.21.15.100:0/2058257101 shutdown_connections 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.550+0000 7f64a055e640 1 -- 172.21.15.100:0/2058257101 wait complete. 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 Processor -- start 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 -- start start 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 0x7f649819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981050e0 0x7f64981a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f649810f680 con 0x7f6498102290 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f649810f500 con 0x7f6498101790 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f64a055e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f649810f800 con 0x7f64981050e0 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f649daf9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f649daf9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57774/0 (socket says 172.21.15.100:57774) 2024-04-30T23:15:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f649daf9640 1 -- 172.21.15.100:0/3494471763 learned_addr learned my addr 172.21.15.100:0/3494471763 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f649e2fa640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 0x7f649819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.551+0000 7f649eafb640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981050e0 0x7f64981a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 -- 172.21.15.100:0/3494471763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981050e0 msgr2=0x7f64981a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981050e0 0x7f64981a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 -- 172.21.15.100:0/3494471763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 msgr2=0x7f649819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 0x7f649819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 -- 172.21.15.100:0/3494471763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64981a1d10 con 0x7f6498102290 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f649daf9640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f648c00e9f0 tx=0x7f648c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f64977fe640 1 -- 172.21.15.100:0/3494471763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c00cd80 con 0x7f6498102290 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f64977fe640 1 -- 172.21.15.100:0/3494471763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f648c0108e0 con 0x7f6498102290 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64981a1fa0 con 0x7f6498102290 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f64977fe640 1 -- 172.21.15.100:0/3494471763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c018980 con 0x7f6498102290 2024-04-30T23:15:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.552+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981a2460 con 0x7f6498102290 2024-04-30T23:15:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64977fe640 1 -- 172.21.15.100:0/3494471763 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f648c010430 con 0x7f6498102290 2024-04-30T23:15:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 Processor -- start 2024-04-30T23:15:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 -- start start 2024-04-30T23:15:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9c0390 0x55605ed66220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55605ecc6d80 con 0x55605e9c0390 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55605ec80a20 con 0x55605e9974d0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64a740e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55605ecc2d40 con 0x55605e99f6b0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.555+0000 7f64977fe640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 0x7f64800a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:41284/0 (socket says 172.21.15.100:41284) 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 -- 172.21.15.100:0/1752434320 learned_addr learned my addr 172.21.15.100:0/1752434320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649eafb640 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9c0390 0x55605ed66220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f64977fe640 1 -- 172.21.15.100:0/3494471763 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f648c0d0a30 con 0x7f6498102290 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649daf9640 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649eafb640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 0x7f64800a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 -- 172.21.15.100:0/1752434320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 msgr2=0x55605ed6d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 -- 172.21.15.100:0/1752434320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9c0390 msgr2=0x55605ed66220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9c0390 0x55605ed66220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 -- 172.21.15.100:0/1752434320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605ec64e00 con 0x55605e9974d0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649eafb640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 0x7f64800a60c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64880058c0 tx=0x7f648800a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6490031b50 tx=0x7f64900098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab243c430352711b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f6494bfe640 1 -- 172.21.15.100:0/1752434320 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900316d0 con 0x55605e9974d0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f6494bfe640 1 -- 172.21.15.100:0/1752434320 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6490036030 con 0x55605e9974d0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.556+0000 7f6494bfe640 1 -- 172.21.15.100:0/1752434320 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900047c0 con 0x55605e9974d0 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 -- 172.21.15.100:0/1752434320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 msgr2=0x55605ed667a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6490031b50 tx=0x7f64900098b0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 -- 172.21.15.100:0/1752434320 shutdown_connections 2024-04-30T23:15:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed667a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 --2- 172.21.15.100:0/1752434320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9c0390 0x55605ed66220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 -- 172.21.15.100:0/1752434320 >> 172.21.15.100:0/1752434320 conn(0x55605e9b44e0 msgr2=0x55605ed5d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.557+0000 7f64a740e740 1 -- 172.21.15.100:0/1752434320 shutdown_connections 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 -- 172.21.15.100:0/1752434320 wait complete. 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 -- start start 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 Processor -- start 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9c0390 0x55605ed77150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55605ed6df10 con 0x55605e9974d0 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55605ec4ddc0 con 0x55605e9c0390 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55605ed6e090 con 0x55605e99f6b0 2024-04-30T23:15:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f64a740e740 10 client.0 _ll_register_callbacks cb 0x55605ec69600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57788/0 (socket says 172.21.15.100:57788) 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f649e2fa640 1 -- 172.21.15.100:0/1455082133 learned_addr learned my addr 172.21.15.100:0/1455082133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f649eafb640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9c0390 0x55605ed77150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.558+0000 7f649daf9640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 -- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 msgr2=0x55605ed701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 -- 172.21.15.100:0/1455082133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9c0390 msgr2=0x55605ed77150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9c0390 0x55605ed77150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 -- 172.21.15.100:0/1455082133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605ec8bc30 con 0x55605e9974d0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f649e2fa640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6490005e30 tx=0x7f6490031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc3e21e375713a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649004a040 con 0x55605e9974d0 2024-04-30T23:15:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6490036030 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6490003b70 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6490003d70 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f64a740e740 10 client.16260 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55605e9d83f0 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6490036030 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f649004d030 con 0x55605e9974d0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f64a740e740 10 client.16260 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.559+0000 7f64a740e740 10 client.16260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f64a740e740 20 client.16260 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e97ef60 0x55605ed7d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f64a740e740 4 client.16260 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55605ecc0810 con 0x55605e97ef60 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f649daf9640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e97ef60 0x55605ed7d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f647dffb640 10 client.16260 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.560+0000 7f649daf9640 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e97ef60 0x55605ed7d670 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39fa8a0d77118f2c server_cookie=daabc9de9df8e841 in_seq=0 out_seq=0 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f647dffb640 1 -- 172.21.15.100:0/1455082133 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55605ecc0810 con 0x55605e97ef60 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f647dffb640 10 client.16260 handle_command_reply: tid=0 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 client.16260 shutdown 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 msgr2=0x55605ed6fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6490005e30 tx=0x7f6490031780 comp rx=0 tx=0).stop 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 shutdown_connections 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e97ef60 0x55605ed7d670 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9c0390 0x55605ed77150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f647dffb640 0 client.16260 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 --2- 172.21.15.100:0/1455082133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed6fcb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 >> 172.21.15.100:0/1455082133 conn(0x55605e9b44e0 msgr2=0x55605ed5c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 shutdown_connections 2024-04-30T23:15:40.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 1 -- 172.21.15.100:0/1455082133 wait complete. 2024-04-30T23:15:40.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.561+0000 7f64a740e740 20 client.16260 trim_cache size 0 max 16384 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 Processor -- start 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 -- start start 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64981aa650 con 0x55605e97ef60 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64981ac250 con 0x55605e9974d0 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f64a740e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f64981aad20 con 0x55605e99f6b0 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57800/0 (socket says 172.21.15.100:57800) 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 -- 172.21.15.100:0/841962332 learned_addr learned my addr 172.21.15.100:0/841962332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649daf9640 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649eafb640 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 -- 172.21.15.100:0/841962332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 msgr2=0x55605ed6f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 -- 172.21.15.100:0/841962332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 msgr2=0x55605ed77070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed77070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.575+0000 7f649e2fa640 1 -- 172.21.15.100:0/841962332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605ed6aae0 con 0x55605e97ef60 2024-04-30T23:15:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f649e2fa640 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6490002230 tx=0x7f6490009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eb4e0972f51e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f647ffff640 1 -- 172.21.15.100:0/841962332 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900317f0 con 0x55605e97ef60 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f647ffff640 1 -- 172.21.15.100:0/841962332 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6490036070 con 0x55605e97ef60 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f647ffff640 1 -- 172.21.15.100:0/841962332 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649002f970 con 0x55605e97ef60 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 -- 172.21.15.100:0/841962332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 msgr2=0x55605ed6ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6490002230 tx=0x7f6490009b60 comp rx=0 tx=0).stop 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 -- 172.21.15.100:0/841962332 shutdown_connections 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed6f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e9974d0 0x55605ed77070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 --2- 172.21.15.100:0/841962332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e97ef60 0x55605ed6ea90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 -- 172.21.15.100:0/841962332 >> 172.21.15.100:0/841962332 conn(0x55605e9b44e0 msgr2=0x55605ed6e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 -- 172.21.15.100:0/841962332 shutdown_connections 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.576+0000 7f64a740e740 1 -- 172.21.15.100:0/841962332 wait complete. 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 -- start start 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 Processor -- start 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e97ef60 0x55605ed746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64981abac0 con 0x55605e9974d0 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64981ab3f0 con 0x55605e97ef60 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f64981a8630 con 0x55605e99f6b0 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f64a740e740 10 client.0 _ll_register_callbacks cb 0x7f648800ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57816/0 (socket says 172.21.15.100:57816) 2024-04-30T23:15:40.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 -- 172.21.15.100:0/3368257292 learned_addr learned my addr 172.21.15.100:0/3368257292 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649e2fa640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e97ef60 0x55605ed746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649eafb640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 -- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 msgr2=0x55605ed75b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed75b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 -- 172.21.15.100:0/3368257292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e97ef60 msgr2=0x55605ed746e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e97ef60 0x55605ed746e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.577+0000 7f649daf9640 1 -- 172.21.15.100:0/3368257292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605eaa27d0 con 0x55605e9974d0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f649daf9640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f648c09c760 tx=0x7f648c0bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be10c71286bad2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b5070 con 0x55605e9974d0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f648c010a90 con 0x55605e9974d0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6490036070 con 0x55605e9974d0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f648c0a0d60 con 0x55605e9974d0 2024-04-30T23:15:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 10 client.16266 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55605ed77230 con 0x55605e9974d0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6490036070 con 0x55605e9974d0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f648c09dce0 con 0x55605e9974d0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 10 client.16266 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 10 client.16266 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 20 client.16266 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e9c0390 0x55605ede5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 4 client.16266 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.578+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55605ecd4990 con 0x55605e9c0390 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f649e2fa640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e9c0390 0x55605ede5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f647dffb640 10 client.16266 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f649e2fa640 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e9c0390 0x55605ede5fd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b543b16e0972d84 server_cookie=fe79f28cf6621aec in_seq=0 out_seq=0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f647dffb640 1 -- 172.21.15.100:0/3368257292 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55605ecd4990 con 0x55605e9c0390 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f647dffb640 10 client.16266 handle_command_reply: tid=0 2024-04-30T23:15:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 client.16266 shutdown 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 msgr2=0x55605ed74c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f648c09c760 tx=0x7f648c0bd040 comp rx=0 tx=0).stop 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 shutdown_connections 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55605e9c0390 0x55605ede5fd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55605e99f6b0 0x55605ed75b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f647dffb640 0 client.16266 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55605e9974d0 0x55605ed74c20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 --2- 172.21.15.100:0/3368257292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55605e97ef60 0x55605ed746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 >> 172.21.15.100:0/3368257292 conn(0x55605e9b44e0 msgr2=0x55605ed6eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 shutdown_connections 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 1 -- 172.21.15.100:0/3368257292 wait complete. 2024-04-30T23:15:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.579+0000 7f64a740e740 20 client.16266 trim_cache size 0 max 16384 2024-04-30T23:15:40.590 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 msgr2=0x7f64800a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 0x7f64800a60c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64880058c0 tx=0x7f648800a250 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 msgr2=0x7f649819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f648c00e9f0 tx=0x7f648c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 shutdown_connections 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f64800a3bb0 0x7f64800a60c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64981050e0 0x7f64981a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6498102290 0x7f649819a7c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 --2- 172.21.15.100:0/3494471763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6498101790 0x7f649819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 >> 172.21.15.100:0/3494471763 conn(0x7f64980fd390 msgr2=0x7f6498105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 shutdown_connections 2024-04-30T23:15:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.580+0000 7f64a055e640 1 -- 172.21.15.100:0/3494471763 wait complete. 2024-04-30T23:15:40.592 INFO:tasks.workunit.client.0.smithi100.stdout:1/19: mknod d3/c7 0 2024-04-30T23:15:40.592 INFO:tasks.workunit.client.0.smithi100.stdout:2/11: getdents . 0 2024-04-30T23:15:40.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-30T23:15:40.594 INFO:tasks.workunit.client.0.smithi100.stdout:5/7: mkdir d1 0 2024-04-30T23:15:40.595 INFO:tasks.workunit.client.0.smithi100.stdout:8/13: rmdir d2 39 2024-04-30T23:15:40.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/21: creat d0/f4 x:0 0 0 2024-04-30T23:15:40.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/22: rename d0 to d0/d5 22 2024-04-30T23:15:40.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/23: dread - d0/f3 zero size 2024-04-30T23:15:40.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/24: rename d0 to d0/d6 22 2024-04-30T23:15:40.620 INFO:tasks.workunit.client.0.smithi100.stdout:5/8: dread f0 [0,4194304] 0 2024-04-30T23:15:40.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/25: dwrite d0/f2 [0,4194304] 0 2024-04-30T23:15:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 -- 172.21.15.100:0/3351106766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 msgr2=0x7f624010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 --2- 172.21.15.100:0/3351106766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f624010ad80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6238009ca0 tx=0x7f623802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 -- 172.21.15.100:0/3351106766 shutdown_connections 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 --2- 172.21.15.100:0/3351106766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f624010ad80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 --2- 172.21.15.100:0/3351106766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f6240104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 --2- 172.21.15.100:0/3351106766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 0x7f6240103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 -- 172.21.15.100:0/3351106766 >> 172.21.15.100:0/3351106766 conn(0x7f62400fdc10 msgr2=0x7f62401000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 -- 172.21.15.100:0/3351106766 shutdown_connections 2024-04-30T23:15:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.705+0000 7f6244c67640 1 -- 172.21.15.100:0/3351106766 wait complete. 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 Processor -- start 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 -- start start 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 0x7f624006a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f624019f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f624010e550 con 0x7f6240108960 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f624010e3d0 con 0x7f6240103c60 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f6244c67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f624010e6d0 con 0x7f6240102a20 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f624019f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57844/0 (socket says 172.21.15.100:57844) 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f623ed9d640 1 -- 172.21.15.100:0/3315071947 learned_addr learned my addr 172.21.15.100:0/3315071947 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.706+0000 7f623e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 0x7f624006a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 -- 172.21.15.100:0/3315071947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 msgr2=0x7f624006a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 0x7f624006a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 -- 172.21.15.100:0/3315071947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 msgr2=0x7f624019f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f624019f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 -- 172.21.15.100:0/3315071947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62401a2070 con 0x7f6240108960 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f624019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f623ed9d640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6238004af0 tx=0x7f6238031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f622f7fe640 1 -- 172.21.15.100:0/3315071947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238003b70 con 0x7f6240108960 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f622f7fe640 1 -- 172.21.15.100:0/3315071947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6238003d10 con 0x7f6240108960 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62401a2300 con 0x7f6240108960 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f622f7fe640 1 -- 172.21.15.100:0/3315071947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623802fb20 con 0x7f6240108960 2024-04-30T23:15:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.707+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401a2850 con 0x7f6240108960 2024-04-30T23:15:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.709+0000 7f622f7fe640 1 -- 172.21.15.100:0/3315071947 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6238004580 con 0x7f6240108960 2024-04-30T23:15:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.709+0000 7f624bc04740 1 Processor -- start 2024-04-30T23:15:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 -- start start 2024-04-30T23:15:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd43f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd446290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5606dd3a3d80 con 0x5606dd09d390 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5606dd35da20 con 0x5606dd07c6b0 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f624bc04740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606dd39fd40 con 0x5606dd0744d0 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57846/0 (socket says 172.21.15.100:57846) 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 -- 172.21.15.100:0/1221492836 learned_addr learned my addr 172.21.15.100:0/1221492836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623e59c640 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd43f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd446290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f622f7fe640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 0x7f62280a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 -- 172.21.15.100:0/1221492836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 msgr2=0x5606dd43f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd43f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 -- 172.21.15.100:0/1221492836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 msgr2=0x5606dd446290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd446290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623dd9b640 1 -- 172.21.15.100:0/1221492836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dd341e00 con 0x5606dd09d390 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.710+0000 7f623ed9d640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 0x7f62280a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.711+0000 7f622f7fe640 1 -- 172.21.15.100:0/3315071947 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f62380f1cb0 con 0x7f6240108960 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.711+0000 7f623dd9b640 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6234013c30 tx=0x7f6234009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebd06895cfd03e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.711+0000 7f622cff9640 1 -- 172.21.15.100:0/1221492836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234013de0 con 0x5606dd09d390 2024-04-30T23:15:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.711+0000 7f622cff9640 1 -- 172.21.15.100:0/1221492836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6234011c70 con 0x5606dd09d390 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.711+0000 7f622cff9640 1 -- 172.21.15.100:0/1221492836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623400f3c0 con 0x5606dd09d390 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- 172.21.15.100:0/1221492836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 msgr2=0x5606dd43ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6234013c30 tx=0x7f6234009b90 comp rx=0 tx=0).stop 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f623ed9d640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 0x7f62280a60c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62380ef7c0 tx=0x7f62380882a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- 172.21.15.100:0/1221492836 shutdown_connections 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd446290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd43f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- 172.21.15.100:0/1221492836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd09d390 0x5606dd43ee10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- 172.21.15.100:0/1221492836 >> 172.21.15.100:0/1221492836 conn(0x5606dd0914e0 msgr2=0x5606dd43a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- 172.21.15.100:0/1221492836 shutdown_connections 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- 172.21.15.100:0/1221492836 wait complete. 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- start start 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 Processor -- start 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd448a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd44fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5606dd446c80 con 0x5606dd07c6b0 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5606dd32adc0 con 0x5606dd09d390 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.712+0000 7f624bc04740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606dd446e00 con 0x5606dd0744d0 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f624bc04740 10 client.0 _ll_register_callbacks cb 0x5606dd346600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57856/0 (socket says 172.21.15.100:57856) 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 -- 172.21.15.100:0/3469190322 learned_addr learned my addr 172.21.15.100:0/3469190322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd448a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd44fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 -- 172.21.15.100:0/3469190322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 msgr2=0x5606dd448a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd448a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 -- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 msgr2=0x5606dd44fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd44fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 -- 172.21.15.100:0/3469190322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dd368c30 con 0x5606dd07c6b0 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd44fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f623e59c640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f62300126e0 tx=0x7f6230012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7098c33eb816be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f6225ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230004050 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f62300041f0 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6234011c70 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6230025050 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f624bc04740 10 client.16278 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.713+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5606dd0b53f0 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6234011c70 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6230003a00 con 0x5606dd07c6b0 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 10 client.16278 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 20 client.16278 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd05bf60 0x5606dd456820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 4 client.16278 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606dd39d810 con 0x5606dd05bf60 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd05bf60 0x5606dd456820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f6225ffb640 10 client.16278 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.714+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd05bf60 0x5606dd456820 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63ac2b3fea1d044 server_cookie=66cae5f78a55d1ba in_seq=0 out_seq=0 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f6225ffb640 1 -- 172.21.15.100:0/3469190322 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5606dd39d810 con 0x5606dd05bf60 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f6225ffb640 10 client.16278 handle_command_reply: tid=0 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 client.16278 shutdown 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 msgr2=0x5606dd448f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f62300126e0 tx=0x7f6230012ba0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 shutdown_connections 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd05bf60 0x5606dd456820 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd44fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd07c6b0 0x5606dd448f90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f6225ffb640 0 client.16278 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 --2- 172.21.15.100:0/3469190322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd0744d0 0x5606dd448a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 >> 172.21.15.100:0/3469190322 conn(0x5606dd0914e0 msgr2=0x5606dd4399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 shutdown_connections 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 1 -- 172.21.15.100:0/3469190322 wait complete. 2024-04-30T23:15:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.716+0000 7f624bc04740 20 client.16278 trim_cache size 0 max 16384 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 Processor -- start 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 -- start start 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd44fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd09d390 0x5606dd45b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62401ac860 con 0x5606dd0744d0 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f62401ae460 con 0x5606dd07c6b0 2024-04-30T23:15:40.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f624bc04740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62401acf30 con 0x5606dd09d390 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd44fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57862/0 (socket says 172.21.15.100:57862) 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 -- 172.21.15.100:0/2026015965 learned_addr learned my addr 172.21.15.100:0/2026015965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd09d390 0x5606dd45b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 -- 172.21.15.100:0/2026015965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd09d390 msgr2=0x5606dd45b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd09d390 0x5606dd45b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 -- 172.21.15.100:0/2026015965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 msgr2=0x5606dd44fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd44fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 -- 172.21.15.100:0/2026015965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dd17f7d0 con 0x5606dd0744d0 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f623dd9b640 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6234013bd0 tx=0x7f6234009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f7fe0582aff90a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.730+0000 7f6227fff640 1 -- 172.21.15.100:0/2026015965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234038070 con 0x5606dd0744d0 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f6227fff640 1 -- 172.21.15.100:0/2026015965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6234013740 con 0x5606dd0744d0 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f6227fff640 1 -- 172.21.15.100:0/2026015965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234005040 con 0x5606dd0744d0 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 -- 172.21.15.100:0/2026015965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 msgr2=0x5606dd443530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6234013bd0 tx=0x7f6234009b90 comp rx=0 tx=0).stop 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 -- 172.21.15.100:0/2026015965 shutdown_connections 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd09d390 0x5606dd45b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd07c6b0 0x5606dd44fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 --2- 172.21.15.100:0/2026015965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd443530 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 -- 172.21.15.100:0/2026015965 >> 172.21.15.100:0/2026015965 conn(0x5606dd0914e0 msgr2=0x5606dd43dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 -- 172.21.15.100:0/2026015965 shutdown_connections 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.731+0000 7f624bc04740 1 -- 172.21.15.100:0/2026015965 wait complete. 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 -- start start 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 Processor -- start 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd07c6b0 0x5606dd44d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd4baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62401adcd0 con 0x5606dd0744d0 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f62401ad600 con 0x5606dd09d390 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62401aa840 con 0x5606dd07c6b0 2024-04-30T23:15:40.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f624bc04740 10 client.0 _ll_register_callbacks cb 0x7f6230009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57876/0 (socket says 172.21.15.100:57876) 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 -- 172.21.15.100:0/3210263684 learned_addr learned my addr 172.21.15.100:0/3210263684 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623e59c640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd07c6b0 0x5606dd44d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd4baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 -- 172.21.15.100:0/3210263684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd07c6b0 msgr2=0x5606dd44d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd07c6b0 0x5606dd44d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 -- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 msgr2=0x5606dd4baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd4baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 -- 172.21.15.100:0/3210263684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dd4bb020 con 0x5606dd0744d0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f623dd9b640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6234013c00 tx=0x7f6234005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a083db8bdf8e56d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.732+0000 7f6225ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:40.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234038040 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f623401fca0 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6234013740 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6234005040 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 10 client.16284 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5606dd4bc2a0 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6234013740 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6234004b00 con 0x5606dd0744d0 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 10 client.16284 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 20 client.16284 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd0313a0 0x5606dd4bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:40.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 4 client.16284 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:15:40.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606dd3b1990 con 0x5606dd0313a0 2024-04-30T23:15:40.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.733+0000 7f623e59c640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd0313a0 0x5606dd4bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:40.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.734+0000 7f6225ffb640 10 client.16284 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:40.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.734+0000 7f623e59c640 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd0313a0 0x5606dd4bead0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95da9e2530214c99 server_cookie=e7e296427a6736b7 in_seq=0 out_seq=0 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f6225ffb640 1 -- 172.21.15.100:0/3210263684 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606dd3b1990 con 0x5606dd0313a0 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f6225ffb640 10 client.16284 handle_command_reply: tid=0 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 client.16284 shutdown 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 msgr2=0x5606dd44d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6234013c00 tx=0x7f6234005c50 comp rx=0 tx=0).stop 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 shutdown_connections 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5606dd0313a0 0x5606dd4bead0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606dd09d390 0x5606dd4baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f6225ffb640 0 client.16284 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:40.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606dd07c6b0 0x5606dd44d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 --2- 172.21.15.100:0/3210263684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5606dd0744d0 0x5606dd44d050 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 >> 172.21.15.100:0/3210263684 conn(0x5606dd0914e0 msgr2=0x5606dd447c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 shutdown_connections 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 1 -- 172.21.15.100:0/3210263684 wait complete. 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.736+0000 7f624bc04740 20 client.16284 trim_cache size 0 max 16384 2024-04-30T23:15:40.745 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 msgr2=0x7f62280a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 0x7f62280a60c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62380ef7c0 tx=0x7f62380882a0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 msgr2=0x7f62401a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6238004af0 tx=0x7f6238031700 comp rx=0 tx=0).stop 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 shutdown_connections 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f62280a3bb0 0x7f62280a60c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6240108960 0x7f62401a1850 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6240103c60 0x7f624019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 --2- 172.21.15.100:0/3315071947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6240102a20 0x7f624006a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:40.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 >> 172.21.15.100:0/3315071947 conn(0x7f62400fdc10 msgr2=0x7f6240104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:40.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 shutdown_connections 2024-04-30T23:15:40.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:40.737+0000 7f6244c67640 1 -- 172.21.15.100:0/3315071947 wait complete. 2024-04-30T23:15:41.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:40 smithi104 ceph-mon[32987]: pgmap v435: 129 pgs: 129 active+clean; 109 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-04-30T23:15:41.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:40 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1136605114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:41.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:40 smithi183 ceph-mon[33560]: pgmap v435: 129 pgs: 129 active+clean; 109 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-04-30T23:15:41.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:40 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1136605114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:41.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:40 smithi100 ceph-mon[29745]: pgmap v435: 129 pgs: 129 active+clean; 109 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-04-30T23:15:41.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:40 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1136605114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:15:41.134 INFO:tasks.workunit.client.0.smithi100.stdout:0/20: creat d2/f7 x:0 0 0 2024-04-30T23:15:41.135 INFO:tasks.workunit.client.0.smithi100.stdout:1/20: creat d3/f8 x:0 0 0 2024-04-30T23:15:41.136 INFO:tasks.workunit.client.0.smithi100.stdout:2/12: truncate f1 215967 0 2024-04-30T23:15:41.136 INFO:tasks.workunit.client.0.smithi100.stdout:8/14: rmdir d2 39 2024-04-30T23:15:41.139 INFO:tasks.workunit.client.0.smithi100.stdout:5/9: link f0 d1/f2 0 2024-04-30T23:15:41.140 INFO:tasks.workunit.client.0.smithi100.stdout:7/26: symlink d0/l7 0 2024-04-30T23:15:41.140 INFO:tasks.workunit.client.0.smithi100.stdout:7/27: dread - d0/f3 zero size 2024-04-30T23:15:41.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/21: creat d2/f8 x:0 0 0 2024-04-30T23:15:41.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/22: chown d2/f4 991203 1 2024-04-30T23:15:41.142 INFO:tasks.workunit.client.0.smithi100.stdout:1/21: creat d3/f9 x:0 0 0 2024-04-30T23:15:41.143 INFO:tasks.workunit.client.0.smithi100.stdout:2/13: symlink l4 0 2024-04-30T23:15:41.145 INFO:tasks.workunit.client.0.smithi100.stdout:5/10: creat d1/f3 x:0 0 0 2024-04-30T23:15:41.145 INFO:tasks.workunit.client.0.smithi100.stdout:5/11: truncate d1/f3 311704 0 2024-04-30T23:15:41.146 INFO:tasks.workunit.client.0.smithi100.stdout:7/28: creat d0/f8 x:0 0 0 2024-04-30T23:15:41.147 INFO:tasks.workunit.client.0.smithi100.stdout:1/22: symlink d3/la 0 2024-04-30T23:15:41.148 INFO:tasks.workunit.client.0.smithi100.stdout:7/29: mknod d0/c9 0 2024-04-30T23:15:41.148 INFO:tasks.workunit.client.0.smithi100.stdout:7/30: dread - d0/f8 zero size 2024-04-30T23:15:41.149 INFO:tasks.workunit.client.0.smithi100.stdout:1/23: mkdir d3/db 0 2024-04-30T23:15:41.149 INFO:tasks.workunit.client.0.smithi100.stdout:1/24: truncate d3/f9 754562 0 2024-04-30T23:15:41.151 INFO:tasks.workunit.client.0.smithi100.stdout:7/31: rename d0/l7 to d0/la 0 2024-04-30T23:15:41.151 INFO:tasks.workunit.client.0.smithi100.stdout:7/32: chown d0/la 322 1 2024-04-30T23:15:41.151 INFO:tasks.workunit.client.0.smithi100.stdout:7/33: dread - d0/f8 zero size 2024-04-30T23:15:41.151 INFO:tasks.workunit.client.0.smithi100.stdout:1/25: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:41.152 INFO:tasks.workunit.client.0.smithi100.stdout:1/26: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:41.152 INFO:tasks.workunit.client.0.smithi100.stdout:1/27: chown f2 48 1 2024-04-30T23:15:41.153 INFO:tasks.workunit.client.0.smithi100.stdout:1/28: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:41.155 INFO:tasks.workunit.client.0.smithi100.stdout:1/29: creat d3/fc x:0 0 0 2024-04-30T23:15:41.156 INFO:tasks.workunit.client.0.smithi100.stdout:8/15: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:41.161 INFO:tasks.workunit.client.0.smithi100.stdout:8/16: link d2/f3 d2/f4 0 2024-04-30T23:15:41.162 INFO:tasks.workunit.client.0.smithi100.stdout:5/12: write d1/f2 [6819832,24561] 0 2024-04-30T23:15:41.188 INFO:tasks.workunit.client.0.smithi100.stdout:7/34: dwrite d0/f4 [0,4194304] 0 2024-04-30T23:15:41.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/30: dwrite f2 [0,4194304] 0 2024-04-30T23:15:41.189 INFO:tasks.workunit.client.0.smithi100.stdout:5/13: dwrite f0 [4194304,4194304] 0 2024-04-30T23:15:41.191 INFO:tasks.workunit.client.0.smithi100.stdout:8/17: dread f0 [0,4194304] 0 2024-04-30T23:15:41.196 INFO:tasks.workunit.client.0.smithi100.stdout:7/35: mknod d0/cb 0 2024-04-30T23:15:41.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/14: mknod d1/c4 0 2024-04-30T23:15:41.196 INFO:tasks.workunit.client.0.smithi100.stdout:7/36: fsync d0/f2 0 2024-04-30T23:15:41.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/15: truncate d1/f3 1014587 0 2024-04-30T23:15:41.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/31: dwrite f2 [0,4194304] 0 2024-04-30T23:15:41.232 INFO:tasks.workunit.client.0.smithi100.stdout:1/32: dwrite f2 [0,4194304] 0 2024-04-30T23:15:41.233 INFO:tasks.workunit.client.0.smithi100.stdout:1/33: link d3/fc d3/db/fd 0 2024-04-30T23:15:41.233 INFO:tasks.workunit.client.0.smithi100.stdout:1/34: write d3/f8 [792665,112190] 0 2024-04-30T23:15:41.234 INFO:tasks.workunit.client.0.smithi100.stdout:1/35: mknod d3/db/ce 0 2024-04-30T23:15:41.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/36: symlink d3/lf 0 2024-04-30T23:15:41.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/37: creat d3/f10 x:0 0 0 2024-04-30T23:15:41.238 INFO:tasks.workunit.client.0.smithi100.stdout:1/38: creat d3/db/f11 x:0 0 0 2024-04-30T23:15:41.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/39: dwrite d3/f8 [0,4194304] 0 2024-04-30T23:15:41.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/40: mknod d3/c12 0 2024-04-30T23:15:41.261 INFO:tasks.workunit.client.0.smithi100.stdout:1/41: symlink d3/l13 0 2024-04-30T23:15:41.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/42: mknod d3/db/c14 0 2024-04-30T23:15:41.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/43: write d3/f9 [1584434,8208] 0 2024-04-30T23:15:41.263 INFO:tasks.workunit.client.0.smithi100.stdout:1/44: dread - d3/f5 zero size 2024-04-30T23:15:41.263 INFO:tasks.workunit.client.0.smithi100.stdout:1/45: mknod d3/c15 0 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:4/18: sync 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:9/1: sync 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/10: sync 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:9/2: unlink - no file 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/11: dread - no filename 2024-04-30T23:15:41.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/12: write - no filename 2024-04-30T23:15:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:3/13: dwrite - no filename 2024-04-30T23:15:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/32: sync 2024-04-30T23:15:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/33: write f5 [158294,33413] 0 2024-04-30T23:15:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/19: mknod c5 0 2024-04-30T23:15:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/20: chown c2 3090363 1 2024-04-30T23:15:41.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/14: creat d1/f2 x:0 0 0 2024-04-30T23:15:41.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/15: chown d1/f2 1 1 2024-04-30T23:15:41.400 INFO:tasks.workunit.client.0.smithi100.stdout:7/37: fsync d0/f8 0 2024-04-30T23:15:41.400 INFO:tasks.workunit.client.0.smithi100.stdout:7/38: chown d0 48 1 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/34: mkdir d7/d9 0 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/35: stat l2 0 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/36: stat c1 0 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/37: chown c1 164 1 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/38: chown d7 51 1 2024-04-30T23:15:41.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/39: truncate f5 1188364 0 2024-04-30T23:15:41.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/16: unlink d1/f2 0 2024-04-30T23:15:41.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/17: dwrite - no filename 2024-04-30T23:15:41.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/40: mknod d7/d9/ca 0 2024-04-30T23:15:41.407 INFO:tasks.workunit.client.0.smithi100.stdout:3/18: symlink d1/l3 0 2024-04-30T23:15:41.408 INFO:tasks.workunit.client.0.smithi100.stdout:6/41: dread f5 [0,4194304] 0 2024-04-30T23:15:41.410 INFO:tasks.workunit.client.0.smithi100.stdout:3/19: rename d1/l3 to d1/l4 0 2024-04-30T23:15:41.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/42: mkdir d7/db 0 2024-04-30T23:15:41.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/20: mknod d1/c5 0 2024-04-30T23:15:41.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/21: fsync - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/22: dwrite - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/23: dread - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/24: fsync - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/25: dwrite - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/26: dwrite - no filename 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/27: chown d1/l4 19890879 1 2024-04-30T23:15:41.413 INFO:tasks.workunit.client.0.smithi100.stdout:3/28: write - no filename 2024-04-30T23:15:41.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/14: dwrite f1 [0,4194304] 0 2024-04-30T23:15:41.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/15: dread - f3 zero size 2024-04-30T23:15:41.414 INFO:tasks.workunit.client.0.smithi100.stdout:6/43: symlink d7/db/lc 0 2024-04-30T23:15:41.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/16: mkdir d5 0 2024-04-30T23:15:41.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/16: getdents d1 0 2024-04-30T23:15:41.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/17: fsync d1/f2 0 2024-04-30T23:15:41.419 INFO:tasks.workunit.client.0.smithi100.stdout:5/18: symlink d1/l5 0 2024-04-30T23:15:41.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/46: fsync d3/db/f11 0 2024-04-30T23:15:41.425 INFO:tasks.workunit.client.0.smithi100.stdout:8/18: write d2/f4 [4145159,76125] 0 2024-04-30T23:15:41.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/47: mkdir d3/d16 0 2024-04-30T23:15:41.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/48: fdatasync d3/db/f11 0 2024-04-30T23:15:41.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/49: chown d3/f9 0 1 2024-04-30T23:15:41.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/50: truncate d3/fc 88010 0 2024-04-30T23:15:41.426 INFO:tasks.workunit.client.0.smithi100.stdout:0/23: sync 2024-04-30T23:15:41.426 INFO:tasks.workunit.client.0.smithi100.stdout:0/24: readlink d2/l6 0 2024-04-30T23:15:41.427 INFO:tasks.workunit.client.0.smithi100.stdout:4/21: dwrite f3 [0,4194304] 0 2024-04-30T23:15:41.428 INFO:tasks.workunit.client.0.smithi100.stdout:0/25: mknod d2/c9 0 2024-04-30T23:15:41.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/22: creat f6 x:0 0 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/26: mkdir d2/da 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/27: write d2/f8 [942811,35796] 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/28: write d2/f7 [840109,31454] 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/29: chown d2/f3 4065 1 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/30: write d2/f8 [1109886,16471] 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/31: fsync d2/f4 0 2024-04-30T23:15:41.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/32: read d2/f4 [565131,17822] 0 2024-04-30T23:15:41.440 INFO:tasks.workunit.client.0.smithi100.stdout:0/33: creat d2/fb x:0 0 0 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/29: unlink d1/l4 0 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/30: dread - no filename 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/31: chown d1/c5 633 1 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/32: stat d1 0 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/33: readlink - no filename 2024-04-30T23:15:41.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/34: dwrite - no filename 2024-04-30T23:15:41.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/35: mknod d1/c6 0 2024-04-30T23:15:41.444 INFO:tasks.workunit.client.0.smithi100.stdout:3/36: symlink d1/l7 0 2024-04-30T23:15:41.444 INFO:tasks.workunit.client.0.smithi100.stdout:3/37: write - no filename 2024-04-30T23:15:41.444 INFO:tasks.workunit.client.0.smithi100.stdout:3/38: readlink d1/l7 0 2024-04-30T23:15:41.444 INFO:tasks.workunit.client.0.smithi100.stdout:3/39: chown d1/l7 1 1 2024-04-30T23:15:41.446 INFO:tasks.workunit.client.0.smithi100.stdout:3/40: creat d1/f8 x:0 0 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:0/34: dread d2/f3 [0,4194304] 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/41: creat d1/f9 x:0 0 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/42: write d1/f9 [274949,59977] 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/43: write d1/f8 [778467,7327] 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/44: chown d1/c6 2023 1 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:1/51: dwrite d3/f4 [0,4194304] 0 2024-04-30T23:15:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:6/44: getdents d7/db 0 2024-04-30T23:15:41.449 INFO:tasks.workunit.client.0.smithi100.stdout:6/45: write f5 [876368,42526] 0 2024-04-30T23:15:41.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/45: rmdir d1 39 2024-04-30T23:15:41.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/46: write d1/f9 [635292,14456] 0 2024-04-30T23:15:41.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/47: write d1/f8 [1524819,118576] 0 2024-04-30T23:15:41.454 INFO:tasks.workunit.client.0.smithi100.stdout:1/52: rename d3/db/fd to d3/db/f17 0 2024-04-30T23:15:41.455 INFO:tasks.workunit.client.0.smithi100.stdout:1/53: readlink d3/la 0 2024-04-30T23:15:41.456 INFO:tasks.workunit.client.0.smithi100.stdout:1/54: mkdir d3/d18 0 2024-04-30T23:15:41.459 INFO:tasks.workunit.client.0.smithi100.stdout:4/23: getdents . 0 2024-04-30T23:15:41.461 INFO:tasks.workunit.client.0.smithi100.stdout:4/24: link c1 c7 0 2024-04-30T23:15:41.477 INFO:tasks.workunit.client.0.smithi100.stdout:3/48: dwrite d1/f8 [0,4194304] 0 2024-04-30T23:15:41.478 INFO:tasks.workunit.client.0.smithi100.stdout:3/49: getdents d1 0 2024-04-30T23:15:41.480 INFO:tasks.workunit.client.0.smithi100.stdout:3/50: creat d1/fa x:0 0 0 2024-04-30T23:15:41.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/55: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:15:41.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/56: fsync d3/f9 0 2024-04-30T23:15:41.486 INFO:tasks.workunit.client.0.smithi100.stdout:4/25: dwrite f6 [0,4194304] 0 2024-04-30T23:15:41.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/26: fdatasync f3 0 2024-04-30T23:15:41.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/27: creat f8 x:0 0 0 2024-04-30T23:15:41.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/28: dread - f8 zero size 2024-04-30T23:15:41.491 INFO:tasks.workunit.client.0.smithi100.stdout:3/51: getdents d1 0 2024-04-30T23:15:41.491 INFO:tasks.workunit.client.0.smithi100.stdout:3/52: stat d1/f9 0 2024-04-30T23:15:41.491 INFO:tasks.workunit.client.0.smithi100.stdout:3/53: dread - d1/fa zero size 2024-04-30T23:15:41.492 INFO:tasks.workunit.client.0.smithi100.stdout:4/29: truncate f3 228653 0 2024-04-30T23:15:41.494 INFO:tasks.workunit.client.0.smithi100.stdout:3/54: mknod d1/cb 0 2024-04-30T23:15:41.494 INFO:tasks.workunit.client.0.smithi100.stdout:3/55: stat d1/cb 0 2024-04-30T23:15:41.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/56: creat d1/fc x:0 0 0 2024-04-30T23:15:41.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/30: getdents . 0 2024-04-30T23:15:41.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/31: write f8 [458969,95229] 0 2024-04-30T23:15:41.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/32: chown f3 6216197 1 2024-04-30T23:15:41.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/33: rmdir - no directory 2024-04-30T23:15:41.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/34: chown f8 1 1 2024-04-30T23:15:41.497 INFO:tasks.workunit.client.0.smithi100.stdout:3/57: symlink d1/ld 0 2024-04-30T23:15:41.498 INFO:tasks.workunit.client.0.smithi100.stdout:3/58: fdatasync d1/f8 0 2024-04-30T23:15:41.500 INFO:tasks.workunit.client.0.smithi100.stdout:3/59: symlink d1/le 0 2024-04-30T23:15:41.501 INFO:tasks.workunit.client.0.smithi100.stdout:3/60: creat d1/ff x:0 0 0 2024-04-30T23:15:41.501 INFO:tasks.workunit.client.0.smithi100.stdout:3/61: write d1/ff [30738,96345] 0 2024-04-30T23:15:41.502 INFO:tasks.workunit.client.0.smithi100.stdout:3/62: creat d1/f10 x:0 0 0 2024-04-30T23:15:41.502 INFO:tasks.workunit.client.0.smithi100.stdout:3/63: fsync d1/f8 0 2024-04-30T23:15:41.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/57: write d3/f5 [1374530,30256] 0 2024-04-30T23:15:41.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/58: rename f2 to d3/f19 0 2024-04-30T23:15:41.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/59: dread d3/fc [0,4194304] 0 2024-04-30T23:15:41.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/64: write d1/f8 [3747947,81215] 0 2024-04-30T23:15:41.516 INFO:tasks.workunit.client.0.smithi100.stdout:3/65: rmdir d1 39 2024-04-30T23:15:41.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/66: mknod d1/c11 0 2024-04-30T23:15:41.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/67: readlink d1/le 0 2024-04-30T23:15:41.518 INFO:tasks.workunit.client.0.smithi100.stdout:3/68: readlink d1/l7 0 2024-04-30T23:15:41.518 INFO:tasks.workunit.client.0.smithi100.stdout:3/69: write d1/f10 [602941,57055] 0 2024-04-30T23:15:41.530 INFO:tasks.workunit.client.0.smithi100.stdout:7/39: dwrite d0/f4 [0,4194304] 0 2024-04-30T23:15:41.530 INFO:tasks.workunit.client.0.smithi100.stdout:7/40: chown d0/la 99 1 2024-04-30T23:15:41.531 INFO:tasks.workunit.client.0.smithi100.stdout:7/41: unlink d0/c1 0 2024-04-30T23:15:41.532 INFO:tasks.workunit.client.0.smithi100.stdout:7/42: mknod d0/cc 0 2024-04-30T23:15:41.532 INFO:tasks.workunit.client.0.smithi100.stdout:7/43: write d0/f8 [487340,86790] 0 2024-04-30T23:15:41.533 INFO:tasks.workunit.client.0.smithi100.stdout:7/44: rename d0/la to d0/ld 0 2024-04-30T23:15:41.603 INFO:tasks.workunit.client.0.smithi100.stdout:0/35: dwrite d2/f5 [0,4194304] 0 2024-04-30T23:15:41.606 INFO:tasks.workunit.client.0.smithi100.stdout:5/19: dwrite d1/f2 [0,4194304] 0 2024-04-30T23:15:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/19: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:41.612 INFO:tasks.workunit.client.0.smithi100.stdout:5/20: symlink d1/l6 0 2024-04-30T23:15:41.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/21: link d1/f3 d1/f7 0 2024-04-30T23:15:41.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/22: fdatasync d1/f2 0 2024-04-30T23:15:41.618 INFO:tasks.workunit.client.0.smithi100.stdout:7/45: dread d0/f4 [0,4194304] 0 2024-04-30T23:15:41.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/60: dwrite d3/f9 [0,4194304] 0 2024-04-30T23:15:41.618 INFO:tasks.workunit.client.0.smithi100.stdout:7/46: stat d0/f4 0 2024-04-30T23:15:41.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/61: stat d3/d16 0 2024-04-30T23:15:41.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/62: chown d3/db 170 1 2024-04-30T23:15:41.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/47: creat d0/fe x:0 0 0 2024-04-30T23:15:41.623 INFO:tasks.workunit.client.0.smithi100.stdout:0/36: dread d2/f5 [0,4194304] 0 2024-04-30T23:15:41.623 INFO:tasks.workunit.client.0.smithi100.stdout:0/37: truncate d2/fb 872622 0 2024-04-30T23:15:41.624 INFO:tasks.workunit.client.0.smithi100.stdout:4/35: dread f8 [0,4194304] 0 2024-04-30T23:15:41.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/38: rmdir d2/da 0 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:0/39: chown d2/f8 398068326 1 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:5/23: fsync d1/f3 0 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/3: sync 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/4: chown . 3801 1 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/5: read - no filename 2024-04-30T23:15:41.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/6: stat - no entries 2024-04-30T23:15:41.628 INFO:tasks.workunit.client.0.smithi100.stdout:9/7: dwrite - no filename 2024-04-30T23:15:41.628 INFO:tasks.workunit.client.0.smithi100.stdout:9/8: chown . 3218 1 2024-04-30T23:15:41.628 INFO:tasks.workunit.client.0.smithi100.stdout:9/9: fdatasync - no filename 2024-04-30T23:15:41.628 INFO:tasks.workunit.client.0.smithi100.stdout:4/36: creat f9 x:0 0 0 2024-04-30T23:15:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/24: rmdir d1 39 2024-04-30T23:15:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:9/10: creat f0 x:0 0 0 2024-04-30T23:15:41.630 INFO:tasks.workunit.client.0.smithi100.stdout:5/25: rename d1 to d1/d8 22 2024-04-30T23:15:41.631 INFO:tasks.workunit.client.0.smithi100.stdout:5/26: dread d1/f7 [0,4194304] 0 2024-04-30T23:15:41.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/27: chown d1/f2 1262420 1 2024-04-30T23:15:41.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/63: write d3/f8 [3094014,113201] 0 2024-04-30T23:15:41.634 INFO:tasks.workunit.client.0.smithi100.stdout:4/37: write f8 [335856,23602] 0 2024-04-30T23:15:41.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/64: rename d3/la to d3/d18/l1a 0 2024-04-30T23:15:41.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/65: write d3/db/f17 [946837,128703] 0 2024-04-30T23:15:41.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/66: truncate d3/f5 316262 0 2024-04-30T23:15:41.640 INFO:tasks.workunit.client.0.smithi100.stdout:8/20: dwrite d2/f3 [4194304,4194304] 0 2024-04-30T23:15:41.642 INFO:tasks.workunit.client.0.smithi100.stdout:8/21: getdents d2 0 2024-04-30T23:15:41.646 INFO:tasks.workunit.client.0.smithi100.stdout:5/28: dread d1/f2 [4194304,4194304] 0 2024-04-30T23:15:41.646 INFO:tasks.workunit.client.0.smithi100.stdout:5/29: write d1/f7 [1669038,10400] 0 2024-04-30T23:15:41.649 INFO:tasks.workunit.client.0.smithi100.stdout:1/67: truncate d3/db/f17 835568 0 2024-04-30T23:15:41.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/30: rename d1/l6 to d1/l9 0 2024-04-30T23:15:41.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/68: getdents d3/d18 0 2024-04-30T23:15:41.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/69: write d3/f10 [212167,48677] 0 2024-04-30T23:15:41.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/70: write d3/f8 [266688,55871] 0 2024-04-30T23:15:41.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/71: stat d3/f4 0 2024-04-30T23:15:41.652 INFO:tasks.workunit.client.0.smithi100.stdout:5/31: symlink d1/la 0 2024-04-30T23:15:41.652 INFO:tasks.workunit.client.0.smithi100.stdout:5/32: chown f0 2 1 2024-04-30T23:15:41.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/11: dwrite f0 [0,4194304] 0 2024-04-30T23:15:41.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/33: mknod d1/cb 0 2024-04-30T23:15:41.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/34: write d1/f7 [2275506,77494] 0 2024-04-30T23:15:41.655 INFO:tasks.workunit.client.0.smithi100.stdout:1/72: fsync d3/db/f17 0 2024-04-30T23:15:41.655 INFO:tasks.workunit.client.0.smithi100.stdout:4/38: dread f6 [0,4194304] 0 2024-04-30T23:15:41.655 INFO:tasks.workunit.client.0.smithi100.stdout:6/46: dwrite f5 [0,4194304] 0 2024-04-30T23:15:41.659 INFO:tasks.workunit.client.0.smithi100.stdout:1/73: mknod d3/d16/c1b 0 2024-04-30T23:15:41.659 INFO:tasks.workunit.client.0.smithi100.stdout:1/74: chown d3/lf 30320 1 2024-04-30T23:15:41.661 INFO:tasks.workunit.client.0.smithi100.stdout:4/39: creat fa x:0 0 0 2024-04-30T23:15:41.662 INFO:tasks.workunit.client.0.smithi100.stdout:6/47: getdents d7/d9 0 2024-04-30T23:15:41.664 INFO:tasks.workunit.client.0.smithi100.stdout:7/48: dwrite d0/f4 [0,4194304] 0 2024-04-30T23:15:41.664 INFO:tasks.workunit.client.0.smithi100.stdout:5/35: rename d1/f2 to d1/fc 0 2024-04-30T23:15:41.665 INFO:tasks.workunit.client.0.smithi100.stdout:1/75: mknod d3/c1c 0 2024-04-30T23:15:41.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/49: mkdir d0/df 0 2024-04-30T23:15:41.668 INFO:tasks.workunit.client.0.smithi100.stdout:7/50: link d0/ld d0/df/l10 0 2024-04-30T23:15:41.669 INFO:tasks.workunit.client.0.smithi100.stdout:8/22: write d2/f3 [291643,73200] 0 2024-04-30T23:15:41.670 INFO:tasks.workunit.client.0.smithi100.stdout:9/12: dread f0 [0,4194304] 0 2024-04-30T23:15:41.670 INFO:tasks.workunit.client.0.smithi100.stdout:5/36: mkdir d1/dd 0 2024-04-30T23:15:41.699 INFO:tasks.workunit.client.0.smithi100.stdout:4/40: dwrite f8 [0,4194304] 0 2024-04-30T23:15:41.699 INFO:tasks.workunit.client.0.smithi100.stdout:4/41: truncate fa 18092 0 2024-04-30T23:15:41.699 INFO:tasks.workunit.client.0.smithi100.stdout:6/48: write f5 [898922,120036] 0 2024-04-30T23:15:41.699 INFO:tasks.workunit.client.0.smithi100.stdout:6/49: write f5 [2042808,96115] 0 2024-04-30T23:15:41.700 INFO:tasks.workunit.client.0.smithi100.stdout:9/13: dwrite f0 [0,4194304] 0 2024-04-30T23:15:41.701 INFO:tasks.workunit.client.0.smithi100.stdout:4/42: creat fb x:0 0 0 2024-04-30T23:15:41.702 INFO:tasks.workunit.client.0.smithi100.stdout:9/14: getdents . 0 2024-04-30T23:15:41.704 INFO:tasks.workunit.client.0.smithi100.stdout:1/76: dread d3/f19 [0,4194304] 0 2024-04-30T23:15:41.704 INFO:tasks.workunit.client.0.smithi100.stdout:1/77: fdatasync d3/f19 0 2024-04-30T23:15:41.705 INFO:tasks.workunit.client.0.smithi100.stdout:4/43: rename fa to fc 0 2024-04-30T23:15:41.706 INFO:tasks.workunit.client.0.smithi100.stdout:1/78: creat d3/d16/f1d x:0 0 0 2024-04-30T23:15:41.707 INFO:tasks.workunit.client.0.smithi100.stdout:4/44: rename c4 to cd 0 2024-04-30T23:15:41.709 INFO:tasks.workunit.client.0.smithi100.stdout:4/45: mkdir de 0 2024-04-30T23:15:41.709 INFO:tasks.workunit.client.0.smithi100.stdout:7/51: dwrite d0/f4 [0,4194304] 0 2024-04-30T23:15:41.709 INFO:tasks.workunit.client.0.smithi100.stdout:5/37: dwrite d1/f3 [0,4194304] 0 2024-04-30T23:15:41.711 INFO:tasks.workunit.client.0.smithi100.stdout:7/52: mknod d0/c11 0 2024-04-30T23:15:41.711 INFO:tasks.workunit.client.0.smithi100.stdout:7/53: stat d0/f4 0 2024-04-30T23:15:41.711 INFO:tasks.workunit.client.0.smithi100.stdout:7/54: chown d0/df 202264695 1 2024-04-30T23:15:41.711 INFO:tasks.workunit.client.0.smithi100.stdout:7/55: chown d0/f3 169 1 2024-04-30T23:15:41.722 INFO:tasks.workunit.client.0.smithi100.stdout:5/38: dread d1/f7 [0,4194304] 0 2024-04-30T23:15:41.723 INFO:tasks.workunit.client.0.smithi100.stdout:5/39: rmdir d1/dd 0 2024-04-30T23:15:41.725 INFO:tasks.workunit.client.0.smithi100.stdout:5/40: creat d1/fe x:0 0 0 2024-04-30T23:15:41.725 INFO:tasks.workunit.client.0.smithi100.stdout:9/15: dwrite f0 [0,4194304] 0 2024-04-30T23:15:41.725 INFO:tasks.workunit.client.0.smithi100.stdout:5/41: rmdir d1 39 2024-04-30T23:15:41.726 INFO:tasks.workunit.client.0.smithi100.stdout:6/50: dread f5 [0,4194304] 0 2024-04-30T23:15:41.726 INFO:tasks.workunit.client.0.smithi100.stdout:6/51: write f5 [4496877,109248] 0 2024-04-30T23:15:41.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/42: rmdir d1 39 2024-04-30T23:15:41.727 INFO:tasks.workunit.client.0.smithi100.stdout:5/43: mknod d1/cf 0 2024-04-30T23:15:41.729 INFO:tasks.workunit.client.0.smithi100.stdout:2/17: sync 2024-04-30T23:15:41.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/70: sync 2024-04-30T23:15:41.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/18: mknod d5/c6 0 2024-04-30T23:15:41.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/19: dread - f3 zero size 2024-04-30T23:15:41.731 INFO:tasks.workunit.client.0.smithi100.stdout:5/44: getdents d1 0 2024-04-30T23:15:41.733 INFO:tasks.workunit.client.0.smithi100.stdout:3/71: symlink d1/l12 0 2024-04-30T23:15:41.734 INFO:tasks.workunit.client.0.smithi100.stdout:2/20: mknod d5/c7 0 2024-04-30T23:15:41.736 INFO:tasks.workunit.client.0.smithi100.stdout:3/72: creat d1/f13 x:0 0 0 2024-04-30T23:15:41.737 INFO:tasks.workunit.client.0.smithi100.stdout:2/21: creat d5/f8 x:0 0 0 2024-04-30T23:15:41.739 INFO:tasks.workunit.client.0.smithi100.stdout:3/73: mkdir d1/d14 0 2024-04-30T23:15:41.742 INFO:tasks.workunit.client.0.smithi100.stdout:1/79: write d3/f4 [4014654,1760] 0 2024-04-30T23:15:41.744 INFO:tasks.workunit.client.0.smithi100.stdout:1/80: unlink d3/db/f17 0 2024-04-30T23:15:41.745 INFO:tasks.workunit.client.0.smithi100.stdout:9/16: write f0 [3594934,57902] 0 2024-04-30T23:15:41.745 INFO:tasks.workunit.client.0.smithi100.stdout:9/17: write f0 [261400,14382] 0 2024-04-30T23:15:41.745 INFO:tasks.workunit.client.0.smithi100.stdout:1/81: truncate d3/f9 1147271 0 2024-04-30T23:15:41.745 INFO:tasks.workunit.client.0.smithi100.stdout:1/82: fsync d3/f5 0 2024-04-30T23:15:41.745 INFO:tasks.workunit.client.0.smithi100.stdout:1/83: fdatasync d3/f5 0 2024-04-30T23:15:41.746 INFO:tasks.workunit.client.0.smithi100.stdout:1/84: chown d3/f19 621923 1 2024-04-30T23:15:41.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/45: write f0 [8061396,37288] 0 2024-04-30T23:15:41.747 INFO:tasks.workunit.client.0.smithi100.stdout:1/85: creat d3/db/f1e x:0 0 0 2024-04-30T23:15:41.747 INFO:tasks.workunit.client.0.smithi100.stdout:1/86: truncate d3/db/f11 473490 0 2024-04-30T23:15:41.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/46: write f6 [9627,27079] 0 2024-04-30T23:15:41.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/47: dread - f9 zero size 2024-04-30T23:15:41.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/48: write fc [888599,12194] 0 2024-04-30T23:15:41.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/49: chown c7 1426 1 2024-04-30T23:15:41.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/50: dread - f9 zero size 2024-04-30T23:15:41.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/51: write fb [438987,115720] 0 2024-04-30T23:15:41.750 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:15:41.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:15:41.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:15:41.753 INFO:tasks.workunit.client.0.smithi100.stdout:3/74: dread d1/f8 [0,4194304] 0 2024-04-30T23:15:41.753 INFO:tasks.workunit.client.0.smithi100.stdout:3/75: truncate d1/f10 604498 0 2024-04-30T23:15:41.768 INFO:tasks.workunit.client.0.smithi100.stdout:4/52: write f8 [2773802,59026] 0 2024-04-30T23:15:41.769 INFO:tasks.workunit.client.0.smithi100.stdout:4/53: rmdir de 0 2024-04-30T23:15:41.772 INFO:tasks.workunit.client.0.smithi100.stdout:1/87: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:41.773 INFO:tasks.workunit.client.0.smithi100.stdout:6/52: dwrite f5 [0,4194304] 0 2024-04-30T23:15:41.773 INFO:tasks.workunit.client.0.smithi100.stdout:6/53: getdents d7/db 0 2024-04-30T23:15:41.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/18: dread f0 [0,4194304] 0 2024-04-30T23:15:41.776 INFO:tasks.workunit.client.0.smithi100.stdout:6/54: creat d7/db/fd x:0 0 0 2024-04-30T23:15:41.776 INFO:tasks.workunit.client.0.smithi100.stdout:6/55: write d7/db/fd [538044,83474] 0 2024-04-30T23:15:41.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/46: write d1/fc [2478318,97982] 0 2024-04-30T23:15:41.791 INFO:tasks.workunit.client.0.smithi100.stdout:4/54: dread f8 [0,4194304] 0 2024-04-30T23:15:41.791 INFO:tasks.workunit.client.0.smithi100.stdout:4/55: truncate fb 1263291 0 2024-04-30T23:15:41.800 INFO:tasks.workunit.client.0.smithi100.stdout:9/19: dread f0 [0,4194304] 0 2024-04-30T23:15:41.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/20: write f0 [2200663,116088] 0 2024-04-30T23:15:41.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/56: dwrite d7/db/fd [0,4194304] 0 2024-04-30T23:15:41.806 INFO:tasks.workunit.client.0.smithi100.stdout:6/57: rmdir d7/db 39 2024-04-30T23:15:41.808 INFO:tasks.workunit.client.0.smithi100.stdout:4/56: dread f8 [0,4194304] 0 2024-04-30T23:15:41.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/58: creat d7/fe x:0 0 0 2024-04-30T23:15:41.809 INFO:tasks.workunit.client.0.smithi100.stdout:4/57: mknod cf 0 2024-04-30T23:15:41.809 INFO:tasks.workunit.client.0.smithi100.stdout:4/58: truncate fc 1248453 0 2024-04-30T23:15:41.809 INFO:tasks.workunit.client.0.smithi100.stdout:4/59: stat f3 0 2024-04-30T23:15:41.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/59: mkdir d7/df 0 2024-04-30T23:15:41.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/60: dread - d7/fe zero size 2024-04-30T23:15:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/21: dread f0 [0,4194304] 0 2024-04-30T23:15:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/22: write f0 [2586916,92027] 0 2024-04-30T23:15:41.824 INFO:tasks.workunit.client.0.smithi100.stdout:5/47: dwrite d1/fc [0,4194304] 0 2024-04-30T23:15:41.829 INFO:tasks.workunit.client.0.smithi100.stdout:6/61: dread d7/db/fd [0,4194304] 0 2024-04-30T23:15:41.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/48: symlink d1/l10 0 2024-04-30T23:15:41.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/49: truncate d1/f3 3495678 0 2024-04-30T23:15:41.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/60: dwrite f3 [0,4194304] 0 2024-04-30T23:15:41.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/61: write f9 [952124,64133] 0 2024-04-30T23:15:41.836 INFO:tasks.workunit.client.0.smithi100.stdout:5/50: truncate d1/fc 4817773 0 2024-04-30T23:15:41.839 INFO:tasks.workunit.client.0.smithi100.stdout:5/51: symlink d1/l11 0 2024-04-30T23:15:41.840 INFO:tasks.workunit.client.0.smithi100.stdout:0/40: sync 2024-04-30T23:15:41.841 INFO:tasks.workunit.client.0.smithi100.stdout:6/62: write d7/db/fd [4151695,90695] 0 2024-04-30T23:15:41.843 INFO:tasks.workunit.client.0.smithi100.stdout:6/63: symlink d7/l10 0 2024-04-30T23:15:41.843 INFO:tasks.workunit.client.0.smithi100.stdout:6/64: getdents d7/d9 0 2024-04-30T23:15:41.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/65: mkdir d7/d11 0 2024-04-30T23:15:41.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/66: unlink c0 0 2024-04-30T23:15:41.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/67: fdatasync d7/fe 0 2024-04-30T23:15:41.849 INFO:tasks.workunit.client.0.smithi100.stdout:6/68: creat d7/d9/f12 x:0 0 0 2024-04-30T23:15:41.851 INFO:tasks.workunit.client.0.smithi100.stdout:4/62: write f3 [2920443,91143] 0 2024-04-30T23:15:41.851 INFO:tasks.workunit.client.0.smithi100.stdout:4/63: write f8 [141871,122413] 0 2024-04-30T23:15:41.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/64: symlink l10 0 2024-04-30T23:15:41.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/65: chown c0 28626053 1 2024-04-30T23:15:41.854 INFO:tasks.workunit.client.0.smithi100.stdout:4/66: chown c1 177628 1 2024-04-30T23:15:41.854 INFO:tasks.workunit.client.0.smithi100.stdout:4/67: write f3 [3245467,62041] 0 2024-04-30T23:15:41.857 INFO:tasks.workunit.client.0.smithi100.stdout:0/41: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:41.857 INFO:tasks.workunit.client.0.smithi100.stdout:0/42: read d2/f4 [2401049,69682] 0 2024-04-30T23:15:41.860 INFO:tasks.workunit.client.0.smithi100.stdout:5/52: write d1/fc [2708211,117954] 0 2024-04-30T23:15:41.860 INFO:tasks.workunit.client.0.smithi100.stdout:0/43: creat d2/fc x:0 0 0 2024-04-30T23:15:41.863 INFO:tasks.workunit.client.0.smithi100.stdout:0/44: creat d2/fd x:0 0 0 2024-04-30T23:15:41.864 INFO:tasks.workunit.client.0.smithi100.stdout:5/53: mkdir d1/d12 0 2024-04-30T23:15:41.877 INFO:tasks.workunit.client.0.smithi100.stdout:6/69: dwrite d7/fe [0,4194304] 0 2024-04-30T23:15:41.877 INFO:tasks.workunit.client.0.smithi100.stdout:4/68: dwrite fb [0,4194304] 0 2024-04-30T23:15:41.879 INFO:tasks.workunit.client.0.smithi100.stdout:6/70: mkdir d7/d13 0 2024-04-30T23:15:41.882 INFO:tasks.workunit.client.0.smithi100.stdout:4/69: creat f11 x:0 0 0 2024-04-30T23:15:41.882 INFO:tasks.workunit.client.0.smithi100.stdout:4/70: stat f11 0 2024-04-30T23:15:41.882 INFO:tasks.workunit.client.0.smithi100.stdout:4/71: write f6 [4812705,120683] 0 2024-04-30T23:15:41.884 INFO:tasks.workunit.client.0.smithi100.stdout:4/72: rename f6 to f12 0 2024-04-30T23:15:41.884 INFO:tasks.workunit.client.0.smithi100.stdout:4/73: write f11 [402771,29554] 0 2024-04-30T23:15:41.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/74: unlink c2 0 2024-04-30T23:15:41.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/75: write f12 [299844,95009] 0 2024-04-30T23:15:41.893 INFO:tasks.workunit.client.0.smithi100.stdout:5/54: dwrite d1/fc [4194304,4194304] 0 2024-04-30T23:15:41.895 INFO:tasks.workunit.client.0.smithi100.stdout:5/55: link d1/l5 d1/l13 0 2024-04-30T23:15:41.897 INFO:tasks.workunit.client.0.smithi100.stdout:5/56: mkdir d1/d14 0 2024-04-30T23:15:41.897 INFO:tasks.workunit.client.0.smithi100.stdout:5/57: getdents d1/d12 0 2024-04-30T23:15:41.897 INFO:tasks.workunit.client.0.smithi100.stdout:5/58: chown d1/f3 7308443 1 2024-04-30T23:15:41.898 INFO:tasks.workunit.client.0.smithi100.stdout:5/59: rmdir d1/d14 0 2024-04-30T23:15:41.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/60: creat d1/d12/f15 x:0 0 0 2024-04-30T23:15:41.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/61: truncate d1/d12/f15 836109 0 2024-04-30T23:15:41.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/62: stat d1/f7 0 2024-04-30T23:15:41.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/63: chown d1/c4 29617327 1 2024-04-30T23:15:41.902 INFO:tasks.workunit.client.0.smithi100.stdout:6/71: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:41.902 INFO:tasks.workunit.client.0.smithi100.stdout:6/72: truncate f5 4695611 0 2024-04-30T23:15:41.907 INFO:tasks.workunit.client.0.smithi100.stdout:5/64: write d1/f7 [164876,45598] 0 2024-04-30T23:15:41.908 INFO:tasks.workunit.client.0.smithi100.stdout:5/65: fdatasync d1/fe 0 2024-04-30T23:15:41.908 INFO:tasks.workunit.client.0.smithi100.stdout:5/66: creat d1/d12/f16 x:0 0 0 2024-04-30T23:15:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 -- 172.21.15.100:0/2227951776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 msgr2=0x7f8718104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2227951776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f8718104080 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f870c009900 tx=0x7f870c02a3f0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 -- 172.21.15.100:0/2227951776 shutdown_connections 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2227951776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 0x7f871810ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2227951776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f8718104080 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2227951776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 0x7f8718103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.915+0000 7f871d7a2640 1 -- 172.21.15.100:0/2227951776 >> 172.21.15.100:0/2227951776 conn(0x7f87180fdc40 msgr2=0x7f87181000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.916+0000 7f871d7a2640 1 -- 172.21.15.100:0/2227951776 shutdown_connections 2024-04-30T23:15:41.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.916+0000 7f871d7a2640 1 -- 172.21.15.100:0/2227951776 wait complete. 2024-04-30T23:15:41.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.916+0000 7f871d7a2640 1 Processor -- start 2024-04-30T23:15:41.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.916+0000 7f871d7a2640 1 -- start start 2024-04-30T23:15:41.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 0x7f871806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 0x7f87181a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f871810e530 con 0x7f8718103c70 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f871810e3b0 con 0x7f8718102a30 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f871d7a2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f871810e6b0 con 0x7f8718108970 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57894/0 (socket says 172.21.15.100:57894) 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 -- 172.21.15.100:0/2271362098 learned_addr learned my addr 172.21.15.100:0/2271362098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87177fe640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 0x7f87181a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f8716ffd640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 0x7f871806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 -- 172.21.15.100:0/2271362098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 msgr2=0x7f87181a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 0x7f87181a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 -- 172.21.15.100:0/2271362098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 msgr2=0x7f871806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 0x7f871806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.917+0000 7f87167fc640 1 -- 172.21.15.100:0/2271362098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87181a1cf0 con 0x7f8718103c70 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f87167fc640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f86fffff640 1 -- 172.21.15.100:0/2271362098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c03f030 con 0x7f8718103c70 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f86fffff640 1 -- 172.21.15.100:0/2271362098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c003cb0 con 0x7f8718103c70 2024-04-30T23:15:41.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87181a1f80 con 0x7f8718103c70 2024-04-30T23:15:41.923 INFO:tasks.workunit.client.0.smithi100.stdout:6/73: dwrite d7/fe [4194304,4194304] 0 2024-04-30T23:15:41.923 INFO:tasks.workunit.client.0.smithi100.stdout:6/74: chown d7/d9 119 1 2024-04-30T23:15:41.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f86fffff640 1 -- 172.21.15.100:0/2271362098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c035070 con 0x7f8718103c70 2024-04-30T23:15:41.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.918+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181a23e0 con 0x7f8718103c70 2024-04-30T23:15:41.924 INFO:tasks.workunit.client.0.smithi100.stdout:5/67: write d1/fc [6090361,85060] 0 2024-04-30T23:15:41.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/75: symlink d7/d13/l14 0 2024-04-30T23:15:41.924 INFO:tasks.workunit.client.0.smithi100.stdout:5/68: dread d1/d12/f15 [0,4194304] 0 2024-04-30T23:15:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f86fffff640 1 -- 172.21.15.100:0/2271362098 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f870c042030 con 0x7f8718103c70 2024-04-30T23:15:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 Processor -- start 2024-04-30T23:15:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 -- start start 2024-04-30T23:15:41.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/69: rename d1/cb to d1/c17 0 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 0x55cd609d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.922+0000 7f872465e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd6093eb00 con 0x55cd60617730 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f872465e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cd608da920 con 0x55cd60638410 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f872465e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cd6093aac0 con 0x55cd6060f550 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:47738/0 (socket says 172.21.15.100:47738) 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 -- 172.21.15.100:0/3337604433 learned_addr learned my addr 172.21.15.100:0/3337604433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f87177fe640 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 0x55cd609d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f86fffff640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 0x7f87000a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 -- 172.21.15.100:0/3337604433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 msgr2=0x55cd609d9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 0x55cd609d9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 -- 172.21.15.100:0/3337604433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 msgr2=0x55cd609e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 -- 172.21.15.100:0/3337604433 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd607187e0 con 0x55cd6060f550 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f87177fe640 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 0x55cd609d9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f86fffff640 1 -- 172.21.15.100:0/2271362098 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f870c0f0cc0 con 0x7f8718103c70 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f8716ffd640 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f870800ac40 tx=0x7f870800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bca0a794bc44650 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f86fd7fa640 1 -- 172.21.15.100:0/3337604433 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708014a40 con 0x55cd6060f550 2024-04-30T23:15:41.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.923+0000 7f87177fe640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 0x7f87000a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.924+0000 7f86fd7fa640 1 -- 172.21.15.100:0/3337604433 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080054d0 con 0x55cd6060f550 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.924+0000 7f86fd7fa640 1 -- 172.21.15.100:0/3337604433 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708004ce0 con 0x55cd6060f550 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f87177fe640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 0x7f87000a6140 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87100098b0 tx=0x7f8710004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 -- 172.21.15.100:0/3337604433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 msgr2=0x55cd609da210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f870800ac40 tx=0x7f870800f790 comp rx=0 tx=0).stop 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 -- 172.21.15.100:0/3337604433 shutdown_connections 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609da210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 --2- 172.21.15.100:0/3337604433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd60638410 0x55cd609d9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.925+0000 7f872465e740 1 -- 172.21.15.100:0/3337604433 >> 172.21.15.100:0/3337604433 conn(0x55cd6062c560 msgr2=0x55cd609d5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.926+0000 7f872465e740 1 -- 172.21.15.100:0/3337604433 shutdown_connections 2024-04-30T23:15:41.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.926+0000 7f872465e740 1 -- 172.21.15.100:0/3337604433 wait complete. 2024-04-30T23:15:41.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.926+0000 7f872465e740 1 -- start start 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.926+0000 7f872465e740 1 Processor -- start 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd6060f550 0x55cd609e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 0x55cd609eac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd609e1b60 con 0x55cd60617730 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cd608d85d0 con 0x55cd6060f550 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cd609e1ce0 con 0x55cd60638410 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57910/0 (socket says 172.21.15.100:57910) 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 -- 172.21.15.100:0/2005996477 learned_addr learned my addr 172.21.15.100:0/2005996477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f872465e740 10 client.0 _ll_register_callbacks cb 0x55cd608e7a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:41.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87177fe640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 0x55cd609eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f8716ffd640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd6060f550 0x55cd609e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 -- 172.21.15.100:0/2005996477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 msgr2=0x55cd609eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 0x55cd609eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 -- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd6060f550 msgr2=0x55cd609e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd6060f550 0x55cd609e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87167fc640 1 -- 172.21.15.100:0/2005996477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd60778f70 con 0x55cd60617730 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.927+0000 7f87177fe640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 0x55cd609eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f87167fc640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f870c0bc9f0 tx=0x7f870c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5ba2ea42deea3a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f86faff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0f2070 con 0x55cd60617730 2024-04-30T23:15:41.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87080054d0 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f870c0baff0 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f870c049070 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f872465e740 10 client.16296 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cd60610170 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.928+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080054d0 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f870c0b9360 con 0x55cd60617730 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 10 client.16296 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 20 client.16296 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd605f71f0 0x55cd609f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 4 client.16296 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd6094c710 con 0x55cd605f71f0 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.929+0000 7f8716ffd640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd605f71f0 0x55cd609f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.930+0000 7f86faff5640 10 client.16296 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:41.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.930+0000 7f8716ffd640 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd605f71f0 0x55cd609f11f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947ecf4dd0bf3a69 server_cookie=a8b872cea8139572 in_seq=0 out_seq=0 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.930+0000 7f86faff5640 1 -- 172.21.15.100:0/2005996477 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55cd6094c710 con 0x55cd605f71f0 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.930+0000 7f86faff5640 10 client.16296 handle_command_reply: tid=0 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.930+0000 7f872465e740 1 client.16296 shutdown 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 msgr2=0x55cd609e3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f870c0bc9f0 tx=0x7f870c02a3f0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 shutdown_connections 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd605f71f0 0x55cd609f11f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60638410 0x55cd609eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609e3d20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f86faff5640 0 client.16296 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 --2- 172.21.15.100:0/2005996477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd6060f550 0x55cd609e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 >> 172.21.15.100:0/2005996477 conn(0x55cd6062c560 msgr2=0x55cd609d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 shutdown_connections 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 1 -- 172.21.15.100:0/2005996477 wait complete. 2024-04-30T23:15:41.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.931+0000 7f872465e740 20 client.16296 trim_cache size 0 max 16384 2024-04-30T23:15:41.938 INFO:tasks.workunit.client.0.smithi100.stdout:5/70: dread d1/f7 [0,4194304] 0 2024-04-30T23:15:41.943 INFO:tasks.workunit.client.0.smithi100.stdout:6/76: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 Processor -- start 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 -- start start 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609eab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87181aa620 con 0x55cd60617730 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f87181ac220 con 0x55cd605f71f0 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f872465e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f87181aacf0 con 0x55cd6060f550 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.953+0000 7f87177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57914/0 (socket says 172.21.15.100:57914) 2024-04-30T23:15:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 -- 172.21.15.100:0/2273907288 learned_addr learned my addr 172.21.15.100:0/2273907288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87167fc640 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 -- 172.21.15.100:0/2273907288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 msgr2=0x55cd609eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 -- 172.21.15.100:0/2273907288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 msgr2=0x55cd609d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 -- 172.21.15.100:0/2273907288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd609de660 con 0x55cd60617730 2024-04-30T23:15:41.957 INFO:tasks.workunit.client.0.smithi100.stdout:5/71: dread f0 [0,4194304] 0 2024-04-30T23:15:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f87177fe640 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f87100139a0 tx=0x7f8710015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba50835f0e8262c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/72: fsync d1/fc 0 2024-04-30T23:15:41.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/73: write d1/d12/f16 [255328,18380] 0 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f86fcff9640 1 -- 172.21.15.100:0/2273907288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710003970 con 0x55cd60617730 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f86fcff9640 1 -- 172.21.15.100:0/2273907288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8710017070 con 0x55cd60617730 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.954+0000 7f86fcff9640 1 -- 172.21.15.100:0/2273907288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871001c6a0 con 0x55cd60617730 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.955+0000 7f872465e740 1 -- 172.21.15.100:0/2273907288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 msgr2=0x55cd609eb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.955+0000 7f872465e740 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f87100139a0 tx=0x7f8710015000 comp rx=0 tx=0).stop 2024-04-30T23:15:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 -- 172.21.15.100:0/2273907288 shutdown_connections 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd60617730 0x55cd609eb070 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd6060f550 0x55cd609eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 --2- 172.21.15.100:0/2273907288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609d5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 -- 172.21.15.100:0/2273907288 >> 172.21.15.100:0/2273907288 conn(0x55cd6062c560 msgr2=0x55cd609d4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 -- 172.21.15.100:0/2273907288 shutdown_connections 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 -- 172.21.15.100:0/2273907288 wait complete. 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 -- start start 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.956+0000 7f872465e740 1 Processor -- start 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60617730 0x55cd609ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57926/0 (socket says 172.21.15.100:57926) 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 -- 172.21.15.100:0/3702386906 learned_addr learned my addr 172.21.15.100:0/3702386906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87181aba90 con 0x55cd6060f550 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f87181ab3c0 con 0x55cd605f71f0 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f87181a8600 con 0x55cd60617730 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f872465e740 10 client.0 _ll_register_callbacks cb 0x7f870c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 -- 172.21.15.100:0/3702386906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60617730 msgr2=0x55cd609ea2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60617730 0x55cd609ea2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 -- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 msgr2=0x55cd609e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.957+0000 7f87167fc640 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd609ea8b0 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f86faff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f87167fc640 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f870c0c11b0 tx=0x7f870c0f4850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c91f58b52f0ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0db020 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f870c0f4430 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8710017070 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f870c0b8f90 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.958+0000 7f872465e740 10 client.16302 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cd609ea8b0 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c0044b0 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f870c0bc140 con 0x55cd6060f550 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 10 client.16302 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 20 client.16302 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd60638410 0x55cd60a59e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 4 client.16302 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8710017070 con 0x55cd60638410 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.959+0000 7f8716ffd640 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd60638410 0x55cd60a59e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.960+0000 7f8716ffd640 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd60638410 0x55cd60a59e10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f2f65a384ebe6 server_cookie=b574b411abe40a86 in_seq=0 out_seq=0 2024-04-30T23:15:41.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.960+0000 7f86faff5640 10 client.16302 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:41.966 INFO:tasks.workunit.client.0.smithi100.stdout:6/77: dread f5 [0,4194304] 0 2024-04-30T23:15:41.966 INFO:tasks.workunit.client.0.smithi100.stdout:6/78: fdatasync d7/db/fd 0 2024-04-30T23:15:41.966 INFO:tasks.workunit.client.0.smithi100.stdout:6/79: stat d7/fe 0 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f86faff5640 1 -- 172.21.15.100:0/3702386906 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8710017070 con 0x55cd60638410 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f86faff5640 10 client.16302 handle_command_reply: tid=0 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 client.16302 shutdown 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 msgr2=0x55cd609e93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f870c0c11b0 tx=0x7f870c0f4850 comp rx=0 tx=0).stop 2024-04-30T23:15:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 shutdown_connections 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55cd60638410 0x55cd60a59e10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cd60617730 0x55cd609ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f86faff5640 0 client.16302 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd6060f550 0x55cd609e93c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 --2- 172.21.15.100:0/3702386906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cd605f71f0 0x55cd609e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 >> 172.21.15.100:0/3702386906 conn(0x55cd6062c560 msgr2=0x55cd609f5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 shutdown_connections 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 1 -- 172.21.15.100:0/3702386906 wait complete. 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.964+0000 7f872465e740 20 client.16302 trim_cache size 0 max 16384 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:41.968 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:15:41.969 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "bba78046-48dc-428e-b8a2-3c1236d5a61b", 2024-04-30T23:15:41.969 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:15:41.969 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:41.969 INFO:tasks.workunit.client.0.smithi100.stdout:5/74: dread d1/f3 [0,4194304] 0 2024-04-30T23:15:41.969 INFO:tasks.workunit.client.0.smithi100.stdout:6/80: getdents d7/d9 0 2024-04-30T23:15:41.969 INFO:tasks.workunit.client.0.smithi100.stdout:5/75: fdatasync d1/f3 0 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 msgr2=0x7f87000a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 0x7f87000a6140 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87100098b0 tx=0x7f8710004a40 comp rx=0 tx=0).stop 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 msgr2=0x7f871819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c004340 comp rx=0 tx=0).stop 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 shutdown_connections 2024-04-30T23:15:41.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f87000a3c30 0x7f87000a6140 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8718108970 0x7f87181a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8718103c70 0x7f871819f010 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 --2- 172.21.15.100:0/2271362098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8718102a30 0x7f871806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 >> 172.21.15.100:0/2271362098 conn(0x7f87180fdc40 msgr2=0x7f8718104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 shutdown_connections 2024-04-30T23:15:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:41.965+0000 7f871d7a2640 1 -- 172.21.15.100:0/2271362098 wait complete. 2024-04-30T23:15:41.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:15:41.981 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:15:41.984 INFO:tasks.workunit.client.0.smithi100.stdout:9/23: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/88: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/76: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/89: dread - d3/db/f1e zero size 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/77: read - d1/fc zero size 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/90: rename d3/d18 to d3/d18/d1f 22 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:7/56: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:8/23: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:2/22: sync 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:2/23: dread - f3 zero size 2024-04-30T23:15:41.985 INFO:tasks.workunit.client.0.smithi100.stdout:2/24: write f3 [620306,27613] 0 2024-04-30T23:15:41.988 INFO:tasks.workunit.client.0.smithi100.stdout:9/24: creat f1 x:0 0 0 2024-04-30T23:15:41.990 INFO:tasks.workunit.client.0.smithi100.stdout:3/78: mkdir d1/d14/d15 0 2024-04-30T23:15:41.993 INFO:tasks.workunit.client.0.smithi100.stdout:7/57: rename d0/f3 to d0/f12 0 2024-04-30T23:15:41.995 INFO:tasks.workunit.client.0.smithi100.stdout:2/25: link c2 d5/c9 0 2024-04-30T23:15:41.996 INFO:tasks.workunit.client.0.smithi100.stdout:5/76: dwrite d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:41.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/81: dwrite d7/fe [4194304,4194304] 0 2024-04-30T23:15:41.997 INFO:tasks.workunit.client.0.smithi100.stdout:8/24: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:41.999 INFO:tasks.workunit.client.0.smithi100.stdout:9/25: creat f2 x:0 0 0 2024-04-30T23:15:41.999 INFO:tasks.workunit.client.0.smithi100.stdout:9/26: chown f2 11659 1 2024-04-30T23:15:42.002 INFO:tasks.workunit.client.0.smithi100.stdout:7/58: symlink d0/df/l13 0 2024-04-30T23:15:42.006 INFO:tasks.workunit.client.0.smithi100.stdout:7/59: dread d0/f8 [0,4194304] 0 2024-04-30T23:15:42.006 INFO:tasks.workunit.client.0.smithi100.stdout:7/60: fsync d0/f8 0 2024-04-30T23:15:42.007 INFO:tasks.workunit.client.0.smithi100.stdout:7/61: dread - d0/fe zero size 2024-04-30T23:15:42.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/26: symlink d5/la 0 2024-04-30T23:15:42.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/27: chown l4 662921076 1 2024-04-30T23:15:42.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/28: read - d5/f8 zero size 2024-04-30T23:15:42.017 INFO:tasks.workunit.client.0.smithi100.stdout:3/79: dwrite d1/f13 [0,4194304] 0 2024-04-30T23:15:42.017 INFO:tasks.workunit.client.0.smithi100.stdout:3/80: fsync d1/f13 0 2024-04-30T23:15:42.019 INFO:tasks.workunit.client.0.smithi100.stdout:5/77: creat d1/d12/f18 x:0 0 0 2024-04-30T23:15:42.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/82: rename d7/db/fd to d7/d11/f15 0 2024-04-30T23:15:42.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/83: fsync d7/d9/f12 0 2024-04-30T23:15:42.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/84: getdents d7/d9 0 2024-04-30T23:15:42.023 INFO:tasks.workunit.client.0.smithi100.stdout:9/27: dwrite f0 [0,4194304] 0 2024-04-30T23:15:42.032 INFO:tasks.workunit.client.0.smithi100.stdout:7/62: truncate d0/f2 105825 0 2024-04-30T23:15:42.042 INFO:tasks.workunit.client.0.smithi100.stdout:3/81: write d1/f9 [161790,74096] 0 2024-04-30T23:15:42.045 INFO:tasks.workunit.client.0.smithi100.stdout:3/82: write d1/f10 [273917,27128] 0 2024-04-30T23:15:42.048 INFO:tasks.workunit.client.0.smithi100.stdout:9/28: creat f3 x:0 0 0 2024-04-30T23:15:42.059 INFO:tasks.workunit.client.0.smithi100.stdout:6/85: write f5 [2998752,108500] 0 2024-04-30T23:15:42.066 INFO:tasks.workunit.client.0.smithi100.stdout:4/76: sync 2024-04-30T23:15:42.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/78: mkdir d1/d19 0 2024-04-30T23:15:42.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/79: chown d1/d12/f15 432 1 2024-04-30T23:15:42.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/80: truncate d1/d12/f18 56159 0 2024-04-30T23:15:42.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/81: chown d1/d12/f18 35663 1 2024-04-30T23:15:42.074 INFO:tasks.workunit.client.0.smithi100.stdout:5/82: dread d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:42.074 INFO:tasks.workunit.client.0.smithi100.stdout:5/83: truncate d1/d12/f15 1736980 0 2024-04-30T23:15:42.075 INFO:tasks.workunit.client.0.smithi100.stdout:5/84: write d1/f3 [2085282,77352] 0 2024-04-30T23:15:42.079 INFO:tasks.workunit.client.0.smithi100.stdout:3/83: creat d1/d14/d15/f16 x:0 0 0 2024-04-30T23:15:42.081 INFO:tasks.workunit.client.0.smithi100.stdout:9/29: mkdir d4 0 2024-04-30T23:15:42.082 INFO:tasks.workunit.client.0.smithi100.stdout:6/86: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:42.090 INFO:tasks.workunit.client.0.smithi100.stdout:5/85: dread d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:42.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/63: link d0/f2 d0/df/f14 0 2024-04-30T23:15:42.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/64: dread - d0/fe zero size 2024-04-30T23:15:42.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/65: stat d0/df 0 2024-04-30T23:15:42.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/66: stat d0/df/l13 0 2024-04-30T23:15:42.101 INFO:tasks.workunit.client.0.smithi100.stdout:3/84: dwrite d1/f10 [0,4194304] 0 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 -- 172.21.15.100:0/3643612156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50581097d0 msgr2=0x7f505810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 --2- 172.21.15.100:0/3643612156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50581097d0 0x7f505810bce0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5050009ca0 tx=0x7f505002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 -- 172.21.15.100:0/3643612156 shutdown_connections 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 --2- 172.21.15.100:0/3643612156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50581097d0 0x7f505810bce0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 --2- 172.21.15.100:0/3643612156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5058106c60 0x7f5058109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 --2- 172.21.15.100:0/3643612156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f5058102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 -- 172.21.15.100:0/3643612156 >> 172.21.15.100:0/3643612156 conn(0x7f50580fd380 msgr2=0x7f50580ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 -- 172.21.15.100:0/3643612156 shutdown_connections 2024-04-30T23:15:42.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.118+0000 7f505f72d640 1 -- 172.21.15.100:0/3643612156 wait complete. 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 Processor -- start 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 -- start start 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f505819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50581097d0 0x7f50581a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f505810f700 con 0x7f5058106c60 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f505810f580 con 0x7f5058101e30 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505f72d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f505810f880 con 0x7f50581097d0 2024-04-30T23:15:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505ccc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f505819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505ccc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57946/0 (socket says 172.21.15.100:57946) 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.119+0000 7f505ccc8640 1 -- 172.21.15.100:0/92936852 learned_addr learned my addr 172.21.15.100:0/92936852 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 -- 172.21.15.100:0/92936852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50581097d0 msgr2=0x7f50581a3980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50581097d0 0x7f50581a3980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 -- 172.21.15.100:0/92936852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 msgr2=0x7f505819c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f505819c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 -- 172.21.15.100:0/92936852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50581a3ff0 con 0x7f5058106c60 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505d4c9640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f505819c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505ccc8640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f504800b4a0 tx=0x7f504800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f504e7fc640 1 -- 172.21.15.100:0/92936852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048014070 con 0x7f5058106c60 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50581a42e0 con 0x7f5058106c60 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f504e7fc640 1 -- 172.21.15.100:0/92936852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5048010ac0 con 0x7f5058106c60 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50581a48b0 con 0x7f5058106c60 2024-04-30T23:15:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.120+0000 7f504e7fc640 1 -- 172.21.15.100:0/92936852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048017c30 con 0x7f5058106c60 2024-04-30T23:15:42.125 INFO:tasks.workunit.client.0.smithi100.stdout:3/85: dwrite d1/fc [0,4194304] 0 2024-04-30T23:15:42.125 INFO:tasks.workunit.client.0.smithi100.stdout:3/86: chown d1/f8 80 1 2024-04-30T23:15:42.125 INFO:tasks.workunit.client.0.smithi100.stdout:6/87: creat d7/db/f16 x:0 0 0 2024-04-30T23:15:42.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 Processor -- start 2024-04-30T23:15:42.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f504e7fc640 1 -- 172.21.15.100:0/92936852 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5048017070 con 0x7f5058106c60 2024-04-30T23:15:42.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 -- start start 2024-04-30T23:15:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937e1390 0x564293b834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b84700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564293a9ab10 con 0x5642937b84d0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564293ae7d80 con 0x5642937c06b0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f50665e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564293aa18b0 con 0x5642937e1390 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57950/0 (socket says 172.21.15.100:57950) 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.124+0000 7f505d4c9640 1 -- 172.21.15.100:0/89773593 learned_addr learned my addr 172.21.15.100:0/89773593 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505ccc8640 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b84700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505dcca640 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937e1390 0x564293b834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 -- 172.21.15.100:0/89773593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937e1390 msgr2=0x564293b834f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937e1390 0x564293b834f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 -- 172.21.15.100:0/89773593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 msgr2=0x564293b84700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b84700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 -- 172.21.15.100:0/89773593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564293a72a40 con 0x5642937b84d0 2024-04-30T23:15:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f504e7fc640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 0x7f50440a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.125+0000 7f505d4c9640 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f50540114f0 tx=0x7f50540119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669bfd9bfbdfd497 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.126+0000 7f504e7fc640 1 -- 172.21.15.100:0/92936852 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f50480cfb40 con 0x7f5058106c60 2024-04-30T23:15:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.126+0000 7f50437fe640 1 -- 172.21.15.100:0/89773593 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054005020 con 0x5642937b84d0 2024-04-30T23:15:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.126+0000 7f505dcca640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 0x7f50440a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.126+0000 7f50437fe640 1 -- 172.21.15.100:0/89773593 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50540047a0 con 0x5642937b84d0 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.126+0000 7f50437fe640 1 -- 172.21.15.100:0/89773593 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505400f840 con 0x5642937b84d0 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 -- 172.21.15.100:0/89773593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 msgr2=0x564293b83a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f505dcca640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 0x7f50440a60c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5050031b50 tx=0x7f50500093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f50540114f0 tx=0x7f50540119b0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 -- 172.21.15.100:0/89773593 shutdown_connections 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b84700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937b84d0 0x564293b83a70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 --2- 172.21.15.100:0/89773593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937e1390 0x564293b834f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.127+0000 7f50665e4740 1 -- 172.21.15.100:0/89773593 >> 172.21.15.100:0/89773593 conn(0x5642937d54e0 msgr2=0x564293b7ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 -- 172.21.15.100:0/89773593 shutdown_connections 2024-04-30T23:15:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 -- 172.21.15.100:0/89773593 wait complete. 2024-04-30T23:15:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 -- start start 2024-04-30T23:15:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 Processor -- start 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.128+0000 7f50665e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b8d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f50665e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 0x564293b94800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f50665e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564293a6ed10 con 0x5642937e1390 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f50665e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564293ae3d40 con 0x5642937c06b0 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f50665e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564293b85210 con 0x5642937b84d0 2024-04-30T23:15:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f50665e4740 10 client.0 _ll_register_callbacks cb 0x564293af4d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505dcca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 0x564293b94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505dcca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 0x564293b94800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57956/0 (socket says 172.21.15.100:57956) 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505dcca640 1 -- 172.21.15.100:0/326761404 learned_addr learned my addr 172.21.15.100:0/326761404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505ccc8640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b8d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 -- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 msgr2=0x564293b8d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b8d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 -- 172.21.15.100:0/326761404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 msgr2=0x564293b94800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 0x564293b94800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.129+0000 7f505d4c9640 1 -- 172.21.15.100:0/326761404 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642938c37d0 con 0x5642937b84d0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f505d4c9640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50540058c0 tx=0x7f5054005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e211f3ec890f7d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f5040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054004030 con 0x5642937b84d0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f5054016040 con 0x5642937b84d0 2024-04-30T23:15:42.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50540047a0 con 0x5642937b84d0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5054044050 con 0x5642937b84d0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f50665e4740 10 client.25786 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.130+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5642937f93f0 con 0x5642937b84d0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50540047a0 con 0x5642937b84d0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f505400f620 con 0x5642937b84d0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 10 client.25786 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 10 client.25786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 20 client.25786 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56429379ff60 0x564293b99200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 4 client.25786 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.131+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564293af5990 con 0x56429379ff60 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.132+0000 7f505ccc8640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56429379ff60 0x564293b99200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.132+0000 7f5040ff9640 10 client.25786 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.132+0000 7f505ccc8640 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56429379ff60 0x564293b99200 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156b2f778a4636aa server_cookie=3dc15797c9b6dc95 in_seq=0 out_seq=0 2024-04-30T23:15:42.137 INFO:tasks.workunit.client.0.smithi100.stdout:4/77: dwrite f3 [0,4194304] 0 2024-04-30T23:15:42.138 INFO:tasks.workunit.client.0.smithi100.stdout:5/86: mkdir d1/d12/d1a 0 2024-04-30T23:15:42.138 INFO:tasks.workunit.client.0.smithi100.stdout:5/87: fsync d1/f7 0 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f5040ff9640 1 -- 172.21.15.100:0/326761404 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x564293af5990 con 0x56429379ff60 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f5040ff9640 10 client.25786 handle_command_reply: tid=0 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 client.25786 shutdown 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 msgr2=0x564293b8d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50540058c0 tx=0x7f5054005230 comp rx=0 tx=0).stop 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 shutdown_connections 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56429379ff60 0x564293b99200 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937e1390 0x564293b94800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937c06b0 0x564293b8d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f5040ff9640 0 client.25786 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 --2- 172.21.15.100:0/326761404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8d360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 >> 172.21.15.100:0/326761404 conn(0x5642937d54e0 msgr2=0x564293b81c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/30: write f0 [2552233,117009] 0 2024-04-30T23:15:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 shutdown_connections 2024-04-30T23:15:42.142 INFO:tasks.workunit.client.0.smithi100.stdout:9/31: write f1 [718787,28952] 0 2024-04-30T23:15:42.142 INFO:tasks.workunit.client.0.smithi100.stdout:9/32: chown f2 507946 1 2024-04-30T23:15:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 1 -- 172.21.15.100:0/326761404 wait complete. 2024-04-30T23:15:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.138+0000 7f50665e4740 20 client.25786 trim_cache size 0 max 16384 2024-04-30T23:15:42.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/67: symlink d0/df/l15 0 2024-04-30T23:15:42.154 INFO:tasks.workunit.client.0.smithi100.stdout:3/87: dwrite d1/ff [0,4194304] 0 2024-04-30T23:15:42.157 INFO:tasks.workunit.client.0.smithi100.stdout:3/88: dread d1/f9 [0,4194304] 0 2024-04-30T23:15:42.157 INFO:tasks.workunit.client.0.smithi100.stdout:3/89: readlink d1/ld 0 2024-04-30T23:15:42.160 INFO:tasks.workunit.client.0.smithi100.stdout:4/78: dwrite f12 [4194304,4194304] 0 2024-04-30T23:15:42.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/29: dwrite f3 [0,4194304] 0 2024-04-30T23:15:42.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/30: fsync d5/f8 0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 Processor -- start 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 -- start start 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 0x564293b9e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50581aa860 con 0x5642937c06b0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f50581ac460 con 0x56429379ff60 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f50665e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50581aaf30 con 0x5642937b84d0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f505dcca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f505ccc8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 0x564293b9e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f505dcca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57964/0 (socket says 172.21.15.100:57964) 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.165+0000 7f505dcca640 1 -- 172.21.15.100:0/942983217 learned_addr learned my addr 172.21.15.100:0/942983217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 -- 172.21.15.100:0/942983217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 msgr2=0x564293b8c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 -- 172.21.15.100:0/942983217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 msgr2=0x564293b8ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 -- 172.21.15.100:0/942983217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642937b90f0 con 0x56429379ff60 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505dcca640 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f505d4c9640 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 0x564293b9e080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f505400fa70 tx=0x7f50540119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c416a135c30c5397 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f5042ffd640 1 -- 172.21.15.100:0/942983217 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054005530 con 0x56429379ff60 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f5042ffd640 1 -- 172.21.15.100:0/942983217 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50540044f0 con 0x56429379ff60 2024-04-30T23:15:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.166+0000 7f5042ffd640 1 -- 172.21.15.100:0/942983217 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50540035f0 con 0x56429379ff60 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- 172.21.15.100:0/942983217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 msgr2=0x564293b9e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 0x564293b9e080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f505400fa70 tx=0x7f50540119b0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- 172.21.15.100:0/942983217 shutdown_connections 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293b8ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5642937b84d0 0x564293b8c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 --2- 172.21.15.100:0/942983217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56429379ff60 0x564293b9e080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- 172.21.15.100:0/942983217 >> 172.21.15.100:0/942983217 conn(0x5642937d54e0 msgr2=0x564293b9d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- 172.21.15.100:0/942983217 shutdown_connections 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- 172.21.15.100:0/942983217 wait complete. 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.167+0000 7f50665e4740 1 -- start start 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 Processor -- start 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 0x564293bf99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 0x564293bfbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293bfe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50581abcd0 con 0x5642937c06b0 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f50581ab600 con 0x5642937b84d0 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50581a8860 con 0x56429379ff60 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f50665e4740 10 client.0 _ll_register_callbacks cb 0x7f50480d3450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 0x564293bf99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505dcca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293bfe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505d4c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 0x564293bf99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:47838/0 (socket says 172.21.15.100:47838) 2024-04-30T23:15:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505d4c9640 1 -- 172.21.15.100:0/3662202737 learned_addr learned my addr 172.21.15.100:0/3662202737 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505ccc8640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 0x564293bfbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505dcca640 1 -- 172.21.15.100:0/3662202737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 msgr2=0x564293bf99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505dcca640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 0x564293bf99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505dcca640 1 -- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 msgr2=0x564293bfbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.168+0000 7f505dcca640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 0x564293bfbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f505dcca640 1 -- 172.21.15.100:0/3662202737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564293aa84b0 con 0x5642937c06b0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f505ccc8640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 0x564293bfbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f505dcca640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293bfe450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f505002aeb0 tx=0x7f505002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72fa087b2ed7cf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505002f610 con 0x5642937c06b0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f505002f7b0 con 0x5642937c06b0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50540044f0 con 0x5642937c06b0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f505002f9b0 con 0x5642937c06b0 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 10 client.16320 fetch_fsmap learned FSMap version 31 2024-04-30T23:15:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564293bffb20 con 0x5642937c06b0 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50540044f0 con 0x5642937c06b0 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5050042040 con 0x5642937c06b0 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 10 client.16320 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 20 client.16320 populate_metadata read hostname 'smithi100' 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5642937e1390 0x564293c02630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.169+0000 7f50665e4740 4 client.16320 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.170+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564293aef800 con 0x5642937e1390 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.170+0000 7f505d4c9640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5642937e1390 0x564293c02630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.170+0000 7f5040ff9640 10 client.16320 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.170+0000 7f505d4c9640 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5642937e1390 0x564293c02630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f483a2ee0a83682 server_cookie=2cc6ac329b8c4f53 in_seq=0 out_seq=0 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.173+0000 7f5040ff9640 1 -- 172.21.15.100:0/3662202737 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1714 (crc 0 0 0) 0x564293aef800 con 0x5642937e1390 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.173+0000 7f5040ff9640 10 client.16320 handle_command_reply: tid=0 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.173+0000 7f50665e4740 1 client.16320 shutdown 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 msgr2=0x564293bfe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293bfe450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f505002aeb0 tx=0x7f505002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 shutdown_connections 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5642937e1390 0x564293c02630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5642937c06b0 0x564293bfe450 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f5040ff9640 0 client.16320 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5642937b84d0 0x564293bfbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 --2- 172.21.15.100:0/3662202737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56429379ff60 0x564293bf99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 >> 172.21.15.100:0/3662202737 conn(0x5642937d54e0 msgr2=0x564293b81b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 shutdown_connections 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 1 -- 172.21.15.100:0/3662202737 wait complete. 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.174+0000 7f50665e4740 20 client.16320 trim_cache size 0 max 16384 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "scrub active (332 inodes in the stack)", 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "bba78046-48dc-428e-b8a2-3c1236d5a61b", 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:15:42.182 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 msgr2=0x7f50440a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 0x7f50440a60c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5050031b50 tx=0x7f50500093f0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 msgr2=0x7f505819c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f504800b4a0 tx=0x7f504800b960 comp rx=0 tx=0).stop 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 shutdown_connections 2024-04-30T23:15:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f50440a3bb0 0x7f50440a60c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50581097d0 0x7f50581a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5058106c60 0x7f505819c9f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 --2- 172.21.15.100:0/92936852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5058101e30 0x7f505819c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 >> 172.21.15.100:0/92936852 conn(0x7f50580fd380 msgr2=0x7f5058102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 shutdown_connections 2024-04-30T23:15:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:15:42.175+0000 7f505f72d640 1 -- 172.21.15.100:0/92936852 wait complete. 2024-04-30T23:15:42.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/33: link f2 d4/f5 0 2024-04-30T23:15:42.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/34: chown f3 18407648 1 2024-04-30T23:15:42.187 INFO:tasks.cephfs.filesystem:scrub status for tag:bba78046-48dc-428e-b8a2-3c1236d5a61b - {'path': '/', 'tag': 'bba78046-48dc-428e-b8a2-3c1236d5a61b', 'options': 'recursive,force'} 2024-04-30T23:15:42.192 INFO:tasks.workunit.client.0.smithi100.stdout:7/68: creat d0/f16 x:0 0 0 2024-04-30T23:15:42.217 INFO:tasks.workunit.client.0.smithi100.stdout:4/79: creat f13 x:0 0 0 2024-04-30T23:15:42.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/31: rename c2 to d5/cb 0 2024-04-30T23:15:42.236 INFO:tasks.workunit.client.0.smithi100.stdout:6/88: truncate d7/fe 6211560 0 2024-04-30T23:15:42.253 INFO:tasks.workunit.client.0.smithi100.stdout:5/88: truncate d1/d12/f15 480079 0 2024-04-30T23:15:42.257 INFO:tasks.workunit.client.0.smithi100.stdout:9/35: mkdir d4/d6 0 2024-04-30T23:15:42.257 INFO:tasks.workunit.client.0.smithi100.stdout:9/36: read - d4/f5 zero size 2024-04-30T23:15:42.257 INFO:tasks.workunit.client.0.smithi100.stdout:9/37: read f0 [1641945,1401] 0 2024-04-30T23:15:42.262 INFO:tasks.workunit.client.0.smithi100.stdout:7/69: write d0/fe [644759,16490] 0 2024-04-30T23:15:42.265 INFO:tasks.workunit.client.0.smithi100.stdout:0/45: sync 2024-04-30T23:15:42.265 INFO:tasks.workunit.client.0.smithi100.stdout:8/25: sync 2024-04-30T23:15:42.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/91: sync 2024-04-30T23:15:42.265 INFO:tasks.workunit.client.0.smithi100.stdout:0/46: fsync d2/fc 0 2024-04-30T23:15:42.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/92: truncate d3/d16/f1d 69833 0 2024-04-30T23:15:42.280 INFO:tasks.workunit.client.0.smithi100.stdout:3/90: symlink d1/l17 0 2024-04-30T23:15:42.341 INFO:tasks.workunit.client.0.smithi100.stdout:4/80: mknod c14 0 2024-04-30T23:15:42.345 INFO:tasks.workunit.client.0.smithi100.stdout:2/32: link l4 d5/lc 0 2024-04-30T23:15:42.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/81: write fb [2736006,123901] 0 2024-04-30T23:15:42.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/82: rmdir - no directory 2024-04-30T23:15:42.373 INFO:tasks.workunit.client.0.smithi100.stdout:4/83: dwrite f11 [0,4194304] 0 2024-04-30T23:15:42.381 INFO:tasks.workunit.client.0.smithi100.stdout:6/89: link d7/l10 d7/d9/l17 0 2024-04-30T23:15:42.402 INFO:tasks.workunit.client.0.smithi100.stdout:4/84: dwrite f13 [0,4194304] 0 2024-04-30T23:15:42.407 INFO:tasks.workunit.client.0.smithi100.stdout:5/89: creat d1/f1b x:0 0 0 2024-04-30T23:15:42.407 INFO:tasks.workunit.client.0.smithi100.stdout:5/90: chown d1/fe 2245610 1 2024-04-30T23:15:42.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/38: rmdir d4/d6 0 2024-04-30T23:15:42.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/39: write d4/f5 [869820,66263] 0 2024-04-30T23:15:42.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/40: truncate f2 1457461 0 2024-04-30T23:15:42.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/41: fdatasync f2 0 2024-04-30T23:15:42.419 INFO:tasks.workunit.client.0.smithi100.stdout:7/70: creat d0/f17 x:0 0 0 2024-04-30T23:15:42.419 INFO:tasks.workunit.client.0.smithi100.stdout:7/71: dread - d0/f17 zero size 2024-04-30T23:15:42.420 INFO:tasks.workunit.client.0.smithi100.stdout:7/72: write d0/fe [124410,99958] 0 2024-04-30T23:15:42.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/47: mknod d2/ce 0 2024-04-30T23:15:42.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/48: chown d2/c9 531237122 1 2024-04-30T23:15:42.428 INFO:tasks.workunit.client.0.smithi100.stdout:8/26: mkdir d2/d5 0 2024-04-30T23:15:42.429 INFO:tasks.workunit.client.0.smithi100.stdout:4/85: dwrite f8 [0,4194304] 0 2024-04-30T23:15:42.431 INFO:tasks.workunit.client.0.smithi100.stdout:5/91: dwrite d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:42.438 INFO:tasks.workunit.client.0.smithi100.stdout:1/93: write d3/f8 [2220460,14701] 0 2024-04-30T23:15:42.438 INFO:tasks.workunit.client.0.smithi100.stdout:1/94: chown d3/f9 60410 1 2024-04-30T23:15:42.453 INFO:tasks.workunit.client.0.smithi100.stdout:4/86: dwrite f12 [4194304,4194304] 0 2024-04-30T23:15:42.458 INFO:tasks.workunit.client.0.smithi100.stdout:3/91: unlink d1/ld 0 2024-04-30T23:15:42.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/92: dwrite d1/fc [0,4194304] 0 2024-04-30T23:15:42.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/33: creat d5/fd x:0 0 0 2024-04-30T23:15:42.540 INFO:tasks.workunit.client.0.smithi100.stdout:6/90: mknod d7/df/c18 0 2024-04-30T23:15:42.540 INFO:tasks.workunit.client.0.smithi100.stdout:6/91: write d7/db/f16 [578705,122882] 0 2024-04-30T23:15:42.545 INFO:tasks.workunit.client.0.smithi100.stdout:6/92: write d7/fe [4425012,14058] 0 2024-04-30T23:15:42.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/93: write d7/d9/f12 [2540115,67276] 0 2024-04-30T23:15:42.570 INFO:tasks.workunit.client.0.smithi100.stdout:6/94: dread d7/db/f16 [0,4194304] 0 2024-04-30T23:15:42.570 INFO:tasks.workunit.client.0.smithi100.stdout:6/95: chown d7/db 115 1 2024-04-30T23:15:42.584 INFO:tasks.workunit.client.0.smithi100.stdout:9/42: mkdir d4/d7 0 2024-04-30T23:15:42.585 INFO:tasks.workunit.client.0.smithi100.stdout:7/73: creat d0/f18 x:0 0 0 2024-04-30T23:15:42.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/49: write d2/fc [703702,35652] 0 2024-04-30T23:15:42.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/50: fdatasync d2/f4 0 2024-04-30T23:15:42.593 INFO:tasks.workunit.client.0.smithi100.stdout:8/27: creat d2/f6 x:0 0 0 2024-04-30T23:15:42.606 INFO:tasks.workunit.client.0.smithi100.stdout:1/95: mkdir d3/d16/d20 0 2024-04-30T23:15:42.611 INFO:tasks.workunit.client.0.smithi100.stdout:0/51: dwrite d2/fb [0,4194304] 0 2024-04-30T23:15:42.619 INFO:tasks.workunit.client.0.smithi100.stdout:4/87: getdents . 0 2024-04-30T23:15:42.619 INFO:tasks.workunit.client.0.smithi100.stdout:4/88: write f9 [1074735,41477] 0 2024-04-30T23:15:42.623 INFO:tasks.workunit.client.0.smithi100.stdout:5/93: creat d1/d12/d1a/f1c x:0 0 0 2024-04-30T23:15:42.623 INFO:tasks.workunit.client.0.smithi100.stdout:5/94: fsync d1/d12/f15 0 2024-04-30T23:15:42.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/96: dwrite d3/db/f11 [0,4194304] 0 2024-04-30T23:15:42.634 INFO:tasks.workunit.client.0.smithi100.stdout:3/92: write d1/f10 [2078856,107248] 0 2024-04-30T23:15:42.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/34: stat d5/c6 0 2024-04-30T23:15:42.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/35: truncate d5/fd 713497 0 2024-04-30T23:15:42.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/36: write d5/fd [764034,9929] 0 2024-04-30T23:15:42.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/93: read d1/ff [1981451,72787] 0 2024-04-30T23:15:42.648 INFO:tasks.workunit.client.0.smithi100.stdout:2/37: fsync d5/fd 0 2024-04-30T23:15:42.730 INFO:tasks.workunit.client.0.smithi100.stdout:6/96: symlink d7/d13/l19 0 2024-04-30T23:15:42.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/97: dread f5 [0,4194304] 0 2024-04-30T23:15:42.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/43: mkdir d4/d7/d8 0 2024-04-30T23:15:42.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/44: dread - f3 zero size 2024-04-30T23:15:42.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/74: mkdir d0/df/d19 0 2024-04-30T23:15:42.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/75: write d0/fe [1535106,62831] 0 2024-04-30T23:15:42.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/76: truncate d0/f2 166337 0 2024-04-30T23:15:42.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/77: chown d0/cc 143 1 2024-04-30T23:15:42.751 INFO:tasks.workunit.client.0.smithi100.stdout:9/45: dread f2 [0,4194304] 0 2024-04-30T23:15:42.764 INFO:tasks.workunit.client.0.smithi100.stdout:8/28: mkdir d2/d7 0 2024-04-30T23:15:42.772 INFO:tasks.workunit.client.0.smithi100.stdout:8/29: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:42.787 INFO:tasks.workunit.client.0.smithi100.stdout:0/52: truncate d2/f8 500715 0 2024-04-30T23:15:42.797 INFO:tasks.workunit.client.0.smithi100.stdout:4/89: symlink l15 0 2024-04-30T23:15:42.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/95: creat d1/f1d x:0 0 0 2024-04-30T23:15:42.815 INFO:tasks.workunit.client.0.smithi100.stdout:1/97: creat d3/f21 x:0 0 0 2024-04-30T23:15:42.815 INFO:tasks.workunit.client.0.smithi100.stdout:1/98: write d3/f8 [1385585,77752] 0 2024-04-30T23:15:42.830 INFO:tasks.workunit.client.0.smithi100.stdout:2/38: creat d5/fe x:0 0 0 2024-04-30T23:15:42.844 INFO:tasks.workunit.client.0.smithi100.stdout:2/39: read f3 [2313105,59915] 0 2024-04-30T23:15:42.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/98: truncate f5 601632 0 2024-04-30T23:15:42.934 INFO:tasks.workunit.client.0.smithi100.stdout:7/78: symlink d0/l1a 0 2024-04-30T23:15:42.936 INFO:tasks.workunit.client.0.smithi100.stdout:9/46: mkdir d4/d9 0 2024-04-30T23:15:42.961 INFO:tasks.workunit.client.0.smithi100.stdout:8/30: creat d2/f8 x:0 0 0 2024-04-30T23:15:42.978 INFO:tasks.workunit.client.0.smithi100.stdout:0/53: unlink d2/c9 0 2024-04-30T23:15:42.980 INFO:tasks.workunit.client.0.smithi100.stdout:8/31: dwrite d2/f3 [4194304,4194304] 0 2024-04-30T23:15:42.986 INFO:tasks.workunit.client.0.smithi100.stdout:4/90: mknod c16 0 2024-04-30T23:15:42.998 INFO:tasks.workunit.client.0.smithi100.stdout:5/96: creat d1/d19/f1e x:0 0 0 2024-04-30T23:15:43.006 INFO:tasks.workunit.client.0.smithi100.stdout:1/99: creat d3/d16/d20/f22 x:0 0 0 2024-04-30T23:15:43.019 INFO:tasks.workunit.client.0.smithi100.stdout:3/94: symlink d1/l18 0 2024-04-30T23:15:43.028 INFO:tasks.workunit.client.0.smithi100.stdout:2/40: symlink d5/lf 0 2024-04-30T23:15:43.028 INFO:tasks.workunit.client.0.smithi100.stdout:2/41: fsync d5/fd 0 2024-04-30T23:15:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:42 smithi104 ceph-mon[32987]: pgmap v436: 129 pgs: 129 active+clean; 142 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 584 op/s 2024-04-30T23:15:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:42 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:15:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:42 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:43.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:42 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:42 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:42 smithi183 ceph-mon[33560]: pgmap v436: 129 pgs: 129 active+clean; 142 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 584 op/s 2024-04-30T23:15:43.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:42 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:15:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:42 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:42 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:42 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:42 smithi100 ceph-mon[29745]: pgmap v436: 129 pgs: 129 active+clean; 142 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 584 op/s 2024-04-30T23:15:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:42 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:15:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:42 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:42 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:43.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:42 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:43.103 INFO:tasks.workunit.client.0.smithi100.stdout:6/99: mkdir d7/d1a 0 2024-04-30T23:15:43.108 INFO:tasks.workunit.client.0.smithi100.stdout:7/79: mkdir d0/d1b 0 2024-04-30T23:15:43.108 INFO:tasks.workunit.client.0.smithi100.stdout:7/80: chown d0 29 1 2024-04-30T23:15:43.110 INFO:tasks.workunit.client.0.smithi100.stdout:9/47: mknod d4/ca 0 2024-04-30T23:15:43.115 INFO:tasks.workunit.client.0.smithi100.stdout:9/48: dread f1 [0,4194304] 0 2024-04-30T23:15:43.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/54: symlink d2/lf 0 2024-04-30T23:15:43.144 INFO:tasks.workunit.client.0.smithi100.stdout:8/32: creat d2/f9 x:0 0 0 2024-04-30T23:15:43.144 INFO:tasks.workunit.client.0.smithi100.stdout:8/33: fsync d2/f6 0 2024-04-30T23:15:43.164 INFO:tasks.workunit.client.0.smithi100.stdout:1/100: rename d3/fc to d3/d18/f23 0 2024-04-30T23:15:43.172 INFO:tasks.workunit.client.0.smithi100.stdout:3/95: creat d1/d14/f19 x:0 0 0 2024-04-30T23:15:43.178 INFO:tasks.workunit.client.0.smithi100.stdout:2/42: truncate f3 3030357 0 2024-04-30T23:15:43.178 INFO:tasks.workunit.client.0.smithi100.stdout:2/43: stat d5/f8 0 2024-04-30T23:15:43.238 INFO:tasks.workunit.client.0.smithi100.stdout:7/81: symlink d0/df/d19/l1c 0 2024-04-30T23:15:43.238 INFO:tasks.workunit.client.0.smithi100.stdout:7/82: stat d0/f4 0 2024-04-30T23:15:43.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/49: mknod d4/d7/d8/cb 0 2024-04-30T23:15:43.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/50: write f3 [646166,93058] 0 2024-04-30T23:15:43.285 INFO:tasks.workunit.client.0.smithi100.stdout:0/55: mknod d2/c10 0 2024-04-30T23:15:43.285 INFO:tasks.workunit.client.0.smithi100.stdout:0/56: write d2/f7 [1479573,108542] 0 2024-04-30T23:15:43.306 INFO:tasks.workunit.client.0.smithi100.stdout:0/57: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:43.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/34: rename f0 to d2/d5/fa 0 2024-04-30T23:15:43.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/35: write d2/f8 [487492,107124] 0 2024-04-30T23:15:43.343 INFO:tasks.workunit.client.0.smithi100.stdout:1/101: mkdir d3/d16/d20/d24 0 2024-04-30T23:15:43.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/44: mkdir d5/d10 0 2024-04-30T23:15:43.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/45: write d5/fd [1105590,92040] 0 2024-04-30T23:15:43.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/46: fdatasync d5/f8 0 2024-04-30T23:15:43.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/47: write d5/fe [666145,99243] 0 2024-04-30T23:15:43.433 INFO:tasks.workunit.client.0.smithi100.stdout:7/83: mkdir d0/d1d 0 2024-04-30T23:15:43.455 INFO:tasks.workunit.client.0.smithi100.stdout:0/58: symlink d2/l11 0 2024-04-30T23:15:43.461 INFO:tasks.workunit.client.0.smithi100.stdout:1/102: symlink d3/d16/d20/l25 0 2024-04-30T23:15:43.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/59: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:43.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/60: truncate d2/f4 4444516 0 2024-04-30T23:15:43.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/61: fsync d2/f5 0 2024-04-30T23:15:43.470 INFO:tasks.workunit.client.0.smithi100.stdout:3/96: rename d1/l12 to d1/l1a 0 2024-04-30T23:15:43.477 INFO:tasks.workunit.client.0.smithi100.stdout:2/48: creat d5/f11 x:0 0 0 2024-04-30T23:15:43.485 INFO:tasks.workunit.client.0.smithi100.stdout:0/62: read d2/fb [1659348,12700] 0 2024-04-30T23:15:43.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/103: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:15:43.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/104: chown d3/d16/d20/f22 4623278 1 2024-04-30T23:15:43.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/105: stat d3/d18 0 2024-04-30T23:15:43.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/49: dwrite f1 [4194304,4194304] 0 2024-04-30T23:15:43.505 INFO:tasks.workunit.client.0.smithi100.stdout:7/84: mkdir d0/d1b/d1e 0 2024-04-30T23:15:43.505 INFO:tasks.workunit.client.0.smithi100.stdout:7/85: fsync d0/fe 0 2024-04-30T23:15:43.510 INFO:tasks.workunit.client.0.smithi100.stdout:1/106: read d3/f5 [1649476,36753] 0 2024-04-30T23:15:43.522 INFO:tasks.workunit.client.0.smithi100.stdout:0/63: creat d2/f12 x:0 0 0 2024-04-30T23:15:43.526 INFO:tasks.workunit.client.0.smithi100.stdout:1/107: write d3/f19 [3572322,110640] 0 2024-04-30T23:15:43.532 INFO:tasks.workunit.client.0.smithi100.stdout:2/50: mkdir d5/d12 0 2024-04-30T23:15:43.534 INFO:tasks.workunit.client.0.smithi100.stdout:7/86: creat d0/f1f x:0 0 0 2024-04-30T23:15:43.536 INFO:tasks.workunit.client.0.smithi100.stdout:3/97: link d1/fa d1/d14/d15/f1b 0 2024-04-30T23:15:43.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/64: symlink d2/l13 0 2024-04-30T23:15:43.538 INFO:tasks.workunit.client.0.smithi100.stdout:0/65: write d2/fb [3545227,49282] 0 2024-04-30T23:15:43.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/87: dread d0/fe [0,4194304] 0 2024-04-30T23:15:43.540 INFO:tasks.workunit.client.0.smithi100.stdout:2/51: rename d5/d10 to d5/d12/d13 0 2024-04-30T23:15:43.540 INFO:tasks.workunit.client.0.smithi100.stdout:2/52: dread - d5/f11 zero size 2024-04-30T23:15:43.540 INFO:tasks.workunit.client.0.smithi100.stdout:2/53: read - d5/f8 zero size 2024-04-30T23:15:43.540 INFO:tasks.workunit.client.0.smithi100.stdout:2/54: readlink l4 0 2024-04-30T23:15:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/98: creat d1/f1c x:0 0 0 2024-04-30T23:15:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/99: chown d1/le 0 1 2024-04-30T23:15:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/100: dread - d1/d14/d15/f16 zero size 2024-04-30T23:15:43.542 INFO:tasks.workunit.client.0.smithi100.stdout:7/88: read d0/f8 [358859,129771] 0 2024-04-30T23:15:43.542 INFO:tasks.workunit.client.0.smithi100.stdout:7/89: dread - d0/f16 zero size 2024-04-30T23:15:43.542 INFO:tasks.workunit.client.0.smithi100.stdout:0/66: mkdir d2/d14 0 2024-04-30T23:15:43.544 INFO:tasks.workunit.client.0.smithi100.stdout:3/101: creat d1/d14/d15/f1d x:0 0 0 2024-04-30T23:15:43.546 INFO:tasks.workunit.client.0.smithi100.stdout:3/102: mkdir d1/d14/d15/d1e 0 2024-04-30T23:15:43.546 INFO:tasks.workunit.client.0.smithi100.stdout:3/103: stat d1/d14/d15/d1e 0 2024-04-30T23:15:43.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/104: symlink d1/d14/l1f 0 2024-04-30T23:15:43.551 INFO:tasks.workunit.client.0.smithi100.stdout:1/108: dwrite d3/f21 [0,4194304] 0 2024-04-30T23:15:43.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/55: write f1 [4508398,84354] 0 2024-04-30T23:15:43.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/56: truncate f3 3961426 0 2024-04-30T23:15:43.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/105: getdents d1 0 2024-04-30T23:15:43.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/106: write d1/d14/d15/f1d [112309,34702] 0 2024-04-30T23:15:43.568 INFO:tasks.workunit.client.0.smithi100.stdout:7/90: dwrite d0/fe [0,4194304] 0 2024-04-30T23:15:43.572 INFO:tasks.workunit.client.0.smithi100.stdout:7/91: rename d0/c9 to d0/d1b/d1e/c20 0 2024-04-30T23:15:43.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/92: write d0/f1f [796226,77938] 0 2024-04-30T23:15:43.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/93: creat d0/df/f21 x:0 0 0 2024-04-30T23:15:43.578 INFO:tasks.workunit.client.0.smithi100.stdout:7/94: dread - d0/df/f21 zero size 2024-04-30T23:15:43.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/95: creat d0/df/f22 x:0 0 0 2024-04-30T23:15:43.579 INFO:tasks.workunit.client.0.smithi100.stdout:1/109: dwrite d3/f21 [0,4194304] 0 2024-04-30T23:15:43.580 INFO:tasks.workunit.client.0.smithi100.stdout:1/110: read - d3/db/f1e zero size 2024-04-30T23:15:43.581 INFO:tasks.workunit.client.0.smithi100.stdout:7/96: mknod d0/d1d/c23 0 2024-04-30T23:15:43.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/111: creat d3/f26 x:0 0 0 2024-04-30T23:15:43.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/112: write d3/f19 [198177,66282] 0 2024-04-30T23:15:43.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/113: dread - d3/d16/d20/f22 zero size 2024-04-30T23:15:43.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/97: mkdir d0/d1b/d24 0 2024-04-30T23:15:43.589 INFO:tasks.workunit.client.0.smithi100.stdout:2/57: dwrite f1 [0,4194304] 0 2024-04-30T23:15:43.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/58: rename d5/f8 to d5/f14 0 2024-04-30T23:15:43.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/59: fsync d5/fd 0 2024-04-30T23:15:43.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/114: dread d3/f4 [0,4194304] 0 2024-04-30T23:15:43.606 INFO:tasks.workunit.client.0.smithi100.stdout:1/115: creat d3/d16/d20/f27 x:0 0 0 2024-04-30T23:15:43.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/116: mknod d3/d18/c28 0 2024-04-30T23:15:43.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/117: write d3/f21 [4270407,68155] 0 2024-04-30T23:15:43.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/118: truncate d3/f26 1023203 0 2024-04-30T23:15:43.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/119: fdatasync d3/f10 0 2024-04-30T23:15:43.612 INFO:tasks.workunit.client.0.smithi100.stdout:2/60: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:43.612 INFO:tasks.workunit.client.0.smithi100.stdout:2/61: write d5/f11 [538373,69865] 0 2024-04-30T23:15:43.615 INFO:tasks.workunit.client.0.smithi100.stdout:2/62: rename d5/lc to d5/d12/l15 0 2024-04-30T23:15:43.627 INFO:tasks.workunit.client.0.smithi100.stdout:2/63: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:43.629 INFO:tasks.workunit.client.0.smithi100.stdout:2/64: rmdir d5/d12 39 2024-04-30T23:15:43.632 INFO:tasks.workunit.client.0.smithi100.stdout:1/120: dwrite d3/d16/f1d [0,4194304] 0 2024-04-30T23:15:43.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/65: creat d5/f16 x:0 0 0 2024-04-30T23:15:43.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/66: write d5/f16 [415276,118504] 0 2024-04-30T23:15:43.642 INFO:tasks.workunit.client.0.smithi100.stdout:1/121: symlink d3/d16/d20/d24/l29 0 2024-04-30T23:15:43.642 INFO:tasks.workunit.client.0.smithi100.stdout:2/67: creat d5/d12/d13/f17 x:0 0 0 2024-04-30T23:15:43.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/68: dread f3 [0,4194304] 0 2024-04-30T23:15:43.656 INFO:tasks.workunit.client.0.smithi100.stdout:1/122: creat d3/d16/d20/f2a x:0 0 0 2024-04-30T23:15:43.665 INFO:tasks.workunit.client.0.smithi100.stdout:2/69: symlink d5/d12/l18 0 2024-04-30T23:15:43.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/123: rename d3/db/f1e to d3/d16/d20/d24/f2b 0 2024-04-30T23:15:43.668 INFO:tasks.workunit.client.0.smithi100.stdout:2/70: rename d5/d12 to d5/d12/d19 22 2024-04-30T23:15:43.668 INFO:tasks.workunit.client.0.smithi100.stdout:2/71: write d5/fe [739946,103736] 0 2024-04-30T23:15:43.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/124: mknod d3/db/c2c 0 2024-04-30T23:15:43.687 INFO:tasks.workunit.client.0.smithi100.stdout:2/72: dwrite f1 [0,4194304] 0 2024-04-30T23:15:43.687 INFO:tasks.workunit.client.0.smithi100.stdout:2/73: dread - d5/d12/d13/f17 zero size 2024-04-30T23:15:43.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/125: rename d3/db/f11 to d3/d16/d20/f2d 0 2024-04-30T23:15:43.692 INFO:tasks.workunit.client.0.smithi100.stdout:1/126: dread d3/f10 [0,4194304] 0 2024-04-30T23:15:43.692 INFO:tasks.workunit.client.0.smithi100.stdout:1/127: readlink d3/d16/d20/l25 0 2024-04-30T23:15:43.694 INFO:tasks.workunit.client.0.smithi100.stdout:2/74: creat d5/d12/f1a x:0 0 0 2024-04-30T23:15:43.697 INFO:tasks.workunit.client.0.smithi100.stdout:1/128: mknod d3/d18/c2e 0 2024-04-30T23:15:43.700 INFO:tasks.workunit.client.0.smithi100.stdout:2/75: symlink d5/d12/l1b 0 2024-04-30T23:15:43.702 INFO:tasks.workunit.client.0.smithi100.stdout:1/129: rmdir d3/d18 39 2024-04-30T23:15:43.702 INFO:tasks.workunit.client.0.smithi100.stdout:1/130: readlink d3/l13 0 2024-04-30T23:15:43.719 INFO:tasks.workunit.client.0.smithi100.stdout:1/131: write d3/d16/f1d [7667,66054] 0 2024-04-30T23:15:43.723 INFO:tasks.workunit.client.0.smithi100.stdout:2/76: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:43.726 INFO:tasks.workunit.client.0.smithi100.stdout:1/132: dread d3/f9 [0,4194304] 0 2024-04-30T23:15:43.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/133: dwrite d3/f21 [0,4194304] 0 2024-04-30T23:15:43.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/134: fdatasync d3/f21 0 2024-04-30T23:15:43.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/135: dread - d3/d16/d20/f2a zero size 2024-04-30T23:15:43.776 INFO:tasks.workunit.client.0.smithi100.stdout:1/136: dwrite d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/137: creat d3/f2f x:0 0 0 2024-04-30T23:15:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/138: readlink d3/d16/d20/l25 0 2024-04-30T23:15:43.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/139: stat d3/d16/d20/f2d 0 2024-04-30T23:15:43.803 INFO:tasks.workunit.client.0.smithi100.stdout:1/140: rename d3/d18/c2e to d3/db/c30 0 2024-04-30T23:15:43.824 INFO:tasks.workunit.client.0.smithi100.stdout:1/141: dwrite d3/d16/d20/f2a [0,4194304] 0 2024-04-30T23:15:43.825 INFO:tasks.workunit.client.0.smithi100.stdout:1/142: chown d3/d18 1497 1 2024-04-30T23:15:44.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:44.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:43 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:15:44.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:44.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:43 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:44.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:43 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:15:44.132 INFO:tasks.workunit.client.0.smithi100.stdout:5/97: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:3/107: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:9/51: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/91: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:8/36: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:6/100: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:2/77: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:7/98: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:1/143: sync 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:7/99: chown d0/f4 6257 1 2024-04-30T23:15:44.133 INFO:tasks.workunit.client.0.smithi100.stdout:0/67: sync 2024-04-30T23:15:44.146 INFO:tasks.workunit.client.0.smithi100.stdout:2/78: write d5/f14 [503634,57111] 0 2024-04-30T23:15:44.146 INFO:tasks.workunit.client.0.smithi100.stdout:6/101: dread d7/d11/f15 [0,4194304] 0 2024-04-30T23:15:44.169 INFO:tasks.workunit.client.0.smithi100.stdout:6/102: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:15:44.169 INFO:tasks.workunit.client.0.smithi100.stdout:6/103: fdatasync d7/d11/f15 0 2024-04-30T23:15:44.169 INFO:tasks.workunit.client.0.smithi100.stdout:6/104: fdatasync d7/fe 0 2024-04-30T23:15:44.178 INFO:tasks.workunit.client.0.smithi100.stdout:6/105: dread d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:44.181 INFO:tasks.workunit.client.0.smithi100.stdout:6/106: dread f5 [0,4194304] 0 2024-04-30T23:15:44.327 INFO:tasks.workunit.client.0.smithi100.stdout:3/108: unlink d1/f1c 0 2024-04-30T23:15:44.331 INFO:tasks.workunit.client.0.smithi100.stdout:2/79: symlink d5/d12/d13/l1c 0 2024-04-30T23:15:44.332 INFO:tasks.workunit.client.0.smithi100.stdout:2/80: readlink d5/d12/l18 0 2024-04-30T23:15:44.333 INFO:tasks.workunit.client.0.smithi100.stdout:6/107: mkdir d7/d1a/d1b 0 2024-04-30T23:15:44.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/98: creat d1/d12/d1a/f1f x:0 0 0 2024-04-30T23:15:44.336 INFO:tasks.workunit.client.0.smithi100.stdout:2/81: dread d5/f11 [0,4194304] 0 2024-04-30T23:15:44.340 INFO:tasks.workunit.client.0.smithi100.stdout:5/99: mknod d1/d12/c20 0 2024-04-30T23:15:44.341 INFO:tasks.workunit.client.0.smithi100.stdout:2/82: symlink d5/l1d 0 2024-04-30T23:15:44.343 INFO:tasks.workunit.client.0.smithi100.stdout:5/100: getdents d1 0 2024-04-30T23:15:44.345 INFO:tasks.workunit.client.0.smithi100.stdout:2/83: creat d5/d12/f1e x:0 0 0 2024-04-30T23:15:44.348 INFO:tasks.workunit.client.0.smithi100.stdout:2/84: creat d5/d12/f1f x:0 0 0 2024-04-30T23:15:44.348 INFO:tasks.workunit.client.0.smithi100.stdout:2/85: fsync d5/fe 0 2024-04-30T23:15:44.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/108: write d7/fe [1995951,61231] 0 2024-04-30T23:15:44.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/86: dread d5/f16 [0,4194304] 0 2024-04-30T23:15:44.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/87: write d5/f16 [1198401,86671] 0 2024-04-30T23:15:44.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/88: chown d5/d12/d13/f17 37907 1 2024-04-30T23:15:44.357 INFO:tasks.workunit.client.0.smithi100.stdout:3/109: dwrite d1/f13 [4194304,4194304] 0 2024-04-30T23:15:44.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/110: creat d1/d14/d15/f20 x:0 0 0 2024-04-30T23:15:44.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/111: write d1/d14/d15/f20 [695253,26396] 0 2024-04-30T23:15:44.362 INFO:tasks.workunit.client.0.smithi100.stdout:3/112: write d1/f10 [1802079,47239] 0 2024-04-30T23:15:44.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/89: dread d5/fd [0,4194304] 0 2024-04-30T23:15:44.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/90: write d5/f14 [2235885,87127] 0 2024-04-30T23:15:44.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/91: write d5/f16 [745258,13036] 0 2024-04-30T23:15:44.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/92: stat f3 0 2024-04-30T23:15:44.363 INFO:tasks.workunit.client.0.smithi100.stdout:5/101: dwrite d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:44.368 INFO:tasks.workunit.client.0.smithi100.stdout:6/109: write d7/db/f16 [1450130,33573] 0 2024-04-30T23:15:44.369 INFO:tasks.workunit.client.0.smithi100.stdout:6/110: fsync d7/d9/f12 0 2024-04-30T23:15:44.369 INFO:tasks.workunit.client.0.smithi100.stdout:6/111: stat d7/d9 0 2024-04-30T23:15:44.369 INFO:tasks.workunit.client.0.smithi100.stdout:6/112: write d7/db/f16 [262506,58840] 0 2024-04-30T23:15:44.374 INFO:tasks.workunit.client.0.smithi100.stdout:3/113: dread d1/ff [0,4194304] 0 2024-04-30T23:15:44.376 INFO:tasks.workunit.client.0.smithi100.stdout:3/114: mkdir d1/d14/d21 0 2024-04-30T23:15:44.377 INFO:tasks.workunit.client.0.smithi100.stdout:3/115: read d1/d14/d15/f20 [411782,12388] 0 2024-04-30T23:15:44.377 INFO:tasks.workunit.client.0.smithi100.stdout:3/116: readlink d1/l7 0 2024-04-30T23:15:44.388 INFO:tasks.workunit.client.0.smithi100.stdout:2/93: dwrite d5/d12/f1e [0,4194304] 0 2024-04-30T23:15:44.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/113: dread d7/fe [0,4194304] 0 2024-04-30T23:15:44.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/114: link d7/d9/f12 d7/d9/f1c 0 2024-04-30T23:15:44.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/115: chown d7/df 964 1 2024-04-30T23:15:44.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/116: write d7/d11/f15 [635445,44286] 0 2024-04-30T23:15:44.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/117: chown d7/d13 62398536 1 2024-04-30T23:15:44.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/118: write d7/d9/f1c [225481,51559] 0 2024-04-30T23:15:44.395 INFO:tasks.workunit.client.0.smithi100.stdout:6/119: creat d7/d11/f1d x:0 0 0 2024-04-30T23:15:44.398 INFO:tasks.workunit.client.0.smithi100.stdout:6/120: link l6 d7/df/l1e 0 2024-04-30T23:15:44.404 INFO:tasks.workunit.client.0.smithi100.stdout:6/121: getdents d7/df 0 2024-04-30T23:15:44.404 INFO:tasks.workunit.client.0.smithi100.stdout:6/122: write d7/d11/f1d [416703,70705] 0 2024-04-30T23:15:44.409 INFO:tasks.workunit.client.0.smithi100.stdout:2/94: write f1 [2325679,8250] 0 2024-04-30T23:15:44.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/117: dwrite d1/d14/d15/f16 [0,4194304] 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/95: symlink d5/d12/d13/l20 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/96: write d5/f14 [2529401,11319] 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/97: write d5/f14 [1262835,63520] 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/98: fdatasync d5/fd 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/99: readlink d5/la 0 2024-04-30T23:15:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/100: fdatasync f3 0 2024-04-30T23:15:44.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/101: unlink f3 0 2024-04-30T23:15:44.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/102: chown d5/f16 1392985 1 2024-04-30T23:15:44.415 INFO:tasks.workunit.client.0.smithi100.stdout:6/123: dread d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:44.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/118: dread d1/d14/d15/f20 [0,4194304] 0 2024-04-30T23:15:44.423 INFO:tasks.workunit.client.0.smithi100.stdout:6/124: dread d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:44.425 INFO:tasks.workunit.client.0.smithi100.stdout:6/125: mknod d7/df/c1f 0 2024-04-30T23:15:44.427 INFO:tasks.workunit.client.0.smithi100.stdout:6/126: creat d7/f20 x:0 0 0 2024-04-30T23:15:44.430 INFO:tasks.workunit.client.0.smithi100.stdout:6/127: creat d7/f21 x:0 0 0 2024-04-30T23:15:44.430 INFO:tasks.workunit.client.0.smithi100.stdout:6/128: dread - d7/f20 zero size 2024-04-30T23:15:44.446 INFO:tasks.workunit.client.0.smithi100.stdout:2/103: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:44.448 INFO:tasks.workunit.client.0.smithi100.stdout:2/104: symlink d5/l21 0 2024-04-30T23:15:44.450 INFO:tasks.workunit.client.0.smithi100.stdout:2/105: mkdir d5/d22 0 2024-04-30T23:15:44.450 INFO:tasks.workunit.client.0.smithi100.stdout:2/106: readlink d5/d12/d13/l20 0 2024-04-30T23:15:44.451 INFO:tasks.workunit.client.0.smithi100.stdout:2/107: symlink d5/d22/l23 0 2024-04-30T23:15:44.452 INFO:tasks.workunit.client.0.smithi100.stdout:2/108: link d5/c6 d5/d22/c24 0 2024-04-30T23:15:44.461 INFO:tasks.workunit.client.0.smithi100.stdout:6/129: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:15:44.478 INFO:tasks.workunit.client.0.smithi100.stdout:2/109: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:44.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/110: dread f1 [0,4194304] 0 2024-04-30T23:15:44.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/111: readlink d5/d12/l1b 0 2024-04-30T23:15:44.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/112: fsync d5/f11 0 2024-04-30T23:15:44.493 INFO:tasks.workunit.client.0.smithi100.stdout:6/130: dwrite d7/fe [0,4194304] 0 2024-04-30T23:15:44.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/113: creat d5/f25 x:0 0 0 2024-04-30T23:15:44.496 INFO:tasks.workunit.client.0.smithi100.stdout:6/131: mkdir d7/d1a/d1b/d22 0 2024-04-30T23:15:44.496 INFO:tasks.workunit.client.0.smithi100.stdout:6/132: chown d7/d13/l14 13387 1 2024-04-30T23:15:44.497 INFO:tasks.workunit.client.0.smithi100.stdout:2/114: mkdir d5/d26 0 2024-04-30T23:15:44.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/115: unlink l4 0 2024-04-30T23:15:44.512 INFO:tasks.workunit.client.0.smithi100.stdout:6/133: getdents d7 0 2024-04-30T23:15:44.512 INFO:tasks.workunit.client.0.smithi100.stdout:6/134: fdatasync d7/d9/f12 0 2024-04-30T23:15:44.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/135: mkdir d7/df/d23 0 2024-04-30T23:15:44.516 INFO:tasks.workunit.client.0.smithi100.stdout:4/92: getdents . 0 2024-04-30T23:15:44.517 INFO:tasks.workunit.client.0.smithi100.stdout:6/136: mkdir d7/df/d23/d24 0 2024-04-30T23:15:44.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/137: truncate f5 259286 0 2024-04-30T23:15:44.520 INFO:tasks.workunit.client.0.smithi100.stdout:6/138: symlink d7/df/l25 0 2024-04-30T23:15:44.522 INFO:tasks.workunit.client.0.smithi100.stdout:2/116: dwrite d5/d12/d13/f17 [0,4194304] 0 2024-04-30T23:15:44.525 INFO:tasks.workunit.client.0.smithi100.stdout:2/117: mknod d5/d12/d13/c27 0 2024-04-30T23:15:44.527 INFO:tasks.workunit.client.0.smithi100.stdout:2/118: creat d5/f28 x:0 0 0 2024-04-30T23:15:44.551 INFO:tasks.workunit.client.0.smithi100.stdout:2/119: dwrite d5/d12/f1f [0,4194304] 0 2024-04-30T23:15:44.551 INFO:tasks.workunit.client.0.smithi100.stdout:2/120: write d5/d12/d13/f17 [5131443,99465] 0 2024-04-30T23:15:44.555 INFO:tasks.workunit.client.0.smithi100.stdout:2/121: mknod d5/c29 0 2024-04-30T23:15:44.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/122: dwrite d5/d12/f1a [0,4194304] 0 2024-04-30T23:15:44.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/123: write d5/fe [1277780,125496] 0 2024-04-30T23:15:44.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/124: chown f1 0 1 2024-04-30T23:15:44.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/125: chown d5/d12/l1b 10 1 2024-04-30T23:15:44.602 INFO:tasks.workunit.client.0.smithi100.stdout:2/126: creat d5/d12/d13/f2a x:0 0 0 2024-04-30T23:15:44.627 INFO:tasks.workunit.client.0.smithi100.stdout:2/127: creat d5/d12/f2b x:0 0 0 2024-04-30T23:15:44.630 INFO:tasks.workunit.client.0.smithi100.stdout:4/93: link cd c17 0 2024-04-30T23:15:44.669 INFO:tasks.workunit.client.0.smithi100.stdout:2/128: link d5/f16 d5/d22/f2c 0 2024-04-30T23:15:44.672 INFO:tasks.workunit.client.0.smithi100.stdout:4/94: chown cd 1528982 1 2024-04-30T23:15:44.712 INFO:tasks.workunit.client.0.smithi100.stdout:8/37: mknod d2/cb 0 2024-04-30T23:15:44.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/68: rename d2/l13 to d2/d14/l15 0 2024-04-30T23:15:44.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/69: chown d2/lf 43441069 1 2024-04-30T23:15:44.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/70: dread - d2/f12 zero size 2024-04-30T23:15:44.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/100: link d0/c11 d0/df/d19/c25 0 2024-04-30T23:15:44.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/101: chown d0 146584 1 2024-04-30T23:15:44.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/102: dread - d0/f17 zero size 2024-04-30T23:15:44.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/129: creat d5/f2d x:0 0 0 2024-04-30T23:15:44.750 INFO:tasks.workunit.client.0.smithi100.stdout:0/71: dwrite d2/fc [0,4194304] 0 2024-04-30T23:15:44.751 INFO:tasks.workunit.client.0.smithi100.stdout:1/144: symlink d3/d16/d20/l31 0 2024-04-30T23:15:44.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/52: mknod d4/d7/d8/cc 0 2024-04-30T23:15:44.796 INFO:tasks.workunit.client.0.smithi100.stdout:9/53: dwrite f0 [4194304,4194304] 0 2024-04-30T23:15:44.800 INFO:tasks.workunit.client.0.smithi100.stdout:6/139: sync 2024-04-30T23:15:44.800 INFO:tasks.workunit.client.0.smithi100.stdout:3/119: sync 2024-04-30T23:15:44.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/54: dwrite f3 [0,4194304] 0 2024-04-30T23:15:44.845 INFO:tasks.workunit.client.0.smithi100.stdout:5/102: rename d1/fc to d1/d12/f21 0 2024-04-30T23:15:44.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/38: rename d2 to d2/d7/dc 22 2024-04-30T23:15:44.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/39: read - d2/f6 zero size 2024-04-30T23:15:44.857 INFO:tasks.workunit.client.0.smithi100.stdout:5/103: dread d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:44.879 INFO:tasks.workunit.client.0.smithi100.stdout:2/130: truncate d5/fe 575695 0 2024-04-30T23:15:44.891 INFO:tasks.workunit.client.0.smithi100.stdout:0/72: creat d2/d14/f16 x:0 0 0 2024-04-30T23:15:44.892 INFO:tasks.workunit.client.0.smithi100.stdout:1/145: rmdir d3/d18 39 2024-04-30T23:15:44.894 INFO:tasks.workunit.client.0.smithi100.stdout:2/131: dread d5/d12/f1f [0,4194304] 0 2024-04-30T23:15:44.949 INFO:tasks.workunit.client.0.smithi100.stdout:6/140: unlink l3 0 2024-04-30T23:15:44.969 INFO:tasks.workunit.client.0.smithi100.stdout:6/141: dwrite d7/d11/f15 [0,4194304] 0 2024-04-30T23:15:44.979 INFO:tasks.workunit.client.0.smithi100.stdout:9/55: creat d4/fd x:0 0 0 2024-04-30T23:15:45.008 INFO:tasks.workunit.client.0.smithi100.stdout:7/103: rename d0/d1b/d1e/c20 to d0/d1b/d24/c26 0 2024-04-30T23:15:45.009 INFO:tasks.workunit.client.0.smithi100.stdout:7/104: read - d0/df/f22 zero size 2024-04-30T23:15:45.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/40: mknod d2/d5/cd 0 2024-04-30T23:15:45.021 INFO:tasks.workunit.client.0.smithi100.stdout:5/104: creat d1/d12/d1a/f22 x:0 0 0 2024-04-30T23:15:45.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/41: dwrite d2/f8 [0,4194304] 0 2024-04-30T23:15:45.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: pgmap v437: 129 pgs: 129 active+clean; 194 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 15 MiB/s wr, 500 op/s 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:15:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:44 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:15:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: pgmap v437: 129 pgs: 129 active+clean; 194 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 15 MiB/s wr, 500 op/s 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:15:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:44 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:15:45.054 INFO:tasks.workunit.client.0.smithi100.stdout:8/42: write d2/f4 [7537916,55470] 0 2024-04-30T23:15:45.055 INFO:tasks.workunit.client.0.smithi100.stdout:0/73: rename d2/lf to d2/l17 0 2024-04-30T23:15:45.055 INFO:tasks.workunit.client.0.smithi100.stdout:0/74: fdatasync d2/f7 0 2024-04-30T23:15:45.059 INFO:tasks.workunit.client.0.smithi100.stdout:1/146: creat d3/d16/d20/d24/f32 x:0 0 0 2024-04-30T23:15:45.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/132: mkdir d5/d2e 0 2024-04-30T23:15:45.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/133: readlink d5/d12/l18 0 2024-04-30T23:15:45.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/134: fdatasync d5/fe 0 2024-04-30T23:15:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: pgmap v437: 129 pgs: 129 active+clean; 194 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 15 MiB/s wr, 500 op/s 2024-04-30T23:15:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:45.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:15:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:15:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:44 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:15:45.074 INFO:tasks.workunit.client.0.smithi100.stdout:4/95: link f3 f18 0 2024-04-30T23:15:45.171 INFO:tasks.workunit.client.0.smithi100.stdout:6/142: creat d7/d13/f26 x:0 0 0 2024-04-30T23:15:45.171 INFO:tasks.workunit.client.0.smithi100.stdout:6/143: chown d7/fe 30 1 2024-04-30T23:15:45.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/56: mknod d4/d9/ce 0 2024-04-30T23:15:45.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/144: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:45.201 INFO:tasks.workunit.client.0.smithi100.stdout:9/57: dwrite f2 [0,4194304] 0 2024-04-30T23:15:45.205 INFO:tasks.workunit.client.0.smithi100.stdout:7/105: mknod d0/c27 0 2024-04-30T23:15:45.224 INFO:tasks.workunit.client.0.smithi100.stdout:5/105: rename d1/f1d to d1/d12/f23 0 2024-04-30T23:15:45.224 INFO:tasks.workunit.client.0.smithi100.stdout:5/106: read d1/f7 [142705,56300] 0 2024-04-30T23:15:45.261 INFO:tasks.workunit.client.0.smithi100.stdout:8/43: rename d2/d5 to d2/de 0 2024-04-30T23:15:45.261 INFO:tasks.workunit.client.0.smithi100.stdout:8/44: chown l1 2428222 1 2024-04-30T23:15:45.261 INFO:tasks.workunit.client.0.smithi100.stdout:8/45: chown d2/cb 1 1 2024-04-30T23:15:45.261 INFO:tasks.workunit.client.0.smithi100.stdout:8/46: readlink l1 0 2024-04-30T23:15:45.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/75: mkdir d2/d14/d18 0 2024-04-30T23:15:45.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/147: rmdir d3/d16/d20/d24 39 2024-04-30T23:15:45.267 INFO:tasks.workunit.client.0.smithi100.stdout:2/135: mkdir d5/d26/d2f 0 2024-04-30T23:15:45.267 INFO:tasks.workunit.client.0.smithi100.stdout:2/136: chown d5/f28 7337 1 2024-04-30T23:15:45.426 INFO:tasks.workunit.client.0.smithi100.stdout:3/120: sync 2024-04-30T23:15:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:6/145: creat d7/f27 x:0 0 0 2024-04-30T23:15:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:6/146: read f5 [23673,64262] 0 2024-04-30T23:15:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:6/147: write d7/f27 [559792,130398] 0 2024-04-30T23:15:45.456 INFO:tasks.workunit.client.0.smithi100.stdout:9/58: getdents d4 0 2024-04-30T23:15:45.465 INFO:tasks.workunit.client.0.smithi100.stdout:7/106: creat d0/d1b/d1e/f28 x:0 0 0 2024-04-30T23:15:45.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/59: dread f0 [4194304,4194304] 0 2024-04-30T23:15:45.477 INFO:tasks.workunit.client.0.smithi100.stdout:5/107: mkdir d1/d12/d24 0 2024-04-30T23:15:45.526 INFO:tasks.workunit.client.0.smithi100.stdout:8/47: link d2/f4 d2/ff 0 2024-04-30T23:15:45.529 INFO:tasks.workunit.client.0.smithi100.stdout:0/76: creat d2/d14/f19 x:0 0 0 2024-04-30T23:15:45.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/148: unlink d3/f10 0 2024-04-30T23:15:45.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/149: chown d3/d18 59 1 2024-04-30T23:15:45.541 INFO:tasks.workunit.client.0.smithi100.stdout:2/137: creat d5/d2e/f30 x:0 0 0 2024-04-30T23:15:45.551 INFO:tasks.workunit.client.0.smithi100.stdout:0/77: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:45.551 INFO:tasks.workunit.client.0.smithi100.stdout:0/78: write d2/fc [4985574,11308] 0 2024-04-30T23:15:45.568 INFO:tasks.workunit.client.0.smithi100.stdout:4/96: mkdir d19 0 2024-04-30T23:15:45.801 INFO:tasks.workunit.client.0.smithi100.stdout:3/121: mkdir d1/d14/d21/d22 0 2024-04-30T23:15:45.829 INFO:tasks.workunit.client.0.smithi100.stdout:6/148: creat d7/d9/f28 x:0 0 0 2024-04-30T23:15:45.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/149: dread d7/f27 [0,4194304] 0 2024-04-30T23:15:45.866 INFO:tasks.workunit.client.0.smithi100.stdout:7/107: creat d0/df/f29 x:0 0 0 2024-04-30T23:15:45.867 INFO:tasks.workunit.client.0.smithi100.stdout:7/108: fsync d0/f16 0 2024-04-30T23:15:45.889 INFO:tasks.workunit.client.0.smithi100.stdout:5/108: creat d1/d12/d24/f25 x:0 0 0 2024-04-30T23:15:45.960 INFO:tasks.workunit.client.0.smithi100.stdout:8/48: mkdir d2/de/d10 0 2024-04-30T23:15:45.961 INFO:tasks.workunit.client.0.smithi100.stdout:8/49: fsync d2/f4 0 2024-04-30T23:15:45.978 INFO:tasks.workunit.client.0.smithi100.stdout:1/150: rmdir d3 39 2024-04-30T23:15:45.981 INFO:tasks.workunit.client.0.smithi100.stdout:2/138: mknod d5/d2e/c31 0 2024-04-30T23:15:45.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/151: dread d3/f21 [0,4194304] 0 2024-04-30T23:15:45.997 INFO:tasks.workunit.client.0.smithi100.stdout:0/79: unlink d2/l17 0 2024-04-30T23:15:46.025 INFO:tasks.workunit.client.0.smithi100.stdout:4/97: mkdir d19/d1a 0 2024-04-30T23:15:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:45 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:45 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:46.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:45 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:46.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:45 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:46.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:45 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:45 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:46.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:45 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:46.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:45 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:46.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:45 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:46.469 INFO:tasks.workunit.client.0.smithi100.stdout:6/150: unlink c1 0 2024-04-30T23:15:46.527 INFO:tasks.workunit.client.0.smithi100.stdout:7/109: mkdir d0/d1b/d24/d2a 0 2024-04-30T23:15:46.554 INFO:tasks.workunit.client.0.smithi100.stdout:9/60: truncate f2 1406527 0 2024-04-30T23:15:46.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/109: creat d1/d12/d1a/f26 x:0 0 0 2024-04-30T23:15:46.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/110: chown d1/f3 6052 1 2024-04-30T23:15:46.585 INFO:tasks.workunit.client.0.smithi100.stdout:5/111: dread d1/d12/f21 [0,4194304] 0 2024-04-30T23:15:46.650 INFO:tasks.workunit.client.0.smithi100.stdout:8/50: symlink d2/de/l11 0 2024-04-30T23:15:46.659 INFO:tasks.workunit.client.0.smithi100.stdout:2/139: creat d5/f32 x:0 0 0 2024-04-30T23:15:46.659 INFO:tasks.workunit.client.0.smithi100.stdout:2/140: chown d5/cb 108501691 1 2024-04-30T23:15:46.670 INFO:tasks.workunit.client.0.smithi100.stdout:1/152: rename d3/f21 to d3/d16/d20/f33 0 2024-04-30T23:15:46.670 INFO:tasks.workunit.client.0.smithi100.stdout:1/153: fsync d3/f26 0 2024-04-30T23:15:46.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/141: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:46.673 INFO:tasks.workunit.client.0.smithi100.stdout:0/80: mknod d2/d14/c1a 0 2024-04-30T23:15:46.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/81: chown l0 7757 1 2024-04-30T23:15:46.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/82: dread - d2/d14/f16 zero size 2024-04-30T23:15:46.867 INFO:tasks.workunit.client.0.smithi100.stdout:3/122: sync 2024-04-30T23:15:46.867 INFO:tasks.workunit.client.0.smithi100.stdout:3/123: read - d1/d14/f19 zero size 2024-04-30T23:15:47.004 INFO:tasks.workunit.client.0.smithi100.stdout:6/151: mknod d7/df/c29 0 2024-04-30T23:15:47.004 INFO:tasks.workunit.client.0.smithi100.stdout:6/152: fdatasync f5 0 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/110: creat d0/d1b/f2b x:0 0 0 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/111: chown d0/c11 74 1 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/112: write d0/f12 [273044,54874] 0 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/113: dread - d0/df/f21 zero size 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/114: dread - d0/df/f29 zero size 2024-04-30T23:15:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/115: truncate d0/df/f29 171779 0 2024-04-30T23:15:47.042 INFO:tasks.workunit.client.0.smithi100.stdout:7/116: dread d0/f4 [0,4194304] 0 2024-04-30T23:15:47.043 INFO:tasks.workunit.client.0.smithi100.stdout:9/61: getdents d4/d7 0 2024-04-30T23:15:47.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: pgmap v438: 129 pgs: 129 active+clean; 308 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 32 MiB/s wr, 522 op/s 2024-04-30T23:15:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:46 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:47.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: pgmap v438: 129 pgs: 129 active+clean; 308 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 32 MiB/s wr, 522 op/s 2024-04-30T23:15:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:46 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:47.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/112: mkdir d1/d12/d27 0 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: pgmap v438: 129 pgs: 129 active+clean; 308 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 32 MiB/s wr, 522 op/s 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:46 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:47.110 INFO:tasks.workunit.client.0.smithi100.stdout:8/51: creat d2/d7/f12 x:0 0 0 2024-04-30T23:15:47.110 INFO:tasks.workunit.client.0.smithi100.stdout:8/52: read - d2/f9 zero size 2024-04-30T23:15:47.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/142: symlink d5/d12/l33 0 2024-04-30T23:15:47.125 INFO:tasks.workunit.client.0.smithi100.stdout:0/83: rename d2/d14/f16 to d2/d14/d18/f1b 0 2024-04-30T23:15:47.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/154: rename d3/d16/d20/l31 to d3/d16/d20/l34 0 2024-04-30T23:15:47.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/155: chown d3/d16/d20/d24 32436 1 2024-04-30T23:15:47.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/156: fsync d3/f9 0 2024-04-30T23:15:47.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/98: truncate f11 3002509 0 2024-04-30T23:15:47.145 INFO:tasks.workunit.client.0.smithi100.stdout:1/157: write d3/d16/d20/f2a [3539141,91719] 0 2024-04-30T23:15:47.157 INFO:tasks.workunit.client.0.smithi100.stdout:4/99: write f3 [1759975,123307] 0 2024-04-30T23:15:47.230 INFO:tasks.workunit.client.0.smithi100.stdout:3/124: creat d1/d14/d21/d22/f23 x:0 0 0 2024-04-30T23:15:47.307 INFO:tasks.workunit.client.0.smithi100.stdout:6/153: truncate d7/db/f16 1932727 0 2024-04-30T23:15:47.341 INFO:tasks.workunit.client.0.smithi100.stdout:7/117: rmdir d0/d1b 39 2024-04-30T23:15:47.342 INFO:tasks.workunit.client.0.smithi100.stdout:9/62: mknod d4/d7/d8/cf 0 2024-04-30T23:15:47.342 INFO:tasks.workunit.client.0.smithi100.stdout:9/63: truncate f1 1049829 0 2024-04-30T23:15:47.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/113: symlink d1/l28 0 2024-04-30T23:15:47.373 INFO:tasks.workunit.client.0.smithi100.stdout:5/114: dwrite d1/f7 [0,4194304] 0 2024-04-30T23:15:47.373 INFO:tasks.workunit.client.0.smithi100.stdout:2/143: symlink d5/d12/d13/l34 0 2024-04-30T23:15:47.374 INFO:tasks.workunit.client.0.smithi100.stdout:0/84: mknod d2/d14/d18/c1c 0 2024-04-30T23:15:47.375 INFO:tasks.workunit.client.0.smithi100.stdout:1/158: getdents d3/db 0 2024-04-30T23:15:47.375 INFO:tasks.workunit.client.0.smithi100.stdout:1/159: chown d3/c12 1498 1 2024-04-30T23:15:47.377 INFO:tasks.workunit.client.0.smithi100.stdout:6/154: truncate d7/d9/f1c 2791700 0 2024-04-30T23:15:47.378 INFO:tasks.workunit.client.0.smithi100.stdout:7/118: getdents d0 0 2024-04-30T23:15:47.378 INFO:tasks.workunit.client.0.smithi100.stdout:7/119: write d0/f8 [589689,2363] 0 2024-04-30T23:15:47.379 INFO:tasks.workunit.client.0.smithi100.stdout:6/155: read d7/f27 [6495,105476] 0 2024-04-30T23:15:47.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/64: mkdir d4/d9/d10 0 2024-04-30T23:15:47.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/65: write f2 [1588720,41121] 0 2024-04-30T23:15:47.384 INFO:tasks.workunit.client.0.smithi100.stdout:5/115: creat d1/d12/d27/f29 x:0 0 0 2024-04-30T23:15:47.384 INFO:tasks.workunit.client.0.smithi100.stdout:2/144: creat d5/d2e/f35 x:0 0 0 2024-04-30T23:15:47.384 INFO:tasks.workunit.client.0.smithi100.stdout:5/116: read - d1/d12/d24/f25 zero size 2024-04-30T23:15:47.384 INFO:tasks.workunit.client.0.smithi100.stdout:5/117: chown d1/l28 35 1 2024-04-30T23:15:47.384 INFO:tasks.workunit.client.0.smithi100.stdout:0/85: link d2/fc d2/d14/f1d 0 2024-04-30T23:15:47.387 INFO:tasks.workunit.client.0.smithi100.stdout:4/100: rename c1 to d19/d1a/c1b 0 2024-04-30T23:15:47.387 INFO:tasks.workunit.client.0.smithi100.stdout:4/101: write f3 [4775176,91362] 0 2024-04-30T23:15:47.388 INFO:tasks.workunit.client.0.smithi100.stdout:7/120: mknod d0/d1b/c2c 0 2024-04-30T23:15:47.390 INFO:tasks.workunit.client.0.smithi100.stdout:6/156: unlink d7/df/l25 0 2024-04-30T23:15:47.391 INFO:tasks.workunit.client.0.smithi100.stdout:5/118: mknod d1/d12/d24/c2a 0 2024-04-30T23:15:47.394 INFO:tasks.workunit.client.0.smithi100.stdout:3/125: rename d1/l18 to d1/d14/d21/d22/l24 0 2024-04-30T23:15:47.395 INFO:tasks.workunit.client.0.smithi100.stdout:4/102: fdatasync f13 0 2024-04-30T23:15:47.397 INFO:tasks.workunit.client.0.smithi100.stdout:7/121: creat d0/df/d19/f2d x:0 0 0 2024-04-30T23:15:47.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/126: creat d1/f25 x:0 0 0 2024-04-30T23:15:47.401 INFO:tasks.workunit.client.0.smithi100.stdout:1/160: rename d3/lf to d3/d16/d20/d24/l35 0 2024-04-30T23:15:47.401 INFO:tasks.workunit.client.0.smithi100.stdout:1/161: write d3/f2f [169872,18443] 0 2024-04-30T23:15:47.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/127: rmdir d1 39 2024-04-30T23:15:47.404 INFO:tasks.workunit.client.0.smithi100.stdout:0/86: dread d2/f3 [0,4194304] 0 2024-04-30T23:15:47.405 INFO:tasks.workunit.client.0.smithi100.stdout:1/162: creat d3/d16/f36 x:0 0 0 2024-04-30T23:15:47.409 INFO:tasks.workunit.client.0.smithi100.stdout:0/87: creat d2/f1e x:0 0 0 2024-04-30T23:15:47.411 INFO:tasks.workunit.client.0.smithi100.stdout:1/163: unlink d3/d16/d20/f2d 0 2024-04-30T23:15:47.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/145: rename d5/fd to d5/d26/d2f/f36 0 2024-04-30T23:15:47.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/146: readlink d5/d12/d13/l1c 0 2024-04-30T23:15:47.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/103: rename c7 to d19/c1c 0 2024-04-30T23:15:47.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/104: stat cf 0 2024-04-30T23:15:47.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/164: dwrite d3/f4 [0,4194304] 0 2024-04-30T23:15:47.437 INFO:tasks.workunit.client.0.smithi100.stdout:1/165: fdatasync d3/f2f 0 2024-04-30T23:15:47.438 INFO:tasks.workunit.client.0.smithi100.stdout:1/166: rename d3/db/c2c to d3/db/c37 0 2024-04-30T23:15:47.439 INFO:tasks.workunit.client.0.smithi100.stdout:4/105: dread f13 [0,4194304] 0 2024-04-30T23:15:47.443 INFO:tasks.workunit.client.0.smithi100.stdout:4/106: link c17 d19/d1a/c1d 0 2024-04-30T23:15:47.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/107: creat d19/d1a/f1e x:0 0 0 2024-04-30T23:15:47.445 INFO:tasks.workunit.client.0.smithi100.stdout:4/108: mknod d19/d1a/c1f 0 2024-04-30T23:15:47.446 INFO:tasks.workunit.client.0.smithi100.stdout:4/109: truncate f12 6576158 0 2024-04-30T23:15:47.461 INFO:tasks.workunit.client.0.smithi100.stdout:1/167: dwrite d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:47.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/53: sync 2024-04-30T23:15:47.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/54: readlink l1 0 2024-04-30T23:15:47.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/55: mkdir d2/d7/d13 0 2024-04-30T23:15:47.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/56: fdatasync d2/ff 0 2024-04-30T23:15:47.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/57: chown d2/f9 7158 1 2024-04-30T23:15:47.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/122: write d0/fe [3672597,75404] 0 2024-04-30T23:15:47.475 INFO:tasks.workunit.client.0.smithi100.stdout:9/66: dwrite f1 [0,4194304] 0 2024-04-30T23:15:47.480 INFO:tasks.workunit.client.0.smithi100.stdout:0/88: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:47.480 INFO:tasks.workunit.client.0.smithi100.stdout:0/89: fsync d2/d14/f1d 0 2024-04-30T23:15:47.482 INFO:tasks.workunit.client.0.smithi100.stdout:0/90: creat d2/d14/d18/f1f x:0 0 0 2024-04-30T23:15:47.483 INFO:tasks.workunit.client.0.smithi100.stdout:4/110: dwrite f8 [0,4194304] 0 2024-04-30T23:15:47.485 INFO:tasks.workunit.client.0.smithi100.stdout:0/91: symlink d2/d14/l20 0 2024-04-30T23:15:47.485 INFO:tasks.workunit.client.0.smithi100.stdout:0/92: readlink d2/l6 0 2024-04-30T23:15:47.486 INFO:tasks.workunit.client.0.smithi100.stdout:6/157: dwrite d7/f20 [0,4194304] 0 2024-04-30T23:15:47.489 INFO:tasks.workunit.client.0.smithi100.stdout:0/93: mknod d2/d14/c21 0 2024-04-30T23:15:47.489 INFO:tasks.workunit.client.0.smithi100.stdout:0/94: truncate d2/d14/f19 707194 0 2024-04-30T23:15:47.491 INFO:tasks.workunit.client.0.smithi100.stdout:3/128: dread d1/fc [0,4194304] 0 2024-04-30T23:15:47.492 INFO:tasks.workunit.client.0.smithi100.stdout:6/158: dread f5 [0,4194304] 0 2024-04-30T23:15:47.493 INFO:tasks.workunit.client.0.smithi100.stdout:6/159: getdents d7/d9 0 2024-04-30T23:15:47.494 INFO:tasks.workunit.client.0.smithi100.stdout:1/168: dread d3/f8 [0,4194304] 0 2024-04-30T23:15:47.494 INFO:tasks.workunit.client.0.smithi100.stdout:7/123: fsync d0/fe 0 2024-04-30T23:15:47.494 INFO:tasks.workunit.client.0.smithi100.stdout:7/124: write d0/f16 [101028,98992] 0 2024-04-30T23:15:47.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/147: dwrite d5/f2d [0,4194304] 0 2024-04-30T23:15:47.494 INFO:tasks.workunit.client.0.smithi100.stdout:6/160: mknod d7/c2a 0 2024-04-30T23:15:47.496 INFO:tasks.workunit.client.0.smithi100.stdout:2/148: write d5/d22/f2c [135248,16562] 0 2024-04-30T23:15:47.498 INFO:tasks.workunit.client.0.smithi100.stdout:8/58: dwrite d2/f3 [8388608,4194304] 0 2024-04-30T23:15:47.498 INFO:tasks.workunit.client.0.smithi100.stdout:8/59: chown d2/f3 24 1 2024-04-30T23:15:47.500 INFO:tasks.workunit.client.0.smithi100.stdout:6/161: mkdir d7/df/d23/d2b 0 2024-04-30T23:15:47.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/162: truncate d7/fe 3072158 0 2024-04-30T23:15:47.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/163: stat f5 0 2024-04-30T23:15:47.504 INFO:tasks.workunit.client.0.smithi100.stdout:6/164: link d7/c2a d7/db/c2c 0 2024-04-30T23:15:47.506 INFO:tasks.workunit.client.0.smithi100.stdout:9/67: write f3 [3404243,55319] 0 2024-04-30T23:15:47.510 INFO:tasks.workunit.client.0.smithi100.stdout:9/68: mknod d4/d9/d10/c11 0 2024-04-30T23:15:47.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/125: rmdir d0/df 39 2024-04-30T23:15:47.514 INFO:tasks.workunit.client.0.smithi100.stdout:2/149: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:47.514 INFO:tasks.workunit.client.0.smithi100.stdout:9/69: creat d4/d7/f12 x:0 0 0 2024-04-30T23:15:47.515 INFO:tasks.workunit.client.0.smithi100.stdout:7/126: mkdir d0/d1b/d2e 0 2024-04-30T23:15:47.518 INFO:tasks.workunit.client.0.smithi100.stdout:8/60: write d2/f3 [11430510,53820] 0 2024-04-30T23:15:47.518 INFO:tasks.workunit.client.0.smithi100.stdout:0/95: write d2/fc [1670700,65634] 0 2024-04-30T23:15:47.518 INFO:tasks.workunit.client.0.smithi100.stdout:0/96: chown d2/d14/d18/f1b 17521068 1 2024-04-30T23:15:47.518 INFO:tasks.workunit.client.0.smithi100.stdout:0/97: write d2/fb [3977751,103738] 0 2024-04-30T23:15:47.518 INFO:tasks.workunit.client.0.smithi100.stdout:0/98: write d2/fd [751161,82323] 0 2024-04-30T23:15:47.519 INFO:tasks.workunit.client.0.smithi100.stdout:8/61: mknod d2/d7/d13/c14 0 2024-04-30T23:15:47.519 INFO:tasks.workunit.client.0.smithi100.stdout:8/62: dread - d2/f6 zero size 2024-04-30T23:15:47.519 INFO:tasks.workunit.client.0.smithi100.stdout:9/70: fdatasync f3 0 2024-04-30T23:15:47.521 INFO:tasks.workunit.client.0.smithi100.stdout:8/63: creat d2/d7/d13/f15 x:0 0 0 2024-04-30T23:15:47.521 INFO:tasks.workunit.client.0.smithi100.stdout:8/64: stat d2/f3 0 2024-04-30T23:15:47.523 INFO:tasks.workunit.client.0.smithi100.stdout:8/65: getdents d2/d7 0 2024-04-30T23:15:47.525 INFO:tasks.workunit.client.0.smithi100.stdout:8/66: link l1 d2/d7/l16 0 2024-04-30T23:15:47.526 INFO:tasks.workunit.client.0.smithi100.stdout:8/67: mkdir d2/de/d10/d17 0 2024-04-30T23:15:47.531 INFO:tasks.workunit.client.0.smithi100.stdout:3/129: dwrite d1/d14/f19 [0,4194304] 0 2024-04-30T23:15:47.531 INFO:tasks.workunit.client.0.smithi100.stdout:3/130: read d1/f8 [465286,130150] 0 2024-04-30T23:15:47.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/131: rmdir d1/d14/d15 39 2024-04-30T23:15:47.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/132: write d1/d14/d15/f20 [1144989,67894] 0 2024-04-30T23:15:47.539 INFO:tasks.workunit.client.0.smithi100.stdout:4/111: dwrite f3 [0,4194304] 0 2024-04-30T23:15:47.539 INFO:tasks.workunit.client.0.smithi100.stdout:1/169: dread d3/f5 [0,4194304] 0 2024-04-30T23:15:47.540 INFO:tasks.workunit.client.0.smithi100.stdout:1/170: fsync d3/f8 0 2024-04-30T23:15:47.541 INFO:tasks.workunit.client.0.smithi100.stdout:1/171: mknod d3/d18/c38 0 2024-04-30T23:15:47.543 INFO:tasks.workunit.client.0.smithi100.stdout:1/172: creat d3/db/f39 x:0 0 0 2024-04-30T23:15:47.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/71: dwrite f3 [0,4194304] 0 2024-04-30T23:15:47.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/72: truncate f1 4845261 0 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/73: creat d4/f13 x:0 0 0 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/74: rename d4/d7 to d4/d7/d14 22 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/75: rename d4/d7/d8 to d4/d7/d8/d15 22 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/76: write f2 [2371559,57616] 0 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/77: truncate f1 5146438 0 2024-04-30T23:15:47.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/78: stat d4/d9/d10/c11 0 2024-04-30T23:15:47.558 INFO:tasks.workunit.client.0.smithi100.stdout:3/133: dread d1/fc [0,4194304] 0 2024-04-30T23:15:47.558 INFO:tasks.workunit.client.0.smithi100.stdout:3/134: write d1/f8 [3895063,44133] 0 2024-04-30T23:15:47.560 INFO:tasks.workunit.client.0.smithi100.stdout:3/135: rename d1/d14/d21/d22 to d1/d14/d15/d1e/d26 0 2024-04-30T23:15:47.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/136: fdatasync d1/ff 0 2024-04-30T23:15:47.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/137: mkdir d1/d14/d15/d27 0 2024-04-30T23:15:47.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/138: chown d1/f13 971 1 2024-04-30T23:15:47.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/173: dread d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:47.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/174: chown d3/f8 9231642 1 2024-04-30T23:15:47.564 INFO:tasks.workunit.client.0.smithi100.stdout:3/139: creat d1/d14/d15/d1e/d26/f28 x:0 0 0 2024-04-30T23:15:47.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/79: write f2 [1106032,32774] 0 2024-04-30T23:15:47.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/80: dread - d4/d7/f12 zero size 2024-04-30T23:15:47.565 INFO:tasks.workunit.client.0.smithi100.stdout:1/175: symlink d3/d16/l3a 0 2024-04-30T23:15:47.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/112: write f13 [2802904,80605] 0 2024-04-30T23:15:47.566 INFO:tasks.workunit.client.0.smithi100.stdout:8/68: dwrite d2/d7/d13/f15 [0,4194304] 0 2024-04-30T23:15:47.566 INFO:tasks.workunit.client.0.smithi100.stdout:3/140: truncate d1/fa 467945 0 2024-04-30T23:15:47.567 INFO:tasks.workunit.client.0.smithi100.stdout:9/81: creat d4/d9/f16 x:0 0 0 2024-04-30T23:15:47.571 INFO:tasks.workunit.client.0.smithi100.stdout:3/141: symlink d1/d14/d15/d27/l29 0 2024-04-30T23:15:47.571 INFO:tasks.workunit.client.0.smithi100.stdout:3/142: truncate d1/d14/d15/d1e/d26/f23 459826 0 2024-04-30T23:15:47.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/69: rename d2/d7/d13 to d2/d7/d18 0 2024-04-30T23:15:47.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/70: chown d2/f9 140 1 2024-04-30T23:15:47.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/71: creat d2/de/d10/f19 x:0 0 0 2024-04-30T23:15:47.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/72: truncate d2/de/d10/f19 485780 0 2024-04-30T23:15:47.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/73: fdatasync d2/f6 0 2024-04-30T23:15:47.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/74: write d2/f4 [9317200,27168] 0 2024-04-30T23:15:47.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/75: truncate d2/f6 420427 0 2024-04-30T23:15:47.584 INFO:tasks.workunit.client.0.smithi100.stdout:8/76: creat d2/de/d10/d17/f1a x:0 0 0 2024-04-30T23:15:47.584 INFO:tasks.workunit.client.0.smithi100.stdout:1/176: write d3/d18/f23 [3131792,38964] 0 2024-04-30T23:15:47.595 INFO:tasks.workunit.client.0.smithi100.stdout:3/143: dwrite d1/f10 [0,4194304] 0 2024-04-30T23:15:47.596 INFO:tasks.workunit.client.0.smithi100.stdout:3/144: read d1/f9 [364919,66707] 0 2024-04-30T23:15:47.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/82: dwrite d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:47.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/83: mknod d4/d7/d8/c17 0 2024-04-30T23:15:47.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/84: chown d4/d9/f16 13 1 2024-04-30T23:15:47.603 INFO:tasks.workunit.client.0.smithi100.stdout:9/85: unlink d4/d7/d8/c17 0 2024-04-30T23:15:47.606 INFO:tasks.workunit.client.0.smithi100.stdout:1/177: dwrite d3/f2f [0,4194304] 0 2024-04-30T23:15:47.621 INFO:tasks.workunit.client.0.smithi100.stdout:9/86: read d4/d9/f16 [2972058,76315] 0 2024-04-30T23:15:47.621 INFO:tasks.workunit.client.0.smithi100.stdout:9/87: chown d4/ca 12674494 1 2024-04-30T23:15:47.621 INFO:tasks.workunit.client.0.smithi100.stdout:9/88: write d4/fd [821478,56646] 0 2024-04-30T23:15:47.621 INFO:tasks.workunit.client.0.smithi100.stdout:3/145: dwrite d1/d14/d15/f1d [0,4194304] 0 2024-04-30T23:15:47.622 INFO:tasks.workunit.client.0.smithi100.stdout:9/89: mknod d4/d7/c18 0 2024-04-30T23:15:47.623 INFO:tasks.workunit.client.0.smithi100.stdout:8/77: dwrite d2/ff [8388608,4194304] 0 2024-04-30T23:15:47.623 INFO:tasks.workunit.client.0.smithi100.stdout:8/78: write d2/f4 [1487123,76739] 0 2024-04-30T23:15:47.623 INFO:tasks.workunit.client.0.smithi100.stdout:8/79: write d2/de/d10/f19 [459702,109974] 0 2024-04-30T23:15:47.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/146: rename d1/c11 to d1/d14/c2a 0 2024-04-30T23:15:47.626 INFO:tasks.workunit.client.0.smithi100.stdout:9/90: mkdir d4/d7/d8/d19 0 2024-04-30T23:15:47.627 INFO:tasks.workunit.client.0.smithi100.stdout:1/178: dwrite d3/f26 [0,4194304] 0 2024-04-30T23:15:47.627 INFO:tasks.workunit.client.0.smithi100.stdout:1/179: dread - d3/d16/d20/f27 zero size 2024-04-30T23:15:47.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/80: creat d2/de/d10/d17/f1b x:0 0 0 2024-04-30T23:15:47.638 INFO:tasks.workunit.client.0.smithi100.stdout:3/147: mkdir d1/d14/d2b 0 2024-04-30T23:15:47.638 INFO:tasks.workunit.client.0.smithi100.stdout:3/148: truncate d1/d14/d15/f1d 4892658 0 2024-04-30T23:15:47.638 INFO:tasks.workunit.client.0.smithi100.stdout:8/81: symlink d2/de/l1c 0 2024-04-30T23:15:47.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/149: mkdir d1/d14/d15/d2c 0 2024-04-30T23:15:47.640 INFO:tasks.workunit.client.0.smithi100.stdout:3/150: creat d1/d14/d21/f2d x:0 0 0 2024-04-30T23:15:47.645 INFO:tasks.workunit.client.0.smithi100.stdout:3/151: getdents d1/d14/d15 0 2024-04-30T23:15:47.645 INFO:tasks.workunit.client.0.smithi100.stdout:3/152: write d1/f9 [377086,31965] 0 2024-04-30T23:15:47.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/91: dwrite f1 [0,4194304] 0 2024-04-30T23:15:47.656 INFO:tasks.workunit.client.0.smithi100.stdout:9/92: mknod d4/d7/c1a 0 2024-04-30T23:15:47.656 INFO:tasks.workunit.client.0.smithi100.stdout:1/180: dwrite d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:15:47.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/93: rename d4/d7/c18 to d4/d9/d10/c1b 0 2024-04-30T23:15:47.658 INFO:tasks.workunit.client.0.smithi100.stdout:9/94: truncate d4/f13 321021 0 2024-04-30T23:15:47.660 INFO:tasks.workunit.client.0.smithi100.stdout:1/181: mkdir d3/d18/d3b 0 2024-04-30T23:15:47.660 INFO:tasks.workunit.client.0.smithi100.stdout:1/182: chown d3/d16/d20/f22 1211918 1 2024-04-30T23:15:47.661 INFO:tasks.workunit.client.0.smithi100.stdout:1/183: creat d3/d16/f3c x:0 0 0 2024-04-30T23:15:47.663 INFO:tasks.workunit.client.0.smithi100.stdout:8/82: rmdir d2 39 2024-04-30T23:15:47.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/153: write d1/d14/f19 [1255559,103920] 0 2024-04-30T23:15:47.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/154: write d1/d14/d15/f20 [250832,16980] 0 2024-04-30T23:15:47.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/155: truncate d1/fc 2044796 0 2024-04-30T23:15:47.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/156: read d1/d14/d15/f20 [471939,30833] 0 2024-04-30T23:15:47.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/157: stat d1/d14/d15/d1e/d26/l24 0 2024-04-30T23:15:47.689 INFO:tasks.workunit.client.0.smithi100.stdout:9/95: dwrite d4/d7/f12 [0,4194304] 0 2024-04-30T23:15:47.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/96: mknod d4/d9/c1c 0 2024-04-30T23:15:47.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/97: symlink d4/d7/d8/d19/l1d 0 2024-04-30T23:15:47.696 INFO:tasks.workunit.client.0.smithi100.stdout:9/98: creat d4/f1e x:0 0 0 2024-04-30T23:15:47.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/99: getdents d4 0 2024-04-30T23:15:47.706 INFO:tasks.workunit.client.0.smithi100.stdout:8/83: dwrite d2/f3 [4194304,4194304] 0 2024-04-30T23:15:47.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/158: dwrite d1/d14/d15/f1b [0,4194304] 0 2024-04-30T23:15:47.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/159: truncate d1/d14/d21/f2d 434595 0 2024-04-30T23:15:47.708 INFO:tasks.workunit.client.0.smithi100.stdout:8/84: link d2/f9 d2/f1d 0 2024-04-30T23:15:47.709 INFO:tasks.workunit.client.0.smithi100.stdout:9/100: write d4/fd [306051,114610] 0 2024-04-30T23:15:47.710 INFO:tasks.workunit.client.0.smithi100.stdout:9/101: chown d4/d9/d10 465861671 1 2024-04-30T23:15:47.710 INFO:tasks.workunit.client.0.smithi100.stdout:3/160: mknod d1/d14/c2e 0 2024-04-30T23:15:47.711 INFO:tasks.workunit.client.0.smithi100.stdout:9/102: rename d4/d7/d8/cf to d4/d9/d10/c1f 0 2024-04-30T23:15:47.712 INFO:tasks.workunit.client.0.smithi100.stdout:3/161: mkdir d1/d14/d2f 0 2024-04-30T23:15:47.712 INFO:tasks.workunit.client.0.smithi100.stdout:3/162: rename d1/d14/d15 to d1/d14/d15/d2c/d30 22 2024-04-30T23:15:47.713 INFO:tasks.workunit.client.0.smithi100.stdout:9/103: symlink d4/d7/l20 0 2024-04-30T23:15:47.714 INFO:tasks.workunit.client.0.smithi100.stdout:9/104: symlink d4/d7/l21 0 2024-04-30T23:15:47.722 INFO:tasks.workunit.client.0.smithi100.stdout:8/85: write d2/f8 [3197163,79042] 0 2024-04-30T23:15:47.740 INFO:tasks.workunit.client.0.smithi100.stdout:9/105: rename d4/d7/d8/cc to d4/d7/d8/c22 0 2024-04-30T23:15:47.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/106: unlink d4/d7/c1a 0 2024-04-30T23:15:47.742 INFO:tasks.workunit.client.0.smithi100.stdout:3/163: dwrite d1/d14/f19 [4194304,4194304] 0 2024-04-30T23:15:47.742 INFO:tasks.workunit.client.0.smithi100.stdout:8/86: dread d2/f8 [0,4194304] 0 2024-04-30T23:15:47.742 INFO:tasks.workunit.client.0.smithi100.stdout:8/87: read - d2/de/d10/d17/f1b zero size 2024-04-30T23:15:47.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/107: symlink d4/d7/d8/d19/l23 0 2024-04-30T23:15:47.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/108: dread - d4/f1e zero size 2024-04-30T23:15:47.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/164: read d1/d14/d15/f16 [391585,114355] 0 2024-04-30T23:15:47.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/165: write d1/f25 [131432,102813] 0 2024-04-30T23:15:47.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/109: dread d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:47.764 INFO:tasks.workunit.client.0.smithi100.stdout:3/166: link d1/d14/d15/f1b d1/d14/d21/f31 0 2024-04-30T23:15:47.764 INFO:tasks.workunit.client.0.smithi100.stdout:3/167: write d1/d14/d21/f2d [1425205,75670] 0 2024-04-30T23:15:47.764 INFO:tasks.workunit.client.0.smithi100.stdout:3/168: readlink d1/l1a 0 2024-04-30T23:15:47.764 INFO:tasks.workunit.client.0.smithi100.stdout:9/110: mkdir d4/d7/d8/d19/d24 0 2024-04-30T23:15:47.767 INFO:tasks.workunit.client.0.smithi100.stdout:9/111: rmdir d4/d7/d8/d19/d24 0 2024-04-30T23:15:47.777 INFO:tasks.workunit.client.0.smithi100.stdout:3/169: dread d1/ff [0,4194304] 0 2024-04-30T23:15:47.779 INFO:tasks.workunit.client.0.smithi100.stdout:3/170: mkdir d1/d14/d15/d32 0 2024-04-30T23:15:47.784 INFO:tasks.workunit.client.0.smithi100.stdout:9/112: dread d4/d7/f12 [0,4194304] 0 2024-04-30T23:15:47.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/171: creat d1/d14/d15/d27/f33 x:0 0 0 2024-04-30T23:15:47.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/172: write d1/f13 [9213735,106519] 0 2024-04-30T23:15:47.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/113: creat d4/d7/d8/f25 x:0 0 0 2024-04-30T23:15:47.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/173: mkdir d1/d14/d15/d27/d34 0 2024-04-30T23:15:47.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/114: dread d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:47.802 INFO:tasks.workunit.client.0.smithi100.stdout:9/115: mkdir d4/d26 0 2024-04-30T23:15:47.803 INFO:tasks.workunit.client.0.smithi100.stdout:9/116: link d4/f1e d4/d9/d10/f27 0 2024-04-30T23:15:47.803 INFO:tasks.workunit.client.0.smithi100.stdout:9/117: write f3 [5150134,116006] 0 2024-04-30T23:15:47.806 INFO:tasks.workunit.client.0.smithi100.stdout:9/118: creat d4/d9/d10/f28 x:0 0 0 2024-04-30T23:15:47.808 INFO:tasks.workunit.client.0.smithi100.stdout:9/119: creat d4/d7/d8/d19/f29 x:0 0 0 2024-04-30T23:15:47.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/120: dwrite f0 [4194304,4194304] 0 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/121: dread d4/d7/f12 [0,4194304] 0 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/122: stat d4/d9/c1c 0 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/123: stat d4/f1e 0 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/124: stat d4/d7/l20 0 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/125: chown d4 1613 1 2024-04-30T23:15:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/126: chown d4/d7/l20 1465 1 2024-04-30T23:15:47.942 INFO:tasks.workunit.client.0.smithi100.stdout:0/99: sync 2024-04-30T23:15:47.942 INFO:tasks.workunit.client.0.smithi100.stdout:2/150: sync 2024-04-30T23:15:47.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/119: sync 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:6/165: sync 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/127: sync 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:4/113: sync 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/128: chown d0/f8 124089597 1 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/129: dread - d0/d1b/d1e/f28 zero size 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:5/120: write f0 [4265570,87425] 0 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:5/121: write d1/d12/f23 [81677,39128] 0 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:5/122: stat d1/fe 0 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/151: rmdir d5/d22 39 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/152: dread - d5/f28 zero size 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/153: chown d5/fe 0 1 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/154: chown d5/fe 70 1 2024-04-30T23:15:47.943 INFO:tasks.workunit.client.0.smithi100.stdout:6/166: creat d7/db/f2d x:0 0 0 2024-04-30T23:15:47.944 INFO:tasks.workunit.client.0.smithi100.stdout:0/100: symlink d2/d14/l22 0 2024-04-30T23:15:47.944 INFO:tasks.workunit.client.0.smithi100.stdout:6/167: mkdir d7/df/d23/d24/d2e 0 2024-04-30T23:15:47.944 INFO:tasks.workunit.client.0.smithi100.stdout:6/168: symlink d7/d1a/l2f 0 2024-04-30T23:15:47.944 INFO:tasks.workunit.client.0.smithi100.stdout:6/169: write d7/d9/f1c [3253482,57721] 0 2024-04-30T23:15:47.956 INFO:tasks.workunit.client.0.smithi100.stdout:5/123: dread d1/d12/f23 [0,4194304] 0 2024-04-30T23:15:47.959 INFO:tasks.workunit.client.0.smithi100.stdout:0/101: write d2/f5 [3070938,100894] 0 2024-04-30T23:15:47.959 INFO:tasks.workunit.client.0.smithi100.stdout:5/124: link d1/d12/d24/c2a d1/c2b 0 2024-04-30T23:15:47.959 INFO:tasks.workunit.client.0.smithi100.stdout:5/125: truncate d1/d12/d1a/f22 1048067 0 2024-04-30T23:15:47.959 INFO:tasks.workunit.client.0.smithi100.stdout:5/126: write d1/d12/f16 [4656909,23435] 0 2024-04-30T23:15:47.959 INFO:tasks.workunit.client.0.smithi100.stdout:2/155: write d5/d12/f1e [2415713,126603] 0 2024-04-30T23:15:47.960 INFO:tasks.workunit.client.0.smithi100.stdout:0/102: link d2/f5 d2/f23 0 2024-04-30T23:15:47.963 INFO:tasks.workunit.client.0.smithi100.stdout:2/156: truncate d5/f14 522413 0 2024-04-30T23:15:47.971 INFO:tasks.workunit.client.0.smithi100.stdout:4/114: dwrite f9 [0,4194304] 0 2024-04-30T23:15:47.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/130: dwrite d0/df/f14 [0,4194304] 0 2024-04-30T23:15:47.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/131: write d0/df/f21 [23613,91594] 0 2024-04-30T23:15:47.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/132: stat d0/fe 0 2024-04-30T23:15:47.980 INFO:tasks.workunit.client.0.smithi100.stdout:5/127: write d1/d12/f16 [3340682,1829] 0 2024-04-30T23:15:47.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/128: mkdir d1/d2c 0 2024-04-30T23:15:47.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/129: write d1/d12/d27/f29 [124507,122156] 0 2024-04-30T23:15:47.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/130: write d1/d12/d1a/f26 [803300,111607] 0 2024-04-30T23:15:47.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/131: creat d1/d12/d1a/f2d x:0 0 0 2024-04-30T23:15:47.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/132: getdents d1/d2c 0 2024-04-30T23:15:47.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/133: write d1/d12/d1a/f2d [759735,112273] 0 2024-04-30T23:15:47.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/103: dwrite d2/fd [0,4194304] 0 2024-04-30T23:15:47.996 INFO:tasks.workunit.client.0.smithi100.stdout:4/115: write f18 [3086249,72644] 0 2024-04-30T23:15:47.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/157: dwrite d5/d12/d13/f17 [4194304,4194304] 0 2024-04-30T23:15:48.000 INFO:tasks.workunit.client.0.smithi100.stdout:0/104: dread d2/f7 [0,4194304] 0 2024-04-30T23:15:48.003 INFO:tasks.workunit.client.0.smithi100.stdout:4/116: rename c16 to d19/c20 0 2024-04-30T23:15:48.003 INFO:tasks.workunit.client.0.smithi100.stdout:4/117: chown cd 2694 1 2024-04-30T23:15:48.004 INFO:tasks.workunit.client.0.smithi100.stdout:2/158: mknod d5/d26/d2f/c37 0 2024-04-30T23:15:48.005 INFO:tasks.workunit.client.0.smithi100.stdout:7/133: dwrite d0/f17 [0,4194304] 0 2024-04-30T23:15:48.006 INFO:tasks.workunit.client.0.smithi100.stdout:0/105: rename d2/f7 to d2/d14/f24 0 2024-04-30T23:15:48.007 INFO:tasks.workunit.client.0.smithi100.stdout:4/118: mkdir d19/d1a/d21 0 2024-04-30T23:15:48.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/159: mkdir d5/d26/d2f/d38 0 2024-04-30T23:15:48.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/160: dread - d5/d2e/f30 zero size 2024-04-30T23:15:48.010 INFO:tasks.workunit.client.0.smithi100.stdout:7/134: creat d0/d1b/d24/f2f x:0 0 0 2024-04-30T23:15:48.015 INFO:tasks.workunit.client.0.smithi100.stdout:7/135: write d0/f17 [4824918,121326] 0 2024-04-30T23:15:48.017 INFO:tasks.workunit.client.0.smithi100.stdout:7/136: symlink d0/d1b/l30 0 2024-04-30T23:15:48.017 INFO:tasks.workunit.client.0.smithi100.stdout:4/119: dread fc [0,4194304] 0 2024-04-30T23:15:48.019 INFO:tasks.workunit.client.0.smithi100.stdout:7/137: rename d0/c27 to d0/d1b/d2e/c31 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/138: link d0/f1f d0/d1b/d2e/f32 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/139: write d0/df/d19/f2d [871286,64701] 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/140: truncate d0/df/d19/f2d 1892705 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/141: truncate d0/f16 1012198 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/142: write d0/df/f21 [498275,17074] 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/143: truncate d0/f1f 1052224 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/144: readlink d0/df/d19/l1c 0 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/145: chown d0/df/f29 50373987 1 2024-04-30T23:15:48.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/146: stat d0/df/d19/l1c 0 2024-04-30T23:15:48.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/147: dread d0/f12 [0,4194304] 0 2024-04-30T23:15:48.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/148: chown d0/f12 21959 1 2024-04-30T23:15:48.028 INFO:tasks.workunit.client.0.smithi100.stdout:7/149: link d0/d1b/l30 d0/l33 0 2024-04-30T23:15:48.029 INFO:tasks.workunit.client.0.smithi100.stdout:7/150: rmdir d0/df/d19 39 2024-04-30T23:15:48.031 INFO:tasks.workunit.client.0.smithi100.stdout:7/151: rename d0/f2 to d0/d1b/d24/d2a/f34 0 2024-04-30T23:15:48.032 INFO:tasks.workunit.client.0.smithi100.stdout:7/152: creat d0/df/d19/f35 x:0 0 0 2024-04-30T23:15:48.040 INFO:tasks.workunit.client.0.smithi100.stdout:4/120: dread f18 [0,4194304] 0 2024-04-30T23:15:48.040 INFO:tasks.workunit.client.0.smithi100.stdout:4/121: chown c17 2554405 1 2024-04-30T23:15:48.045 INFO:tasks.workunit.client.0.smithi100.stdout:7/153: read d0/df/f21 [209504,126964] 0 2024-04-30T23:15:48.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:47 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:47 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:47 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:47 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:47 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:48.047 INFO:tasks.workunit.client.0.smithi100.stdout:0/106: dwrite d2/f5 [0,4194304] 0 2024-04-30T23:15:48.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/107: symlink d2/l25 0 2024-04-30T23:15:48.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/108: read d2/f4 [2601589,52933] 0 2024-04-30T23:15:48.049 INFO:tasks.workunit.client.0.smithi100.stdout:0/109: mkdir d2/d14/d26 0 2024-04-30T23:15:48.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:47 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:47 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:47 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:47 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:47 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:48.053 INFO:tasks.workunit.client.0.smithi100.stdout:7/154: rename d0/d1b/d2e/c31 to d0/df/d19/c36 0 2024-04-30T23:15:48.053 INFO:tasks.workunit.client.0.smithi100.stdout:7/155: stat d0/d1b/f2b 0 2024-04-30T23:15:48.053 INFO:tasks.workunit.client.0.smithi100.stdout:7/156: dread - d0/d1b/d24/f2f zero size 2024-04-30T23:15:48.053 INFO:tasks.workunit.client.0.smithi100.stdout:7/157: read d0/f8 [247584,34857] 0 2024-04-30T23:15:48.056 INFO:tasks.workunit.client.0.smithi100.stdout:7/158: mknod d0/d1b/d24/d2a/c37 0 2024-04-30T23:15:48.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/159: mknod d0/d1d/c38 0 2024-04-30T23:15:48.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/160: chown d0/d1b/d24/f2f 1 1 2024-04-30T23:15:48.060 INFO:tasks.workunit.client.0.smithi100.stdout:7/161: creat d0/df/f39 x:0 0 0 2024-04-30T23:15:48.063 INFO:tasks.workunit.client.0.smithi100.stdout:2/161: write d5/d12/d13/f17 [6923723,74411] 0 2024-04-30T23:15:48.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/162: rename d0/f12 to d0/df/d19/f3a 0 2024-04-30T23:15:48.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/163: creat d0/d1b/d24/f3b x:0 0 0 2024-04-30T23:15:48.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/164: fdatasync d0/df/f22 0 2024-04-30T23:15:48.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/165: fdatasync d0/df/f29 0 2024-04-30T23:15:48.067 INFO:tasks.workunit.client.0.smithi100.stdout:7/166: mkdir d0/d1d/d3c 0 2024-04-30T23:15:48.069 INFO:tasks.workunit.client.0.smithi100.stdout:7/167: mkdir d0/d1b/d2e/d3d 0 2024-04-30T23:15:48.069 INFO:tasks.workunit.client.0.smithi100.stdout:7/168: chown d0/d1b/d24/c26 510 1 2024-04-30T23:15:48.071 INFO:tasks.workunit.client.0.smithi100.stdout:7/169: creat d0/d1b/f3e x:0 0 0 2024-04-30T23:15:48.073 INFO:tasks.workunit.client.0.smithi100.stdout:0/110: dwrite d2/f1e [0,4194304] 0 2024-04-30T23:15:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:47 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:47 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:47 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:47 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:47 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:48.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/162: write d5/f2d [2497523,57843] 0 2024-04-30T23:15:48.077 INFO:tasks.workunit.client.0.smithi100.stdout:0/111: symlink d2/d14/d26/l27 0 2024-04-30T23:15:48.077 INFO:tasks.workunit.client.0.smithi100.stdout:4/122: dwrite d19/d1a/f1e [0,4194304] 0 2024-04-30T23:15:48.077 INFO:tasks.workunit.client.0.smithi100.stdout:4/123: fsync fc 0 2024-04-30T23:15:48.082 INFO:tasks.workunit.client.0.smithi100.stdout:4/124: rmdir d19/d1a 39 2024-04-30T23:15:48.084 INFO:tasks.workunit.client.0.smithi100.stdout:4/125: symlink d19/d1a/d21/l22 0 2024-04-30T23:15:48.084 INFO:tasks.workunit.client.0.smithi100.stdout:4/126: write f8 [4866006,103744] 0 2024-04-30T23:15:48.087 INFO:tasks.workunit.client.0.smithi100.stdout:4/127: rename d19/d1a/c1b to d19/d1a/d21/c23 0 2024-04-30T23:15:48.090 INFO:tasks.workunit.client.0.smithi100.stdout:4/128: symlink d19/d1a/d21/l24 0 2024-04-30T23:15:48.093 INFO:tasks.workunit.client.0.smithi100.stdout:4/129: rmdir d19/d1a/d21 39 2024-04-30T23:15:48.098 INFO:tasks.workunit.client.0.smithi100.stdout:0/112: write d2/f3 [1282527,93926] 0 2024-04-30T23:15:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:4/130: truncate d19/d1a/f1e 1702580 0 2024-04-30T23:15:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:4/131: fdatasync f3 0 2024-04-30T23:15:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:0/113: dread d2/d14/f19 [0,4194304] 0 2024-04-30T23:15:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/163: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/164: fdatasync d5/d12/f1a 0 2024-04-30T23:15:48.102 INFO:tasks.workunit.client.0.smithi100.stdout:0/114: mknod d2/d14/d18/c28 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:2/165: getdents d5/d12 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:2/166: fdatasync d5/f25 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:2/167: write d5/d12/d13/f17 [4353885,107146] 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:2/168: truncate d5/d12/d13/f2a 399675 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:7/170: dwrite d0/d1b/d1e/f28 [0,4194304] 0 2024-04-30T23:15:48.104 INFO:tasks.workunit.client.0.smithi100.stdout:7/171: getdents d0/d1d/d3c 0 2024-04-30T23:15:48.105 INFO:tasks.workunit.client.0.smithi100.stdout:4/132: rename fb to d19/d1a/d21/f25 0 2024-04-30T23:15:48.107 INFO:tasks.workunit.client.0.smithi100.stdout:0/115: creat d2/d14/d18/f29 x:0 0 0 2024-04-30T23:15:48.109 INFO:tasks.workunit.client.0.smithi100.stdout:7/172: truncate d0/df/f29 162125 0 2024-04-30T23:15:48.115 INFO:tasks.workunit.client.0.smithi100.stdout:4/133: rmdir d19/d1a/d21 39 2024-04-30T23:15:48.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/169: mknod d5/d12/c39 0 2024-04-30T23:15:48.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/170: fdatasync d5/f2d 0 2024-04-30T23:15:48.130 INFO:tasks.workunit.client.0.smithi100.stdout:2/171: chown d5/d12/f1e 28 1 2024-04-30T23:15:48.147 INFO:tasks.workunit.client.0.smithi100.stdout:2/172: write d5/d12/f1a [2440306,19472] 0 2024-04-30T23:15:48.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/173: mknod d5/d22/c3a 0 2024-04-30T23:15:48.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/174: truncate d5/d2e/f30 385367 0 2024-04-30T23:15:48.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/175: fdatasync d5/f16 0 2024-04-30T23:15:48.150 INFO:tasks.workunit.client.0.smithi100.stdout:2/176: symlink d5/d26/l3b 0 2024-04-30T23:15:48.159 INFO:tasks.workunit.client.0.smithi100.stdout:0/116: dwrite d2/d14/d18/f1b [0,4194304] 0 2024-04-30T23:15:48.160 INFO:tasks.workunit.client.0.smithi100.stdout:0/117: rename d2 to d2/d14/d2a 22 2024-04-30T23:15:48.160 INFO:tasks.workunit.client.0.smithi100.stdout:4/134: dwrite f9 [0,4194304] 0 2024-04-30T23:15:48.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/118: creat d2/d14/d18/f2b x:0 0 0 2024-04-30T23:15:48.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/119: write d2/d14/d18/f29 [220397,3423] 0 2024-04-30T23:15:48.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/120: chown d2/l11 0 1 2024-04-30T23:15:48.163 INFO:tasks.workunit.client.0.smithi100.stdout:0/121: unlink d2/d14/d18/f1b 0 2024-04-30T23:15:48.177 INFO:tasks.workunit.client.0.smithi100.stdout:4/135: dread f8 [0,4194304] 0 2024-04-30T23:15:48.177 INFO:tasks.workunit.client.0.smithi100.stdout:4/136: write fc [2187283,74952] 0 2024-04-30T23:15:48.180 INFO:tasks.workunit.client.0.smithi100.stdout:0/122: dread d2/fd [0,4194304] 0 2024-04-30T23:15:48.184 INFO:tasks.workunit.client.0.smithi100.stdout:4/137: write d19/d1a/f1e [589829,17237] 0 2024-04-30T23:15:48.185 INFO:tasks.workunit.client.0.smithi100.stdout:4/138: creat d19/f26 x:0 0 0 2024-04-30T23:15:48.185 INFO:tasks.workunit.client.0.smithi100.stdout:4/139: write d19/f26 [383589,42385] 0 2024-04-30T23:15:48.186 INFO:tasks.workunit.client.0.smithi100.stdout:4/140: rmdir d19/d1a/d21 39 2024-04-30T23:15:48.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/184: sync 2024-04-30T23:15:48.187 INFO:tasks.workunit.client.0.smithi100.stdout:4/141: creat d19/f27 x:0 0 0 2024-04-30T23:15:48.200 INFO:tasks.workunit.client.0.smithi100.stdout:1/185: dread d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:48.200 INFO:tasks.workunit.client.0.smithi100.stdout:1/186: write d3/f19 [2887168,31022] 0 2024-04-30T23:15:48.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/187: read d3/f2f [541903,7679] 0 2024-04-30T23:15:48.222 INFO:tasks.workunit.client.0.smithi100.stdout:4/142: dwrite fc [0,4194304] 0 2024-04-30T23:15:48.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/188: creat d3/db/f3d x:0 0 0 2024-04-30T23:15:48.225 INFO:tasks.workunit.client.0.smithi100.stdout:4/143: rename d19/d1a/d21/l24 to d19/d1a/l28 0 2024-04-30T23:15:48.225 INFO:tasks.workunit.client.0.smithi100.stdout:1/189: creat d3/db/f3e x:0 0 0 2024-04-30T23:15:48.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/144: mkdir d19/d1a/d29 0 2024-04-30T23:15:48.227 INFO:tasks.workunit.client.0.smithi100.stdout:1/190: mkdir d3/d16/d20/d24/d3f 0 2024-04-30T23:15:48.227 INFO:tasks.workunit.client.0.smithi100.stdout:1/191: write d3/db/f39 [445070,3595] 0 2024-04-30T23:15:48.228 INFO:tasks.workunit.client.0.smithi100.stdout:1/192: link d3/d16/d20/f33 d3/db/f40 0 2024-04-30T23:15:48.233 INFO:tasks.workunit.client.0.smithi100.stdout:1/193: dread d3/f9 [0,4194304] 0 2024-04-30T23:15:48.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/194: mknod d3/db/c41 0 2024-04-30T23:15:48.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/195: read - d3/d16/f3c zero size 2024-04-30T23:15:48.239 INFO:tasks.workunit.client.0.smithi100.stdout:4/145: write f8 [2473910,8206] 0 2024-04-30T23:15:48.241 INFO:tasks.workunit.client.0.smithi100.stdout:4/146: creat d19/d1a/d29/f2a x:0 0 0 2024-04-30T23:15:48.242 INFO:tasks.workunit.client.0.smithi100.stdout:4/147: creat d19/d1a/d21/f2b x:0 0 0 2024-04-30T23:15:48.243 INFO:tasks.workunit.client.0.smithi100.stdout:4/148: mknod d19/d1a/d21/c2c 0 2024-04-30T23:15:48.252 INFO:tasks.workunit.client.0.smithi100.stdout:4/149: dread f12 [4194304,4194304] 0 2024-04-30T23:15:48.252 INFO:tasks.workunit.client.0.smithi100.stdout:4/150: truncate f11 3643572 0 2024-04-30T23:15:48.253 INFO:tasks.workunit.client.0.smithi100.stdout:4/151: creat d19/d1a/d21/f2d x:0 0 0 2024-04-30T23:15:48.254 INFO:tasks.workunit.client.0.smithi100.stdout:4/152: mknod d19/c2e 0 2024-04-30T23:15:48.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/153: truncate f13 2947568 0 2024-04-30T23:15:48.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/154: fsync f3 0 2024-04-30T23:15:48.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/155: fsync d19/d1a/d21/f25 0 2024-04-30T23:15:48.257 INFO:tasks.workunit.client.0.smithi100.stdout:4/156: creat d19/f2f x:0 0 0 2024-04-30T23:15:48.257 INFO:tasks.workunit.client.0.smithi100.stdout:4/157: chown d19/d1a/d21/f2b 214215981 1 2024-04-30T23:15:48.257 INFO:tasks.workunit.client.0.smithi100.stdout:4/158: chown d19/f26 31250 1 2024-04-30T23:15:48.264 INFO:tasks.workunit.client.0.smithi100.stdout:1/196: dwrite d3/f8 [0,4194304] 0 2024-04-30T23:15:48.265 INFO:tasks.workunit.client.0.smithi100.stdout:4/159: write f12 [3609381,80544] 0 2024-04-30T23:15:48.265 INFO:tasks.workunit.client.0.smithi100.stdout:4/160: dread - d19/f2f zero size 2024-04-30T23:15:48.265 INFO:tasks.workunit.client.0.smithi100.stdout:4/161: chown d19/d1a/f1e 463 1 2024-04-30T23:15:48.266 INFO:tasks.workunit.client.0.smithi100.stdout:1/197: symlink d3/d18/d3b/l42 0 2024-04-30T23:15:48.278 INFO:tasks.workunit.client.0.smithi100.stdout:1/198: read d3/f26 [1374975,32630] 0 2024-04-30T23:15:48.278 INFO:tasks.workunit.client.0.smithi100.stdout:1/199: chown d3/d16/l3a 3954 1 2024-04-30T23:15:48.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/200: link d3/d16/d20/d24/f32 d3/d18/f43 0 2024-04-30T23:15:48.280 INFO:tasks.workunit.client.0.smithi100.stdout:4/162: dread f18 [0,4194304] 0 2024-04-30T23:15:48.281 INFO:tasks.workunit.client.0.smithi100.stdout:1/201: creat d3/d16/d20/d24/f44 x:0 0 0 2024-04-30T23:15:48.282 INFO:tasks.workunit.client.0.smithi100.stdout:1/202: creat d3/d16/d20/f45 x:0 0 0 2024-04-30T23:15:48.282 INFO:tasks.workunit.client.0.smithi100.stdout:1/203: fsync d3/f4 0 2024-04-30T23:15:48.282 INFO:tasks.workunit.client.0.smithi100.stdout:1/204: write d3/f9 [1652170,74198] 0 2024-04-30T23:15:48.286 INFO:tasks.workunit.client.0.smithi100.stdout:4/163: truncate f9 2225292 0 2024-04-30T23:15:48.287 INFO:tasks.workunit.client.0.smithi100.stdout:4/164: truncate d19/d1a/d21/f25 586507 0 2024-04-30T23:15:48.289 INFO:tasks.workunit.client.0.smithi100.stdout:4/165: mkdir d19/d1a/d21/d30 0 2024-04-30T23:15:48.289 INFO:tasks.workunit.client.0.smithi100.stdout:4/166: fdatasync d19/d1a/d29/f2a 0 2024-04-30T23:15:48.289 INFO:tasks.workunit.client.0.smithi100.stdout:4/167: stat d19/d1a/d21/f2d 0 2024-04-30T23:15:48.304 INFO:tasks.workunit.client.0.smithi100.stdout:4/168: write fc [2486939,38613] 0 2024-04-30T23:15:48.305 INFO:tasks.workunit.client.0.smithi100.stdout:1/205: dwrite d3/f8 [0,4194304] 0 2024-04-30T23:15:48.306 INFO:tasks.workunit.client.0.smithi100.stdout:4/169: rename d19/d1a/d29/f2a to d19/d1a/d21/d30/f31 0 2024-04-30T23:15:48.307 INFO:tasks.workunit.client.0.smithi100.stdout:4/170: fdatasync f18 0 2024-04-30T23:15:48.326 INFO:tasks.workunit.client.0.smithi100.stdout:4/171: dread fc [0,4194304] 0 2024-04-30T23:15:48.327 INFO:tasks.workunit.client.0.smithi100.stdout:4/172: mkdir d19/d1a/d21/d32 0 2024-04-30T23:15:48.328 INFO:tasks.workunit.client.0.smithi100.stdout:4/173: truncate f9 784145 0 2024-04-30T23:15:48.328 INFO:tasks.workunit.client.0.smithi100.stdout:4/174: truncate d19/d1a/f1e 2618478 0 2024-04-30T23:15:48.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/206: dwrite d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:48.330 INFO:tasks.workunit.client.0.smithi100.stdout:1/207: creat d3/d16/d20/d24/d3f/f46 x:0 0 0 2024-04-30T23:15:48.332 INFO:tasks.workunit.client.0.smithi100.stdout:1/208: symlink d3/l47 0 2024-04-30T23:15:48.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/209: getdents d3/db 0 2024-04-30T23:15:48.342 INFO:tasks.workunit.client.0.smithi100.stdout:4/175: dread f18 [0,4194304] 0 2024-04-30T23:15:48.344 INFO:tasks.workunit.client.0.smithi100.stdout:4/176: rename d19/d1a/d21/d30 to d19/d33 0 2024-04-30T23:15:48.345 INFO:tasks.workunit.client.0.smithi100.stdout:4/177: truncate f13 2842042 0 2024-04-30T23:15:48.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/178: mknod d19/c34 0 2024-04-30T23:15:48.355 INFO:tasks.workunit.client.0.smithi100.stdout:1/210: dwrite d3/d16/d20/f22 [0,4194304] 0 2024-04-30T23:15:48.361 INFO:tasks.workunit.client.0.smithi100.stdout:1/211: fdatasync d3/f9 0 2024-04-30T23:15:48.374 INFO:tasks.workunit.client.0.smithi100.stdout:4/179: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:48.374 INFO:tasks.workunit.client.0.smithi100.stdout:4/180: chown d19/d1a/d21/d32 18850 1 2024-04-30T23:15:48.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/212: dwrite d3/db/f3e [0,4194304] 0 2024-04-30T23:15:48.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/213: write d3/d16/d20/d24/f2b [114373,88778] 0 2024-04-30T23:15:48.389 INFO:tasks.workunit.client.0.smithi100.stdout:1/214: creat d3/d16/d20/d24/f48 x:0 0 0 2024-04-30T23:15:48.390 INFO:tasks.workunit.client.0.smithi100.stdout:1/215: symlink d3/d16/l49 0 2024-04-30T23:15:48.391 INFO:tasks.workunit.client.0.smithi100.stdout:1/216: rmdir d3/db 39 2024-04-30T23:15:48.394 INFO:tasks.workunit.client.0.smithi100.stdout:4/181: dread f12 [0,4194304] 0 2024-04-30T23:15:48.395 INFO:tasks.workunit.client.0.smithi100.stdout:4/182: symlink d19/d1a/l35 0 2024-04-30T23:15:48.395 INFO:tasks.workunit.client.0.smithi100.stdout:4/183: chown d19/c34 1305619 1 2024-04-30T23:15:48.396 INFO:tasks.workunit.client.0.smithi100.stdout:4/184: link f11 d19/d1a/d21/d32/f36 0 2024-04-30T23:15:48.407 INFO:tasks.workunit.client.0.smithi100.stdout:4/185: dread d19/d1a/f1e [0,4194304] 0 2024-04-30T23:15:48.408 INFO:tasks.workunit.client.0.smithi100.stdout:4/186: creat d19/d1a/f37 x:0 0 0 2024-04-30T23:15:48.408 INFO:tasks.workunit.client.0.smithi100.stdout:4/187: write d19/f27 [635607,7598] 0 2024-04-30T23:15:48.409 INFO:tasks.workunit.client.0.smithi100.stdout:4/188: write d19/f27 [1094523,100750] 0 2024-04-30T23:15:48.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/217: dwrite d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:15:48.420 INFO:tasks.workunit.client.0.smithi100.stdout:1/218: mknod d3/d16/d20/c4a 0 2024-04-30T23:15:48.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/219: mkdir d3/db/d4b 0 2024-04-30T23:15:48.434 INFO:tasks.workunit.client.0.smithi100.stdout:4/189: dwrite f9 [0,4194304] 0 2024-04-30T23:15:48.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/88: sync 2024-04-30T23:15:48.480 INFO:tasks.workunit.client.0.smithi100.stdout:8/89: write d2/f3 [7369201,48845] 0 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: pgmap v439: 129 pgs: 129 active+clean; 341 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 465 op/s 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:48 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:49.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: pgmap v439: 129 pgs: 129 active+clean; 341 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 465 op/s 2024-04-30T23:15:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:48 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: pgmap v439: 129 pgs: 129 active+clean; 341 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 465 op/s 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:48 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:49.122 INFO:tasks.workunit.client.0.smithi100.stdout:3/174: sync 2024-04-30T23:15:49.127 INFO:tasks.workunit.client.0.smithi100.stdout:3/175: write d1/d14/d21/f2d [1114808,54594] 0 2024-04-30T23:15:49.127 INFO:tasks.workunit.client.0.smithi100.stdout:3/176: fdatasync d1/f9 0 2024-04-30T23:15:49.129 INFO:tasks.workunit.client.0.smithi100.stdout:3/177: mknod d1/d14/d2f/c35 0 2024-04-30T23:15:49.130 INFO:tasks.workunit.client.0.smithi100.stdout:3/178: creat d1/d14/f36 x:0 0 0 2024-04-30T23:15:49.153 INFO:tasks.workunit.client.0.smithi100.stdout:3/179: dwrite d1/f13 [4194304,4194304] 0 2024-04-30T23:15:49.157 INFO:tasks.workunit.client.0.smithi100.stdout:3/180: dread d1/f9 [0,4194304] 0 2024-04-30T23:15:49.158 INFO:tasks.workunit.client.0.smithi100.stdout:3/181: symlink d1/d14/d21/l37 0 2024-04-30T23:15:49.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/182: dwrite d1/d14/d15/f1b [4194304,4194304] 0 2024-04-30T23:15:49.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/183: read d1/f8 [2616420,88492] 0 2024-04-30T23:15:49.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/184: stat d1/d14/d15/f1d 0 2024-04-30T23:15:49.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/185: getdents d1/d14/d15/d2c 0 2024-04-30T23:15:49.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/186: mkdir d1/d38 0 2024-04-30T23:15:49.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/187: write d1/d14/d15/f20 [1898445,51056] 0 2024-04-30T23:15:49.201 INFO:tasks.workunit.client.0.smithi100.stdout:3/188: dwrite d1/d14/d15/d1e/d26/f28 [0,4194304] 0 2024-04-30T23:15:49.203 INFO:tasks.workunit.client.0.smithi100.stdout:3/189: creat d1/d14/d15/d1e/f39 x:0 0 0 2024-04-30T23:15:49.219 INFO:tasks.workunit.client.0.smithi100.stdout:3/190: write d1/f13 [8171361,66662] 0 2024-04-30T23:15:49.219 INFO:tasks.workunit.client.0.smithi100.stdout:3/191: readlink d1/le 0 2024-04-30T23:15:49.219 INFO:tasks.workunit.client.0.smithi100.stdout:3/192: read d1/d14/d15/d1e/d26/f23 [276777,88709] 0 2024-04-30T23:15:49.219 INFO:tasks.workunit.client.0.smithi100.stdout:3/193: chown d1/d14/c2e 7209 1 2024-04-30T23:15:49.221 INFO:tasks.workunit.client.0.smithi100.stdout:3/194: fsync d1/f13 0 2024-04-30T23:15:49.221 INFO:tasks.workunit.client.0.smithi100.stdout:3/195: chown d1/ff 17944 1 2024-04-30T23:15:49.222 INFO:tasks.workunit.client.0.smithi100.stdout:3/196: chown d1/d14/d15/f16 72408 1 2024-04-30T23:15:49.243 INFO:tasks.workunit.client.0.smithi100.stdout:3/197: dwrite d1/d14/d15/d1e/d26/f28 [4194304,4194304] 0 2024-04-30T23:15:49.255 INFO:tasks.workunit.client.0.smithi100.stdout:3/198: dread d1/fa [0,4194304] 0 2024-04-30T23:15:49.259 INFO:tasks.workunit.client.0.smithi100.stdout:3/199: write d1/d14/d15/f20 [1023099,85971] 0 2024-04-30T23:15:49.283 INFO:tasks.workunit.client.0.smithi100.stdout:3/200: write d1/d14/d21/f31 [4258843,82099] 0 2024-04-30T23:15:49.285 INFO:tasks.workunit.client.0.smithi100.stdout:3/201: rename d1/cb to d1/d14/c3a 0 2024-04-30T23:15:49.286 INFO:tasks.workunit.client.0.smithi100.stdout:3/202: rmdir d1/d14/d15/d1e/d26 39 2024-04-30T23:15:49.286 INFO:tasks.workunit.client.0.smithi100.stdout:3/203: dread - d1/d14/d15/d1e/f39 zero size 2024-04-30T23:15:49.288 INFO:tasks.workunit.client.0.smithi100.stdout:3/204: mknod d1/c3b 0 2024-04-30T23:15:49.301 INFO:tasks.workunit.client.0.smithi100.stdout:3/205: dread d1/d14/d15/f1d [0,4194304] 0 2024-04-30T23:15:49.301 INFO:tasks.workunit.client.0.smithi100.stdout:3/206: fsync d1/d14/f36 0 2024-04-30T23:15:49.326 INFO:tasks.workunit.client.0.smithi100.stdout:3/207: dwrite d1/d14/d21/f31 [0,4194304] 0 2024-04-30T23:15:49.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/208: unlink d1/f25 0 2024-04-30T23:15:49.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/209: symlink d1/d14/d21/l3c 0 2024-04-30T23:15:49.334 INFO:tasks.workunit.client.0.smithi100.stdout:3/210: fdatasync d1/d14/d15/f20 0 2024-04-30T23:15:49.337 INFO:tasks.workunit.client.0.smithi100.stdout:3/211: rename d1/l17 to d1/d14/d15/d27/d34/l3d 0 2024-04-30T23:15:49.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/212: dwrite d1/fc [0,4194304] 0 2024-04-30T23:15:49.372 INFO:tasks.workunit.client.0.smithi100.stdout:3/213: write d1/d14/d15/d1e/d26/f28 [6210470,72215] 0 2024-04-30T23:15:49.384 INFO:tasks.workunit.client.0.smithi100.stdout:3/214: dread d1/f10 [0,4194304] 0 2024-04-30T23:15:49.384 INFO:tasks.workunit.client.0.smithi100.stdout:3/215: creat d1/d14/d15/d32/f3e x:0 0 0 2024-04-30T23:15:49.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/216: symlink d1/d14/d15/d1e/d26/l3f 0 2024-04-30T23:15:49.387 INFO:tasks.workunit.client.0.smithi100.stdout:3/217: truncate d1/d14/d15/f1d 660586 0 2024-04-30T23:15:49.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/218: truncate d1/f8 1055173 0 2024-04-30T23:15:49.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/219: stat d1/c6 0 2024-04-30T23:15:49.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/220: dwrite d1/f9 [0,4194304] 0 2024-04-30T23:15:49.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/221: dread - d1/d14/d15/d32/f3e zero size 2024-04-30T23:15:49.411 INFO:tasks.workunit.client.0.smithi100.stdout:3/222: unlink d1/c6 0 2024-04-30T23:15:49.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/223: getdents d1/d14/d15/d32 0 2024-04-30T23:15:49.434 INFO:tasks.workunit.client.0.smithi100.stdout:3/224: dwrite d1/d14/d15/f1d [0,4194304] 0 2024-04-30T23:15:49.435 INFO:tasks.workunit.client.0.smithi100.stdout:3/225: creat d1/d14/d15/d32/f40 x:0 0 0 2024-04-30T23:15:49.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/226: mkdir d1/d14/d2f/d41 0 2024-04-30T23:15:49.437 INFO:tasks.workunit.client.0.smithi100.stdout:3/227: symlink d1/d14/d15/l42 0 2024-04-30T23:15:49.438 INFO:tasks.workunit.client.0.smithi100.stdout:3/228: rename d1/f8 to d1/d38/f43 0 2024-04-30T23:15:49.439 INFO:tasks.workunit.client.0.smithi100.stdout:3/229: stat d1/d14/d15 0 2024-04-30T23:15:49.440 INFO:tasks.workunit.client.0.smithi100.stdout:3/230: rename d1/fc to d1/d14/d15/f44 0 2024-04-30T23:15:49.440 INFO:tasks.workunit.client.0.smithi100.stdout:3/231: stat d1/d14/d15/d32 0 2024-04-30T23:15:49.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/232: link d1/d14/d15/f16 d1/d14/d15/d1e/d26/f45 0 2024-04-30T23:15:49.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/233: rmdir d1/d14/d2f/d41 0 2024-04-30T23:15:49.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/234: chown d1/d14/d15/f44 88 1 2024-04-30T23:15:49.457 INFO:tasks.workunit.client.0.smithi100.stdout:3/235: write d1/d14/d15/d1e/d26/f28 [262815,26692] 0 2024-04-30T23:15:49.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/127: sync 2024-04-30T23:15:49.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/128: unlink d4/d7/d8/c22 0 2024-04-30T23:15:49.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/129: write d4/d9/f16 [4722351,107616] 0 2024-04-30T23:15:49.489 INFO:tasks.workunit.client.0.smithi100.stdout:9/130: dread - d4/d7/d8/d19/f29 zero size 2024-04-30T23:15:49.490 INFO:tasks.workunit.client.0.smithi100.stdout:9/131: creat d4/f2a x:0 0 0 2024-04-30T23:15:49.634 INFO:tasks.workunit.client.0.smithi100.stdout:6/170: sync 2024-04-30T23:15:49.634 INFO:tasks.workunit.client.0.smithi100.stdout:6/171: dread - d7/d13/f26 zero size 2024-04-30T23:15:49.634 INFO:tasks.workunit.client.0.smithi100.stdout:6/172: stat d7/d11 0 2024-04-30T23:15:49.635 INFO:tasks.workunit.client.0.smithi100.stdout:6/173: creat d7/d1a/f30 x:0 0 0 2024-04-30T23:15:49.636 INFO:tasks.workunit.client.0.smithi100.stdout:6/174: creat d7/d9/f31 x:0 0 0 2024-04-30T23:15:49.638 INFO:tasks.workunit.client.0.smithi100.stdout:6/175: link d7/db/f16 d7/d1a/f32 0 2024-04-30T23:15:49.639 INFO:tasks.workunit.client.0.smithi100.stdout:6/176: symlink d7/df/d23/d24/d2e/l33 0 2024-04-30T23:15:49.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/177: rename d7/d13 to d7/d11/d34 0 2024-04-30T23:15:49.642 INFO:tasks.workunit.client.0.smithi100.stdout:6/178: mknod d7/df/d23/d2b/c35 0 2024-04-30T23:15:49.642 INFO:tasks.workunit.client.0.smithi100.stdout:6/179: write d7/d9/f12 [4264171,104150] 0 2024-04-30T23:15:49.642 INFO:tasks.workunit.client.0.smithi100.stdout:6/180: fdatasync d7/d9/f31 0 2024-04-30T23:15:49.662 INFO:tasks.workunit.client.0.smithi100.stdout:6/181: dwrite d7/f21 [0,4194304] 0 2024-04-30T23:15:49.662 INFO:tasks.workunit.client.0.smithi100.stdout:6/182: stat d7/df/d23/d2b 0 2024-04-30T23:15:49.662 INFO:tasks.workunit.client.0.smithi100.stdout:6/183: chown d7/d9/f31 53721314 1 2024-04-30T23:15:49.665 INFO:tasks.workunit.client.0.smithi100.stdout:6/184: unlink d7/d9/f1c 0 2024-04-30T23:15:49.667 INFO:tasks.workunit.client.0.smithi100.stdout:6/185: fsync d7/db/f16 0 2024-04-30T23:15:49.669 INFO:tasks.workunit.client.0.smithi100.stdout:6/186: creat d7/d1a/d1b/f36 x:0 0 0 2024-04-30T23:15:49.669 INFO:tasks.workunit.client.0.smithi100.stdout:6/187: chown d7/fe 9 1 2024-04-30T23:15:49.670 INFO:tasks.workunit.client.0.smithi100.stdout:6/188: mkdir d7/df/d23/d24/d2e/d37 0 2024-04-30T23:15:49.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/189: unlink d7/d11/f1d 0 2024-04-30T23:15:49.677 INFO:tasks.workunit.client.0.smithi100.stdout:6/190: mkdir d7/d1a/d1b/d22/d38 0 2024-04-30T23:15:49.678 INFO:tasks.workunit.client.0.smithi100.stdout:6/191: creat d7/d1a/d1b/f39 x:0 0 0 2024-04-30T23:15:49.679 INFO:tasks.workunit.client.0.smithi100.stdout:6/192: symlink d7/d9/l3a 0 2024-04-30T23:15:49.701 INFO:tasks.workunit.client.0.smithi100.stdout:6/193: dwrite d7/d1a/d1b/f39 [0,4194304] 0 2024-04-30T23:15:49.703 INFO:tasks.workunit.client.0.smithi100.stdout:6/194: mkdir d7/db/d3b 0 2024-04-30T23:15:49.704 INFO:tasks.workunit.client.0.smithi100.stdout:6/195: creat d7/df/f3c x:0 0 0 2024-04-30T23:15:49.704 INFO:tasks.workunit.client.0.smithi100.stdout:6/196: fdatasync d7/d1a/d1b/f36 0 2024-04-30T23:15:49.706 INFO:tasks.workunit.client.0.smithi100.stdout:6/197: symlink d7/db/l3d 0 2024-04-30T23:15:49.706 INFO:tasks.workunit.client.0.smithi100.stdout:6/198: read - d7/d9/f28 zero size 2024-04-30T23:15:49.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/199: mkdir d7/d1a/d3e 0 2024-04-30T23:15:49.731 INFO:tasks.workunit.client.0.smithi100.stdout:6/200: dwrite d7/d9/f28 [0,4194304] 0 2024-04-30T23:15:49.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/201: dwrite d7/d1a/d1b/f36 [0,4194304] 0 2024-04-30T23:15:49.756 INFO:tasks.workunit.client.0.smithi100.stdout:6/202: mkdir d7/d1a/d1b/d3f 0 2024-04-30T23:15:49.757 INFO:tasks.workunit.client.0.smithi100.stdout:6/203: rmdir d7/df/d23 39 2024-04-30T23:15:49.781 INFO:tasks.workunit.client.0.smithi100.stdout:6/204: dwrite d7/d1a/d1b/f36 [4194304,4194304] 0 2024-04-30T23:15:49.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/205: rmdir d7/d11 39 2024-04-30T23:15:49.783 INFO:tasks.workunit.client.0.smithi100.stdout:6/206: creat d7/d1a/d1b/f40 x:0 0 0 2024-04-30T23:15:49.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/207: creat d7/df/f41 x:0 0 0 2024-04-30T23:15:49.811 INFO:tasks.workunit.client.0.smithi100.stdout:6/208: dwrite d7/d1a/d1b/f40 [0,4194304] 0 2024-04-30T23:15:49.813 INFO:tasks.workunit.client.0.smithi100.stdout:6/209: mkdir d7/df/d23/d2b/d42 0 2024-04-30T23:15:49.826 INFO:tasks.workunit.client.0.smithi100.stdout:6/210: read d7/fe [501242,36118] 0 2024-04-30T23:15:49.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/211: rename d7/f20 to d7/df/d23/d2b/d42/f43 0 2024-04-30T23:15:49.830 INFO:tasks.workunit.client.0.smithi100.stdout:6/212: creat d7/db/f44 x:0 0 0 2024-04-30T23:15:49.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/213: dread f5 [0,4194304] 0 2024-04-30T23:15:49.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/214: rmdir d7/d9 39 2024-04-30T23:15:49.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/215: dread - d7/db/f44 zero size 2024-04-30T23:15:49.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/216: chown d7/d9/l17 57218254 1 2024-04-30T23:15:49.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/217: read d7/d9/f28 [849052,54615] 0 2024-04-30T23:15:49.857 INFO:tasks.workunit.client.0.smithi100.stdout:6/218: write d7/d1a/d1b/f36 [7959493,2359] 0 2024-04-30T23:15:49.857 INFO:tasks.workunit.client.0.smithi100.stdout:6/219: write f5 [1164963,88919] 0 2024-04-30T23:15:49.867 INFO:tasks.workunit.client.0.smithi100.stdout:6/220: write d7/d1a/d1b/f36 [2956447,12971] 0 2024-04-30T23:15:49.911 INFO:tasks.workunit.client.0.smithi100.stdout:5/134: sync 2024-04-30T23:15:49.912 INFO:tasks.workunit.client.0.smithi100.stdout:5/135: symlink d1/d12/d1a/l2e 0 2024-04-30T23:15:49.912 INFO:tasks.workunit.client.0.smithi100.stdout:5/136: stat d1/la 0 2024-04-30T23:15:49.914 INFO:tasks.workunit.client.0.smithi100.stdout:6/221: dwrite d7/d1a/d1b/f40 [0,4194304] 0 2024-04-30T23:15:49.939 INFO:tasks.workunit.client.0.smithi100.stdout:5/137: dwrite d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:49.941 INFO:tasks.workunit.client.0.smithi100.stdout:5/138: link d1/l5 d1/d12/l2f 0 2024-04-30T23:15:49.941 INFO:tasks.workunit.client.0.smithi100.stdout:5/139: stat d1/d12/f16 0 2024-04-30T23:15:49.950 INFO:tasks.workunit.client.0.smithi100.stdout:6/222: dwrite d7/d9/f31 [0,4194304] 0 2024-04-30T23:15:49.953 INFO:tasks.workunit.client.0.smithi100.stdout:6/223: symlink d7/df/d23/d24/d2e/l45 0 2024-04-30T23:15:49.966 INFO:tasks.workunit.client.0.smithi100.stdout:5/140: dwrite d1/d12/d1a/f1f [0,4194304] 0 2024-04-30T23:15:49.967 INFO:tasks.workunit.client.0.smithi100.stdout:6/224: write d7/d11/f15 [314573,2702] 0 2024-04-30T23:15:49.969 INFO:tasks.workunit.client.0.smithi100.stdout:5/141: creat d1/f30 x:0 0 0 2024-04-30T23:15:49.970 INFO:tasks.workunit.client.0.smithi100.stdout:6/225: rename d7/df/c29 to d7/df/d23/d24/d2e/d37/c46 0 2024-04-30T23:15:49.971 INFO:tasks.workunit.client.0.smithi100.stdout:5/142: link d1/f3 d1/d12/f31 0 2024-04-30T23:15:49.974 INFO:tasks.workunit.client.0.smithi100.stdout:6/226: rename d7/fe to d7/d1a/d1b/d3f/f47 0 2024-04-30T23:15:49.974 INFO:tasks.workunit.client.0.smithi100.stdout:6/227: chown d7/db/c2c 2625595 1 2024-04-30T23:15:49.975 INFO:tasks.workunit.client.0.smithi100.stdout:5/143: creat d1/d12/d1a/f32 x:0 0 0 2024-04-30T23:15:49.975 INFO:tasks.workunit.client.0.smithi100.stdout:5/144: creat d1/d2c/f33 x:0 0 0 2024-04-30T23:15:49.976 INFO:tasks.workunit.client.0.smithi100.stdout:5/145: mkdir d1/d12/d24/d34 0 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/146: dread d1/d12/f31 [0,4194304] 0 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/147: rename d1/d12 to d1/d12/d24/d34/d35 22 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/148: dread - d1/f1b zero size 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/149: readlink d1/l28 0 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/150: write d1/d12/f18 [4423691,100197] 0 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/151: fsync d1/d12/f16 0 2024-04-30T23:15:49.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/152: fdatasync d1/d12/f23 0 2024-04-30T23:15:49.994 INFO:tasks.workunit.client.0.smithi100.stdout:5/153: rmdir d1/d2c 39 2024-04-30T23:15:49.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/228: dwrite d7/f27 [0,4194304] 0 2024-04-30T23:15:49.999 INFO:tasks.workunit.client.0.smithi100.stdout:6/229: mknod d7/d1a/d1b/d22/d38/c48 0 2024-04-30T23:15:50.000 INFO:tasks.workunit.client.0.smithi100.stdout:6/230: symlink d7/d1a/d1b/d22/d38/l49 0 2024-04-30T23:15:50.022 INFO:tasks.workunit.client.0.smithi100.stdout:5/154: dwrite d1/d12/f21 [0,4194304] 0 2024-04-30T23:15:50.023 INFO:tasks.workunit.client.0.smithi100.stdout:6/231: dwrite d7/d9/f28 [4194304,4194304] 0 2024-04-30T23:15:50.023 INFO:tasks.workunit.client.0.smithi100.stdout:5/155: creat d1/d12/d1a/f36 x:0 0 0 2024-04-30T23:15:50.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/232: mknod d7/db/d3b/c4a 0 2024-04-30T23:15:50.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/233: write d7/d9/f31 [4214243,10421] 0 2024-04-30T23:15:50.030 INFO:tasks.workunit.client.0.smithi100.stdout:5/156: mkdir d1/d37 0 2024-04-30T23:15:50.031 INFO:tasks.workunit.client.0.smithi100.stdout:5/157: symlink d1/d12/d24/l38 0 2024-04-30T23:15:50.031 INFO:tasks.workunit.client.0.smithi100.stdout:5/158: getdents d1/d12/d24/d34 0 2024-04-30T23:15:50.031 INFO:tasks.workunit.client.0.smithi100.stdout:5/159: fdatasync d1/d12/d1a/f1f 0 2024-04-30T23:15:50.032 INFO:tasks.workunit.client.0.smithi100.stdout:5/160: creat d1/d37/f39 x:0 0 0 2024-04-30T23:15:50.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/173: sync 2024-04-30T23:15:50.042 INFO:tasks.workunit.client.0.smithi100.stdout:5/161: dread d1/d12/d1a/f1f [0,4194304] 0 2024-04-30T23:15:50.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:49 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:50.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:49 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:50.054 INFO:tasks.workunit.client.0.smithi100.stdout:6/234: dwrite d7/d1a/d1b/f39 [0,4194304] 0 2024-04-30T23:15:50.056 INFO:tasks.workunit.client.0.smithi100.stdout:6/235: mkdir d7/d11/d34/d4b 0 2024-04-30T23:15:50.056 INFO:tasks.workunit.client.0.smithi100.stdout:6/236: write d7/d11/d34/f26 [542923,5300] 0 2024-04-30T23:15:50.056 INFO:tasks.workunit.client.0.smithi100.stdout:6/237: write d7/d9/f28 [762180,84244] 0 2024-04-30T23:15:50.062 INFO:tasks.workunit.client.0.smithi100.stdout:6/238: fsync d7/d9/f28 0 2024-04-30T23:15:50.062 INFO:tasks.workunit.client.0.smithi100.stdout:5/162: dread d1/d12/f21 [0,4194304] 0 2024-04-30T23:15:50.064 INFO:tasks.workunit.client.0.smithi100.stdout:6/239: creat d7/d1a/d3e/f4c x:0 0 0 2024-04-30T23:15:50.065 INFO:tasks.workunit.client.0.smithi100.stdout:5/163: mkdir d1/d12/d24/d3a 0 2024-04-30T23:15:50.066 INFO:tasks.workunit.client.0.smithi100.stdout:7/174: dwrite d0/d1b/d2e/f32 [0,4194304] 0 2024-04-30T23:15:50.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:49 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:50.087 INFO:tasks.workunit.client.0.smithi100.stdout:5/164: dwrite d1/d12/d1a/f36 [0,4194304] 0 2024-04-30T23:15:50.087 INFO:tasks.workunit.client.0.smithi100.stdout:5/165: read d1/d12/f23 [91670,65495] 0 2024-04-30T23:15:50.090 INFO:tasks.workunit.client.0.smithi100.stdout:5/166: rename d1/d12/d1a/f1c to d1/f3b 0 2024-04-30T23:15:50.092 INFO:tasks.workunit.client.0.smithi100.stdout:6/240: dwrite d7/d1a/f32 [0,4194304] 0 2024-04-30T23:15:50.093 INFO:tasks.workunit.client.0.smithi100.stdout:6/241: stat d7/d9/f12 0 2024-04-30T23:15:50.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/175: dwrite d0/df/f21 [0,4194304] 0 2024-04-30T23:15:50.096 INFO:tasks.workunit.client.0.smithi100.stdout:6/242: rename d7/db/f2d to d7/df/d23/f4d 0 2024-04-30T23:15:50.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/176: mkdir d0/d1d/d3f 0 2024-04-30T23:15:50.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/177: dread - d0/df/f22 zero size 2024-04-30T23:15:50.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/243: rename d7/d11/f15 to d7/df/d23/f4e 0 2024-04-30T23:15:50.103 INFO:tasks.workunit.client.0.smithi100.stdout:6/244: mkdir d7/df/d23/d4f 0 2024-04-30T23:15:50.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/245: creat d7/d1a/d1b/d22/f50 x:0 0 0 2024-04-30T23:15:50.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/246: creat d7/d9/f51 x:0 0 0 2024-04-30T23:15:50.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/247: stat d7/d9 0 2024-04-30T23:15:50.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/248: creat d7/f52 x:0 0 0 2024-04-30T23:15:50.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/249: write d7/d1a/d3e/f4c [271912,30750] 0 2024-04-30T23:15:50.112 INFO:tasks.workunit.client.0.smithi100.stdout:7/178: read d0/d1b/d2e/f32 [2777594,71200] 0 2024-04-30T23:15:50.113 INFO:tasks.workunit.client.0.smithi100.stdout:7/179: creat d0/d1b/d1e/f40 x:0 0 0 2024-04-30T23:15:50.113 INFO:tasks.workunit.client.0.smithi100.stdout:7/180: fsync d0/f18 0 2024-04-30T23:15:50.114 INFO:tasks.workunit.client.0.smithi100.stdout:7/181: mknod d0/d1d/c41 0 2024-04-30T23:15:50.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/182: truncate d0/df/f14 2045849 0 2024-04-30T23:15:50.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/183: dread - d0/d1b/f3e zero size 2024-04-30T23:15:50.116 INFO:tasks.workunit.client.0.smithi100.stdout:7/184: truncate d0/df/d19/f2d 225476 0 2024-04-30T23:15:50.118 INFO:tasks.workunit.client.0.smithi100.stdout:7/185: mkdir d0/d1b/d2e/d3d/d42 0 2024-04-30T23:15:50.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/186: mknod d0/d1b/d2e/c43 0 2024-04-30T23:15:50.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/187: readlink d0/ld 0 2024-04-30T23:15:50.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/188: fsync d0/fe 0 2024-04-30T23:15:50.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/189: symlink d0/d1b/l44 0 2024-04-30T23:15:50.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/250: dwrite d7/f52 [0,4194304] 0 2024-04-30T23:15:50.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/190: dwrite d0/f8 [0,4194304] 0 2024-04-30T23:15:50.147 INFO:tasks.workunit.client.0.smithi100.stdout:7/191: symlink d0/df/l45 0 2024-04-30T23:15:50.149 INFO:tasks.workunit.client.0.smithi100.stdout:6/251: write d7/db/f16 [4106860,109690] 0 2024-04-30T23:15:50.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/192: dwrite d0/d1b/d2e/f32 [0,4194304] 0 2024-04-30T23:15:50.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/193: readlink d0/df/l15 0 2024-04-30T23:15:50.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/194: chown d0/d1b/f2b 0 1 2024-04-30T23:15:50.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/195: dread - d0/d1b/d24/f2f zero size 2024-04-30T23:15:50.176 INFO:tasks.workunit.client.0.smithi100.stdout:7/196: link d0/f1f d0/d1b/d24/d2a/f46 0 2024-04-30T23:15:50.177 INFO:tasks.workunit.client.0.smithi100.stdout:7/197: creat d0/d1d/d3c/f47 x:0 0 0 2024-04-30T23:15:50.177 INFO:tasks.workunit.client.0.smithi100.stdout:7/198: read - d0/d1b/f2b zero size 2024-04-30T23:15:50.181 INFO:tasks.workunit.client.0.smithi100.stdout:6/252: dwrite d7/d1a/d3e/f4c [0,4194304] 0 2024-04-30T23:15:50.181 INFO:tasks.workunit.client.0.smithi100.stdout:6/253: write d7/d1a/d1b/f36 [8201469,13523] 0 2024-04-30T23:15:50.203 INFO:tasks.workunit.client.0.smithi100.stdout:7/199: dwrite d0/d1b/f2b [0,4194304] 0 2024-04-30T23:15:50.222 INFO:tasks.workunit.client.0.smithi100.stdout:7/200: dwrite d0/d1d/d3c/f47 [0,4194304] 0 2024-04-30T23:15:50.222 INFO:tasks.workunit.client.0.smithi100.stdout:7/201: truncate d0/d1b/d1e/f40 378552 0 2024-04-30T23:15:50.224 INFO:tasks.workunit.client.0.smithi100.stdout:7/202: mkdir d0/d1b/d2e/d3d/d42/d48 0 2024-04-30T23:15:50.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/203: truncate d0/d1b/d24/d2a/f46 630114 0 2024-04-30T23:15:50.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/204: write d0/df/f29 [445772,79373] 0 2024-04-30T23:15:50.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/205: stat d0/d1b/d1e 0 2024-04-30T23:15:50.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/206: chown d0/f18 7 1 2024-04-30T23:15:50.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/207: chown d0/l33 15967 1 2024-04-30T23:15:50.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/208: dwrite d0/df/f29 [0,4194304] 0 2024-04-30T23:15:50.279 INFO:tasks.workunit.client.0.smithi100.stdout:7/209: dwrite d0/d1b/d2e/f32 [0,4194304] 0 2024-04-30T23:15:50.279 INFO:tasks.workunit.client.0.smithi100.stdout:7/210: write d0/df/f14 [2060898,75279] 0 2024-04-30T23:15:50.294 INFO:tasks.workunit.client.0.smithi100.stdout:7/211: dread d0/d1b/d24/d2a/f46 [0,4194304] 0 2024-04-30T23:15:50.295 INFO:tasks.workunit.client.0.smithi100.stdout:7/212: link d0/f18 d0/d1b/d1e/f49 0 2024-04-30T23:15:50.296 INFO:tasks.workunit.client.0.smithi100.stdout:7/213: mkdir d0/d1b/d2e/d3d/d42/d48/d4a 0 2024-04-30T23:15:50.296 INFO:tasks.workunit.client.0.smithi100.stdout:7/214: write d0/d1b/d24/f3b [197064,88728] 0 2024-04-30T23:15:50.296 INFO:tasks.workunit.client.0.smithi100.stdout:7/215: truncate d0/d1b/f2b 1087766 0 2024-04-30T23:15:50.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/216: mkdir d0/df/d19/d4b 0 2024-04-30T23:15:50.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/217: write d0/d1b/f3e [953165,130485] 0 2024-04-30T23:15:50.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/218: truncate d0/df/d19/f3a 890930 0 2024-04-30T23:15:50.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/219: write d0/df/f22 [970999,51504] 0 2024-04-30T23:15:50.299 INFO:tasks.workunit.client.0.smithi100.stdout:7/220: creat d0/d1b/d2e/d3d/d42/d48/d4a/f4c x:0 0 0 2024-04-30T23:15:50.464 INFO:tasks.workunit.client.0.smithi100.stdout:2/177: sync 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/220: sync 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/123: sync 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:4/190: sync 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:4/191: chown d19/d1a/d21/l22 200684 1 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/221: chown d3/d18/d3b/l42 1195610331 1 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/222: write d3/d18/f43 [1045628,4918] 0 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/223: truncate d3/d16/d20/d24/f44 283298 0 2024-04-30T23:15:50.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/124: symlink d2/l2c 0 2024-04-30T23:15:50.466 INFO:tasks.workunit.client.0.smithi100.stdout:1/224: creat d3/db/d4b/f4c x:0 0 0 2024-04-30T23:15:50.468 INFO:tasks.workunit.client.0.smithi100.stdout:0/125: creat d2/d14/d18/f2d x:0 0 0 2024-04-30T23:15:50.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/126: creat d2/f2e x:0 0 0 2024-04-30T23:15:50.479 INFO:tasks.workunit.client.0.smithi100.stdout:2/178: dread d5/d12/f1e [0,4194304] 0 2024-04-30T23:15:50.479 INFO:tasks.workunit.client.0.smithi100.stdout:2/179: fsync d5/d2e/f30 0 2024-04-30T23:15:50.480 INFO:tasks.workunit.client.0.smithi100.stdout:2/180: stat d5/d12/l15 0 2024-04-30T23:15:50.480 INFO:tasks.workunit.client.0.smithi100.stdout:2/181: chown d5/d12/d13/f17 26 1 2024-04-30T23:15:50.481 INFO:tasks.workunit.client.0.smithi100.stdout:2/182: creat d5/d12/f3c x:0 0 0 2024-04-30T23:15:50.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/183: dread d5/d2e/f30 [0,4194304] 0 2024-04-30T23:15:50.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/184: write d5/f32 [82112,122629] 0 2024-04-30T23:15:50.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/185: readlink d5/d22/l23 0 2024-04-30T23:15:50.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/127: dwrite d2/f2e [0,4194304] 0 2024-04-30T23:15:50.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/128: dread - d2/d14/d18/f1f zero size 2024-04-30T23:15:50.500 INFO:tasks.workunit.client.0.smithi100.stdout:0/129: truncate d2/f4 4276537 0 2024-04-30T23:15:50.502 INFO:tasks.workunit.client.0.smithi100.stdout:0/130: creat d2/d14/f2f x:0 0 0 2024-04-30T23:15:50.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/131: mkdir d2/d14/d26/d30 0 2024-04-30T23:15:50.505 INFO:tasks.workunit.client.0.smithi100.stdout:0/132: rename d2/d14/d18/c28 to d2/d14/c31 0 2024-04-30T23:15:50.506 INFO:tasks.workunit.client.0.smithi100.stdout:0/133: mkdir d2/d14/d26/d30/d32 0 2024-04-30T23:15:50.507 INFO:tasks.workunit.client.0.smithi100.stdout:2/186: dwrite d5/f16 [0,4194304] 0 2024-04-30T23:15:50.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/134: creat d2/d14/d18/f33 x:0 0 0 2024-04-30T23:15:50.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/135: write d2/f12 [608748,62344] 0 2024-04-30T23:15:50.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/136: write d2/d14/f2f [128948,37794] 0 2024-04-30T23:15:50.509 INFO:tasks.workunit.client.0.smithi100.stdout:0/137: truncate d2/d14/d18/f1f 365582 0 2024-04-30T23:15:50.512 INFO:tasks.workunit.client.0.smithi100.stdout:2/187: creat d5/d12/f3d x:0 0 0 2024-04-30T23:15:50.531 INFO:tasks.workunit.client.0.smithi100.stdout:0/138: dwrite d2/f8 [0,4194304] 0 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:3/236: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:7/221: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:8/90: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:9/132: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/254: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:5/167: sync 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:7/222: write d0/d1b/d1e/f49 [365689,102659] 0 2024-04-30T23:15:50.649 INFO:tasks.workunit.client.0.smithi100.stdout:3/237: write d1/d14/f36 [636052,118988] 0 2024-04-30T23:15:50.650 INFO:tasks.workunit.client.0.smithi100.stdout:7/223: fsync d0/df/f29 0 2024-04-30T23:15:50.650 INFO:tasks.workunit.client.0.smithi100.stdout:3/238: stat d1/d14/d15 0 2024-04-30T23:15:50.650 INFO:tasks.workunit.client.0.smithi100.stdout:9/133: rename d4/ca to d4/c2b 0 2024-04-30T23:15:50.650 INFO:tasks.workunit.client.0.smithi100.stdout:8/91: truncate d2/de/fa 1936766 0 2024-04-30T23:15:50.651 INFO:tasks.workunit.client.0.smithi100.stdout:6/255: creat d7/df/f53 x:0 0 0 2024-04-30T23:15:50.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/224: link d0/d1b/d24/d2a/f46 d0/d1b/d2e/d3d/d42/d48/d4a/f4d 0 2024-04-30T23:15:50.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/225: chown d0/d1b/d24/d2a/f46 15 1 2024-04-30T23:15:50.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/134: truncate d4/d9/f16 1964503 0 2024-04-30T23:15:50.657 INFO:tasks.workunit.client.0.smithi100.stdout:6/256: mknod d7/db/d3b/c54 0 2024-04-30T23:15:50.659 INFO:tasks.workunit.client.0.smithi100.stdout:8/92: symlink d2/d7/l1e 0 2024-04-30T23:15:50.677 INFO:tasks.workunit.client.0.smithi100.stdout:5/168: dwrite d1/fe [0,4194304] 0 2024-04-30T23:15:50.677 INFO:tasks.workunit.client.0.smithi100.stdout:5/169: chown d1/c2b 29246 1 2024-04-30T23:15:50.677 INFO:tasks.workunit.client.0.smithi100.stdout:5/170: chown d1/d12/d24/d3a 522686 1 2024-04-30T23:15:50.683 INFO:tasks.workunit.client.0.smithi100.stdout:3/239: dwrite d1/ff [0,4194304] 0 2024-04-30T23:15:50.683 INFO:tasks.workunit.client.0.smithi100.stdout:9/135: dwrite d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:50.695 INFO:tasks.workunit.client.0.smithi100.stdout:5/171: write d1/f7 [4068134,93080] 0 2024-04-30T23:15:50.696 INFO:tasks.workunit.client.0.smithi100.stdout:5/172: read d1/d12/d1a/f22 [976322,28664] 0 2024-04-30T23:15:50.698 INFO:tasks.workunit.client.0.smithi100.stdout:9/136: dread d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:50.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/257: dwrite d7/df/d23/f4e [0,4194304] 0 2024-04-30T23:15:50.702 INFO:tasks.workunit.client.0.smithi100.stdout:8/93: write d2/d7/d18/f15 [1166906,62619] 0 2024-04-30T23:15:50.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/226: dwrite d0/d1b/d1e/f28 [4194304,4194304] 0 2024-04-30T23:15:50.702 INFO:tasks.workunit.client.0.smithi100.stdout:8/94: chown d2/f6 347 1 2024-04-30T23:15:50.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/227: write d0/d1b/f3e [1601013,123664] 0 2024-04-30T23:15:50.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/240: dwrite d1/f9 [0,4194304] 0 2024-04-30T23:15:50.711 INFO:tasks.workunit.client.0.smithi100.stdout:8/95: rename l1 to d2/de/d10/l1f 0 2024-04-30T23:15:50.713 INFO:tasks.workunit.client.0.smithi100.stdout:3/241: rmdir d1/d14/d15/d32 39 2024-04-30T23:15:50.713 INFO:tasks.workunit.client.0.smithi100.stdout:3/242: dread - d1/d14/d15/d1e/f39 zero size 2024-04-30T23:15:50.715 INFO:tasks.workunit.client.0.smithi100.stdout:7/228: rename d0/f4 to d0/d1b/d2e/d3d/d42/d48/d4a/f4e 0 2024-04-30T23:15:50.715 INFO:tasks.workunit.client.0.smithi100.stdout:8/96: creat d2/d7/f20 x:0 0 0 2024-04-30T23:15:50.717 INFO:tasks.workunit.client.0.smithi100.stdout:3/243: truncate d1/d14/f19 142155 0 2024-04-30T23:15:50.719 INFO:tasks.workunit.client.0.smithi100.stdout:7/229: mkdir d0/df/d4f 0 2024-04-30T23:15:50.719 INFO:tasks.workunit.client.0.smithi100.stdout:7/230: truncate d0/df/f21 4919351 0 2024-04-30T23:15:50.719 INFO:tasks.workunit.client.0.smithi100.stdout:3/244: rmdir d1/d14/d15/d27 39 2024-04-30T23:15:50.721 INFO:tasks.workunit.client.0.smithi100.stdout:7/231: creat d0/d1b/d2e/d3d/d42/d48/f50 x:0 0 0 2024-04-30T23:15:50.721 INFO:tasks.workunit.client.0.smithi100.stdout:3/245: symlink d1/d14/d2b/l46 0 2024-04-30T23:15:50.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/232: rename d0/d1b/d24/d2a/c37 to d0/d1b/d24/d2a/c51 0 2024-04-30T23:15:50.728 INFO:tasks.workunit.client.0.smithi100.stdout:5/173: dwrite d1/d12/f31 [0,4194304] 0 2024-04-30T23:15:50.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/233: creat d0/d1b/d24/d2a/f52 x:0 0 0 2024-04-30T23:15:50.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/234: mkdir d0/df/d4f/d53 0 2024-04-30T23:15:50.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/235: fsync d0/df/f39 0 2024-04-30T23:15:50.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/236: truncate d0/d1b/f3e 2130556 0 2024-04-30T23:15:50.735 INFO:tasks.workunit.client.0.smithi100.stdout:8/97: dread d2/d7/d18/f15 [0,4194304] 0 2024-04-30T23:15:50.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/237: dread d0/df/f22 [0,4194304] 0 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/98: symlink d2/de/l21 0 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/99: dread - d2/f9 zero size 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/100: readlink d2/d7/l16 0 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/101: chown d2/f1d 1260 1 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/102: write d2/d7/f20 [581845,99976] 0 2024-04-30T23:15:50.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/103: fsync d2/f8 0 2024-04-30T23:15:50.743 INFO:tasks.workunit.client.0.smithi100.stdout:7/238: dread d0/df/f22 [0,4194304] 0 2024-04-30T23:15:50.744 INFO:tasks.workunit.client.0.smithi100.stdout:3/246: dwrite d1/d14/d15/d32/f40 [0,4194304] 0 2024-04-30T23:15:50.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/104: fdatasync d2/d7/f20 0 2024-04-30T23:15:50.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/105: dread - d2/de/d10/d17/f1b zero size 2024-04-30T23:15:50.748 INFO:tasks.workunit.client.0.smithi100.stdout:7/239: dread d0/f16 [0,4194304] 0 2024-04-30T23:15:50.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/106: creat d2/de/f22 x:0 0 0 2024-04-30T23:15:50.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/107: write d2/f9 [903589,34929] 0 2024-04-30T23:15:50.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/108: read d2/f3 [1764847,104380] 0 2024-04-30T23:15:50.753 INFO:tasks.workunit.client.0.smithi100.stdout:5/174: dwrite d1/d12/d1a/f1f [0,4194304] 0 2024-04-30T23:15:50.754 INFO:tasks.workunit.client.0.smithi100.stdout:5/175: write d1/d37/f39 [805201,58343] 0 2024-04-30T23:15:50.754 INFO:tasks.workunit.client.0.smithi100.stdout:5/176: truncate d1/d12/d1a/f2d 342343 0 2024-04-30T23:15:50.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/109: dread d2/de/fa [0,4194304] 0 2024-04-30T23:15:50.761 INFO:tasks.workunit.client.0.smithi100.stdout:8/110: rename d2/de/l11 to d2/d7/l23 0 2024-04-30T23:15:50.764 INFO:tasks.workunit.client.0.smithi100.stdout:8/111: rename d2/d7/d18/c14 to d2/c24 0 2024-04-30T23:15:50.765 INFO:tasks.workunit.client.0.smithi100.stdout:8/112: truncate d2/f6 339848 0 2024-04-30T23:15:50.765 INFO:tasks.workunit.client.0.smithi100.stdout:8/113: fdatasync d2/d7/d18/f15 0 2024-04-30T23:15:50.766 INFO:tasks.workunit.client.0.smithi100.stdout:8/114: write d2/d7/f20 [1185435,42639] 0 2024-04-30T23:15:50.780 INFO:tasks.workunit.client.0.smithi100.stdout:5/177: dwrite d1/d12/d27/f29 [0,4194304] 0 2024-04-30T23:15:50.785 INFO:tasks.workunit.client.0.smithi100.stdout:8/115: dread d2/ff [8388608,4194304] 0 2024-04-30T23:15:50.793 INFO:tasks.workunit.client.0.smithi100.stdout:5/178: read d1/f7 [641353,80512] 0 2024-04-30T23:15:50.794 INFO:tasks.workunit.client.0.smithi100.stdout:5/179: getdents d1/d2c 0 2024-04-30T23:15:50.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/180: rename d1/l11 to d1/d2c/l3c 0 2024-04-30T23:15:50.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/116: dread d2/ff [4194304,4194304] 0 2024-04-30T23:15:50.800 INFO:tasks.workunit.client.0.smithi100.stdout:8/117: chown d2/d7/f12 37130 1 2024-04-30T23:15:50.800 INFO:tasks.workunit.client.0.smithi100.stdout:8/118: stat d2/de/d10/d17 0 2024-04-30T23:15:50.808 INFO:tasks.workunit.client.0.smithi100.stdout:8/119: truncate d2/f3 5413526 0 2024-04-30T23:15:50.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/120: rename d2/de/cd to d2/de/d10/d17/c25 0 2024-04-30T23:15:50.811 INFO:tasks.workunit.client.0.smithi100.stdout:8/121: getdents d2 0 2024-04-30T23:15:50.823 INFO:tasks.workunit.client.0.smithi100.stdout:5/181: dwrite d1/d12/f21 [4194304,4194304] 0 2024-04-30T23:15:50.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/122: dread d2/ff [0,4194304] 0 2024-04-30T23:15:50.823 INFO:tasks.workunit.client.0.smithi100.stdout:5/182: write d1/d12/d1a/f32 [62722,98043] 0 2024-04-30T23:15:50.824 INFO:tasks.workunit.client.0.smithi100.stdout:8/123: creat d2/d7/f26 x:0 0 0 2024-04-30T23:15:50.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/183: creat d1/d12/d1a/f3d x:0 0 0 2024-04-30T23:15:50.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/184: dread - d1/d12/d1a/f3d zero size 2024-04-30T23:15:50.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/185: mkdir d1/d3e 0 2024-04-30T23:15:50.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/124: symlink d2/d7/l27 0 2024-04-30T23:15:50.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/186: link d1/d2c/l3c d1/d2c/l3f 0 2024-04-30T23:15:50.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/125: dread d2/f4 [0,4194304] 0 2024-04-30T23:15:50.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/187: dwrite d1/f3b [0,4194304] 0 2024-04-30T23:15:50.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/188: mknod d1/d12/d24/c40 0 2024-04-30T23:15:50.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/126: dwrite d2/f8 [4194304,4194304] 0 2024-04-30T23:15:50.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/127: mknod d2/de/d10/c28 0 2024-04-30T23:15:50.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/128: truncate d2/de/d10/d17/f1b 715075 0 2024-04-30T23:15:50.859 INFO:tasks.workunit.client.0.smithi100.stdout:8/129: chown d2/de/d10/d17 1023 1 2024-04-30T23:15:50.860 INFO:tasks.workunit.client.0.smithi100.stdout:8/130: mkdir d2/d29 0 2024-04-30T23:15:50.861 INFO:tasks.workunit.client.0.smithi100.stdout:8/131: mknod d2/de/d10/c2a 0 2024-04-30T23:15:50.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/132: dread d2/de/fa [0,4194304] 0 2024-04-30T23:15:50.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/133: dread - d2/d7/f12 zero size 2024-04-30T23:15:50.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/134: write d2/d7/f20 [1200199,14202] 0 2024-04-30T23:15:50.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/135: write d2/d7/f12 [407836,85391] 0 2024-04-30T23:15:50.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/136: truncate d2/d7/f12 1494851 0 2024-04-30T23:15:50.879 INFO:tasks.workunit.client.0.smithi100.stdout:5/189: dwrite d1/f1b [0,4194304] 0 2024-04-30T23:15:50.894 INFO:tasks.workunit.client.0.smithi100.stdout:8/137: dwrite d2/de/f22 [0,4194304] 0 2024-04-30T23:15:50.897 INFO:tasks.workunit.client.0.smithi100.stdout:8/138: getdents d2/de/d10/d17 0 2024-04-30T23:15:50.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/190: dwrite d1/d12/d1a/f36 [0,4194304] 0 2024-04-30T23:15:50.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/191: unlink d1/d37/f39 0 2024-04-30T23:15:50.920 INFO:tasks.workunit.client.0.smithi100.stdout:8/139: dwrite d2/de/f22 [4194304,4194304] 0 2024-04-30T23:15:50.924 INFO:tasks.workunit.client.0.smithi100.stdout:8/140: dread d2/f3 [4194304,4194304] 0 2024-04-30T23:15:50.925 INFO:tasks.workunit.client.0.smithi100.stdout:8/141: creat d2/d29/f2b x:0 0 0 2024-04-30T23:15:50.944 INFO:tasks.workunit.client.0.smithi100.stdout:8/142: dwrite d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:50.946 INFO:tasks.workunit.client.0.smithi100.stdout:8/143: mknod d2/d29/c2c 0 2024-04-30T23:15:50.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/144: read d2/f9 [523546,64573] 0 2024-04-30T23:15:50.951 INFO:tasks.workunit.client.0.smithi100.stdout:8/145: link d2/de/d10/d17/f1b d2/d7/f2d 0 2024-04-30T23:15:50.951 INFO:tasks.workunit.client.0.smithi100.stdout:8/146: write d2/f3 [5329980,18596] 0 2024-04-30T23:15:51.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:50 smithi104 ceph-mon[32987]: pgmap v440: 129 pgs: 129 active+clean; 427 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 47 MiB/s wr, 529 op/s 2024-04-30T23:15:51.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:50 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:51.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:50 smithi183 ceph-mon[33560]: pgmap v440: 129 pgs: 129 active+clean; 427 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 47 MiB/s wr, 529 op/s 2024-04-30T23:15:51.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:50 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:50 smithi100 ceph-mon[29745]: pgmap v440: 129 pgs: 129 active+clean; 427 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 47 MiB/s wr, 529 op/s 2024-04-30T23:15:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:50 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:51.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/192: sync 2024-04-30T23:15:51.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/225: sync 2024-04-30T23:15:51.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/193: rename d19/d1a to d19/d1a/d21/d32/d38 22 2024-04-30T23:15:51.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/226: write d3/d16/f36 [106403,93594] 0 2024-04-30T23:15:51.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/227: dread - d3/d16/d20/d24/d3f/f46 zero size 2024-04-30T23:15:51.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/228: link d3/d16/d20/f22 d3/f4d 0 2024-04-30T23:15:51.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/229: chown d3/d18/c28 828 1 2024-04-30T23:15:51.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/230: chown d3/d16/f1d 1540899109 1 2024-04-30T23:15:51.249 INFO:tasks.workunit.client.0.smithi100.stdout:1/231: unlink d3/c1c 0 2024-04-30T23:15:51.249 INFO:tasks.workunit.client.0.smithi100.stdout:1/232: chown d3/db/ce 317 1 2024-04-30T23:15:51.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/194: dread f9 [0,4194304] 0 2024-04-30T23:15:51.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/233: dread d3/f4d [0,4194304] 0 2024-04-30T23:15:51.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/234: fsync d3/db/f3d 0 2024-04-30T23:15:51.281 INFO:tasks.workunit.client.0.smithi100.stdout:4/195: dwrite d19/d1a/f37 [0,4194304] 0 2024-04-30T23:15:51.283 INFO:tasks.workunit.client.0.smithi100.stdout:4/196: rename d19/c1c to d19/c39 0 2024-04-30T23:15:51.284 INFO:tasks.workunit.client.0.smithi100.stdout:4/197: getdents d19/d1a 0 2024-04-30T23:15:51.286 INFO:tasks.workunit.client.0.smithi100.stdout:1/235: rename d3/d16/d20/l34 to d3/d16/l4e 0 2024-04-30T23:15:51.288 INFO:tasks.workunit.client.0.smithi100.stdout:4/198: rename c17 to d19/d1a/d21/d32/c3a 0 2024-04-30T23:15:51.290 INFO:tasks.workunit.client.0.smithi100.stdout:4/199: symlink d19/d1a/d29/l3b 0 2024-04-30T23:15:51.307 INFO:tasks.workunit.client.0.smithi100.stdout:1/236: dwrite d3/f4 [0,4194304] 0 2024-04-30T23:15:51.310 INFO:tasks.workunit.client.0.smithi100.stdout:1/237: rename d3/f19 to d3/f4f 0 2024-04-30T23:15:51.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/200: dwrite d19/f26 [0,4194304] 0 2024-04-30T23:15:51.316 INFO:tasks.workunit.client.0.smithi100.stdout:1/238: write d3/d18/f43 [400659,2799] 0 2024-04-30T23:15:51.317 INFO:tasks.workunit.client.0.smithi100.stdout:4/201: rmdir d19/d1a/d21 39 2024-04-30T23:15:51.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/239: symlink d3/d18/d3b/l50 0 2024-04-30T23:15:51.349 INFO:tasks.workunit.client.0.smithi100.stdout:4/202: dwrite f3 [0,4194304] 0 2024-04-30T23:15:51.351 INFO:tasks.workunit.client.0.smithi100.stdout:4/203: mkdir d19/d1a/d21/d3c 0 2024-04-30T23:15:51.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/240: dwrite d3/d16/d20/d24/f2b [0,4194304] 0 2024-04-30T23:15:51.364 INFO:tasks.workunit.client.0.smithi100.stdout:4/204: write d19/f2f [1829533,90313] 0 2024-04-30T23:15:51.382 INFO:tasks.workunit.client.0.smithi100.stdout:1/241: dwrite d3/db/f40 [0,4194304] 0 2024-04-30T23:15:51.383 INFO:tasks.workunit.client.0.smithi100.stdout:1/242: getdents d3/db 0 2024-04-30T23:15:51.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/243: mkdir d3/d16/d20/d24/d51 0 2024-04-30T23:15:51.401 INFO:tasks.workunit.client.0.smithi100.stdout:1/244: dread d3/d16/d20/d24/f2b [0,4194304] 0 2024-04-30T23:15:51.401 INFO:tasks.workunit.client.0.smithi100.stdout:1/245: write d3/d16/d20/d24/f48 [408139,73320] 0 2024-04-30T23:15:51.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/246: dwrite d3/f26 [0,4194304] 0 2024-04-30T23:15:51.426 INFO:tasks.workunit.client.0.smithi100.stdout:1/247: mknod d3/d16/c52 0 2024-04-30T23:15:51.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/188: sync 2024-04-30T23:15:51.503 INFO:tasks.workunit.client.0.smithi100.stdout:2/189: truncate d5/f16 236178 0 2024-04-30T23:15:51.637 INFO:tasks.workunit.client.0.smithi100.stdout:0/139: sync 2024-04-30T23:15:51.637 INFO:tasks.workunit.client.0.smithi100.stdout:0/140: chown d2/d14/d26/d30/d32 29386749 1 2024-04-30T23:15:51.637 INFO:tasks.workunit.client.0.smithi100.stdout:0/141: chown d2/d14/d18 6 1 2024-04-30T23:15:51.638 INFO:tasks.workunit.client.0.smithi100.stdout:0/142: rmdir d2/d14/d26/d30 39 2024-04-30T23:15:51.652 INFO:tasks.workunit.client.0.smithi100.stdout:0/143: dread d2/f5 [0,4194304] 0 2024-04-30T23:15:51.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/144: dwrite d2/d14/d18/f2b [0,4194304] 0 2024-04-30T23:15:51.680 INFO:tasks.workunit.client.0.smithi100.stdout:0/145: dread d2/fb [0,4194304] 0 2024-04-30T23:15:51.685 INFO:tasks.workunit.client.0.smithi100.stdout:0/146: unlink d2/fd 0 2024-04-30T23:15:51.704 INFO:tasks.workunit.client.0.smithi100.stdout:0/147: dwrite d2/d14/d18/f2d [0,4194304] 0 2024-04-30T23:15:51.704 INFO:tasks.workunit.client.0.smithi100.stdout:0/148: readlink d2/d14/l20 0 2024-04-30T23:15:51.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/149: mkdir d2/d34 0 2024-04-30T23:15:51.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/150: chown d2/c10 0 1 2024-04-30T23:15:51.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/151: fdatasync d2/f5 0 2024-04-30T23:15:51.707 INFO:tasks.workunit.client.0.smithi100.stdout:0/152: unlink d2/f4 0 2024-04-30T23:15:51.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/153: write d2/d14/f1d [3876741,64884] 0 2024-04-30T23:15:51.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/154: readlink d2/l11 0 2024-04-30T23:15:51.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/155: dwrite d2/d14/f19 [0,4194304] 0 2024-04-30T23:15:51.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/156: mkdir d2/d14/d35 0 2024-04-30T23:15:51.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/157: chown d2/d14/d35 38766 1 2024-04-30T23:15:51.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/158: dread d2/d14/d18/f1f [0,4194304] 0 2024-04-30T23:15:51.734 INFO:tasks.workunit.client.0.smithi100.stdout:0/159: dread d2/fb [0,4194304] 0 2024-04-30T23:15:51.734 INFO:tasks.workunit.client.0.smithi100.stdout:0/160: stat d2/d14/d26/d30 0 2024-04-30T23:15:51.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/161: rmdir d2/d34 0 2024-04-30T23:15:51.765 INFO:tasks.workunit.client.0.smithi100.stdout:0/162: dwrite d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:51.788 INFO:tasks.workunit.client.0.smithi100.stdout:6/258: sync 2024-04-30T23:15:51.788 INFO:tasks.workunit.client.0.smithi100.stdout:0/163: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:51.791 INFO:tasks.workunit.client.0.smithi100.stdout:6/259: rename d7/d9/ca to d7/df/d23/d2b/d42/c55 0 2024-04-30T23:15:51.791 INFO:tasks.workunit.client.0.smithi100.stdout:6/260: readlink l2 0 2024-04-30T23:15:51.791 INFO:tasks.workunit.client.0.smithi100.stdout:6/261: chown d7/df/d23/d24/d2e/d37 95678114 1 2024-04-30T23:15:51.793 INFO:tasks.workunit.client.0.smithi100.stdout:0/164: creat d2/f36 x:0 0 0 2024-04-30T23:15:51.793 INFO:tasks.workunit.client.0.smithi100.stdout:0/165: readlink d2/d14/l15 0 2024-04-30T23:15:51.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/262: dread d7/d9/f31 [0,4194304] 0 2024-04-30T23:15:51.806 INFO:tasks.workunit.client.0.smithi100.stdout:6/263: creat d7/df/d23/d24/d2e/f56 x:0 0 0 2024-04-30T23:15:51.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/264: mkdir d7/d11/d57 0 2024-04-30T23:15:51.809 INFO:tasks.workunit.client.0.smithi100.stdout:6/265: creat d7/db/d3b/f58 x:0 0 0 2024-04-30T23:15:51.818 INFO:tasks.workunit.client.0.smithi100.stdout:0/166: dwrite d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:51.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/167: mknod d2/d14/d35/c37 0 2024-04-30T23:15:51.837 INFO:tasks.workunit.client.0.smithi100.stdout:6/266: dwrite d7/d1a/f30 [0,4194304] 0 2024-04-30T23:15:51.842 INFO:tasks.workunit.client.0.smithi100.stdout:0/168: dwrite d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:51.862 INFO:tasks.workunit.client.0.smithi100.stdout:0/169: dwrite d2/d14/d18/f1f [0,4194304] 0 2024-04-30T23:15:51.864 INFO:tasks.workunit.client.0.smithi100.stdout:0/170: mkdir d2/d14/d26/d38 0 2024-04-30T23:15:51.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/171: creat d2/d14/d35/f39 x:0 0 0 2024-04-30T23:15:51.867 INFO:tasks.workunit.client.0.smithi100.stdout:0/172: rename d2/d14/d18/f2b to d2/f3a 0 2024-04-30T23:15:51.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/173: creat d2/d14/d26/d30/d32/f3b x:0 0 0 2024-04-30T23:15:51.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/174: chown d2/d14/d26/d30/d32/f3b 2 1 2024-04-30T23:15:51.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/175: chown d2/d14/d18 33677 1 2024-04-30T23:15:51.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/176: truncate d2/d14/f19 3700455 0 2024-04-30T23:15:51.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/177: creat d2/d14/d26/f3c x:0 0 0 2024-04-30T23:15:51.883 INFO:tasks.workunit.client.0.smithi100.stdout:0/178: write d2/d14/f24 [2854500,120492] 0 2024-04-30T23:15:51.883 INFO:tasks.workunit.client.0.smithi100.stdout:0/179: fdatasync d2/f1e 0 2024-04-30T23:15:51.884 INFO:tasks.workunit.client.0.smithi100.stdout:0/180: creat d2/d14/d26/d30/f3d x:0 0 0 2024-04-30T23:15:51.885 INFO:tasks.workunit.client.0.smithi100.stdout:0/181: truncate d2/fc 2510693 0 2024-04-30T23:15:51.885 INFO:tasks.workunit.client.0.smithi100.stdout:0/182: fdatasync d2/d14/d35/f39 0 2024-04-30T23:15:51.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/183: mknod d2/d14/d35/c3e 0 2024-04-30T23:15:51.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/184: dread - d2/d14/d18/f33 zero size 2024-04-30T23:15:51.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/185: readlink d2/l25 0 2024-04-30T23:15:51.894 INFO:tasks.workunit.client.0.smithi100.stdout:0/186: dread d2/d14/f19 [0,4194304] 0 2024-04-30T23:15:51.896 INFO:tasks.workunit.client.0.smithi100.stdout:0/187: rename d2/d14/f1d to d2/d14/d26/d38/f3f 0 2024-04-30T23:15:51.897 INFO:tasks.workunit.client.0.smithi100.stdout:0/188: mkdir d2/d14/d35/d40 0 2024-04-30T23:15:51.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/189: rename d2/l6 to d2/d14/d35/d40/l41 0 2024-04-30T23:15:51.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/190: write d2/d14/d26/d30/d32/f3b [770771,86151] 0 2024-04-30T23:15:51.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/191: chown d2/d14/l20 423416 1 2024-04-30T23:15:51.906 INFO:tasks.workunit.client.0.smithi100.stdout:0/192: rmdir d2 39 2024-04-30T23:15:51.907 INFO:tasks.workunit.client.0.smithi100.stdout:0/193: chown d2/d14/d18/f29 468743 1 2024-04-30T23:15:51.918 INFO:tasks.workunit.client.0.smithi100.stdout:0/194: dread d2/f23 [0,4194304] 0 2024-04-30T23:15:51.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/195: link d2/f8 d2/d14/d18/f42 0 2024-04-30T23:15:51.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/196: unlink d2/f36 0 2024-04-30T23:15:51.930 INFO:tasks.workunit.client.0.smithi100.stdout:0/197: creat d2/d14/d35/f43 x:0 0 0 2024-04-30T23:15:51.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/198: symlink d2/d14/d18/l44 0 2024-04-30T23:15:52.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:51 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:52.049 INFO:tasks.workunit.client.0.smithi100.stdout:9/137: sync 2024-04-30T23:15:52.049 INFO:tasks.workunit.client.0.smithi100.stdout:4/205: sync 2024-04-30T23:15:52.050 INFO:tasks.workunit.client.0.smithi100.stdout:3/247: sync 2024-04-30T23:15:52.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/206: getdents d19/d1a 0 2024-04-30T23:15:52.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/207: creat d19/d1a/d21/d32/f3d x:0 0 0 2024-04-30T23:15:52.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:51 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:52.052 INFO:tasks.workunit.client.0.smithi100.stdout:4/208: mknod d19/d1a/d21/d32/c3e 0 2024-04-30T23:15:52.053 INFO:tasks.workunit.client.0.smithi100.stdout:4/209: mkdir d19/d33/d3f 0 2024-04-30T23:15:52.053 INFO:tasks.workunit.client.0.smithi100.stdout:4/210: truncate d19/d33/f31 1043917 0 2024-04-30T23:15:52.053 INFO:tasks.workunit.client.0.smithi100.stdout:4/211: fsync d19/d1a/d21/f2b 0 2024-04-30T23:15:52.055 INFO:tasks.workunit.client.0.smithi100.stdout:4/212: truncate f11 54230 0 2024-04-30T23:15:52.056 INFO:tasks.workunit.client.0.smithi100.stdout:4/213: mkdir d19/d33/d3f/d40 0 2024-04-30T23:15:52.057 INFO:tasks.workunit.client.0.smithi100.stdout:4/214: creat d19/d33/d3f/f41 x:0 0 0 2024-04-30T23:15:52.057 INFO:tasks.workunit.client.0.smithi100.stdout:4/215: chown f8 6273 1 2024-04-30T23:15:52.059 INFO:tasks.workunit.client.0.smithi100.stdout:4/216: rename d19/d1a/d21/l22 to d19/d33/l42 0 2024-04-30T23:15:52.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/217: dread f8 [0,4194304] 0 2024-04-30T23:15:52.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:51 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:52.074 INFO:tasks.workunit.client.0.smithi100.stdout:4/218: mknod d19/d1a/d21/d32/c43 0 2024-04-30T23:15:52.075 INFO:tasks.workunit.client.0.smithi100.stdout:4/219: mkdir d19/d33/d3f/d44 0 2024-04-30T23:15:52.076 INFO:tasks.workunit.client.0.smithi100.stdout:9/138: read d4/d7/d8/f25 [4180183,24593] 0 2024-04-30T23:15:52.077 INFO:tasks.workunit.client.0.smithi100.stdout:9/139: mknod d4/d9/c2c 0 2024-04-30T23:15:52.077 INFO:tasks.workunit.client.0.smithi100.stdout:9/140: rename d4 to d4/d9/d2d 22 2024-04-30T23:15:52.078 INFO:tasks.workunit.client.0.smithi100.stdout:9/141: mkdir d4/d9/d10/d2e 0 2024-04-30T23:15:52.079 INFO:tasks.workunit.client.0.smithi100.stdout:3/248: dwrite d1/ff [0,4194304] 0 2024-04-30T23:15:52.080 INFO:tasks.workunit.client.0.smithi100.stdout:3/249: chown d1/d14/d15/d1e/d26/f28 2500418 1 2024-04-30T23:15:52.080 INFO:tasks.workunit.client.0.smithi100.stdout:4/220: rmdir d19/d33/d3f/d44 0 2024-04-30T23:15:52.080 INFO:tasks.workunit.client.0.smithi100.stdout:9/142: rmdir d4/d9/d10/d2e 0 2024-04-30T23:15:52.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/250: creat d1/d14/d15/d2c/f47 x:0 0 0 2024-04-30T23:15:52.083 INFO:tasks.workunit.client.0.smithi100.stdout:3/251: rmdir d1/d14/d15 39 2024-04-30T23:15:52.096 INFO:tasks.workunit.client.0.smithi100.stdout:4/221: dread f18 [0,4194304] 0 2024-04-30T23:15:52.097 INFO:tasks.workunit.client.0.smithi100.stdout:4/222: mkdir d19/d1a/d45 0 2024-04-30T23:15:52.098 INFO:tasks.workunit.client.0.smithi100.stdout:4/223: mknod d19/c46 0 2024-04-30T23:15:52.098 INFO:tasks.workunit.client.0.smithi100.stdout:4/224: stat f12 0 2024-04-30T23:15:52.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/225: mknod d19/d1a/d29/c47 0 2024-04-30T23:15:52.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/226: write d19/d1a/d21/f25 [19684,76601] 0 2024-04-30T23:15:52.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/227: fdatasync d19/d1a/d21/d32/f36 0 2024-04-30T23:15:52.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/143: dwrite d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:15:52.101 INFO:tasks.workunit.client.0.smithi100.stdout:4/228: unlink fc 0 2024-04-30T23:15:52.101 INFO:tasks.workunit.client.0.smithi100.stdout:4/229: stat d19/d1a/d21/d32/c43 0 2024-04-30T23:15:52.101 INFO:tasks.workunit.client.0.smithi100.stdout:4/230: chown d19/c2e 410919 1 2024-04-30T23:15:52.102 INFO:tasks.workunit.client.0.smithi100.stdout:4/231: chown d19/c39 483623802 1 2024-04-30T23:15:52.114 INFO:tasks.workunit.client.0.smithi100.stdout:4/232: dread f12 [0,4194304] 0 2024-04-30T23:15:52.115 INFO:tasks.workunit.client.0.smithi100.stdout:4/233: creat d19/d1a/f48 x:0 0 0 2024-04-30T23:15:52.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/234: creat d19/d1a/d21/f49 x:0 0 0 2024-04-30T23:15:52.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/235: dread - d19/d1a/d21/f49 zero size 2024-04-30T23:15:52.119 INFO:tasks.workunit.client.0.smithi100.stdout:4/236: truncate d19/d1a/f1e 253269 0 2024-04-30T23:15:52.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/237: truncate f18 816321 0 2024-04-30T23:15:52.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/144: dwrite f3 [0,4194304] 0 2024-04-30T23:15:52.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/145: write d4/d7/d8/f25 [2203212,59254] 0 2024-04-30T23:15:52.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/146: chown d4/d9 240 1 2024-04-30T23:15:52.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/238: mkdir d19/d1a/d21/d4a 0 2024-04-30T23:15:52.123 INFO:tasks.workunit.client.0.smithi100.stdout:4/239: dread - d19/d1a/f48 zero size 2024-04-30T23:15:52.125 INFO:tasks.workunit.client.0.smithi100.stdout:4/240: dread d19/d1a/d21/d32/f36 [0,4194304] 0 2024-04-30T23:15:52.127 INFO:tasks.workunit.client.0.smithi100.stdout:6/267: sync 2024-04-30T23:15:52.127 INFO:tasks.workunit.client.0.smithi100.stdout:8/147: sync 2024-04-30T23:15:52.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/192: sync 2024-04-30T23:15:52.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/190: sync 2024-04-30T23:15:52.127 INFO:tasks.workunit.client.0.smithi100.stdout:1/248: sync 2024-04-30T23:15:52.130 INFO:tasks.workunit.client.0.smithi100.stdout:5/193: mknod d1/c41 0 2024-04-30T23:15:52.130 INFO:tasks.workunit.client.0.smithi100.stdout:0/199: sync 2024-04-30T23:15:52.130 INFO:tasks.workunit.client.0.smithi100.stdout:7/240: sync 2024-04-30T23:15:52.130 INFO:tasks.workunit.client.0.smithi100.stdout:7/241: chown d0/df 5632 1 2024-04-30T23:15:52.130 INFO:tasks.workunit.client.0.smithi100.stdout:7/242: chown d0/d1b/d24/d2a 120098376 1 2024-04-30T23:15:52.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/268: mkdir d7/d1a/d1b/d59 0 2024-04-30T23:15:52.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/269: readlink d7/d1a/l2f 0 2024-04-30T23:15:52.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/270: write d7/d1a/d1b/d3f/f47 [1824741,65694] 0 2024-04-30T23:15:52.134 INFO:tasks.workunit.client.0.smithi100.stdout:1/249: link d3/d16/d20/d24/f2b d3/d18/f53 0 2024-04-30T23:15:52.135 INFO:tasks.workunit.client.0.smithi100.stdout:7/243: dread d0/df/f22 [0,4194304] 0 2024-04-30T23:15:52.137 INFO:tasks.workunit.client.0.smithi100.stdout:2/191: mknod d5/d12/c3e 0 2024-04-30T23:15:52.137 INFO:tasks.workunit.client.0.smithi100.stdout:4/241: getdents d19/d1a/d21 0 2024-04-30T23:15:52.139 INFO:tasks.workunit.client.0.smithi100.stdout:9/147: rmdir d4/d26 0 2024-04-30T23:15:52.140 INFO:tasks.workunit.client.0.smithi100.stdout:8/148: unlink d2/de/d10/c2a 0 2024-04-30T23:15:52.140 INFO:tasks.workunit.client.0.smithi100.stdout:8/149: readlink d2/d7/l1e 0 2024-04-30T23:15:52.141 INFO:tasks.workunit.client.0.smithi100.stdout:1/250: symlink d3/l54 0 2024-04-30T23:15:52.143 INFO:tasks.workunit.client.0.smithi100.stdout:7/244: creat d0/d1b/d2e/d3d/d42/f54 x:0 0 0 2024-04-30T23:15:52.143 INFO:tasks.workunit.client.0.smithi100.stdout:7/245: fsync d0/f18 0 2024-04-30T23:15:52.143 INFO:tasks.workunit.client.0.smithi100.stdout:7/246: write d0/d1b/d24/f2f [900256,23486] 0 2024-04-30T23:15:52.143 INFO:tasks.workunit.client.0.smithi100.stdout:7/247: chown d0/f16 226714 1 2024-04-30T23:15:52.144 INFO:tasks.workunit.client.0.smithi100.stdout:5/194: dread d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:52.146 INFO:tasks.workunit.client.0.smithi100.stdout:6/271: write d7/f52 [608744,30050] 0 2024-04-30T23:15:52.150 INFO:tasks.workunit.client.0.smithi100.stdout:5/195: write d1/d12/d1a/f26 [177697,40233] 0 2024-04-30T23:15:52.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/192: rename d5/d2e/c31 to d5/d22/c3f 0 2024-04-30T23:15:52.152 INFO:tasks.workunit.client.0.smithi100.stdout:4/242: unlink d19/d1a/f1e 0 2024-04-30T23:15:52.152 INFO:tasks.workunit.client.0.smithi100.stdout:1/251: truncate d3/d16/d20/f27 2862860 0 2024-04-30T23:15:52.152 INFO:tasks.workunit.client.0.smithi100.stdout:0/200: dwrite d2/d14/d18/f1f [4194304,4194304] 0 2024-04-30T23:15:52.154 INFO:tasks.workunit.client.0.smithi100.stdout:6/272: mkdir d7/d1a/d1b/d5a 0 2024-04-30T23:15:52.154 INFO:tasks.workunit.client.0.smithi100.stdout:6/273: write d7/f52 [296329,80752] 0 2024-04-30T23:15:52.155 INFO:tasks.workunit.client.0.smithi100.stdout:5/196: rmdir d1/d12/d24/d3a 0 2024-04-30T23:15:52.157 INFO:tasks.workunit.client.0.smithi100.stdout:8/150: rename d2/de/f22 to d2/d29/f2e 0 2024-04-30T23:15:52.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/193: link d5/d2e/f35 d5/d22/f40 0 2024-04-30T23:15:52.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/194: chown d5/d12/f3c 1 1 2024-04-30T23:15:52.163 INFO:tasks.workunit.client.0.smithi100.stdout:9/148: truncate d4/d7/d8/f25 1243275 0 2024-04-30T23:15:52.166 INFO:tasks.workunit.client.0.smithi100.stdout:1/252: symlink d3/d16/d20/l55 0 2024-04-30T23:15:52.166 INFO:tasks.workunit.client.0.smithi100.stdout:1/253: readlink d3/d16/d20/l55 0 2024-04-30T23:15:52.167 INFO:tasks.workunit.client.0.smithi100.stdout:4/243: symlink d19/d1a/d29/l4b 0 2024-04-30T23:15:52.167 INFO:tasks.workunit.client.0.smithi100.stdout:0/201: dread d2/f5 [0,4194304] 0 2024-04-30T23:15:52.168 INFO:tasks.workunit.client.0.smithi100.stdout:4/244: dread - d19/d1a/d21/f2b zero size 2024-04-30T23:15:52.170 INFO:tasks.workunit.client.0.smithi100.stdout:6/274: truncate f5 217533 0 2024-04-30T23:15:52.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/248: dwrite d0/df/d19/f35 [0,4194304] 0 2024-04-30T23:15:52.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/249: truncate d0/df/f21 5737236 0 2024-04-30T23:15:52.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/250: stat d0/d1b/d1e/f28 0 2024-04-30T23:15:52.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/251: truncate d0/d1b/f3e 3151113 0 2024-04-30T23:15:52.172 INFO:tasks.workunit.client.0.smithi100.stdout:5/197: rename d1/d12/d1a/f36 to d1/d12/d27/f42 0 2024-04-30T23:15:52.174 INFO:tasks.workunit.client.0.smithi100.stdout:2/195: rename d5/f32 to d5/f41 0 2024-04-30T23:15:52.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/149: rename d4/d7/d8/cb to d4/d7/d8/c2f 0 2024-04-30T23:15:52.183 INFO:tasks.workunit.client.0.smithi100.stdout:0/202: rename d2/d14/d18/f1f to d2/d14/d18/f45 0 2024-04-30T23:15:52.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/254: dwrite d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:52.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/255: chown d3/d16/d20/f45 789595780 1 2024-04-30T23:15:52.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/256: chown d3/d18/d3b/l50 17 1 2024-04-30T23:15:52.187 INFO:tasks.workunit.client.0.smithi100.stdout:6/275: mknod d7/d1a/d1b/d3f/c5b 0 2024-04-30T23:15:52.189 INFO:tasks.workunit.client.0.smithi100.stdout:7/252: creat d0/d1b/f55 x:0 0 0 2024-04-30T23:15:52.190 INFO:tasks.workunit.client.0.smithi100.stdout:4/245: rename d19/d1a/d21/d32/c43 to d19/d1a/d21/d4a/c4c 0 2024-04-30T23:15:52.192 INFO:tasks.workunit.client.0.smithi100.stdout:0/203: write d2/d14/f19 [2722163,74922] 0 2024-04-30T23:15:52.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/150: mkdir d4/d9/d30 0 2024-04-30T23:15:52.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/151: write d4/f1e [30803,7484] 0 2024-04-30T23:15:52.196 INFO:tasks.workunit.client.0.smithi100.stdout:6/276: creat d7/db/f5c x:0 0 0 2024-04-30T23:15:52.197 INFO:tasks.workunit.client.0.smithi100.stdout:4/246: readlink l15 0 2024-04-30T23:15:52.199 INFO:tasks.workunit.client.0.smithi100.stdout:7/253: rename d0/d1b/f3e to d0/df/d19/d4b/f56 0 2024-04-30T23:15:52.199 INFO:tasks.workunit.client.0.smithi100.stdout:7/254: chown d0/f17 38413 1 2024-04-30T23:15:52.202 INFO:tasks.workunit.client.0.smithi100.stdout:9/152: write f3 [4196082,58390] 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:5/198: symlink d1/d2c/l43 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:2/196: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:0/204: rename d2/l11 to d2/l46 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:5/199: chown d1/d12/d27 1421 1 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:6/277: symlink d7/db/l5d 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:4/247: link cd d19/d1a/d21/d3c/c4d 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:4/248: write d19/d33/d3f/f41 [1041843,112883] 0 2024-04-30T23:15:52.207 INFO:tasks.workunit.client.0.smithi100.stdout:4/249: write f11 [1052453,9504] 0 2024-04-30T23:15:52.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/153: symlink d4/d7/l31 0 2024-04-30T23:15:52.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/154: chown d4/d9/d10/c1b 9804217 1 2024-04-30T23:15:52.211 INFO:tasks.workunit.client.0.smithi100.stdout:1/257: dwrite d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:52.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/250: read f3 [496908,108774] 0 2024-04-30T23:15:52.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/251: write d19/d1a/d21/d32/f36 [1531943,99907] 0 2024-04-30T23:15:52.213 INFO:tasks.workunit.client.0.smithi100.stdout:2/197: truncate d5/d22/f2c 160589 0 2024-04-30T23:15:52.213 INFO:tasks.workunit.client.0.smithi100.stdout:2/198: chown d5/d26 3211 1 2024-04-30T23:15:52.213 INFO:tasks.workunit.client.0.smithi100.stdout:2/199: truncate d5/f41 957848 0 2024-04-30T23:15:52.213 INFO:tasks.workunit.client.0.smithi100.stdout:2/200: fsync d5/f28 0 2024-04-30T23:15:52.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/205: symlink d2/d14/d26/d30/l47 0 2024-04-30T23:15:52.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/206: truncate d2/d14/d18/f33 677276 0 2024-04-30T23:15:52.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/200: creat d1/d12/d27/f44 x:0 0 0 2024-04-30T23:15:52.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/201: write d1/d12/f16 [2668139,4299] 0 2024-04-30T23:15:52.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/202: truncate d1/d12/d24/f25 238772 0 2024-04-30T23:15:52.218 INFO:tasks.workunit.client.0.smithi100.stdout:9/155: symlink d4/l32 0 2024-04-30T23:15:52.223 INFO:tasks.workunit.client.0.smithi100.stdout:7/255: dwrite d0/df/f29 [0,4194304] 0 2024-04-30T23:15:52.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/201: creat d5/d22/f42 x:0 0 0 2024-04-30T23:15:52.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/207: symlink d2/d14/d35/l48 0 2024-04-30T23:15:52.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/208: truncate d2/d14/d35/f39 650691 0 2024-04-30T23:15:52.232 INFO:tasks.workunit.client.0.smithi100.stdout:9/156: link d4/d9/d10/f28 d4/f33 0 2024-04-30T23:15:52.232 INFO:tasks.workunit.client.0.smithi100.stdout:9/157: stat d4/d9/d10/f28 0 2024-04-30T23:15:52.233 INFO:tasks.workunit.client.0.smithi100.stdout:1/258: dread d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:52.233 INFO:tasks.workunit.client.0.smithi100.stdout:2/202: chown d5/d12/f2b 31 1 2024-04-30T23:15:52.234 INFO:tasks.workunit.client.0.smithi100.stdout:4/252: unlink f11 0 2024-04-30T23:15:52.234 INFO:tasks.workunit.client.0.smithi100.stdout:4/253: fsync d19/d1a/d21/f25 0 2024-04-30T23:15:52.234 INFO:tasks.workunit.client.0.smithi100.stdout:4/254: truncate d19/f26 5101640 0 2024-04-30T23:15:52.235 INFO:tasks.workunit.client.0.smithi100.stdout:0/209: creat d2/d14/d35/d40/f49 x:0 0 0 2024-04-30T23:15:52.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/259: getdents d3/d16/d20/d24/d3f 0 2024-04-30T23:15:52.238 INFO:tasks.workunit.client.0.smithi100.stdout:2/203: rename d5/d12/f1a to d5/d26/d2f/d38/f43 0 2024-04-30T23:15:52.239 INFO:tasks.workunit.client.0.smithi100.stdout:7/256: write d0/df/f14 [157552,35389] 0 2024-04-30T23:15:52.243 INFO:tasks.workunit.client.0.smithi100.stdout:4/255: mkdir d19/d1a/d21/d32/d4e 0 2024-04-30T23:15:52.243 INFO:tasks.workunit.client.0.smithi100.stdout:0/210: rename d2/d14/d26/l27 to d2/d14/l4a 0 2024-04-30T23:15:52.243 INFO:tasks.workunit.client.0.smithi100.stdout:4/256: write d19/d1a/d21/f49 [188901,56318] 0 2024-04-30T23:15:52.243 INFO:tasks.workunit.client.0.smithi100.stdout:5/203: dwrite d1/d12/d27/f44 [0,4194304] 0 2024-04-30T23:15:52.243 INFO:tasks.workunit.client.0.smithi100.stdout:5/204: fsync d1/d12/d1a/f3d 0 2024-04-30T23:15:52.244 INFO:tasks.workunit.client.0.smithi100.stdout:0/211: link d2/f3a d2/d14/d35/f4b 0 2024-04-30T23:15:52.245 INFO:tasks.workunit.client.0.smithi100.stdout:0/212: chown d2/d14/d35/d40/f49 0 1 2024-04-30T23:15:52.245 INFO:tasks.workunit.client.0.smithi100.stdout:0/213: chown d2/d14/c1a 233 1 2024-04-30T23:15:52.247 INFO:tasks.workunit.client.0.smithi100.stdout:4/257: rename d19/d1a/d21/d32/c3a to d19/d1a/d21/c4f 0 2024-04-30T23:15:52.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/260: read d3/d16/d20/f22 [2294384,63810] 0 2024-04-30T23:15:52.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/261: dread - d3/db/d4b/f4c zero size 2024-04-30T23:15:52.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/262: stat d3/d16/d20/d24/l29 0 2024-04-30T23:15:52.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/263: chown d3/c7 483496110 1 2024-04-30T23:15:52.250 INFO:tasks.workunit.client.0.smithi100.stdout:5/205: creat d1/d3e/f45 x:0 0 0 2024-04-30T23:15:52.252 INFO:tasks.workunit.client.0.smithi100.stdout:0/214: rmdir d2/d14/d35/d40 39 2024-04-30T23:15:52.252 INFO:tasks.workunit.client.0.smithi100.stdout:0/215: truncate d2/d14/d18/f42 4457020 0 2024-04-30T23:15:52.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/158: write f3 [1899178,30977] 0 2024-04-30T23:15:52.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/159: write d4/d9/d10/f28 [4749224,113169] 0 2024-04-30T23:15:52.254 INFO:tasks.workunit.client.0.smithi100.stdout:4/258: creat d19/d1a/d21/f50 x:0 0 0 2024-04-30T23:15:52.254 INFO:tasks.workunit.client.0.smithi100.stdout:4/259: write d19/d33/f31 [1541864,48867] 0 2024-04-30T23:15:52.256 INFO:tasks.workunit.client.0.smithi100.stdout:1/264: rename d3/d16/d20/d24/l29 to d3/d18/l56 0 2024-04-30T23:15:52.262 INFO:tasks.workunit.client.0.smithi100.stdout:9/160: getdents d4/d9/d10 0 2024-04-30T23:15:52.266 INFO:tasks.workunit.client.0.smithi100.stdout:2/204: dwrite d5/d22/f40 [0,4194304] 0 2024-04-30T23:15:52.266 INFO:tasks.workunit.client.0.smithi100.stdout:2/205: readlink d5/l1d 0 2024-04-30T23:15:52.268 INFO:tasks.workunit.client.0.smithi100.stdout:1/265: mknod d3/db/d4b/c57 0 2024-04-30T23:15:52.268 INFO:tasks.workunit.client.0.smithi100.stdout:1/266: readlink d3/l54 0 2024-04-30T23:15:52.268 INFO:tasks.workunit.client.0.smithi100.stdout:9/161: mknod d4/d9/d10/c34 0 2024-04-30T23:15:52.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/162: dread d4/fd [0,4194304] 0 2024-04-30T23:15:52.273 INFO:tasks.workunit.client.0.smithi100.stdout:2/206: rename d5/d12/d13/f2a to d5/d2e/f44 0 2024-04-30T23:15:52.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/257: dwrite d0/df/d19/d4b/f56 [0,4194304] 0 2024-04-30T23:15:52.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/258: readlink d0/df/d19/l1c 0 2024-04-30T23:15:52.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/259: write d0/f18 [1200161,103626] 0 2024-04-30T23:15:52.280 INFO:tasks.workunit.client.0.smithi100.stdout:9/163: mknod d4/d9/d30/c35 0 2024-04-30T23:15:52.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/260: read d0/d1b/d1e/f40 [257261,128496] 0 2024-04-30T23:15:52.282 INFO:tasks.workunit.client.0.smithi100.stdout:7/261: creat d0/d1b/d2e/d3d/f57 x:0 0 0 2024-04-30T23:15:52.288 INFO:tasks.workunit.client.0.smithi100.stdout:1/267: dread d3/d16/d20/d24/f2b [0,4194304] 0 2024-04-30T23:15:52.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/216: dwrite d2/d14/d35/f39 [0,4194304] 0 2024-04-30T23:15:52.289 INFO:tasks.workunit.client.0.smithi100.stdout:0/217: readlink d2/d14/l15 0 2024-04-30T23:15:52.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/268: fdatasync d3/d16/d20/f45 0 2024-04-30T23:15:52.292 INFO:tasks.workunit.client.0.smithi100.stdout:1/269: rename d3/db/d4b/f4c to d3/f58 0 2024-04-30T23:15:52.292 INFO:tasks.workunit.client.0.smithi100.stdout:1/270: chown d3/d16/d20/f27 0 1 2024-04-30T23:15:52.293 INFO:tasks.workunit.client.0.smithi100.stdout:1/271: chown d3 1 1 2024-04-30T23:15:52.293 INFO:tasks.workunit.client.0.smithi100.stdout:1/272: write d3/d18/f43 [822187,54752] 0 2024-04-30T23:15:52.293 INFO:tasks.workunit.client.0.smithi100.stdout:1/273: write d3/db/f3d [715111,27859] 0 2024-04-30T23:15:52.295 INFO:tasks.workunit.client.0.smithi100.stdout:2/207: dwrite d5/d12/f3d [0,4194304] 0 2024-04-30T23:15:52.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/208: creat d5/f45 x:0 0 0 2024-04-30T23:15:52.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/209: dread - d5/d12/f2b zero size 2024-04-30T23:15:52.304 INFO:tasks.workunit.client.0.smithi100.stdout:7/262: dread d0/d1b/d1e/f28 [0,4194304] 0 2024-04-30T23:15:52.305 INFO:tasks.workunit.client.0.smithi100.stdout:7/263: readlink d0/df/l10 0 2024-04-30T23:15:52.306 INFO:tasks.workunit.client.0.smithi100.stdout:7/264: getdents d0/d1b/d24 0 2024-04-30T23:15:52.312 INFO:tasks.workunit.client.0.smithi100.stdout:0/218: dwrite d2/d14/f2f [0,4194304] 0 2024-04-30T23:15:52.313 INFO:tasks.workunit.client.0.smithi100.stdout:0/219: chown d2/f2e 12 1 2024-04-30T23:15:52.313 INFO:tasks.workunit.client.0.smithi100.stdout:0/220: truncate d2/d14/d26/d30/f3d 1021483 0 2024-04-30T23:15:52.313 INFO:tasks.workunit.client.0.smithi100.stdout:9/164: dwrite d4/f2a [0,4194304] 0 2024-04-30T23:15:52.313 INFO:tasks.workunit.client.0.smithi100.stdout:2/210: dread d5/d12/f3d [0,4194304] 0 2024-04-30T23:15:52.314 INFO:tasks.workunit.client.0.smithi100.stdout:1/274: dread d3/f4f [0,4194304] 0 2024-04-30T23:15:52.316 INFO:tasks.workunit.client.0.smithi100.stdout:9/165: getdents d4 0 2024-04-30T23:15:52.317 INFO:tasks.workunit.client.0.smithi100.stdout:2/211: rename d5/d26/d2f/c37 to d5/d26/d2f/d38/c46 0 2024-04-30T23:15:52.319 INFO:tasks.workunit.client.0.smithi100.stdout:9/166: creat d4/d7/d8/f36 x:0 0 0 2024-04-30T23:15:52.319 INFO:tasks.workunit.client.0.smithi100.stdout:9/167: chown d4/d7 440466506 1 2024-04-30T23:15:52.319 INFO:tasks.workunit.client.0.smithi100.stdout:9/168: chown d4/d7/d8 0 1 2024-04-30T23:15:52.320 INFO:tasks.workunit.client.0.smithi100.stdout:2/212: rmdir d5/d26 39 2024-04-30T23:15:52.320 INFO:tasks.workunit.client.0.smithi100.stdout:2/213: fsync d5/d2e/f35 0 2024-04-30T23:15:52.321 INFO:tasks.workunit.client.0.smithi100.stdout:9/169: rename d4/d9/d30 to d4/d7/d8/d37 0 2024-04-30T23:15:52.323 INFO:tasks.workunit.client.0.smithi100.stdout:9/170: creat d4/d7/f38 x:0 0 0 2024-04-30T23:15:52.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/221: read d2/f2e [3234306,110015] 0 2024-04-30T23:15:52.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/265: write d0/d1b/d2e/d3d/d42/d48/d4a/f4e [339268,80617] 0 2024-04-30T23:15:52.330 INFO:tasks.workunit.client.0.smithi100.stdout:7/266: symlink d0/df/l58 0 2024-04-30T23:15:52.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/267: creat d0/df/d4f/d53/f59 x:0 0 0 2024-04-30T23:15:52.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/268: truncate d0/df/f22 1734414 0 2024-04-30T23:15:52.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/269: chown d0/f18 803393884 1 2024-04-30T23:15:52.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/270: truncate d0/df/d19/f2d 343724 0 2024-04-30T23:15:52.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/271: chown d0/d1d 165991 1 2024-04-30T23:15:52.334 INFO:tasks.workunit.client.0.smithi100.stdout:7/272: creat d0/df/d4f/d53/f5a x:0 0 0 2024-04-30T23:15:52.334 INFO:tasks.workunit.client.0.smithi100.stdout:7/273: fdatasync d0/d1b/d1e/f28 0 2024-04-30T23:15:52.338 INFO:tasks.workunit.client.0.smithi100.stdout:9/171: write d4/f33 [1779379,35827] 0 2024-04-30T23:15:52.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/222: read d2/f23 [3543351,72434] 0 2024-04-30T23:15:52.342 INFO:tasks.workunit.client.0.smithi100.stdout:0/223: mkdir d2/d4c 0 2024-04-30T23:15:52.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/214: dwrite d5/fe [0,4194304] 0 2024-04-30T23:15:52.343 INFO:tasks.workunit.client.0.smithi100.stdout:1/275: dwrite d3/db/f39 [0,4194304] 0 2024-04-30T23:15:52.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/224: symlink d2/l4d 0 2024-04-30T23:15:52.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/225: fdatasync d2/d14/d26/d38/f3f 0 2024-04-30T23:15:52.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/215: truncate f1 5082509 0 2024-04-30T23:15:52.347 INFO:tasks.workunit.client.0.smithi100.stdout:2/216: stat d5/d12/f1e 0 2024-04-30T23:15:52.350 INFO:tasks.workunit.client.0.smithi100.stdout:1/276: rmdir d3/d18/d3b 39 2024-04-30T23:15:52.350 INFO:tasks.workunit.client.0.smithi100.stdout:1/277: fsync d3/f4 0 2024-04-30T23:15:52.353 INFO:tasks.workunit.client.0.smithi100.stdout:0/226: symlink d2/d14/d26/l4e 0 2024-04-30T23:15:52.353 INFO:tasks.workunit.client.0.smithi100.stdout:0/227: fdatasync d2/d14/d35/d40/f49 0 2024-04-30T23:15:52.356 INFO:tasks.workunit.client.0.smithi100.stdout:2/217: mkdir d5/d47 0 2024-04-30T23:15:52.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/172: write d4/f2a [986602,107090] 0 2024-04-30T23:15:52.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/173: write d4/d7/d8/f36 [572411,30265] 0 2024-04-30T23:15:52.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/174: fdatasync d4/d9/d10/f27 0 2024-04-30T23:15:52.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/175: write d4/f2a [1466506,33880] 0 2024-04-30T23:15:52.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/176: write f0 [405923,42914] 0 2024-04-30T23:15:52.367 INFO:tasks.workunit.client.0.smithi100.stdout:7/274: dwrite d0/d1b/d2e/f32 [4194304,4194304] 0 2024-04-30T23:15:52.368 INFO:tasks.workunit.client.0.smithi100.stdout:1/278: mkdir d3/d16/d20/d24/d51/d59 0 2024-04-30T23:15:52.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/228: creat d2/d14/d26/f4f x:0 0 0 2024-04-30T23:15:52.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/229: chown d2/d14/l15 8 1 2024-04-30T23:15:52.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/230: fsync d2/d14/d26/d30/f3d 0 2024-04-30T23:15:52.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/231: write d2/d14/f19 [1747612,106884] 0 2024-04-30T23:15:52.375 INFO:tasks.workunit.client.0.smithi100.stdout:7/275: mkdir d0/d1b/d2e/d3d/d42/d48/d4a/d5b 0 2024-04-30T23:15:52.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/276: symlink d0/df/d4f/d53/l5c 0 2024-04-30T23:15:52.384 INFO:tasks.workunit.client.0.smithi100.stdout:2/218: dwrite d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:15:52.385 INFO:tasks.workunit.client.0.smithi100.stdout:9/177: dwrite d4/d7/f38 [0,4194304] 0 2024-04-30T23:15:52.386 INFO:tasks.workunit.client.0.smithi100.stdout:0/232: read d2/d14/f2f [362500,7781] 0 2024-04-30T23:15:52.386 INFO:tasks.workunit.client.0.smithi100.stdout:0/233: write d2/f5 [4278258,45333] 0 2024-04-30T23:15:52.388 INFO:tasks.workunit.client.0.smithi100.stdout:9/178: symlink d4/d7/d8/d19/l39 0 2024-04-30T23:15:52.391 INFO:tasks.workunit.client.0.smithi100.stdout:0/234: rename d2/d14/d26 to d2/d50 0 2024-04-30T23:15:52.391 INFO:tasks.workunit.client.0.smithi100.stdout:0/235: fsync d2/d14/d18/f33 0 2024-04-30T23:15:52.394 INFO:tasks.workunit.client.0.smithi100.stdout:2/219: mknod d5/d12/c48 0 2024-04-30T23:15:52.394 INFO:tasks.workunit.client.0.smithi100.stdout:1/279: dwrite d3/db/f40 [0,4194304] 0 2024-04-30T23:15:52.395 INFO:tasks.workunit.client.0.smithi100.stdout:9/179: creat d4/d9/d10/f3a x:0 0 0 2024-04-30T23:15:52.396 INFO:tasks.workunit.client.0.smithi100.stdout:2/220: rename d5/f41 to d5/f49 0 2024-04-30T23:15:52.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/221: creat d5/d26/f4a x:0 0 0 2024-04-30T23:15:52.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/222: truncate d5/d26/d2f/f36 21970 0 2024-04-30T23:15:52.402 INFO:tasks.workunit.client.0.smithi100.stdout:2/223: mkdir d5/d12/d13/d4b 0 2024-04-30T23:15:52.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/277: dwrite d0/d1b/d1e/f28 [4194304,4194304] 0 2024-04-30T23:15:52.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/278: dread - d0/d1b/d2e/d3d/d42/d48/f50 zero size 2024-04-30T23:15:52.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/279: write d0/d1b/d2e/d3d/d42/d48/d4a/f4c [501803,66107] 0 2024-04-30T23:15:52.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/280: dread d0/d1b/f2b [0,4194304] 0 2024-04-30T23:15:52.416 INFO:tasks.workunit.client.0.smithi100.stdout:7/281: link d0/l33 d0/d1b/d2e/d3d/l5d 0 2024-04-30T23:15:52.418 INFO:tasks.workunit.client.0.smithi100.stdout:7/282: mkdir d0/d1d/d5e 0 2024-04-30T23:15:52.422 INFO:tasks.workunit.client.0.smithi100.stdout:9/180: dwrite d4/f5 [0,4194304] 0 2024-04-30T23:15:52.422 INFO:tasks.workunit.client.0.smithi100.stdout:9/181: chown f1 5 1 2024-04-30T23:15:52.423 INFO:tasks.workunit.client.0.smithi100.stdout:9/182: mknod d4/d9/d10/c3b 0 2024-04-30T23:15:52.423 INFO:tasks.workunit.client.0.smithi100.stdout:9/183: chown f3 6433 1 2024-04-30T23:15:52.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/236: dwrite d2/f1e [0,4194304] 0 2024-04-30T23:15:52.431 INFO:tasks.workunit.client.0.smithi100.stdout:0/237: write d2/d50/d30/d32/f3b [292700,36822] 0 2024-04-30T23:15:52.432 INFO:tasks.workunit.client.0.smithi100.stdout:0/238: mknod d2/d50/d38/c51 0 2024-04-30T23:15:52.432 INFO:tasks.workunit.client.0.smithi100.stdout:0/239: chown d2/d14/d35/c37 16653481 1 2024-04-30T23:15:52.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/240: creat d2/f52 x:0 0 0 2024-04-30T23:15:52.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/241: write d2/d14/f24 [3862385,115034] 0 2024-04-30T23:15:52.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/242: fsync d2/d14/d35/d40/f49 0 2024-04-30T23:15:52.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/224: read d5/d22/f40 [874871,63389] 0 2024-04-30T23:15:52.435 INFO:tasks.workunit.client.0.smithi100.stdout:1/280: dwrite d3/db/f3d [0,4194304] 0 2024-04-30T23:15:52.435 INFO:tasks.workunit.client.0.smithi100.stdout:0/243: creat d2/d50/d30/f53 x:0 0 0 2024-04-30T23:15:52.438 INFO:tasks.workunit.client.0.smithi100.stdout:9/184: write d4/d7/f38 [1634367,72615] 0 2024-04-30T23:15:52.438 INFO:tasks.workunit.client.0.smithi100.stdout:7/283: truncate d0/d1b/d1e/f28 3873142 0 2024-04-30T23:15:52.439 INFO:tasks.workunit.client.0.smithi100.stdout:9/185: write d4/fd [517357,44615] 0 2024-04-30T23:15:52.440 INFO:tasks.workunit.client.0.smithi100.stdout:1/281: dread d3/d18/f43 [0,4194304] 0 2024-04-30T23:15:52.440 INFO:tasks.workunit.client.0.smithi100.stdout:1/282: write d3/d16/d20/d24/f32 [809820,63466] 0 2024-04-30T23:15:52.440 INFO:tasks.workunit.client.0.smithi100.stdout:1/283: truncate d3/d16/f36 708178 0 2024-04-30T23:15:52.445 INFO:tasks.workunit.client.0.smithi100.stdout:1/284: mknod d3/d16/d20/c5a 0 2024-04-30T23:15:52.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/285: rename d3/d16/f1d to d3/d18/f5b 0 2024-04-30T23:15:52.449 INFO:tasks.workunit.client.0.smithi100.stdout:2/225: dread d5/d26/d2f/f36 [0,4194304] 0 2024-04-30T23:15:52.449 INFO:tasks.workunit.client.0.smithi100.stdout:1/286: creat d3/d16/d20/d24/f5c x:0 0 0 2024-04-30T23:15:52.449 INFO:tasks.workunit.client.0.smithi100.stdout:1/287: truncate d3/d18/f23 4853481 0 2024-04-30T23:15:52.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/252: sync 2024-04-30T23:15:52.450 INFO:tasks.workunit.client.0.smithi100.stdout:8/151: sync 2024-04-30T23:15:52.451 INFO:tasks.workunit.client.0.smithi100.stdout:6/278: sync 2024-04-30T23:15:52.452 INFO:tasks.workunit.client.0.smithi100.stdout:2/226: mkdir d5/d47/d4c 0 2024-04-30T23:15:52.452 INFO:tasks.workunit.client.0.smithi100.stdout:0/244: dread d2/f8 [0,4194304] 0 2024-04-30T23:15:52.454 INFO:tasks.workunit.client.0.smithi100.stdout:9/186: dread d4/d7/f38 [0,4194304] 0 2024-04-30T23:15:52.454 INFO:tasks.workunit.client.0.smithi100.stdout:8/152: symlink d2/de/d10/d17/l2f 0 2024-04-30T23:15:52.456 INFO:tasks.workunit.client.0.smithi100.stdout:6/279: creat d7/df/d23/d24/d2e/d37/f5e x:0 0 0 2024-04-30T23:15:52.458 INFO:tasks.workunit.client.0.smithi100.stdout:0/245: symlink d2/d14/d18/l54 0 2024-04-30T23:15:52.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/187: rename d4/l32 to d4/d7/d8/l3c 0 2024-04-30T23:15:52.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/153: rmdir d2/d29 39 2024-04-30T23:15:52.463 INFO:tasks.workunit.client.0.smithi100.stdout:3/253: unlink d1/d38/f43 0 2024-04-30T23:15:52.463 INFO:tasks.workunit.client.0.smithi100.stdout:7/284: dwrite d0/df/d19/f3a [0,4194304] 0 2024-04-30T23:15:52.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/280: creat d7/df/d23/d24/f5f x:0 0 0 2024-04-30T23:15:52.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/281: truncate d7/db/d3b/f58 362721 0 2024-04-30T23:15:52.467 INFO:tasks.workunit.client.0.smithi100.stdout:9/188: unlink d4/d7/d8/c2f 0 2024-04-30T23:15:52.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/282: symlink d7/db/d3b/l60 0 2024-04-30T23:15:52.472 INFO:tasks.workunit.client.0.smithi100.stdout:9/189: rmdir d4/d9/d10 39 2024-04-30T23:15:52.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/288: dwrite d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:52.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/289: write d3/f4f [3480999,82025] 0 2024-04-30T23:15:52.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/290: fsync d3/d18/f5b 0 2024-04-30T23:15:52.475 INFO:tasks.workunit.client.0.smithi100.stdout:9/190: mkdir d4/d7/d8/d37/d3d 0 2024-04-30T23:15:52.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/246: dread d2/fb [0,4194304] 0 2024-04-30T23:15:52.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/247: write d2/d14/d18/f2d [4998370,127824] 0 2024-04-30T23:15:52.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/248: write d2/d50/d38/f3f [1750978,124008] 0 2024-04-30T23:15:52.476 INFO:tasks.workunit.client.0.smithi100.stdout:1/291: creat d3/d18/f5d x:0 0 0 2024-04-30T23:15:52.477 INFO:tasks.workunit.client.0.smithi100.stdout:9/191: symlink d4/d7/l3e 0 2024-04-30T23:15:52.478 INFO:tasks.workunit.client.0.smithi100.stdout:0/249: unlink d2/d14/d35/c3e 0 2024-04-30T23:15:52.478 INFO:tasks.workunit.client.0.smithi100.stdout:9/192: symlink d4/d9/d10/l3f 0 2024-04-30T23:15:52.482 INFO:tasks.workunit.client.0.smithi100.stdout:0/250: rmdir d2/d14/d35 39 2024-04-30T23:15:52.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/227: dwrite d5/d2e/f35 [0,4194304] 0 2024-04-30T23:15:52.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/228: dread - d5/d26/f4a zero size 2024-04-30T23:15:52.483 INFO:tasks.workunit.client.0.smithi100.stdout:3/254: read d1/d14/d15/f1b [2593849,84049] 0 2024-04-30T23:15:52.487 INFO:tasks.workunit.client.0.smithi100.stdout:3/255: creat d1/d14/d21/f48 x:0 0 0 2024-04-30T23:15:52.488 INFO:tasks.workunit.client.0.smithi100.stdout:5/206: sync 2024-04-30T23:15:52.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/260: sync 2024-04-30T23:15:52.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/154: write d2/d7/f26 [581101,52958] 0 2024-04-30T23:15:52.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/261: link f8 d19/d33/d3f/f51 0 2024-04-30T23:15:52.490 INFO:tasks.workunit.client.0.smithi100.stdout:3/256: dread d1/d14/f19 [0,4194304] 0 2024-04-30T23:15:52.490 INFO:tasks.workunit.client.0.smithi100.stdout:3/257: chown d1/d14/d21/f31 2449235 1 2024-04-30T23:15:52.491 INFO:tasks.workunit.client.0.smithi100.stdout:5/207: creat d1/d19/f46 x:0 0 0 2024-04-30T23:15:52.492 INFO:tasks.workunit.client.0.smithi100.stdout:8/155: creat d2/d29/f30 x:0 0 0 2024-04-30T23:15:52.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/262: mknod d19/d1a/d21/d4a/c52 0 2024-04-30T23:15:52.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/258: truncate d1/d14/f36 655577 0 2024-04-30T23:15:52.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/156: mknod d2/de/d10/d17/c31 0 2024-04-30T23:15:52.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/157: stat d2/de/d10/f19 0 2024-04-30T23:15:52.500 INFO:tasks.workunit.client.0.smithi100.stdout:8/158: mknod d2/d7/d18/c32 0 2024-04-30T23:15:52.500 INFO:tasks.workunit.client.0.smithi100.stdout:7/285: dwrite d0/d1b/d24/f3b [0,4194304] 0 2024-04-30T23:15:52.500 INFO:tasks.workunit.client.0.smithi100.stdout:7/286: read - d0/d1b/d2e/d3d/f57 zero size 2024-04-30T23:15:52.507 INFO:tasks.workunit.client.0.smithi100.stdout:7/287: creat d0/df/d19/f5f x:0 0 0 2024-04-30T23:15:52.507 INFO:tasks.workunit.client.0.smithi100.stdout:9/193: dwrite f0 [0,4194304] 0 2024-04-30T23:15:52.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/229: read d5/f14 [2781168,81422] 0 2024-04-30T23:15:52.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/230: chown d5 4359192 1 2024-04-30T23:15:52.511 INFO:tasks.workunit.client.0.smithi100.stdout:0/251: dread d2/d14/d18/f45 [4194304,4194304] 0 2024-04-30T23:15:52.516 INFO:tasks.workunit.client.0.smithi100.stdout:5/208: dwrite d1/d3e/f45 [0,4194304] 0 2024-04-30T23:15:52.516 INFO:tasks.workunit.client.0.smithi100.stdout:3/259: dread d1/d14/d15/f1b [4194304,4194304] 0 2024-04-30T23:15:52.518 INFO:tasks.workunit.client.0.smithi100.stdout:9/194: creat d4/d7/d8/d37/d3d/f40 x:0 0 0 2024-04-30T23:15:52.520 INFO:tasks.workunit.client.0.smithi100.stdout:6/283: dwrite d7/d1a/d1b/d22/f50 [0,4194304] 0 2024-04-30T23:15:52.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/252: mknod d2/d14/d35/c55 0 2024-04-30T23:15:52.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/260: mknod d1/d14/d21/c49 0 2024-04-30T23:15:52.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/195: getdents d4/d9/d10 0 2024-04-30T23:15:52.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/196: write d4/f33 [5504148,109823] 0 2024-04-30T23:15:52.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/197: chown d4/d7/l3e 147 1 2024-04-30T23:15:52.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/284: symlink d7/d11/l61 0 2024-04-30T23:15:52.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/231: mknod d5/d12/c4d 0 2024-04-30T23:15:52.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/232: fsync d5/f2d 0 2024-04-30T23:15:52.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/233: truncate d5/d12/f2b 455246 0 2024-04-30T23:15:52.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/234: write d5/f14 [331341,12959] 0 2024-04-30T23:15:52.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/235: chown d5/d26/d2f 7385668 1 2024-04-30T23:15:52.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/253: creat d2/d14/d35/d40/f56 x:0 0 0 2024-04-30T23:15:52.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/254: write d2/d14/d35/d40/f49 [586493,5430] 0 2024-04-30T23:15:52.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/255: chown d2/d14/f19 317536 1 2024-04-30T23:15:52.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/256: chown d2/d14/d35/c37 2084302805 1 2024-04-30T23:15:52.527 INFO:tasks.workunit.client.0.smithi100.stdout:3/261: dread d1/d14/f36 [0,4194304] 0 2024-04-30T23:15:52.528 INFO:tasks.workunit.client.0.smithi100.stdout:9/198: creat d4/d7/d8/d37/d3d/f41 x:0 0 0 2024-04-30T23:15:52.531 INFO:tasks.workunit.client.0.smithi100.stdout:0/257: mkdir d2/d14/d35/d57 0 2024-04-30T23:15:52.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/262: creat d1/f4a x:0 0 0 2024-04-30T23:15:52.533 INFO:tasks.workunit.client.0.smithi100.stdout:5/209: read d1/d12/f23 [60877,39845] 0 2024-04-30T23:15:52.535 INFO:tasks.workunit.client.0.smithi100.stdout:0/258: getdents d2 0 2024-04-30T23:15:52.535 INFO:tasks.workunit.client.0.smithi100.stdout:0/259: write d2/d50/f3c [878033,79249] 0 2024-04-30T23:15:52.535 INFO:tasks.workunit.client.0.smithi100.stdout:8/159: dwrite d2/de/d10/f19 [0,4194304] 0 2024-04-30T23:15:52.536 INFO:tasks.workunit.client.0.smithi100.stdout:7/288: dwrite d0/f16 [0,4194304] 0 2024-04-30T23:15:52.537 INFO:tasks.workunit.client.0.smithi100.stdout:5/210: link d1/d19/f46 d1/d3e/f47 0 2024-04-30T23:15:52.544 INFO:tasks.workunit.client.0.smithi100.stdout:5/211: rename d1/f3b to d1/d12/d24/f48 0 2024-04-30T23:15:52.545 INFO:tasks.workunit.client.0.smithi100.stdout:2/236: read d5/d22/f40 [868509,97523] 0 2024-04-30T23:15:52.545 INFO:tasks.workunit.client.0.smithi100.stdout:2/237: fsync d5/d22/f42 0 2024-04-30T23:15:52.547 INFO:tasks.workunit.client.0.smithi100.stdout:5/212: creat d1/d2c/f49 x:0 0 0 2024-04-30T23:15:52.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/213: write d1/d12/d1a/f22 [1695237,97902] 0 2024-04-30T23:15:52.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/214: stat d1/d12/d24/f25 0 2024-04-30T23:15:52.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/215: truncate d1/d12/f23 981961 0 2024-04-30T23:15:52.556 INFO:tasks.workunit.client.0.smithi100.stdout:7/289: unlink d0/df/f21 0 2024-04-30T23:15:52.556 INFO:tasks.workunit.client.0.smithi100.stdout:2/238: truncate d5/f2d 2880640 0 2024-04-30T23:15:52.558 INFO:tasks.workunit.client.0.smithi100.stdout:7/290: rename d0/d1b/d2e/d3d/d42 to d0/d1b/d60 0 2024-04-30T23:15:52.559 INFO:tasks.workunit.client.0.smithi100.stdout:2/239: link d5/d12/f3c d5/d22/f4e 0 2024-04-30T23:15:52.559 INFO:tasks.workunit.client.0.smithi100.stdout:2/240: chown d5/d22/c24 4710918 1 2024-04-30T23:15:52.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/291: link d0/df/l13 d0/d1b/d60/l61 0 2024-04-30T23:15:52.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/292: chown d0/df/l58 1 1 2024-04-30T23:15:52.564 INFO:tasks.workunit.client.0.smithi100.stdout:0/260: dwrite d2/d14/d35/d40/f49 [0,4194304] 0 2024-04-30T23:15:52.564 INFO:tasks.workunit.client.0.smithi100.stdout:7/293: rename d0/df/l15 to d0/d1b/d60/l62 0 2024-04-30T23:15:52.568 INFO:tasks.workunit.client.0.smithi100.stdout:0/261: rename d2/d14/c21 to d2/d50/d30/c58 0 2024-04-30T23:15:52.568 INFO:tasks.workunit.client.0.smithi100.stdout:0/262: fdatasync d2/f8 0 2024-04-30T23:15:52.568 INFO:tasks.workunit.client.0.smithi100.stdout:0/263: chown d2/d14/d35/d40 15038719 1 2024-04-30T23:15:52.571 INFO:tasks.workunit.client.0.smithi100.stdout:7/294: creat d0/d1b/d2e/f63 x:0 0 0 2024-04-30T23:15:52.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/295: rename d0/fe to d0/d1b/d60/d48/f64 0 2024-04-30T23:15:52.575 INFO:tasks.workunit.client.0.smithi100.stdout:5/216: dwrite d1/d12/d1a/f1f [0,4194304] 0 2024-04-30T23:15:52.578 INFO:tasks.workunit.client.0.smithi100.stdout:5/217: rename d1/d12/d1a/f1f to d1/d19/f4a 0 2024-04-30T23:15:52.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/218: mknod d1/d19/c4b 0 2024-04-30T23:15:52.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/219: write d1/d12/d24/f25 [930778,28856] 0 2024-04-30T23:15:52.581 INFO:tasks.workunit.client.0.smithi100.stdout:5/220: creat d1/d12/d27/f4c x:0 0 0 2024-04-30T23:15:52.581 INFO:tasks.workunit.client.0.smithi100.stdout:9/199: dwrite d4/f2a [0,4194304] 0 2024-04-30T23:15:52.582 INFO:tasks.workunit.client.0.smithi100.stdout:3/263: dread d1/d14/d15/f44 [0,4194304] 0 2024-04-30T23:15:52.582 INFO:tasks.workunit.client.0.smithi100.stdout:9/200: fdatasync d4/d9/d10/f3a 0 2024-04-30T23:15:52.582 INFO:tasks.workunit.client.0.smithi100.stdout:5/221: getdents d1/d12 0 2024-04-30T23:15:52.582 INFO:tasks.workunit.client.0.smithi100.stdout:5/222: chown d1/d2c 130180 1 2024-04-30T23:15:52.582 INFO:tasks.workunit.client.0.smithi100.stdout:0/264: dread d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:52.583 INFO:tasks.workunit.client.0.smithi100.stdout:0/265: read d2/d14/f24 [3539450,95946] 0 2024-04-30T23:15:52.583 INFO:tasks.workunit.client.0.smithi100.stdout:3/264: symlink d1/d14/d15/d32/l4b 0 2024-04-30T23:15:52.585 INFO:tasks.workunit.client.0.smithi100.stdout:9/201: rename d4/f13 to d4/d7/d8/d37/f42 0 2024-04-30T23:15:52.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/266: creat d2/f59 x:0 0 0 2024-04-30T23:15:52.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/267: dread - d2/d14/d35/d40/f56 zero size 2024-04-30T23:15:52.593 INFO:tasks.workunit.client.0.smithi100.stdout:0/268: mkdir d2/d5a 0 2024-04-30T23:15:52.594 INFO:tasks.workunit.client.0.smithi100.stdout:0/269: truncate d2/d14/f19 3089930 0 2024-04-30T23:15:52.594 INFO:tasks.workunit.client.0.smithi100.stdout:0/270: write d2/d50/f3c [1664282,66990] 0 2024-04-30T23:15:52.596 INFO:tasks.workunit.client.0.smithi100.stdout:0/271: rename d2/f3 to d2/d50/d30/d32/f5b 0 2024-04-30T23:15:52.598 INFO:tasks.workunit.client.0.smithi100.stdout:7/296: dwrite d0/df/d19/d4b/f56 [4194304,4194304] 0 2024-04-30T23:15:52.602 INFO:tasks.workunit.client.0.smithi100.stdout:7/297: symlink d0/d1b/d24/d2a/l65 0 2024-04-30T23:15:52.604 INFO:tasks.workunit.client.0.smithi100.stdout:9/202: dread f2 [0,4194304] 0 2024-04-30T23:15:52.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/203: rename d4/d7/d8/d19/l1d to d4/d7/d8/d37/l43 0 2024-04-30T23:15:52.606 INFO:tasks.workunit.client.0.smithi100.stdout:9/204: creat d4/d7/f44 x:0 0 0 2024-04-30T23:15:52.607 INFO:tasks.workunit.client.0.smithi100.stdout:5/223: dwrite d1/fe [0,4194304] 0 2024-04-30T23:15:52.607 INFO:tasks.workunit.client.0.smithi100.stdout:9/205: link d4/d9/d10/c1b d4/d9/d10/c45 0 2024-04-30T23:15:52.608 INFO:tasks.workunit.client.0.smithi100.stdout:3/265: dwrite d1/d14/d15/d2c/f47 [0,4194304] 0 2024-04-30T23:15:52.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/272: unlink d2/ce 0 2024-04-30T23:15:52.611 INFO:tasks.workunit.client.0.smithi100.stdout:5/224: rename d1/l28 to d1/d19/l4d 0 2024-04-30T23:15:52.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/225: rmdir d1/d12/d24 39 2024-04-30T23:15:52.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/226: fsync d1/f7 0 2024-04-30T23:15:52.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/227: readlink d1/d2c/l43 0 2024-04-30T23:15:52.615 INFO:tasks.workunit.client.0.smithi100.stdout:5/228: chown d1/d12/d24/f25 1393355782 1 2024-04-30T23:15:52.617 INFO:tasks.workunit.client.0.smithi100.stdout:5/229: creat d1/d12/d24/f4e x:0 0 0 2024-04-30T23:15:52.619 INFO:tasks.workunit.client.0.smithi100.stdout:5/230: symlink d1/d37/l4f 0 2024-04-30T23:15:52.619 INFO:tasks.workunit.client.0.smithi100.stdout:5/231: truncate d1/d12/d1a/f2d 1048961 0 2024-04-30T23:15:52.621 INFO:tasks.workunit.client.0.smithi100.stdout:0/273: dread d2/d14/f19 [0,4194304] 0 2024-04-30T23:15:52.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/274: write d2/d14/d35/d40/f56 [513261,122772] 0 2024-04-30T23:15:52.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/275: truncate d2/f59 516411 0 2024-04-30T23:15:52.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/276: getdents d2/d4c 0 2024-04-30T23:15:52.623 INFO:tasks.workunit.client.0.smithi100.stdout:0/277: mknod d2/d14/d35/d40/c5c 0 2024-04-30T23:15:52.623 INFO:tasks.workunit.client.0.smithi100.stdout:0/278: write d2/fc [505155,88004] 0 2024-04-30T23:15:52.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/279: mkdir d2/d50/d38/d5d 0 2024-04-30T23:15:52.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/298: dwrite d0/df/d19/f3a [0,4194304] 0 2024-04-30T23:15:52.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/299: write d0/df/f14 [1385151,111559] 0 2024-04-30T23:15:52.629 INFO:tasks.workunit.client.0.smithi100.stdout:0/280: creat d2/d14/d35/f5e x:0 0 0 2024-04-30T23:15:52.630 INFO:tasks.workunit.client.0.smithi100.stdout:7/300: rename d0/d1b/d24/d2a/l65 to d0/d1b/d60/d48/d4a/d5b/l66 0 2024-04-30T23:15:52.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/281: rename d2 to d2/d14/d5f 22 2024-04-30T23:15:52.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/301: truncate d0/df/d4f/d53/f59 454831 0 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:7/302: rmdir d0/d1b/d24 39 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/282: write d2/d50/d30/f3d [326084,90447] 0 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/283: fsync d2/f5 0 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/284: chown d2/d50/d38/c51 16254352 1 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/285: write d2/f12 [1036084,67419] 0 2024-04-30T23:15:52.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/232: dread d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:52.633 INFO:tasks.workunit.client.0.smithi100.stdout:5/233: dread - d1/d2c/f33 zero size 2024-04-30T23:15:52.633 INFO:tasks.workunit.client.0.smithi100.stdout:5/234: chown d1/c2b 179306 1 2024-04-30T23:15:52.638 INFO:tasks.workunit.client.0.smithi100.stdout:3/266: dwrite d1/d14/d15/d1e/f39 [0,4194304] 0 2024-04-30T23:15:52.638 INFO:tasks.workunit.client.0.smithi100.stdout:3/267: chown d1/d14/d21 33349738 1 2024-04-30T23:15:52.651 INFO:tasks.workunit.client.0.smithi100.stdout:7/303: dread d0/d1b/d24/d2a/f34 [0,4194304] 0 2024-04-30T23:15:52.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/304: dread d0/d1b/d1e/f40 [0,4194304] 0 2024-04-30T23:15:52.655 INFO:tasks.workunit.client.0.smithi100.stdout:7/305: mknod d0/d1b/c67 0 2024-04-30T23:15:52.655 INFO:tasks.workunit.client.0.smithi100.stdout:7/306: chown d0/d1b/d60/d48/d4a/d5b/l66 4606898 1 2024-04-30T23:15:52.662 INFO:tasks.workunit.client.0.smithi100.stdout:0/286: dwrite d2/d14/d35/f39 [0,4194304] 0 2024-04-30T23:15:52.662 INFO:tasks.workunit.client.0.smithi100.stdout:5/235: dwrite d1/d19/f1e [0,4194304] 0 2024-04-30T23:15:52.664 INFO:tasks.workunit.client.0.smithi100.stdout:0/287: link d2/d14/d35/d40/f49 d2/d14/d35/d57/f60 0 2024-04-30T23:15:52.664 INFO:tasks.workunit.client.0.smithi100.stdout:0/288: write d2/d50/d30/f53 [311742,40327] 0 2024-04-30T23:15:52.666 INFO:tasks.workunit.client.0.smithi100.stdout:0/289: rmdir d2/d50/d30/d32 39 2024-04-30T23:15:52.668 INFO:tasks.workunit.client.0.smithi100.stdout:0/290: mknod d2/d14/d35/c61 0 2024-04-30T23:15:52.668 INFO:tasks.workunit.client.0.smithi100.stdout:0/291: stat d2/fb 0 2024-04-30T23:15:52.668 INFO:tasks.workunit.client.0.smithi100.stdout:0/292: write d2/f23 [4057632,26684] 0 2024-04-30T23:15:52.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/268: dwrite d1/f13 [8388608,4194304] 0 2024-04-30T23:15:52.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/293: getdents d2/d50/d38 0 2024-04-30T23:15:52.672 INFO:tasks.workunit.client.0.smithi100.stdout:3/269: getdents d1/d14/d15/d27 0 2024-04-30T23:15:52.676 INFO:tasks.workunit.client.0.smithi100.stdout:7/307: dread d0/f17 [0,4194304] 0 2024-04-30T23:15:52.676 INFO:tasks.workunit.client.0.smithi100.stdout:0/294: mkdir d2/d14/d35/d57/d62 0 2024-04-30T23:15:52.677 INFO:tasks.workunit.client.0.smithi100.stdout:7/308: mknod d0/df/d4f/d53/c68 0 2024-04-30T23:15:52.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/295: creat d2/d50/d30/d32/f63 x:0 0 0 2024-04-30T23:15:52.679 INFO:tasks.workunit.client.0.smithi100.stdout:7/309: mknod d0/c69 0 2024-04-30T23:15:52.679 INFO:tasks.workunit.client.0.smithi100.stdout:0/296: mkdir d2/d5a/d64 0 2024-04-30T23:15:52.683 INFO:tasks.workunit.client.0.smithi100.stdout:0/297: truncate d2/f12 462672 0 2024-04-30T23:15:52.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/298: write d2/d14/d35/f43 [916846,61799] 0 2024-04-30T23:15:52.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/299: chown d2/f2e 3821 1 2024-04-30T23:15:52.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/300: truncate d2/d14/d35/f4b 221872 0 2024-04-30T23:15:52.690 INFO:tasks.workunit.client.0.smithi100.stdout:0/301: rmdir d2/d5a/d64 0 2024-04-30T23:15:52.695 INFO:tasks.workunit.client.0.smithi100.stdout:0/302: truncate d2/d14/d35/f43 923840 0 2024-04-30T23:15:52.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/303: write d2/d14/d35/f39 [4751615,31835] 0 2024-04-30T23:15:52.697 INFO:tasks.workunit.client.0.smithi100.stdout:0/304: truncate d2/d14/d18/f45 3431609 0 2024-04-30T23:15:52.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/305: write d2/f8 [2762449,22328] 0 2024-04-30T23:15:52.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/310: rename d0/df/d19 to d0/d1d/d5e/d6a 0 2024-04-30T23:15:52.729 INFO:tasks.workunit.client.0.smithi100.stdout:0/306: dwrite d2/d14/d18/f45 [0,4194304] 0 2024-04-30T23:15:52.745 INFO:tasks.workunit.client.0.smithi100.stdout:7/311: dwrite d0/d1b/d60/d48/d4a/f4e [4194304,4194304] 0 2024-04-30T23:15:52.745 INFO:tasks.workunit.client.0.smithi100.stdout:7/312: stat d0/f18 0 2024-04-30T23:15:52.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/313: mknod d0/d1b/d24/d2a/c6b 0 2024-04-30T23:15:52.748 INFO:tasks.workunit.client.0.smithi100.stdout:7/314: creat d0/d1b/d60/d48/d4a/d5b/f6c x:0 0 0 2024-04-30T23:15:52.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/315: dread d0/d1b/d24/f2f [0,4194304] 0 2024-04-30T23:15:52.755 INFO:tasks.workunit.client.0.smithi100.stdout:7/316: creat d0/d1d/d5e/d6a/f6d x:0 0 0 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/160: sync 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/285: sync 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:2/241: sync 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/263: sync 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:1/292: sync 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/286: truncate d7/d9/f31 4567869 0 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/264: read f12 [847642,28380] 0 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/287: truncate d7/d9/f51 1038681 0 2024-04-30T23:15:52.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/288: write d7/d9/f28 [9231037,73905] 0 2024-04-30T23:15:52.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/289: dread - d7/df/d23/d24/d2e/d37/f5e zero size 2024-04-30T23:15:52.760 INFO:tasks.workunit.client.0.smithi100.stdout:2/242: stat d5/d22/c24 0 2024-04-30T23:15:52.760 INFO:tasks.workunit.client.0.smithi100.stdout:8/161: link d2/de/d10/c28 d2/de/d10/c33 0 2024-04-30T23:15:52.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/293: mkdir d3/d16/d20/d24/d3f/d5e 0 2024-04-30T23:15:52.761 INFO:tasks.workunit.client.0.smithi100.stdout:4/265: mkdir d19/d1a/d21/d4a/d53 0 2024-04-30T23:15:52.762 INFO:tasks.workunit.client.0.smithi100.stdout:2/243: creat d5/d47/d4c/f4f x:0 0 0 2024-04-30T23:15:52.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/294: rename d3/d18/d3b to d3/d16/d20/d24/d51/d59/d5f 0 2024-04-30T23:15:52.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/295: fdatasync d3/d16/f3c 0 2024-04-30T23:15:52.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/296: write d3/f4 [5180311,27049] 0 2024-04-30T23:15:52.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/297: mkdir d3/d18/d60 0 2024-04-30T23:15:52.767 INFO:tasks.workunit.client.0.smithi100.stdout:4/266: rename d19/d1a/l35 to d19/d1a/d21/d32/l54 0 2024-04-30T23:15:52.767 INFO:tasks.workunit.client.0.smithi100.stdout:4/267: write d19/f26 [5183629,29219] 0 2024-04-30T23:15:52.767 INFO:tasks.workunit.client.0.smithi100.stdout:1/298: creat d3/db/d4b/f61 x:0 0 0 2024-04-30T23:15:52.769 INFO:tasks.workunit.client.0.smithi100.stdout:1/299: symlink d3/d16/d20/d24/d51/l62 0 2024-04-30T23:15:52.770 INFO:tasks.workunit.client.0.smithi100.stdout:6/290: dread d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:52.770 INFO:tasks.workunit.client.0.smithi100.stdout:1/300: write d3/d16/d20/f45 [707678,7999] 0 2024-04-30T23:15:52.772 INFO:tasks.workunit.client.0.smithi100.stdout:8/162: write d2/de/d10/f19 [2583337,58521] 0 2024-04-30T23:15:52.772 INFO:tasks.workunit.client.0.smithi100.stdout:4/268: rename d19/d1a/d21/d32/f36 to d19/d1a/d21/d3c/f55 0 2024-04-30T23:15:52.772 INFO:tasks.workunit.client.0.smithi100.stdout:4/269: chown d19/d1a/l28 0 1 2024-04-30T23:15:52.772 INFO:tasks.workunit.client.0.smithi100.stdout:6/291: mkdir d7/d1a/d62 0 2024-04-30T23:15:52.778 INFO:tasks.workunit.client.0.smithi100.stdout:8/163: dread d2/f1d [0,4194304] 0 2024-04-30T23:15:52.779 INFO:tasks.workunit.client.0.smithi100.stdout:7/317: dread d0/f8 [0,4194304] 0 2024-04-30T23:15:52.780 INFO:tasks.workunit.client.0.smithi100.stdout:8/164: mknod d2/de/d10/d17/c34 0 2024-04-30T23:15:52.789 INFO:tasks.workunit.client.0.smithi100.stdout:2/244: dwrite d5/f45 [0,4194304] 0 2024-04-30T23:15:52.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/165: dread d2/de/fa [0,4194304] 0 2024-04-30T23:15:52.793 INFO:tasks.workunit.client.0.smithi100.stdout:2/245: creat d5/d2e/f50 x:0 0 0 2024-04-30T23:15:52.793 INFO:tasks.workunit.client.0.smithi100.stdout:2/246: chown d5/f45 19 1 2024-04-30T23:15:52.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/166: symlink d2/de/d10/d17/l35 0 2024-04-30T23:15:52.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/167: write d2/f8 [2329772,85463] 0 2024-04-30T23:15:52.795 INFO:tasks.workunit.client.0.smithi100.stdout:4/270: dwrite d19/d1a/d21/f25 [0,4194304] 0 2024-04-30T23:15:52.798 INFO:tasks.workunit.client.0.smithi100.stdout:4/271: creat d19/d33/d3f/f56 x:0 0 0 2024-04-30T23:15:52.798 INFO:tasks.workunit.client.0.smithi100.stdout:4/272: write d19/f2f [4562271,80182] 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/273: write d19/d1a/d21/f49 [1207600,110804] 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/274: write d19/d1a/d21/f50 [444751,8361] 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/275: write d19/d33/d3f/f41 [1767008,55990] 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/276: readlink d19/d1a/d29/l4b 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/277: write d19/d1a/d21/f50 [539935,47380] 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/278: symlink d19/d1a/l57 0 2024-04-30T23:15:52.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/279: readlink d19/d1a/l28 0 2024-04-30T23:15:52.801 INFO:tasks.workunit.client.0.smithi100.stdout:4/280: truncate f8 4263986 0 2024-04-30T23:15:52.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/318: dwrite d0/d1b/d60/d48/d4a/f4c [0,4194304] 0 2024-04-30T23:15:52.804 INFO:tasks.workunit.client.0.smithi100.stdout:4/281: rmdir d19/d1a/d21/d32 39 2024-04-30T23:15:52.809 INFO:tasks.workunit.client.0.smithi100.stdout:4/282: rename d19/d1a/d21/d4a/c4c to d19/d33/d3f/c58 0 2024-04-30T23:15:52.810 INFO:tasks.workunit.client.0.smithi100.stdout:2/247: dread d5/d2e/f35 [0,4194304] 0 2024-04-30T23:15:52.815 INFO:tasks.workunit.client.0.smithi100.stdout:2/248: write d5/d26/d2f/f36 [863636,15143] 0 2024-04-30T23:15:52.816 INFO:tasks.workunit.client.0.smithi100.stdout:2/249: creat d5/d47/d4c/f51 x:0 0 0 2024-04-30T23:15:52.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/168: dwrite d2/f3 [0,4194304] 0 2024-04-30T23:15:52.817 INFO:tasks.workunit.client.0.smithi100.stdout:2/250: creat d5/d12/d13/d4b/f52 x:0 0 0 2024-04-30T23:15:52.818 INFO:tasks.workunit.client.0.smithi100.stdout:7/319: write d0/f16 [2877742,60512] 0 2024-04-30T23:15:52.818 INFO:tasks.workunit.client.0.smithi100.stdout:2/251: mknod d5/c53 0 2024-04-30T23:15:52.826 INFO:tasks.workunit.client.0.smithi100.stdout:2/252: getdents d5/d12/d13/d4b 0 2024-04-30T23:15:52.826 INFO:tasks.workunit.client.0.smithi100.stdout:2/253: chown d5/d2e/f44 13 1 2024-04-30T23:15:52.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/254: creat d5/d26/f54 x:0 0 0 2024-04-30T23:15:52.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/255: write d5/d22/f40 [1849894,16400] 0 2024-04-30T23:15:52.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/256: truncate d5/d12/f2b 831028 0 2024-04-30T23:15:52.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/169: dread d2/d7/d18/f15 [0,4194304] 0 2024-04-30T23:15:52.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/170: dread - d2/d29/f30 zero size 2024-04-30T23:15:52.834 INFO:tasks.workunit.client.0.smithi100.stdout:4/283: dwrite d19/d1a/d21/f2b [0,4194304] 0 2024-04-30T23:15:52.841 INFO:tasks.workunit.client.0.smithi100.stdout:2/257: dread d5/f2d [0,4194304] 0 2024-04-30T23:15:52.842 INFO:tasks.workunit.client.0.smithi100.stdout:2/258: mkdir d5/d47/d4c/d55 0 2024-04-30T23:15:52.845 INFO:tasks.workunit.client.0.smithi100.stdout:4/284: write f9 [1916722,121257] 0 2024-04-30T23:15:52.846 INFO:tasks.workunit.client.0.smithi100.stdout:4/285: rename d19/d33/l42 to d19/d1a/l59 0 2024-04-30T23:15:52.846 INFO:tasks.workunit.client.0.smithi100.stdout:4/286: fdatasync d19/d1a/d21/d3c/f55 0 2024-04-30T23:15:52.847 INFO:tasks.workunit.client.0.smithi100.stdout:4/287: dread - d19/d1a/d21/d32/f3d zero size 2024-04-30T23:15:52.862 INFO:tasks.workunit.client.0.smithi100.stdout:8/171: dwrite d2/d7/d18/f15 [0,4194304] 0 2024-04-30T23:15:52.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/259: dwrite d5/d22/f4e [0,4194304] 0 2024-04-30T23:15:52.868 INFO:tasks.workunit.client.0.smithi100.stdout:8/172: dread d2/d7/f20 [0,4194304] 0 2024-04-30T23:15:52.868 INFO:tasks.workunit.client.0.smithi100.stdout:2/260: creat d5/d12/d13/d4b/f56 x:0 0 0 2024-04-30T23:15:52.869 INFO:tasks.workunit.client.0.smithi100.stdout:2/261: mknod d5/d26/d2f/d38/c57 0 2024-04-30T23:15:52.870 INFO:tasks.workunit.client.0.smithi100.stdout:2/262: mkdir d5/d58 0 2024-04-30T23:15:52.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/288: dwrite d19/d33/d3f/f51 [0,4194304] 0 2024-04-30T23:15:52.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/173: dread d2/d7/f12 [0,4194304] 0 2024-04-30T23:15:52.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/174: chown d2/d7/f2d 222034013 1 2024-04-30T23:15:52.873 INFO:tasks.workunit.client.0.smithi100.stdout:4/289: creat d19/d33/f5a x:0 0 0 2024-04-30T23:15:52.876 INFO:tasks.workunit.client.0.smithi100.stdout:2/263: rmdir d5/d47/d4c/d55 0 2024-04-30T23:15:52.876 INFO:tasks.workunit.client.0.smithi100.stdout:2/264: getdents d5/d58 0 2024-04-30T23:15:52.876 INFO:tasks.workunit.client.0.smithi100.stdout:2/265: write d5/d2e/f44 [1297169,37926] 0 2024-04-30T23:15:52.878 INFO:tasks.workunit.client.0.smithi100.stdout:2/266: creat d5/d12/d13/f59 x:0 0 0 2024-04-30T23:15:52.878 INFO:tasks.workunit.client.0.smithi100.stdout:2/267: stat d5/d12/d13/l20 0 2024-04-30T23:15:52.879 INFO:tasks.workunit.client.0.smithi100.stdout:2/268: stat d5/d26/f4a 0 2024-04-30T23:15:52.887 INFO:tasks.workunit.client.0.smithi100.stdout:8/175: read d2/d7/d18/f15 [2495,124644] 0 2024-04-30T23:15:52.888 INFO:tasks.workunit.client.0.smithi100.stdout:8/176: mknod d2/de/d10/c36 0 2024-04-30T23:15:52.889 INFO:tasks.workunit.client.0.smithi100.stdout:8/177: write d2/f4 [6329733,104072] 0 2024-04-30T23:15:52.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/178: write d2/d7/f20 [1033958,59272] 0 2024-04-30T23:15:52.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/179: fdatasync d2/f6 0 2024-04-30T23:15:52.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/180: write d2/d29/f2b [977541,21052] 0 2024-04-30T23:15:52.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/181: read - d2/d29/f30 zero size 2024-04-30T23:15:52.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/182: readlink d2/d7/l23 0 2024-04-30T23:15:52.907 INFO:tasks.workunit.client.0.smithi100.stdout:4/290: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:52.909 INFO:tasks.workunit.client.0.smithi100.stdout:4/291: symlink d19/l5b 0 2024-04-30T23:15:52.910 INFO:tasks.workunit.client.0.smithi100.stdout:4/292: symlink d19/l5c 0 2024-04-30T23:15:52.910 INFO:tasks.workunit.client.0.smithi100.stdout:4/293: write d19/d1a/d21/f49 [1397127,17559] 0 2024-04-30T23:15:52.912 INFO:tasks.workunit.client.0.smithi100.stdout:8/183: dwrite d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:52.912 INFO:tasks.workunit.client.0.smithi100.stdout:8/184: write d2/de/d10/f19 [1999844,3588] 0 2024-04-30T23:15:52.914 INFO:tasks.workunit.client.0.smithi100.stdout:8/185: dread d2/de/d10/d17/f1b [0,4194304] 0 2024-04-30T23:15:52.921 INFO:tasks.workunit.client.0.smithi100.stdout:9/206: sync 2024-04-30T23:15:52.921 INFO:tasks.workunit.client.0.smithi100.stdout:9/207: chown d4/d9/c1c 36 1 2024-04-30T23:15:52.938 INFO:tasks.workunit.client.0.smithi100.stdout:4/294: dwrite d19/d1a/d21/f49 [0,4194304] 0 2024-04-30T23:15:52.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/186: dwrite d2/f3 [4194304,4194304] 0 2024-04-30T23:15:52.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/187: readlink d2/d7/l23 0 2024-04-30T23:15:52.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/188: fdatasync d2/d29/f2b 0 2024-04-30T23:15:52.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/295: mkdir d19/d1a/d21/d4a/d53/d5d 0 2024-04-30T23:15:52.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/296: write d19/d33/d3f/f51 [4514646,112048] 0 2024-04-30T23:15:52.942 INFO:tasks.workunit.client.0.smithi100.stdout:8/189: link d2/de/l1c d2/d7/l37 0 2024-04-30T23:15:52.959 INFO:tasks.workunit.client.0.smithi100.stdout:4/297: dwrite d19/d1a/d21/f2d [0,4194304] 0 2024-04-30T23:15:52.959 INFO:tasks.workunit.client.0.smithi100.stdout:4/298: readlink d19/l5b 0 2024-04-30T23:15:52.961 INFO:tasks.workunit.client.0.smithi100.stdout:4/299: truncate d19/d33/f31 772278 0 2024-04-30T23:15:52.975 INFO:tasks.workunit.client.0.smithi100.stdout:4/300: write d19/d1a/d21/f2b [247091,30224] 0 2024-04-30T23:15:52.977 INFO:tasks.workunit.client.0.smithi100.stdout:4/301: rmdir d19/d1a/d21/d3c 39 2024-04-30T23:15:52.978 INFO:tasks.workunit.client.0.smithi100.stdout:4/302: readlink l15 0 2024-04-30T23:15:52.978 INFO:tasks.workunit.client.0.smithi100.stdout:4/303: truncate d19/d1a/d21/d32/f3d 790924 0 2024-04-30T23:15:52.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/304: mkdir d19/d1a/d21/d4a/d53/d5e 0 2024-04-30T23:15:52.991 INFO:tasks.workunit.client.0.smithi100.stdout:4/305: write d19/d1a/d21/f25 [2457989,104091] 0 2024-04-30T23:15:52.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/306: creat d19/d1a/d29/f5f x:0 0 0 2024-04-30T23:15:52.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/307: truncate d19/d1a/d21/f2b 4981559 0 2024-04-30T23:15:52.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/308: chown d19/d33/f31 237049 1 2024-04-30T23:15:52.993 INFO:tasks.workunit.client.0.smithi100.stdout:4/309: symlink d19/d33/d3f/l60 0 2024-04-30T23:15:53.014 INFO:tasks.workunit.client.0.smithi100.stdout:4/310: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:53.014 INFO:tasks.workunit.client.0.smithi100.stdout:4/311: fdatasync d19/d1a/d21/d3c/f55 0 2024-04-30T23:15:53.032 INFO:tasks.workunit.client.0.smithi100.stdout:4/312: dwrite f9 [0,4194304] 0 2024-04-30T23:15:53.032 INFO:tasks.workunit.client.0.smithi100.stdout:4/313: chown d19/d1a/d21/f2b 741142 1 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:3/270: sync 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:5/236: sync 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:3/271: fsync d1/ff 0 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:5/237: readlink d1/d2c/l3f 0 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:5/238: readlink d1/d19/l4d 0 2024-04-30T23:15:53.044 INFO:tasks.workunit.client.0.smithi100.stdout:5/239: stat d1/d2c/f33 0 2024-04-30T23:15:53.046 INFO:tasks.workunit.client.0.smithi100.stdout:4/314: dread d19/d33/d3f/f51 [0,4194304] 0 2024-04-30T23:15:53.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:53.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:15:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:52 smithi104 ceph-mon[32987]: pgmap v441: 129 pgs: 129 active+clean; 500 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 56 MiB/s wr, 467 op/s 2024-04-30T23:15:53.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:52 smithi183 ceph-mon[33560]: pgmap v441: 129 pgs: 129 active+clean; 500 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 56 MiB/s wr, 467 op/s 2024-04-30T23:15:53.056 INFO:tasks.workunit.client.0.smithi100.stdout:3/272: write d1/d14/d15/f1d [477382,112634] 0 2024-04-30T23:15:53.056 INFO:tasks.workunit.client.0.smithi100.stdout:3/273: write d1/f13 [7215644,105563] 0 2024-04-30T23:15:53.063 INFO:tasks.workunit.client.0.smithi100.stdout:3/274: dread d1/d14/d21/f2d [0,4194304] 0 2024-04-30T23:15:53.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/315: dwrite f12 [0,4194304] 0 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:15:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:53.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:52 smithi100 ceph-mon[29745]: pgmap v441: 129 pgs: 129 active+clean; 500 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 56 MiB/s wr, 467 op/s 2024-04-30T23:15:53.076 INFO:tasks.workunit.client.0.smithi100.stdout:5/240: dwrite f0 [0,4194304] 0 2024-04-30T23:15:53.078 INFO:tasks.workunit.client.0.smithi100.stdout:5/241: creat d1/d12/d24/d34/f50 x:0 0 0 2024-04-30T23:15:53.078 INFO:tasks.workunit.client.0.smithi100.stdout:5/242: stat d1/d12/d27/f29 0 2024-04-30T23:15:53.084 INFO:tasks.workunit.client.0.smithi100.stdout:3/275: dwrite d1/f4a [0,4194304] 0 2024-04-30T23:15:53.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/243: dwrite d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:53.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/316: dwrite f3 [0,4194304] 0 2024-04-30T23:15:53.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/317: truncate f18 956374 0 2024-04-30T23:15:53.112 INFO:tasks.workunit.client.0.smithi100.stdout:5/244: dread d1/d12/f18 [0,4194304] 0 2024-04-30T23:15:53.113 INFO:tasks.workunit.client.0.smithi100.stdout:5/245: mknod d1/d19/c51 0 2024-04-30T23:15:53.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/276: dwrite d1/d14/d15/f1b [4194304,4194304] 0 2024-04-30T23:15:53.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/277: chown d1/d14/d2b/l46 138566 1 2024-04-30T23:15:53.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/278: stat d1/d14/d15/f44 0 2024-04-30T23:15:53.124 INFO:tasks.workunit.client.0.smithi100.stdout:0/307: sync 2024-04-30T23:15:53.124 INFO:tasks.workunit.client.0.smithi100.stdout:1/301: sync 2024-04-30T23:15:53.124 INFO:tasks.workunit.client.0.smithi100.stdout:1/302: stat d3/db/f3d 0 2024-04-30T23:15:53.126 INFO:tasks.workunit.client.0.smithi100.stdout:0/308: creat d2/f65 x:0 0 0 2024-04-30T23:15:53.126 INFO:tasks.workunit.client.0.smithi100.stdout:0/309: fdatasync d2/d50/d38/f3f 0 2024-04-30T23:15:53.127 INFO:tasks.workunit.client.0.smithi100.stdout:1/303: mkdir d3/d16/d20/d24/d3f/d63 0 2024-04-30T23:15:53.128 INFO:tasks.workunit.client.0.smithi100.stdout:4/318: dread d19/f26 [0,4194304] 0 2024-04-30T23:15:53.128 INFO:tasks.workunit.client.0.smithi100.stdout:1/304: rename d3/db/d4b/f61 to d3/d18/d60/f64 0 2024-04-30T23:15:53.131 INFO:tasks.workunit.client.0.smithi100.stdout:3/279: dread d1/d14/d15/d2c/f47 [0,4194304] 0 2024-04-30T23:15:53.132 INFO:tasks.workunit.client.0.smithi100.stdout:3/280: getdents d1/d14/d15/d1e/d26 0 2024-04-30T23:15:53.133 INFO:tasks.workunit.client.0.smithi100.stdout:3/281: truncate d1/d14/d15/f44 4177224 0 2024-04-30T23:15:53.134 INFO:tasks.workunit.client.0.smithi100.stdout:3/282: link d1/d14/d21/f48 d1/d14/d2b/f4c 0 2024-04-30T23:15:53.136 INFO:tasks.workunit.client.0.smithi100.stdout:5/246: dwrite d1/d12/f21 [4194304,4194304] 0 2024-04-30T23:15:53.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/319: write d19/f26 [3511865,70629] 0 2024-04-30T23:15:53.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/320: truncate d19/d33/d3f/f41 1959401 0 2024-04-30T23:15:53.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/321: write d19/d33/d3f/f56 [836802,129804] 0 2024-04-30T23:15:53.141 INFO:tasks.workunit.client.0.smithi100.stdout:2/269: sync 2024-04-30T23:15:53.141 INFO:tasks.workunit.client.0.smithi100.stdout:6/292: sync 2024-04-30T23:15:53.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/208: sync 2024-04-30T23:15:53.141 INFO:tasks.workunit.client.0.smithi100.stdout:2/270: chown d5/c29 57714 1 2024-04-30T23:15:53.141 INFO:tasks.workunit.client.0.smithi100.stdout:6/293: write d7/db/f5c [394128,99752] 0 2024-04-30T23:15:53.143 INFO:tasks.workunit.client.0.smithi100.stdout:4/322: link d19/d1a/c1f d19/d1a/c61 0 2024-04-30T23:15:53.143 INFO:tasks.workunit.client.0.smithi100.stdout:0/310: read d2/d14/d35/d40/f49 [3558868,79699] 0 2024-04-30T23:15:53.144 INFO:tasks.workunit.client.0.smithi100.stdout:2/271: getdents d5/d26/d2f 0 2024-04-30T23:15:53.147 INFO:tasks.workunit.client.0.smithi100.stdout:6/294: symlink d7/df/d23/d2b/l63 0 2024-04-30T23:15:53.148 INFO:tasks.workunit.client.0.smithi100.stdout:6/295: truncate d7/d9/f51 1221692 0 2024-04-30T23:15:53.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/190: sync 2024-04-30T23:15:53.148 INFO:tasks.workunit.client.0.smithi100.stdout:7/320: sync 2024-04-30T23:15:53.148 INFO:tasks.workunit.client.0.smithi100.stdout:4/323: mknod d19/d1a/d21/d4a/d53/c62 0 2024-04-30T23:15:53.150 INFO:tasks.workunit.client.0.smithi100.stdout:2/272: mknod d5/d12/d13/c5a 0 2024-04-30T23:15:53.150 INFO:tasks.workunit.client.0.smithi100.stdout:2/273: dread - d5/f28 zero size 2024-04-30T23:15:53.152 INFO:tasks.workunit.client.0.smithi100.stdout:6/296: mknod d7/df/d23/d2b/c64 0 2024-04-30T23:15:53.153 INFO:tasks.workunit.client.0.smithi100.stdout:8/191: mkdir d2/de/d38 0 2024-04-30T23:15:53.153 INFO:tasks.workunit.client.0.smithi100.stdout:8/192: fsync d2/f3 0 2024-04-30T23:15:53.153 INFO:tasks.workunit.client.0.smithi100.stdout:4/324: link d19/c20 d19/d1a/d29/c63 0 2024-04-30T23:15:53.153 INFO:tasks.workunit.client.0.smithi100.stdout:4/325: chown d19/f27 27 1 2024-04-30T23:15:53.154 INFO:tasks.workunit.client.0.smithi100.stdout:2/274: creat d5/d26/d2f/f5b x:0 0 0 2024-04-30T23:15:53.154 INFO:tasks.workunit.client.0.smithi100.stdout:2/275: dread - d5/f25 zero size 2024-04-30T23:15:53.158 INFO:tasks.workunit.client.0.smithi100.stdout:2/276: mknod d5/d12/c5c 0 2024-04-30T23:15:53.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/277: symlink d5/d12/d13/d4b/l5d 0 2024-04-30T23:15:53.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/278: dread - d5/d26/f54 zero size 2024-04-30T23:15:53.162 INFO:tasks.workunit.client.0.smithi100.stdout:2/279: rmdir d5/d26/d2f 39 2024-04-30T23:15:53.163 INFO:tasks.workunit.client.0.smithi100.stdout:3/283: write d1/f4a [4113272,77275] 0 2024-04-30T23:15:53.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/247: dwrite d1/d12/d27/f29 [0,4194304] 0 2024-04-30T23:15:53.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/284: read d1/d14/f36 [384338,129829] 0 2024-04-30T23:15:53.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/305: dwrite d3/d18/f53 [0,4194304] 0 2024-04-30T23:15:53.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/306: truncate d3/f58 363762 0 2024-04-30T23:15:53.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/307: fdatasync d3/d16/d20/f45 0 2024-04-30T23:15:53.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/193: unlink d2/de/d10/d17/c25 0 2024-04-30T23:15:53.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/326: truncate d19/d33/d3f/f41 1528125 0 2024-04-30T23:15:53.174 INFO:tasks.workunit.client.0.smithi100.stdout:5/248: link d1/l10 d1/d12/d1a/l52 0 2024-04-30T23:15:53.174 INFO:tasks.workunit.client.0.smithi100.stdout:5/249: fdatasync d1/d19/f1e 0 2024-04-30T23:15:53.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/327: getdents d19/d1a/d21/d32 0 2024-04-30T23:15:53.182 INFO:tasks.workunit.client.0.smithi100.stdout:4/328: mkdir d19/d1a/d21/d32/d64 0 2024-04-30T23:15:53.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/209: dwrite d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:53.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/210: rename d4/d9/d10/c1b to d4/d7/c46 0 2024-04-30T23:15:53.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/211: dread - d4/d7/d8/d37/d3d/f40 zero size 2024-04-30T23:15:53.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/212: chown d4/d7/f38 8 1 2024-04-30T23:15:53.190 INFO:tasks.workunit.client.0.smithi100.stdout:8/194: write d2/d7/f12 [50283,43425] 0 2024-04-30T23:15:53.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/311: dwrite d2/fc [0,4194304] 0 2024-04-30T23:15:53.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/213: mknod d4/d7/d8/c47 0 2024-04-30T23:15:53.191 INFO:tasks.workunit.client.0.smithi100.stdout:7/321: dread d0/d1b/d60/d48/d4a/f4e [4194304,4194304] 0 2024-04-30T23:15:53.191 INFO:tasks.workunit.client.0.smithi100.stdout:7/322: fsync d0/df/f29 0 2024-04-30T23:15:53.192 INFO:tasks.workunit.client.0.smithi100.stdout:8/195: creat d2/de/d38/f39 x:0 0 0 2024-04-30T23:15:53.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/308: dread d3/d18/f53 [0,4194304] 0 2024-04-30T23:15:53.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/309: fdatasync d3/d16/d20/f2a 0 2024-04-30T23:15:53.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/310: chown d3/f4d 39 1 2024-04-30T23:15:53.203 INFO:tasks.workunit.client.0.smithi100.stdout:1/311: truncate d3/db/f3e 78026 0 2024-04-30T23:15:53.204 INFO:tasks.workunit.client.0.smithi100.stdout:3/285: dwrite d1/ff [0,4194304] 0 2024-04-30T23:15:53.204 INFO:tasks.workunit.client.0.smithi100.stdout:3/286: read d1/d14/d15/d1e/d26/f23 [122885,53971] 0 2024-04-30T23:15:53.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/312: dread d2/d50/f3c [0,4194304] 0 2024-04-30T23:15:53.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/313: readlink d2/l2c 0 2024-04-30T23:15:53.204 INFO:tasks.workunit.client.0.smithi100.stdout:6/297: dwrite d7/f27 [4194304,4194304] 0 2024-04-30T23:15:53.205 INFO:tasks.workunit.client.0.smithi100.stdout:1/312: rename d3/l54 to d3/l65 0 2024-04-30T23:15:53.205 INFO:tasks.workunit.client.0.smithi100.stdout:1/313: fsync d3/d16/f3c 0 2024-04-30T23:15:53.205 INFO:tasks.workunit.client.0.smithi100.stdout:3/287: dread d1/d14/d15/d1e/d26/f23 [0,4194304] 0 2024-04-30T23:15:53.208 INFO:tasks.workunit.client.0.smithi100.stdout:6/298: rmdir d7/df/d23/d2b/d42 39 2024-04-30T23:15:53.208 INFO:tasks.workunit.client.0.smithi100.stdout:6/299: write d7/d11/d34/f26 [1045142,33084] 0 2024-04-30T23:15:53.210 INFO:tasks.workunit.client.0.smithi100.stdout:4/329: dread d19/d33/d3f/f41 [0,4194304] 0 2024-04-30T23:15:53.210 INFO:tasks.workunit.client.0.smithi100.stdout:5/250: dwrite d1/d19/f46 [0,4194304] 0 2024-04-30T23:15:53.210 INFO:tasks.workunit.client.0.smithi100.stdout:5/251: fdatasync d1/d12/d24/f25 0 2024-04-30T23:15:53.210 INFO:tasks.workunit.client.0.smithi100.stdout:6/300: rmdir d7/df/d23/d2b 39 2024-04-30T23:15:53.211 INFO:tasks.workunit.client.0.smithi100.stdout:8/196: write d2/ff [3821233,123416] 0 2024-04-30T23:15:53.213 INFO:tasks.workunit.client.0.smithi100.stdout:4/330: mkdir d19/d1a/d29/d65 0 2024-04-30T23:15:53.214 INFO:tasks.workunit.client.0.smithi100.stdout:5/252: mknod d1/d12/d1a/c53 0 2024-04-30T23:15:53.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/301: rename d7/df/d23/f4d to d7/d1a/d1b/d3f/f65 0 2024-04-30T23:15:53.218 INFO:tasks.workunit.client.0.smithi100.stdout:8/197: getdents d2/de/d10/d17 0 2024-04-30T23:15:53.218 INFO:tasks.workunit.client.0.smithi100.stdout:4/331: mknod d19/d1a/d29/c66 0 2024-04-30T23:15:53.220 INFO:tasks.workunit.client.0.smithi100.stdout:1/314: unlink d3/d16/l3a 0 2024-04-30T23:15:53.221 INFO:tasks.workunit.client.0.smithi100.stdout:5/253: symlink d1/d12/d27/l54 0 2024-04-30T23:15:53.222 INFO:tasks.workunit.client.0.smithi100.stdout:8/198: rmdir d2/de 39 2024-04-30T23:15:53.223 INFO:tasks.workunit.client.0.smithi100.stdout:4/332: symlink d19/d1a/d21/d4a/d53/d5e/l67 0 2024-04-30T23:15:53.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/315: rmdir d3/d16/d20/d24/d51/d59 39 2024-04-30T23:15:53.224 INFO:tasks.workunit.client.0.smithi100.stdout:5/254: symlink d1/d12/d24/d34/l55 0 2024-04-30T23:15:53.225 INFO:tasks.workunit.client.0.smithi100.stdout:5/255: write d1/d12/d1a/f26 [10544,97307] 0 2024-04-30T23:15:53.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/314: dwrite d2/d14/f2f [0,4194304] 0 2024-04-30T23:15:53.232 INFO:tasks.workunit.client.0.smithi100.stdout:8/199: dread d2/de/fa [0,4194304] 0 2024-04-30T23:15:53.235 INFO:tasks.workunit.client.0.smithi100.stdout:5/256: symlink d1/l56 0 2024-04-30T23:15:53.235 INFO:tasks.workunit.client.0.smithi100.stdout:5/257: read - d1/d12/d1a/f3d zero size 2024-04-30T23:15:53.236 INFO:tasks.workunit.client.0.smithi100.stdout:4/333: unlink d19/d1a/d21/f49 0 2024-04-30T23:15:53.236 INFO:tasks.workunit.client.0.smithi100.stdout:0/315: creat d2/d5a/f66 x:0 0 0 2024-04-30T23:15:53.237 INFO:tasks.workunit.client.0.smithi100.stdout:8/200: mkdir d2/d7/d18/d3a 0 2024-04-30T23:15:53.240 INFO:tasks.workunit.client.0.smithi100.stdout:5/258: symlink d1/d12/l57 0 2024-04-30T23:15:53.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/302: dwrite d7/df/d23/d2b/d42/f43 [0,4194304] 0 2024-04-30T23:15:53.248 INFO:tasks.workunit.client.0.smithi100.stdout:3/288: dwrite d1/d14/d2b/f4c [0,4194304] 0 2024-04-30T23:15:53.248 INFO:tasks.workunit.client.0.smithi100.stdout:3/289: fdatasync d1/d14/d21/f48 0 2024-04-30T23:15:53.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/259: dread d1/d12/d1a/f22 [0,4194304] 0 2024-04-30T23:15:53.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/260: fsync d1/fe 0 2024-04-30T23:15:53.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/261: write d1/d12/d1a/f2d [1727403,54245] 0 2024-04-30T23:15:53.251 INFO:tasks.workunit.client.0.smithi100.stdout:3/290: mkdir d1/d14/d21/d4d 0 2024-04-30T23:15:53.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/291: creat d1/f4e x:0 0 0 2024-04-30T23:15:53.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/292: symlink d1/d14/d15/d1e/l4f 0 2024-04-30T23:15:53.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/293: fdatasync d1/f4a 0 2024-04-30T23:15:53.255 INFO:tasks.workunit.client.0.smithi100.stdout:3/294: link d1/d14/c2a d1/d14/d2f/c50 0 2024-04-30T23:15:53.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/334: dread d19/d1a/d21/f2d [0,4194304] 0 2024-04-30T23:15:53.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/335: chown d19/d33/f5a 3629 1 2024-04-30T23:15:53.260 INFO:tasks.workunit.client.0.smithi100.stdout:4/336: creat d19/d1a/d21/d4a/d53/d5d/f68 x:0 0 0 2024-04-30T23:15:53.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/316: dwrite d3/d16/d20/d24/f48 [0,4194304] 0 2024-04-30T23:15:53.260 INFO:tasks.workunit.client.0.smithi100.stdout:0/316: dread d2/fb [0,4194304] 0 2024-04-30T23:15:53.263 INFO:tasks.workunit.client.0.smithi100.stdout:0/317: symlink d2/d5a/l67 0 2024-04-30T23:15:53.264 INFO:tasks.workunit.client.0.smithi100.stdout:6/303: dread d7/d1a/f30 [0,4194304] 0 2024-04-30T23:15:53.265 INFO:tasks.workunit.client.0.smithi100.stdout:0/318: mkdir d2/d4c/d68 0 2024-04-30T23:15:53.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/317: rmdir d3/d16/d20 39 2024-04-30T23:15:53.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/318: chown d3/d16/d20/d24/d51 23 1 2024-04-30T23:15:53.271 INFO:tasks.workunit.client.0.smithi100.stdout:1/319: link d3/d18/l1a d3/d16/l66 0 2024-04-30T23:15:53.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/320: mknod d3/d16/d20/d24/d3f/d5e/c67 0 2024-04-30T23:15:53.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/321: creat d3/d18/f68 x:0 0 0 2024-04-30T23:15:53.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/322: readlink d3/d18/l1a 0 2024-04-30T23:15:53.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/323: fdatasync d3/d18/f5b 0 2024-04-30T23:15:53.275 INFO:tasks.workunit.client.0.smithi100.stdout:1/324: stat d3/d16/d20/d24/d51/d59/d5f/l50 0 2024-04-30T23:15:53.279 INFO:tasks.workunit.client.0.smithi100.stdout:5/262: dwrite d1/d12/d24/f25 [0,4194304] 0 2024-04-30T23:15:53.280 INFO:tasks.workunit.client.0.smithi100.stdout:5/263: chown d1/d12/d27/f4c 0 1 2024-04-30T23:15:53.282 INFO:tasks.workunit.client.0.smithi100.stdout:3/295: dwrite d1/ff [0,4194304] 0 2024-04-30T23:15:53.284 INFO:tasks.workunit.client.0.smithi100.stdout:3/296: mknod d1/d14/d15/d1e/d26/c51 0 2024-04-30T23:15:53.284 INFO:tasks.workunit.client.0.smithi100.stdout:3/297: chown d1/d14/d15/d1e/d26/l3f 3757 1 2024-04-30T23:15:53.288 INFO:tasks.workunit.client.0.smithi100.stdout:6/304: dwrite d7/d9/f51 [0,4194304] 0 2024-04-30T23:15:53.294 INFO:tasks.workunit.client.0.smithi100.stdout:0/319: dread d2/d50/d38/f3f [0,4194304] 0 2024-04-30T23:15:53.294 INFO:tasks.workunit.client.0.smithi100.stdout:6/305: rename d7/d1a/d1b/d3f/f65 to d7/d1a/d1b/d5a/f66 0 2024-04-30T23:15:53.294 INFO:tasks.workunit.client.0.smithi100.stdout:0/320: dread - d2/d5a/f66 zero size 2024-04-30T23:15:53.294 INFO:tasks.workunit.client.0.smithi100.stdout:4/337: dwrite d19/d33/f31 [0,4194304] 0 2024-04-30T23:15:53.294 INFO:tasks.workunit.client.0.smithi100.stdout:4/338: truncate d19/d33/d3f/f41 1906325 0 2024-04-30T23:15:53.296 INFO:tasks.workunit.client.0.smithi100.stdout:3/298: dread d1/d14/d15/f1b [0,4194304] 0 2024-04-30T23:15:53.296 INFO:tasks.workunit.client.0.smithi100.stdout:3/299: write d1/d14/d15/d1e/d26/f45 [2349260,75092] 0 2024-04-30T23:15:53.298 INFO:tasks.workunit.client.0.smithi100.stdout:6/306: mknod d7/d11/d34/c67 0 2024-04-30T23:15:53.299 INFO:tasks.workunit.client.0.smithi100.stdout:5/264: dread d1/d12/d24/f48 [0,4194304] 0 2024-04-30T23:15:53.299 INFO:tasks.workunit.client.0.smithi100.stdout:1/325: dwrite d3/d18/f43 [0,4194304] 0 2024-04-30T23:15:53.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/339: rename d19/d1a/d29/l3b to d19/d1a/d21/d4a/d53/l69 0 2024-04-30T23:15:53.302 INFO:tasks.workunit.client.0.smithi100.stdout:3/300: symlink d1/d38/l52 0 2024-04-30T23:15:53.302 INFO:tasks.workunit.client.0.smithi100.stdout:3/301: write d1/d14/d15/f20 [241595,107173] 0 2024-04-30T23:15:53.303 INFO:tasks.workunit.client.0.smithi100.stdout:5/265: creat d1/d12/d27/f58 x:0 0 0 2024-04-30T23:15:53.303 INFO:tasks.workunit.client.0.smithi100.stdout:5/266: stat f0 0 2024-04-30T23:15:53.307 INFO:tasks.workunit.client.0.smithi100.stdout:6/307: rename d7/d1a/d1b/d3f/f47 to d7/df/d23/d24/d2e/d37/f68 0 2024-04-30T23:15:53.308 INFO:tasks.workunit.client.0.smithi100.stdout:4/340: creat d19/d1a/d21/d4a/f6a x:0 0 0 2024-04-30T23:15:53.312 INFO:tasks.workunit.client.0.smithi100.stdout:1/326: dread d3/d18/f5b [0,4194304] 0 2024-04-30T23:15:53.313 INFO:tasks.workunit.client.0.smithi100.stdout:6/308: write d7/db/d3b/f58 [104918,51780] 0 2024-04-30T23:15:53.315 INFO:tasks.workunit.client.0.smithi100.stdout:6/309: creat d7/df/d23/d24/d2e/f69 x:0 0 0 2024-04-30T23:15:53.318 INFO:tasks.workunit.client.0.smithi100.stdout:0/321: dwrite d2/d14/d35/f39 [0,4194304] 0 2024-04-30T23:15:53.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/322: creat d2/d4c/d68/f69 x:0 0 0 2024-04-30T23:15:53.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/323: chown d2/d14/d35/d57/d62 44 1 2024-04-30T23:15:53.322 INFO:tasks.workunit.client.0.smithi100.stdout:0/324: creat d2/d5a/f6a x:0 0 0 2024-04-30T23:15:53.322 INFO:tasks.workunit.client.0.smithi100.stdout:0/325: dread - d2/d4c/d68/f69 zero size 2024-04-30T23:15:53.324 INFO:tasks.workunit.client.0.smithi100.stdout:6/310: dread d7/d11/d34/f26 [0,4194304] 0 2024-04-30T23:15:53.327 INFO:tasks.workunit.client.0.smithi100.stdout:6/311: symlink d7/d1a/d1b/d3f/l6a 0 2024-04-30T23:15:53.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/327: dread d3/d18/f43 [0,4194304] 0 2024-04-30T23:15:53.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/328: write d3/d16/f3c [64090,130717] 0 2024-04-30T23:15:53.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/329: write d3/f4d [4189725,42932] 0 2024-04-30T23:15:53.331 INFO:tasks.workunit.client.0.smithi100.stdout:1/330: rename d3/d16/d20/d24/d3f to d3/d16/d20/d24/d69 0 2024-04-30T23:15:53.332 INFO:tasks.workunit.client.0.smithi100.stdout:1/331: creat d3/f6a x:0 0 0 2024-04-30T23:15:53.335 INFO:tasks.workunit.client.0.smithi100.stdout:4/341: dwrite d19/d33/d3f/f56 [0,4194304] 0 2024-04-30T23:15:53.340 INFO:tasks.workunit.client.0.smithi100.stdout:4/342: dread d19/d1a/d21/f50 [0,4194304] 0 2024-04-30T23:15:53.340 INFO:tasks.workunit.client.0.smithi100.stdout:4/343: write d19/d1a/d21/d32/f3d [1212958,110664] 0 2024-04-30T23:15:53.343 INFO:tasks.workunit.client.0.smithi100.stdout:5/267: dread d1/d19/f4a [0,4194304] 0 2024-04-30T23:15:53.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/302: dwrite d1/d14/d15/d1e/d26/f23 [0,4194304] 0 2024-04-30T23:15:53.344 INFO:tasks.workunit.client.0.smithi100.stdout:4/344: creat d19/d1a/d21/d4a/d53/d5e/f6b x:0 0 0 2024-04-30T23:15:53.344 INFO:tasks.workunit.client.0.smithi100.stdout:4/345: stat d19/d1a/d21/f2b 0 2024-04-30T23:15:53.344 INFO:tasks.workunit.client.0.smithi100.stdout:4/346: dread - d19/d1a/d21/d4a/d53/d5d/f68 zero size 2024-04-30T23:15:53.344 INFO:tasks.workunit.client.0.smithi100.stdout:4/347: chown d19/d1a/f37 389 1 2024-04-30T23:15:53.351 INFO:tasks.workunit.client.0.smithi100.stdout:0/326: dwrite d2/fb [0,4194304] 0 2024-04-30T23:15:53.351 INFO:tasks.workunit.client.0.smithi100.stdout:6/312: dread d7/df/d23/f4e [0,4194304] 0 2024-04-30T23:15:53.351 INFO:tasks.workunit.client.0.smithi100.stdout:0/327: write d2/f3a [359010,123248] 0 2024-04-30T23:15:53.351 INFO:tasks.workunit.client.0.smithi100.stdout:0/328: truncate d2/d14/d18/f42 5231649 0 2024-04-30T23:15:53.351 INFO:tasks.workunit.client.0.smithi100.stdout:0/329: chown d2/f52 1904199 1 2024-04-30T23:15:53.356 INFO:tasks.workunit.client.0.smithi100.stdout:5/268: rename d1/f3 to d1/d2c/f59 0 2024-04-30T23:15:53.357 INFO:tasks.workunit.client.0.smithi100.stdout:6/313: mkdir d7/d1a/d3e/d6b 0 2024-04-30T23:15:53.357 INFO:tasks.workunit.client.0.smithi100.stdout:6/314: dread - d7/df/f3c zero size 2024-04-30T23:15:53.357 INFO:tasks.workunit.client.0.smithi100.stdout:6/315: chown f5 369753245 1 2024-04-30T23:15:53.358 INFO:tasks.workunit.client.0.smithi100.stdout:0/330: creat d2/d14/d35/d57/f6b x:0 0 0 2024-04-30T23:15:53.359 INFO:tasks.workunit.client.0.smithi100.stdout:1/332: dwrite d3/d18/d60/f64 [0,4194304] 0 2024-04-30T23:15:53.361 INFO:tasks.workunit.client.0.smithi100.stdout:4/348: link l10 d19/d1a/l6c 0 2024-04-30T23:15:53.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/269: rename d1/d12/d24/f48 to d1/f5a 0 2024-04-30T23:15:53.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/270: write d1/d12/f15 [1031822,17302] 0 2024-04-30T23:15:53.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/271: dread - d1/d2c/f49 zero size 2024-04-30T23:15:53.364 INFO:tasks.workunit.client.0.smithi100.stdout:0/331: mkdir d2/d50/d38/d6c 0 2024-04-30T23:15:53.368 INFO:tasks.workunit.client.0.smithi100.stdout:1/333: unlink d3/d16/d20/d24/d51/d59/d5f/l42 0 2024-04-30T23:15:53.369 INFO:tasks.workunit.client.0.smithi100.stdout:3/303: dwrite d1/d14/d15/f44 [0,4194304] 0 2024-04-30T23:15:53.371 INFO:tasks.workunit.client.0.smithi100.stdout:1/334: unlink d3/l47 0 2024-04-30T23:15:53.372 INFO:tasks.workunit.client.0.smithi100.stdout:1/335: readlink d3/l13 0 2024-04-30T23:15:53.383 INFO:tasks.workunit.client.0.smithi100.stdout:3/304: getdents d1/d14/d15/d1e 0 2024-04-30T23:15:53.383 INFO:tasks.workunit.client.0.smithi100.stdout:3/305: stat d1/d14/d21/f2d 0 2024-04-30T23:15:53.385 INFO:tasks.workunit.client.0.smithi100.stdout:3/306: creat d1/d14/d2b/f53 x:0 0 0 2024-04-30T23:15:53.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/307: creat d1/d14/d15/d27/d34/f54 x:0 0 0 2024-04-30T23:15:53.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/308: fsync d1/d14/d15/d1e/d26/f23 0 2024-04-30T23:15:53.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/309: write d1/d14/d15/f1b [94346,115964] 0 2024-04-30T23:15:53.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/316: dwrite d7/db/d3b/f58 [0,4194304] 0 2024-04-30T23:15:53.394 INFO:tasks.workunit.client.0.smithi100.stdout:4/349: dwrite d19/d1a/d21/d4a/f6a [0,4194304] 0 2024-04-30T23:15:53.394 INFO:tasks.workunit.client.0.smithi100.stdout:3/310: dread d1/d14/f36 [0,4194304] 0 2024-04-30T23:15:53.394 INFO:tasks.workunit.client.0.smithi100.stdout:3/311: write d1/f4e [956647,100671] 0 2024-04-30T23:15:53.395 INFO:tasks.workunit.client.0.smithi100.stdout:2/280: sync 2024-04-30T23:15:53.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/350: truncate d19/d33/d3f/f51 1276518 0 2024-04-30T23:15:53.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/351: readlink d19/d1a/l6c 0 2024-04-30T23:15:53.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/352: fdatasync d19/d1a/d21/d4a/f6a 0 2024-04-30T23:15:53.399 INFO:tasks.workunit.client.0.smithi100.stdout:4/353: rename d19/d1a/d21/d32 to d19/d1a/d6d 0 2024-04-30T23:15:53.401 INFO:tasks.workunit.client.0.smithi100.stdout:4/354: mkdir d19/d1a/d6d/d4e/d6e 0 2024-04-30T23:15:53.402 INFO:tasks.workunit.client.0.smithi100.stdout:5/272: dwrite d1/d2c/f49 [0,4194304] 0 2024-04-30T23:15:53.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/355: rmdir d19/d1a/d21/d4a/d53 39 2024-04-30T23:15:53.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/356: write d19/d33/d3f/f56 [4579193,37923] 0 2024-04-30T23:15:53.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/357: readlink d19/d1a/l28 0 2024-04-30T23:15:53.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/358: write d19/d1a/d6d/f3d [1413429,21981] 0 2024-04-30T23:15:53.403 INFO:tasks.workunit.client.0.smithi100.stdout:0/332: dwrite d2/f3a [0,4194304] 0 2024-04-30T23:15:53.404 INFO:tasks.workunit.client.0.smithi100.stdout:0/333: readlink d2/d14/l15 0 2024-04-30T23:15:53.409 INFO:tasks.workunit.client.0.smithi100.stdout:2/281: write d5/d26/d2f/d38/f43 [360169,84489] 0 2024-04-30T23:15:53.411 INFO:tasks.workunit.client.0.smithi100.stdout:5/273: rmdir d1/d2c 39 2024-04-30T23:15:53.411 INFO:tasks.workunit.client.0.smithi100.stdout:5/274: fsync d1/d12/d1a/f3d 0 2024-04-30T23:15:53.414 INFO:tasks.workunit.client.0.smithi100.stdout:0/334: creat d2/d14/d35/d57/d62/f6d x:0 0 0 2024-04-30T23:15:53.414 INFO:tasks.workunit.client.0.smithi100.stdout:0/335: write d2/d14/d35/d57/f60 [177142,35878] 0 2024-04-30T23:15:53.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/312: read d1/d14/d21/f31 [7498289,28534] 0 2024-04-30T23:15:53.418 INFO:tasks.workunit.client.0.smithi100.stdout:0/336: mkdir d2/d50/d38/d6c/d6e 0 2024-04-30T23:15:53.418 INFO:tasks.workunit.client.0.smithi100.stdout:0/337: chown d2/d50/d30/d32/f63 125831758 1 2024-04-30T23:15:53.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/313: creat d1/d14/d21/f55 x:0 0 0 2024-04-30T23:15:53.425 INFO:tasks.workunit.client.0.smithi100.stdout:4/359: write d19/d33/d3f/f56 [137313,129322] 0 2024-04-30T23:15:53.425 INFO:tasks.workunit.client.0.smithi100.stdout:6/317: dwrite d7/df/f3c [0,4194304] 0 2024-04-30T23:15:53.425 INFO:tasks.workunit.client.0.smithi100.stdout:4/360: write d19/f27 [1394842,124737] 0 2024-04-30T23:15:53.426 INFO:tasks.workunit.client.0.smithi100.stdout:0/338: creat d2/d50/d30/f6f x:0 0 0 2024-04-30T23:15:53.427 INFO:tasks.workunit.client.0.smithi100.stdout:9/214: sync 2024-04-30T23:15:53.428 INFO:tasks.workunit.client.0.smithi100.stdout:8/201: sync 2024-04-30T23:15:53.428 INFO:tasks.workunit.client.0.smithi100.stdout:7/323: sync 2024-04-30T23:15:53.428 INFO:tasks.workunit.client.0.smithi100.stdout:7/324: fsync d0/d1b/d60/f54 0 2024-04-30T23:15:53.428 INFO:tasks.workunit.client.0.smithi100.stdout:3/314: symlink d1/d14/d15/d2c/l56 0 2024-04-30T23:15:53.431 INFO:tasks.workunit.client.0.smithi100.stdout:6/318: symlink d7/d1a/d62/l6c 0 2024-04-30T23:15:53.432 INFO:tasks.workunit.client.0.smithi100.stdout:7/325: dread d0/d1b/d1e/f40 [0,4194304] 0 2024-04-30T23:15:53.433 INFO:tasks.workunit.client.0.smithi100.stdout:7/326: read - d0/d1d/d5e/d6a/f5f zero size 2024-04-30T23:15:53.433 INFO:tasks.workunit.client.0.smithi100.stdout:0/339: mkdir d2/d50/d38/d6c/d6e/d70 0 2024-04-30T23:15:53.434 INFO:tasks.workunit.client.0.smithi100.stdout:9/215: symlink d4/l48 0 2024-04-30T23:15:53.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/275: write d1/d12/d27/f44 [1742099,87644] 0 2024-04-30T23:15:53.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/276: chown d1/d37/l4f 93126663 1 2024-04-30T23:15:53.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/315: unlink d1/l7 0 2024-04-30T23:15:53.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/316: truncate d1/d14/d21/f55 343170 0 2024-04-30T23:15:53.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/319: creat d7/db/d3b/f6d x:0 0 0 2024-04-30T23:15:53.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/320: dread - d7/df/f41 zero size 2024-04-30T23:15:53.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/321: write d7/df/d23/d24/d2e/d37/f5e [40197,57440] 0 2024-04-30T23:15:53.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/327: truncate d0/f18 777734 0 2024-04-30T23:15:53.440 INFO:tasks.workunit.client.0.smithi100.stdout:2/282: read d5/d12/f1f [1430679,105656] 0 2024-04-30T23:15:53.448 INFO:tasks.workunit.client.0.smithi100.stdout:0/340: creat d2/d50/f71 x:0 0 0 2024-04-30T23:15:53.449 INFO:tasks.workunit.client.0.smithi100.stdout:3/317: mkdir d1/d14/d2b/d57 0 2024-04-30T23:15:53.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/361: dwrite d19/d1a/d21/f25 [0,4194304] 0 2024-04-30T23:15:53.451 INFO:tasks.workunit.client.0.smithi100.stdout:4/362: truncate d19/d1a/f48 378666 0 2024-04-30T23:15:53.451 INFO:tasks.workunit.client.0.smithi100.stdout:0/341: rename d2/d14/f2f to d2/d4c/d68/f72 0 2024-04-30T23:15:53.452 INFO:tasks.workunit.client.0.smithi100.stdout:2/283: symlink d5/d12/l5e 0 2024-04-30T23:15:53.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/342: creat d2/f73 x:0 0 0 2024-04-30T23:15:53.459 INFO:tasks.workunit.client.0.smithi100.stdout:9/216: dwrite d4/d7/d8/d37/f42 [0,4194304] 0 2024-04-30T23:15:53.463 INFO:tasks.workunit.client.0.smithi100.stdout:9/217: rmdir d4/d9/d10 39 2024-04-30T23:15:53.463 INFO:tasks.workunit.client.0.smithi100.stdout:9/218: truncate d4/d9/d10/f3a 1008955 0 2024-04-30T23:15:53.468 INFO:tasks.workunit.client.0.smithi100.stdout:7/328: dread d0/d1b/d60/d48/d4a/f4c [0,4194304] 0 2024-04-30T23:15:53.471 INFO:tasks.workunit.client.0.smithi100.stdout:7/329: creat d0/d1d/f6e x:0 0 0 2024-04-30T23:15:53.471 INFO:tasks.workunit.client.0.smithi100.stdout:7/330: readlink d0/d1b/d2e/d3d/l5d 0 2024-04-30T23:15:53.471 INFO:tasks.workunit.client.0.smithi100.stdout:7/331: chown d0/df/d4f/d53/c68 2 1 2024-04-30T23:15:53.471 INFO:tasks.workunit.client.0.smithi100.stdout:7/332: stat d0/d1b/d24/d2a/f34 0 2024-04-30T23:15:53.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/333: mkdir d0/d1d/d3c/d6f 0 2024-04-30T23:15:53.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/334: stat d0/d1d/d5e 0 2024-04-30T23:15:53.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/277: write d1/f1b [4078594,87554] 0 2024-04-30T23:15:53.474 INFO:tasks.workunit.client.0.smithi100.stdout:8/202: dwrite d2/d7/f12 [0,4194304] 0 2024-04-30T23:15:53.478 INFO:tasks.workunit.client.0.smithi100.stdout:6/322: dwrite d7/d1a/d1b/d22/f50 [0,4194304] 0 2024-04-30T23:15:53.478 INFO:tasks.workunit.client.0.smithi100.stdout:8/203: symlink d2/l3b 0 2024-04-30T23:15:53.482 INFO:tasks.workunit.client.0.smithi100.stdout:6/323: mkdir d7/df/d23/d24/d6e 0 2024-04-30T23:15:53.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/363: dwrite f9 [4194304,4194304] 0 2024-04-30T23:15:53.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/204: creat d2/d7/f3c x:0 0 0 2024-04-30T23:15:53.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/205: fsync d2/d7/f12 0 2024-04-30T23:15:53.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/206: chown d2/d7/l27 4625 1 2024-04-30T23:15:53.484 INFO:tasks.workunit.client.0.smithi100.stdout:8/207: getdents d2/de/d10/d17 0 2024-04-30T23:15:53.486 INFO:tasks.workunit.client.0.smithi100.stdout:6/324: creat d7/d1a/d1b/f6f x:0 0 0 2024-04-30T23:15:53.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/219: dwrite d4/f1e [0,4194304] 0 2024-04-30T23:15:53.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/364: creat d19/f6f x:0 0 0 2024-04-30T23:15:53.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/365: chown d19/d33/d3f/f56 7945270 1 2024-04-30T23:15:53.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/366: creat d19/d1a/d21/d4a/d53/f70 x:0 0 0 2024-04-30T23:15:53.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/367: stat d19/c46 0 2024-04-30T23:15:53.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/368: chown d19/d1a/d21/d4a/c52 936 1 2024-04-30T23:15:53.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/369: chown d19/d1a/d21/d3c/f55 15701202 1 2024-04-30T23:15:53.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/370: dread - d19/d1a/d29/f5f zero size 2024-04-30T23:15:53.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/371: mknod d19/c71 0 2024-04-30T23:15:53.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/372: truncate d19/f26 2189961 0 2024-04-30T23:15:53.497 INFO:tasks.workunit.client.0.smithi100.stdout:3/318: dwrite d1/d14/f36 [0,4194304] 0 2024-04-30T23:15:53.497 INFO:tasks.workunit.client.0.smithi100.stdout:2/284: dwrite d5/d26/f54 [0,4194304] 0 2024-04-30T23:15:53.499 INFO:tasks.workunit.client.0.smithi100.stdout:0/343: dwrite d2/d14/d35/f39 [4194304,4194304] 0 2024-04-30T23:15:53.502 INFO:tasks.workunit.client.0.smithi100.stdout:3/319: symlink d1/d14/l58 0 2024-04-30T23:15:53.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/325: dread d7/df/d23/f4e [0,4194304] 0 2024-04-30T23:15:53.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/326: chown l6 1707724 1 2024-04-30T23:15:53.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/327: chown d7/l10 275820797 1 2024-04-30T23:15:53.508 INFO:tasks.workunit.client.0.smithi100.stdout:3/320: symlink d1/d14/d15/d27/d34/l59 0 2024-04-30T23:15:53.512 INFO:tasks.workunit.client.0.smithi100.stdout:0/344: rmdir d2 39 2024-04-30T23:15:53.512 INFO:tasks.workunit.client.0.smithi100.stdout:0/345: read - d2/f65 zero size 2024-04-30T23:15:53.518 INFO:tasks.workunit.client.0.smithi100.stdout:9/220: dwrite d4/d7/f38 [0,4194304] 0 2024-04-30T23:15:53.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/278: dwrite f0 [0,4194304] 0 2024-04-30T23:15:53.520 INFO:tasks.workunit.client.0.smithi100.stdout:9/221: truncate d4/d9/d10/f28 1835952 0 2024-04-30T23:15:53.521 INFO:tasks.workunit.client.0.smithi100.stdout:9/222: write d4/d7/d8/d37/d3d/f40 [531357,128815] 0 2024-04-30T23:15:53.523 INFO:tasks.workunit.client.0.smithi100.stdout:5/279: mkdir d1/d12/d1a/d5b 0 2024-04-30T23:15:53.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/321: dread d1/f13 [4194304,4194304] 0 2024-04-30T23:15:53.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/322: write d1/d14/d15/d27/f33 [613571,31483] 0 2024-04-30T23:15:53.529 INFO:tasks.workunit.client.0.smithi100.stdout:3/323: mknod d1/d14/d15/d32/c5a 0 2024-04-30T23:15:53.530 INFO:tasks.workunit.client.0.smithi100.stdout:9/223: rename d4/d9/d10/c11 to d4/d7/d8/c49 0 2024-04-30T23:15:53.530 INFO:tasks.workunit.client.0.smithi100.stdout:9/224: stat d4/d7/d8/d19/f29 0 2024-04-30T23:15:53.530 INFO:tasks.workunit.client.0.smithi100.stdout:9/225: readlink d4/d7/l20 0 2024-04-30T23:15:53.533 INFO:tasks.workunit.client.0.smithi100.stdout:6/328: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:15:53.533 INFO:tasks.workunit.client.0.smithi100.stdout:0/346: dread d2/d14/d18/f2d [0,4194304] 0 2024-04-30T23:15:53.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/324: link d1/d14/l58 d1/d14/d15/d1e/d26/l5b 0 2024-04-30T23:15:53.535 INFO:tasks.workunit.client.0.smithi100.stdout:9/226: link f3 d4/d9/d10/f4a 0 2024-04-30T23:15:53.535 INFO:tasks.workunit.client.0.smithi100.stdout:2/285: dread f1 [0,4194304] 0 2024-04-30T23:15:53.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/373: dwrite d19/d33/f5a [0,4194304] 0 2024-04-30T23:15:53.535 INFO:tasks.workunit.client.0.smithi100.stdout:2/286: write d5/f16 [550431,128433] 0 2024-04-30T23:15:53.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/347: creat d2/d50/d38/d6c/f74 x:0 0 0 2024-04-30T23:15:53.543 INFO:tasks.workunit.client.0.smithi100.stdout:3/325: creat d1/d38/f5c x:0 0 0 2024-04-30T23:15:53.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/326: truncate d1/fa 422170 0 2024-04-30T23:15:53.548 INFO:tasks.workunit.client.0.smithi100.stdout:0/348: mkdir d2/d14/d35/d57/d62/d75 0 2024-04-30T23:15:53.548 INFO:tasks.workunit.client.0.smithi100.stdout:0/349: fdatasync d2/f12 0 2024-04-30T23:15:53.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/280: dwrite d1/d12/d1a/f26 [0,4194304] 0 2024-04-30T23:15:53.552 INFO:tasks.workunit.client.0.smithi100.stdout:3/327: mkdir d1/d14/d15/d27/d5d 0 2024-04-30T23:15:53.553 INFO:tasks.workunit.client.0.smithi100.stdout:0/350: creat d2/d50/d38/d5d/f76 x:0 0 0 2024-04-30T23:15:53.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/227: write d4/f2a [2444602,124281] 0 2024-04-30T23:15:53.556 INFO:tasks.workunit.client.0.smithi100.stdout:3/328: creat d1/d14/d2f/f5e x:0 0 0 2024-04-30T23:15:53.556 INFO:tasks.workunit.client.0.smithi100.stdout:9/228: creat d4/d7/d8/d37/f4b x:0 0 0 2024-04-30T23:15:53.556 INFO:tasks.workunit.client.0.smithi100.stdout:4/374: dread d19/d33/d3f/f41 [0,4194304] 0 2024-04-30T23:15:53.558 INFO:tasks.workunit.client.0.smithi100.stdout:3/329: truncate d1/d14/d15/d1e/d26/f28 4197732 0 2024-04-30T23:15:53.559 INFO:tasks.workunit.client.0.smithi100.stdout:9/229: mknod d4/d7/d8/d37/c4c 0 2024-04-30T23:15:53.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/230: link d4/d7/d8/f36 d4/d7/d8/f4d 0 2024-04-30T23:15:53.567 INFO:tasks.workunit.client.0.smithi100.stdout:2/287: dwrite d5/d12/d13/d4b/f56 [0,4194304] 0 2024-04-30T23:15:53.568 INFO:tasks.workunit.client.0.smithi100.stdout:2/288: write d5/d12/d13/d4b/f52 [869826,71837] 0 2024-04-30T23:15:53.581 INFO:tasks.workunit.client.0.smithi100.stdout:6/329: dwrite d7/d1a/d1b/f40 [0,4194304] 0 2024-04-30T23:15:53.591 INFO:tasks.workunit.client.0.smithi100.stdout:6/330: creat d7/d1a/d1b/d22/f70 x:0 0 0 2024-04-30T23:15:53.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/331: unlink d7/df/c1f 0 2024-04-30T23:15:53.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/332: link d7/df/d23/d2b/c64 d7/d11/d34/c71 0 2024-04-30T23:15:53.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/333: mknod d7/df/d23/d4f/c72 0 2024-04-30T23:15:53.596 INFO:tasks.workunit.client.0.smithi100.stdout:5/281: dwrite d1/f7 [4194304,4194304] 0 2024-04-30T23:15:53.596 INFO:tasks.workunit.client.0.smithi100.stdout:5/282: stat d1/fe 0 2024-04-30T23:15:53.597 INFO:tasks.workunit.client.0.smithi100.stdout:0/351: dwrite d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:53.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/283: mkdir d1/d37/d5c 0 2024-04-30T23:15:53.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/284: truncate d1/d12/d27/f58 615005 0 2024-04-30T23:15:53.599 INFO:tasks.workunit.client.0.smithi100.stdout:4/375: dwrite d19/d33/f31 [0,4194304] 0 2024-04-30T23:15:53.599 INFO:tasks.workunit.client.0.smithi100.stdout:4/376: write d19/f26 [1588392,18682] 0 2024-04-30T23:15:53.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/231: dwrite f1 [0,4194304] 0 2024-04-30T23:15:53.599 INFO:tasks.workunit.client.0.smithi100.stdout:0/352: rename d2/f12 to d2/d5a/f77 0 2024-04-30T23:15:53.599 INFO:tasks.workunit.client.0.smithi100.stdout:0/353: stat d2/d14/d35/d40 0 2024-04-30T23:15:53.600 INFO:tasks.workunit.client.0.smithi100.stdout:0/354: dread - d2/f65 zero size 2024-04-30T23:15:53.600 INFO:tasks.workunit.client.0.smithi100.stdout:0/355: write d2/d50/d30/f53 [1041259,16592] 0 2024-04-30T23:15:53.600 INFO:tasks.workunit.client.0.smithi100.stdout:0/356: read d2/d14/d18/f42 [2278905,21328] 0 2024-04-30T23:15:53.602 INFO:tasks.workunit.client.0.smithi100.stdout:5/285: mkdir d1/d2c/d5d 0 2024-04-30T23:15:53.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/286: mkdir d1/d5e 0 2024-04-30T23:15:53.605 INFO:tasks.workunit.client.0.smithi100.stdout:5/287: unlink d1/d12/d24/c2a 0 2024-04-30T23:15:53.605 INFO:tasks.workunit.client.0.smithi100.stdout:5/288: chown d1/d37/d5c 11286598 1 2024-04-30T23:15:53.605 INFO:tasks.workunit.client.0.smithi100.stdout:5/289: read d1/d12/d27/f44 [2752028,63069] 0 2024-04-30T23:15:53.606 INFO:tasks.workunit.client.0.smithi100.stdout:3/330: dwrite d1/f10 [4194304,4194304] 0 2024-04-30T23:15:53.612 INFO:tasks.workunit.client.0.smithi100.stdout:2/289: dwrite d5/d12/d13/d4b/f56 [4194304,4194304] 0 2024-04-30T23:15:53.612 INFO:tasks.workunit.client.0.smithi100.stdout:3/331: creat d1/d14/f5f x:0 0 0 2024-04-30T23:15:53.613 INFO:tasks.workunit.client.0.smithi100.stdout:3/332: chown d1/d14/d21/c49 71 1 2024-04-30T23:15:53.614 INFO:tasks.workunit.client.0.smithi100.stdout:6/334: dread d7/df/d23/d24/d2e/d37/f68 [0,4194304] 0 2024-04-30T23:15:53.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/333: truncate d1/f13 5121660 0 2024-04-30T23:15:53.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/334: chown d1/d14/d21/f31 40333292 1 2024-04-30T23:15:53.625 INFO:tasks.workunit.client.0.smithi100.stdout:6/335: creat d7/d1a/f73 x:0 0 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/336: rename d7/d1a/d1b/f40 to d7/df/d23/d24/d2e/d37/f74 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/337: mkdir d7/d1a/d3e/d6b/d75 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/338: truncate d7/df/d23/d24/f5f 400145 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/339: write d7/df/d23/d24/d2e/f69 [221520,53773] 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/340: mknod d7/d11/d34/c76 0 2024-04-30T23:15:53.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/341: chown d7/db 10839082 1 2024-04-30T23:15:53.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/290: read d1/d3e/f47 [4148721,121350] 0 2024-04-30T23:15:53.633 INFO:tasks.workunit.client.0.smithi100.stdout:4/377: dwrite d19/d1a/d21/d4a/d53/d5e/f6b [0,4194304] 0 2024-04-30T23:15:53.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/290: dread d5/d22/f4e [0,4194304] 0 2024-04-30T23:15:53.635 INFO:tasks.workunit.client.0.smithi100.stdout:4/378: write d19/d1a/d21/f50 [417257,54656] 0 2024-04-30T23:15:53.638 INFO:tasks.workunit.client.0.smithi100.stdout:9/232: dwrite d4/d7/d8/d37/d3d/f41 [0,4194304] 0 2024-04-30T23:15:53.641 INFO:tasks.workunit.client.0.smithi100.stdout:0/357: dwrite d2/d14/d35/d57/f60 [0,4194304] 0 2024-04-30T23:15:53.642 INFO:tasks.workunit.client.0.smithi100.stdout:5/291: mkdir d1/d5f 0 2024-04-30T23:15:53.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/379: creat d19/d1a/d21/d4a/d53/d5d/f72 x:0 0 0 2024-04-30T23:15:53.643 INFO:tasks.workunit.client.0.smithi100.stdout:1/336: sync 2024-04-30T23:15:53.644 INFO:tasks.workunit.client.0.smithi100.stdout:1/337: readlink d3/d18/l56 0 2024-04-30T23:15:53.646 INFO:tasks.workunit.client.0.smithi100.stdout:5/292: chown d1/d12/f16 1 1 2024-04-30T23:15:53.651 INFO:tasks.workunit.client.0.smithi100.stdout:4/380: symlink d19/d33/d3f/l73 0 2024-04-30T23:15:53.654 INFO:tasks.workunit.client.0.smithi100.stdout:4/381: unlink cd 0 2024-04-30T23:15:53.655 INFO:tasks.workunit.client.0.smithi100.stdout:6/342: dread d7/db/d3b/f58 [0,4194304] 0 2024-04-30T23:15:53.655 INFO:tasks.workunit.client.0.smithi100.stdout:5/293: mkdir d1/d2c/d60 0 2024-04-30T23:15:53.658 INFO:tasks.workunit.client.0.smithi100.stdout:5/294: symlink d1/d37/d5c/l61 0 2024-04-30T23:15:53.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/335: sync 2024-04-30T23:15:53.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/336: write d0/d1b/d1e/f40 [96468,102403] 0 2024-04-30T23:15:53.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/337: read d0/d1b/d24/d2a/f34 [1895579,76879] 0 2024-04-30T23:15:53.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/338: fdatasync d0/d1b/d2e/d3d/f57 0 2024-04-30T23:15:53.660 INFO:tasks.workunit.client.0.smithi100.stdout:7/339: getdents d0/df/d4f/d53 0 2024-04-30T23:15:53.660 INFO:tasks.workunit.client.0.smithi100.stdout:7/340: write d0/d1b/d1e/f40 [824717,3225] 0 2024-04-30T23:15:53.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/208: sync 2024-04-30T23:15:53.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/341: creat d0/d1b/d2e/f70 x:0 0 0 2024-04-30T23:15:53.664 INFO:tasks.workunit.client.0.smithi100.stdout:7/342: mknod d0/d1b/d60/c71 0 2024-04-30T23:15:53.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/358: dwrite d2/d50/d30/d32/f3b [0,4194304] 0 2024-04-30T23:15:53.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/359: dread - d2/d50/d38/d6c/f74 zero size 2024-04-30T23:15:53.669 INFO:tasks.workunit.client.0.smithi100.stdout:7/343: unlink d0/d1d/d5e/d6a/c25 0 2024-04-30T23:15:53.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/344: mkdir d0/d1d/d3c/d6f/d72 0 2024-04-30T23:15:53.674 INFO:tasks.workunit.client.0.smithi100.stdout:7/345: symlink d0/d1b/d24/d2a/l73 0 2024-04-30T23:15:53.674 INFO:tasks.workunit.client.0.smithi100.stdout:7/346: stat d0/d1b/d24/d2a/l73 0 2024-04-30T23:15:53.674 INFO:tasks.workunit.client.0.smithi100.stdout:3/335: dwrite d1/d14/d15/d1e/d26/f28 [4194304,4194304] 0 2024-04-30T23:15:53.683 INFO:tasks.workunit.client.0.smithi100.stdout:4/382: dread d19/d1a/d21/f50 [0,4194304] 0 2024-04-30T23:15:53.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/338: dwrite d3/d16/d20/f2a [0,4194304] 0 2024-04-30T23:15:53.685 INFO:tasks.workunit.client.0.smithi100.stdout:4/383: truncate d19/f2f 3662959 0 2024-04-30T23:15:53.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/339: truncate d3/d16/d20/d24/f48 2408744 0 2024-04-30T23:15:53.689 INFO:tasks.workunit.client.0.smithi100.stdout:4/384: rename d19/d1a/d21/d3c/c4d to d19/d33/c74 0 2024-04-30T23:15:53.691 INFO:tasks.workunit.client.0.smithi100.stdout:1/340: symlink d3/d16/l6b 0 2024-04-30T23:15:53.693 INFO:tasks.workunit.client.0.smithi100.stdout:4/385: mknod d19/d1a/d21/d4a/d53/c75 0 2024-04-30T23:15:53.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/233: write d4/d9/d10/f27 [1511881,21645] 0 2024-04-30T23:15:53.694 INFO:tasks.workunit.client.0.smithi100.stdout:2/291: dwrite d5/d22/f4e [0,4194304] 0 2024-04-30T23:15:53.694 INFO:tasks.workunit.client.0.smithi100.stdout:6/343: dwrite d7/df/d23/d2b/d42/f43 [0,4194304] 0 2024-04-30T23:15:53.694 INFO:tasks.workunit.client.0.smithi100.stdout:6/344: write d7/d1a/d1b/f6f [897997,28374] 0 2024-04-30T23:15:53.694 INFO:tasks.workunit.client.0.smithi100.stdout:5/295: dwrite d1/d12/f18 [4194304,4194304] 0 2024-04-30T23:15:53.698 INFO:tasks.workunit.client.0.smithi100.stdout:9/234: truncate d4/d7/f12 1415816 0 2024-04-30T23:15:53.699 INFO:tasks.workunit.client.0.smithi100.stdout:7/347: write d0/f1f [4780176,29211] 0 2024-04-30T23:15:53.700 INFO:tasks.workunit.client.0.smithi100.stdout:6/345: mkdir d7/d11/d77 0 2024-04-30T23:15:53.703 INFO:tasks.workunit.client.0.smithi100.stdout:8/209: dwrite d2/d7/f20 [0,4194304] 0 2024-04-30T23:15:53.704 INFO:tasks.workunit.client.0.smithi100.stdout:8/210: chown d2/d7/l37 467138199 1 2024-04-30T23:15:53.704 INFO:tasks.workunit.client.0.smithi100.stdout:3/336: dwrite d1/d14/d15/d1e/d26/f45 [4194304,4194304] 0 2024-04-30T23:15:53.704 INFO:tasks.workunit.client.0.smithi100.stdout:4/386: write f12 [6152515,19549] 0 2024-04-30T23:15:53.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/235: rename d4/d7/f44 to d4/d7/d8/d19/f4e 0 2024-04-30T23:15:53.706 INFO:tasks.workunit.client.0.smithi100.stdout:7/348: mknod d0/d1b/d60/d48/d4a/d5b/c74 0 2024-04-30T23:15:53.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/346: symlink d7/df/l78 0 2024-04-30T23:15:53.714 INFO:tasks.workunit.client.0.smithi100.stdout:8/211: creat d2/d7/d18/d3a/f3d x:0 0 0 2024-04-30T23:15:53.719 INFO:tasks.workunit.client.0.smithi100.stdout:5/296: rename d1/d37/d5c/l61 to d1/d19/l62 0 2024-04-30T23:15:53.719 INFO:tasks.workunit.client.0.smithi100.stdout:5/297: fsync d1/d19/f4a 0 2024-04-30T23:15:53.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/349: rmdir d0/d1b/d60/d48/d4a 39 2024-04-30T23:15:53.722 INFO:tasks.workunit.client.0.smithi100.stdout:8/212: creat d2/f3e x:0 0 0 2024-04-30T23:15:53.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/337: write d1/d14/d15/f16 [6578662,11355] 0 2024-04-30T23:15:53.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/387: creat d19/d1a/d21/d4a/d53/f76 x:0 0 0 2024-04-30T23:15:53.725 INFO:tasks.workunit.client.0.smithi100.stdout:1/341: write d3/d16/d20/d24/f48 [1513935,95956] 0 2024-04-30T23:15:53.727 INFO:tasks.workunit.client.0.smithi100.stdout:2/292: dwrite d5/d2e/f44 [0,4194304] 0 2024-04-30T23:15:53.728 INFO:tasks.workunit.client.0.smithi100.stdout:6/347: rename d7/db/l5d to d7/df/l79 0 2024-04-30T23:15:53.730 INFO:tasks.workunit.client.0.smithi100.stdout:7/350: getdents d0/d1b/d60/d48 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:8/213: getdents d2/d7/d18 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:3/338: creat d1/d38/f60 x:0 0 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:1/342: creat d3/d16/d20/d24/d69/d63/f6c x:0 0 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/236: dwrite d4/d7/d8/d37/d3d/f41 [0,4194304] 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/237: fdatasync f2 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/238: fdatasync d4/d9/d10/f27 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/239: write d4/d7/d8/d19/f4e [71291,54702] 0 2024-04-30T23:15:53.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/240: chown d4/d7/d8/d19/l23 451 1 2024-04-30T23:15:53.743 INFO:tasks.workunit.client.0.smithi100.stdout:4/388: rename d19/d1a/d21/f50 to d19/d33/f77 0 2024-04-30T23:15:53.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/214: creat d2/de/d38/f3f x:0 0 0 2024-04-30T23:15:53.748 INFO:tasks.workunit.client.0.smithi100.stdout:8/215: chown d2/de/d10/c36 1731594386 1 2024-04-30T23:15:53.749 INFO:tasks.workunit.client.0.smithi100.stdout:3/339: mknod d1/d14/d2f/c61 0 2024-04-30T23:15:53.755 INFO:tasks.workunit.client.0.smithi100.stdout:9/241: getdents d4/d7/d8/d37/d3d 0 2024-04-30T23:15:53.757 INFO:tasks.workunit.client.0.smithi100.stdout:5/298: dwrite d1/d12/d1a/f22 [0,4194304] 0 2024-04-30T23:15:53.757 INFO:tasks.workunit.client.0.smithi100.stdout:1/343: dread d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:15:53.757 INFO:tasks.workunit.client.0.smithi100.stdout:1/344: write d3/db/f3e [617259,30200] 0 2024-04-30T23:15:53.757 INFO:tasks.workunit.client.0.smithi100.stdout:1/345: chown d3/d16/d20/f45 46 1 2024-04-30T23:15:53.759 INFO:tasks.workunit.client.0.smithi100.stdout:7/351: dwrite d0/d1d/f6e [0,4194304] 0 2024-04-30T23:15:53.759 INFO:tasks.workunit.client.0.smithi100.stdout:2/293: dwrite d5/d47/d4c/f51 [0,4194304] 0 2024-04-30T23:15:53.759 INFO:tasks.workunit.client.0.smithi100.stdout:2/294: getdents d5/d58 0 2024-04-30T23:15:53.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/216: creat d2/de/f40 x:0 0 0 2024-04-30T23:15:53.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/242: read d4/d7/d8/d37/d3d/f40 [118566,83870] 0 2024-04-30T23:15:53.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/346: dread d3/d16/d20/f45 [0,4194304] 0 2024-04-30T23:15:53.762 INFO:tasks.workunit.client.0.smithi100.stdout:5/299: symlink d1/d12/d27/l63 0 2024-04-30T23:15:53.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/300: getdents d1/d12/d1a/d5b 0 2024-04-30T23:15:53.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/301: chown d1/d12/d24/d34 5014 1 2024-04-30T23:15:53.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/302: fsync d1/d12/d27/f29 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/389: mkdir d19/d1a/d6d/d64/d78 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:7/352: link d0/d1b/d60/d48/d4a/d5b/f6c d0/d1b/d24/f75 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:2/295: mknod d5/d2e/c5f 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/243: mknod d4/d7/c4f 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:1/347: unlink d3/d18/c38 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:5/303: mknod d1/d12/d1a/c64 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/390: chown d19/d1a/l6c 3 1 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/244: unlink d4/d7/c4f 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/391: mknod d19/d33/d3f/c79 0 2024-04-30T23:15:53.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/392: readlink d19/d1a/d6d/l54 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:4/393: truncate d19/d33/f77 1093705 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/245: mkdir d4/d9/d50 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:2/296: dread d5/d22/f4e [0,4194304] 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:4/394: symlink d19/d1a/d6d/l7a 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:8/217: dwrite d2/de/f40 [0,4194304] 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:8/218: dread - d2/de/d38/f3f zero size 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:8/219: fdatasync d2/de/f40 0 2024-04-30T23:15:53.789 INFO:tasks.workunit.client.0.smithi100.stdout:2/297: unlink d5/d26/d2f/d38/c46 0 2024-04-30T23:15:53.790 INFO:tasks.workunit.client.0.smithi100.stdout:8/220: rename d2/d7/l37 to d2/d29/l41 0 2024-04-30T23:15:53.791 INFO:tasks.workunit.client.0.smithi100.stdout:8/221: chown d2/f6 84 1 2024-04-30T23:15:53.791 INFO:tasks.workunit.client.0.smithi100.stdout:5/304: write d1/d12/d27/f29 [1929043,55951] 0 2024-04-30T23:15:53.792 INFO:tasks.workunit.client.0.smithi100.stdout:2/298: link d5/d22/f2c d5/d22/f60 0 2024-04-30T23:15:53.792 INFO:tasks.workunit.client.0.smithi100.stdout:2/299: fdatasync d5/f16 0 2024-04-30T23:15:53.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/348: dread d3/d18/f23 [0,4194304] 0 2024-04-30T23:15:53.793 INFO:tasks.workunit.client.0.smithi100.stdout:4/395: symlink d19/d1a/d29/d65/l7b 0 2024-04-30T23:15:53.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/222: creat d2/de/d10/d17/f42 x:0 0 0 2024-04-30T23:15:53.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/305: creat d1/d2c/d60/f65 x:0 0 0 2024-04-30T23:15:53.796 INFO:tasks.workunit.client.0.smithi100.stdout:2/300: rmdir d5/d47 39 2024-04-30T23:15:53.798 INFO:tasks.workunit.client.0.smithi100.stdout:7/353: dwrite d0/d1b/d24/f3b [0,4194304] 0 2024-04-30T23:15:53.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/223: rmdir d2/de 39 2024-04-30T23:15:53.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/306: mkdir d1/d2c/d60/d66 0 2024-04-30T23:15:53.808 INFO:tasks.workunit.client.0.smithi100.stdout:2/301: link d5/d2e/f35 d5/d26/d2f/d38/f61 0 2024-04-30T23:15:53.809 INFO:tasks.workunit.client.0.smithi100.stdout:5/307: creat d1/d37/f67 x:0 0 0 2024-04-30T23:15:53.810 INFO:tasks.workunit.client.0.smithi100.stdout:9/246: dwrite d4/d7/d8/d37/d3d/f40 [0,4194304] 0 2024-04-30T23:15:53.810 INFO:tasks.workunit.client.0.smithi100.stdout:9/247: readlink d4/d7/l21 0 2024-04-30T23:15:53.812 INFO:tasks.workunit.client.0.smithi100.stdout:2/302: truncate d5/d2e/f35 70302 0 2024-04-30T23:15:53.812 INFO:tasks.workunit.client.0.smithi100.stdout:2/303: chown d5/c6 471591452 1 2024-04-30T23:15:53.813 INFO:tasks.workunit.client.0.smithi100.stdout:5/308: creat d1/d5f/f68 x:0 0 0 2024-04-30T23:15:53.813 INFO:tasks.workunit.client.0.smithi100.stdout:5/309: fdatasync d1/d5f/f68 0 2024-04-30T23:15:53.814 INFO:tasks.workunit.client.0.smithi100.stdout:5/310: chown d1/d19/f4a 261 1 2024-04-30T23:15:53.816 INFO:tasks.workunit.client.0.smithi100.stdout:1/349: dwrite d3/d16/d20/f45 [0,4194304] 0 2024-04-30T23:15:53.818 INFO:tasks.workunit.client.0.smithi100.stdout:2/304: truncate d5/d12/d13/f17 5146951 0 2024-04-30T23:15:53.818 INFO:tasks.workunit.client.0.smithi100.stdout:5/311: stat d1/la 0 2024-04-30T23:15:53.818 INFO:tasks.workunit.client.0.smithi100.stdout:5/312: write d1/d19/f4a [4408234,98763] 0 2024-04-30T23:15:53.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/350: truncate d3/d16/d20/f22 3175070 0 2024-04-30T23:15:53.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/224: write d2/ff [5558897,94510] 0 2024-04-30T23:15:53.823 INFO:tasks.workunit.client.0.smithi100.stdout:2/305: dread d5/d12/f2b [0,4194304] 0 2024-04-30T23:15:53.824 INFO:tasks.workunit.client.0.smithi100.stdout:1/351: truncate d3/f26 1560353 0 2024-04-30T23:15:53.824 INFO:tasks.workunit.client.0.smithi100.stdout:4/396: dwrite d19/d1a/d21/f25 [0,4194304] 0 2024-04-30T23:15:53.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/225: mknod d2/c43 0 2024-04-30T23:15:53.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/352: creat d3/d18/f6d x:0 0 0 2024-04-30T23:15:53.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/226: unlink d2/d7/d18/f15 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:1/353: creat d3/d16/d20/d24/f6e x:0 0 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:1/354: fsync d3/db/f3d 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:1/355: chown d3/d16/d20/d24/f48 154970510 1 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/313: write d1/d12/f18 [4663523,21515] 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/314: fdatasync f0 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/227: rename d2/d7/f2d to d2/de/f44 0 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/228: read - d2/de/d38/f3f zero size 2024-04-30T23:15:53.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/229: readlink d2/d7/l27 0 2024-04-30T23:15:53.835 INFO:tasks.workunit.client.0.smithi100.stdout:8/230: dread - d2/de/d38/f3f zero size 2024-04-30T23:15:53.835 INFO:tasks.workunit.client.0.smithi100.stdout:9/248: write d4/d7/d8/d37/d3d/f41 [3594629,101614] 0 2024-04-30T23:15:53.836 INFO:tasks.workunit.client.0.smithi100.stdout:8/231: creat d2/d7/f45 x:0 0 0 2024-04-30T23:15:53.838 INFO:tasks.workunit.client.0.smithi100.stdout:9/249: mkdir d4/d9/d51 0 2024-04-30T23:15:53.849 INFO:tasks.workunit.client.0.smithi100.stdout:5/315: write d1/d12/f31 [6168760,105435] 0 2024-04-30T23:15:53.851 INFO:tasks.workunit.client.0.smithi100.stdout:4/397: dwrite d19/d1a/d29/f5f [0,4194304] 0 2024-04-30T23:15:53.852 INFO:tasks.workunit.client.0.smithi100.stdout:8/232: dread d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:53.854 INFO:tasks.workunit.client.0.smithi100.stdout:4/398: symlink d19/d33/d3f/l7c 0 2024-04-30T23:15:53.855 INFO:tasks.workunit.client.0.smithi100.stdout:8/233: creat d2/de/d10/d17/f46 x:0 0 0 2024-04-30T23:15:53.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/234: truncate d2/d7/d18/d3a/f3d 405415 0 2024-04-30T23:15:53.856 INFO:tasks.workunit.client.0.smithi100.stdout:4/399: mkdir d19/d33/d7d 0 2024-04-30T23:15:53.859 INFO:tasks.workunit.client.0.smithi100.stdout:8/235: dread d2/f1d [0,4194304] 0 2024-04-30T23:15:53.859 INFO:tasks.workunit.client.0.smithi100.stdout:8/236: truncate d2/f1d 1381267 0 2024-04-30T23:15:53.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/237: write d2/de/f40 [2562775,89526] 0 2024-04-30T23:15:53.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/238: write d2/d7/f3c [780042,53117] 0 2024-04-30T23:15:53.873 INFO:tasks.workunit.client.0.smithi100.stdout:8/239: link d2/f4 d2/d29/f47 0 2024-04-30T23:15:53.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/306: dwrite d5/d12/f1f [0,4194304] 0 2024-04-30T23:15:53.873 INFO:tasks.workunit.client.0.smithi100.stdout:4/400: dread f12 [0,4194304] 0 2024-04-30T23:15:53.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/307: fsync d5/d26/d2f/f36 0 2024-04-30T23:15:53.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/308: readlink d5/d12/l1b 0 2024-04-30T23:15:53.875 INFO:tasks.workunit.client.0.smithi100.stdout:4/401: mkdir d19/d1a/d21/d4a/d53/d5e/d7e 0 2024-04-30T23:15:53.876 INFO:tasks.workunit.client.0.smithi100.stdout:4/402: creat d19/d1a/d21/d3c/f7f x:0 0 0 2024-04-30T23:15:53.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/309: dread d5/d12/f3d [0,4194304] 0 2024-04-30T23:15:53.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/310: chown d5/d2e/f35 617391481 1 2024-04-30T23:15:53.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/311: fdatasync d5/f49 0 2024-04-30T23:15:53.936 INFO:tasks.workunit.client.0.smithi100.stdout:7/354: dwrite d0/d1b/d2e/f32 [0,4194304] 0 2024-04-30T23:15:53.938 INFO:tasks.workunit.client.0.smithi100.stdout:7/355: creat d0/d1b/d60/d48/f76 x:0 0 0 2024-04-30T23:15:53.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/356: dwrite d3/d16/f36 [0,4194304] 0 2024-04-30T23:15:53.945 INFO:tasks.workunit.client.0.smithi100.stdout:4/403: dwrite f8 [0,4194304] 0 2024-04-30T23:15:53.947 INFO:tasks.workunit.client.0.smithi100.stdout:8/240: dwrite d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:53.947 INFO:tasks.workunit.client.0.smithi100.stdout:8/241: chown d2/d7/f3c 137 1 2024-04-30T23:15:53.950 INFO:tasks.workunit.client.0.smithi100.stdout:1/357: unlink d3/d16/d20/d24/f32 0 2024-04-30T23:15:53.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/404: creat d19/d1a/d6d/d4e/d6e/f80 x:0 0 0 2024-04-30T23:15:53.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/312: dread d5/d26/f54 [0,4194304] 0 2024-04-30T23:15:53.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/313: write d5/f16 [1431102,73264] 0 2024-04-30T23:15:53.960 INFO:tasks.workunit.client.0.smithi100.stdout:9/250: dwrite f3 [0,4194304] 0 2024-04-30T23:15:53.961 INFO:tasks.workunit.client.0.smithi100.stdout:5/316: dwrite d1/d19/f1e [4194304,4194304] 0 2024-04-30T23:15:53.961 INFO:tasks.workunit.client.0.smithi100.stdout:5/317: dread - d1/d5f/f68 zero size 2024-04-30T23:15:53.964 INFO:tasks.workunit.client.0.smithi100.stdout:2/314: creat d5/f62 x:0 0 0 2024-04-30T23:15:53.967 INFO:tasks.workunit.client.0.smithi100.stdout:7/356: dwrite d0/d1d/f6e [0,4194304] 0 2024-04-30T23:15:53.967 INFO:tasks.workunit.client.0.smithi100.stdout:7/357: write d0/d1b/d1e/f49 [980373,109319] 0 2024-04-30T23:15:53.967 INFO:tasks.workunit.client.0.smithi100.stdout:8/242: write d2/d7/f26 [595666,20003] 0 2024-04-30T23:15:53.968 INFO:tasks.workunit.client.0.smithi100.stdout:8/243: dread - d2/de/d10/d17/f42 zero size 2024-04-30T23:15:53.968 INFO:tasks.workunit.client.0.smithi100.stdout:8/244: chown d2/de/d10/c36 263766599 1 2024-04-30T23:15:53.968 INFO:tasks.workunit.client.0.smithi100.stdout:8/245: chown d2 0 1 2024-04-30T23:15:53.968 INFO:tasks.workunit.client.0.smithi100.stdout:8/246: write d2/f8 [8964481,19931] 0 2024-04-30T23:15:53.972 INFO:tasks.workunit.client.0.smithi100.stdout:5/318: write d1/d3e/f47 [794142,121077] 0 2024-04-30T23:15:53.972 INFO:tasks.workunit.client.0.smithi100.stdout:5/319: readlink d1/d19/l62 0 2024-04-30T23:15:53.973 INFO:tasks.workunit.client.0.smithi100.stdout:2/315: creat d5/d26/d2f/f63 x:0 0 0 2024-04-30T23:15:53.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/358: truncate d0/d1d/d3c/f47 3165003 0 2024-04-30T23:15:53.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/359: fsync d0/df/f29 0 2024-04-30T23:15:53.979 INFO:tasks.workunit.client.0.smithi100.stdout:8/247: rename d2/de/d10/c36 to d2/d7/c48 0 2024-04-30T23:15:53.982 INFO:tasks.workunit.client.0.smithi100.stdout:1/358: dwrite d3/d16/d20/d24/f48 [0,4194304] 0 2024-04-30T23:15:53.985 INFO:tasks.workunit.client.0.smithi100.stdout:9/251: dwrite d4/d7/d8/d37/d3d/f40 [4194304,4194304] 0 2024-04-30T23:15:53.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/320: rename d1/d37/f67 to d1/d12/d24/d34/f69 0 2024-04-30T23:15:53.990 INFO:tasks.workunit.client.0.smithi100.stdout:1/359: getdents d3/d16/d20/d24/d69 0 2024-04-30T23:15:53.991 INFO:tasks.workunit.client.0.smithi100.stdout:9/252: getdents d4/d7/d8 0 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:3/340: sync 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:6/348: sync 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:6/349: write d7/f52 [1957831,55064] 0 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:6/350: write d7/df/f53 [467972,120228] 0 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:7/360: write d0/d1d/d5e/d6a/d4b/f56 [5796962,118987] 0 2024-04-30T23:15:53.996 INFO:tasks.workunit.client.0.smithi100.stdout:7/361: chown d0/d1b/d60/d48/d4a/f4d 435823539 1 2024-04-30T23:15:53.997 INFO:tasks.workunit.client.0.smithi100.stdout:0/360: sync 2024-04-30T23:15:53.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/405: dwrite d19/d1a/d21/d3c/f7f [0,4194304] 0 2024-04-30T23:15:54.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/316: dwrite d5/f2d [0,4194304] 0 2024-04-30T23:15:54.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/317: chown d5/d26/d2f/d38/c57 15256 1 2024-04-30T23:15:54.009 INFO:tasks.workunit.client.0.smithi100.stdout:5/321: read d1/d12/d1a/f2d [220405,68578] 0 2024-04-30T23:15:54.009 INFO:tasks.workunit.client.0.smithi100.stdout:5/322: fsync d1/d12/d27/f42 0 2024-04-30T23:15:54.015 INFO:tasks.workunit.client.0.smithi100.stdout:5/323: mknod d1/d12/d1a/c6a 0 2024-04-30T23:15:54.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/318: unlink d5/f11 0 2024-04-30T23:15:54.015 INFO:tasks.workunit.client.0.smithi100.stdout:7/362: write d0/d1b/d1e/f28 [3021163,368] 0 2024-04-30T23:15:54.018 INFO:tasks.workunit.client.0.smithi100.stdout:8/248: dwrite d2/de/f44 [0,4194304] 0 2024-04-30T23:15:54.018 INFO:tasks.workunit.client.0.smithi100.stdout:8/249: truncate d2/de/d10/d17/f1a 959859 0 2024-04-30T23:15:54.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/406: dread d19/d1a/d21/d3c/f7f [0,4194304] 0 2024-04-30T23:15:54.020 INFO:tasks.workunit.client.0.smithi100.stdout:8/250: dread d2/de/d10/d17/f1a [0,4194304] 0 2024-04-30T23:15:54.020 INFO:tasks.workunit.client.0.smithi100.stdout:7/363: getdents d0/d1b/d1e 0 2024-04-30T23:15:54.021 INFO:tasks.workunit.client.0.smithi100.stdout:2/319: symlink d5/d58/l64 0 2024-04-30T23:15:54.022 INFO:tasks.workunit.client.0.smithi100.stdout:3/341: dread d1/f4a [0,4194304] 0 2024-04-30T23:15:54.023 INFO:tasks.workunit.client.0.smithi100.stdout:2/320: truncate d5/f49 544146 0 2024-04-30T23:15:54.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/342: creat d1/d14/d15/f62 x:0 0 0 2024-04-30T23:15:54.025 INFO:tasks.workunit.client.0.smithi100.stdout:2/321: rmdir d5/d26 39 2024-04-30T23:15:54.027 INFO:tasks.workunit.client.0.smithi100.stdout:3/343: creat d1/d14/d15/d32/f63 x:0 0 0 2024-04-30T23:15:54.028 INFO:tasks.workunit.client.0.smithi100.stdout:2/322: getdents d5/d22 0 2024-04-30T23:15:54.028 INFO:tasks.workunit.client.0.smithi100.stdout:4/407: write f3 [352634,117106] 0 2024-04-30T23:15:54.030 INFO:tasks.workunit.client.0.smithi100.stdout:3/344: symlink d1/d38/l64 0 2024-04-30T23:15:54.030 INFO:tasks.workunit.client.0.smithi100.stdout:3/345: write d1/d14/d21/f55 [1105874,4066] 0 2024-04-30T23:15:54.030 INFO:tasks.workunit.client.0.smithi100.stdout:0/361: dwrite d2/d5a/f77 [0,4194304] 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:2/323: creat d5/d58/f65 x:0 0 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:2/324: stat d5/l1d 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:2/325: fdatasync d5/d26/d2f/d38/f61 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:2/326: stat d5/d22/f42 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:4/408: rename d19/d33/c74 to d19/d33/c81 0 2024-04-30T23:15:54.033 INFO:tasks.workunit.client.0.smithi100.stdout:4/409: write d19/d1a/d21/f25 [4351189,83002] 0 2024-04-30T23:15:54.036 INFO:tasks.workunit.client.0.smithi100.stdout:5/324: getdents d1/d12/d1a 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/346: creat d1/d14/d2f/f65 x:0 0 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/347: fsync d1/d38/f5c 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/348: write d1/d38/f5c [875530,101398] 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/349: write d1/d14/d15/d27/f33 [1339986,121206] 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/350: write d1/d38/f60 [929158,60243] 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:9/253: dwrite d4/d7/d8/d19/f29 [0,4194304] 0 2024-04-30T23:15:54.038 INFO:tasks.workunit.client.0.smithi100.stdout:9/254: stat d4/d7/d8/d37/f42 0 2024-04-30T23:15:54.039 INFO:tasks.workunit.client.0.smithi100.stdout:6/351: dwrite d7/d1a/d1b/f6f [0,4194304] 0 2024-04-30T23:15:54.042 INFO:tasks.workunit.client.0.smithi100.stdout:0/362: rename d2/d14/d35/d57/d62/f6d to d2/d14/d35/d57/f78 0 2024-04-30T23:15:54.042 INFO:tasks.workunit.client.0.smithi100.stdout:0/363: fdatasync d2/d50/d38/d5d/f76 0 2024-04-30T23:15:54.050 INFO:tasks.workunit.client.0.smithi100.stdout:2/327: mkdir d5/d47/d66 0 2024-04-30T23:15:54.052 INFO:tasks.workunit.client.0.smithi100.stdout:5/325: creat d1/d12/d27/f6b x:0 0 0 2024-04-30T23:15:54.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/351: mknod d1/d14/d15/d2c/c66 0 2024-04-30T23:15:54.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/352: fdatasync d1/d14/f5f 0 2024-04-30T23:15:54.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/353: chown d1/d14/d15/d1e/f39 7 1 2024-04-30T23:15:54.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/354: readlink d1/d38/l52 0 2024-04-30T23:15:54.061 INFO:tasks.workunit.client.0.smithi100.stdout:4/410: dwrite d19/d33/f77 [0,4194304] 0 2024-04-30T23:15:54.061 INFO:tasks.workunit.client.0.smithi100.stdout:4/411: stat d19/d1a/d21/d4a/d53/d5e 0 2024-04-30T23:15:54.061 INFO:tasks.workunit.client.0.smithi100.stdout:4/412: chown d19/d1a/d6d/d64 10892 1 2024-04-30T23:15:54.063 INFO:tasks.workunit.client.0.smithi100.stdout:0/364: mknod d2/d50/d38/d6c/d6e/c79 0 2024-04-30T23:15:54.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/328: mknod d5/d2e/c67 0 2024-04-30T23:15:54.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/255: creat d4/f52 x:0 0 0 2024-04-30T23:15:54.068 INFO:tasks.workunit.client.0.smithi100.stdout:5/326: write d1/d3e/f45 [318697,106024] 0 2024-04-30T23:15:54.068 INFO:tasks.workunit.client.0.smithi100.stdout:5/327: truncate d1/d12/d27/f6b 135360 0 2024-04-30T23:15:54.069 INFO:tasks.workunit.client.0.smithi100.stdout:4/413: rename f18 to d19/d1a/d6d/d64/d78/f82 0 2024-04-30T23:15:54.071 INFO:tasks.workunit.client.0.smithi100.stdout:0/365: creat d2/d50/d38/f7a x:0 0 0 2024-04-30T23:15:54.071 INFO:tasks.workunit.client.0.smithi100.stdout:0/366: chown d2/d5a/f66 182767 1 2024-04-30T23:15:54.071 INFO:tasks.workunit.client.0.smithi100.stdout:0/367: truncate d2/d50/d38/d6c/f74 431857 0 2024-04-30T23:15:54.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/328: symlink d1/d2c/d60/d66/l6c 0 2024-04-30T23:15:54.076 INFO:tasks.workunit.client.0.smithi100.stdout:6/352: dwrite f5 [0,4194304] 0 2024-04-30T23:15:54.077 INFO:tasks.workunit.client.0.smithi100.stdout:5/329: link d1/d12/d24/d34/f50 d1/d37/f6d 0 2024-04-30T23:15:54.081 INFO:tasks.workunit.client.0.smithi100.stdout:2/329: write d5/d12/d13/d4b/f56 [7326685,22328] 0 2024-04-30T23:15:54.083 INFO:tasks.workunit.client.0.smithi100.stdout:5/330: truncate d1/f30 325086 0 2024-04-30T23:15:54.083 INFO:tasks.workunit.client.0.smithi100.stdout:3/355: dwrite d1/d14/d15/f1d [4194304,4194304] 0 2024-04-30T23:15:54.084 INFO:tasks.workunit.client.0.smithi100.stdout:4/414: write d19/d1a/d21/f25 [4109159,9308] 0 2024-04-30T23:15:54.084 INFO:tasks.workunit.client.0.smithi100.stdout:2/330: truncate d5/f45 3465044 0 2024-04-30T23:15:54.085 INFO:tasks.workunit.client.0.smithi100.stdout:5/331: chown d1/fe 7377827 1 2024-04-30T23:15:54.087 INFO:tasks.workunit.client.0.smithi100.stdout:3/356: mkdir d1/d14/d21/d67 0 2024-04-30T23:15:54.087 INFO:tasks.workunit.client.0.smithi100.stdout:3/357: fdatasync d1/d14/d2f/f5e 0 2024-04-30T23:15:54.087 INFO:tasks.workunit.client.0.smithi100.stdout:5/332: readlink d1/l56 0 2024-04-30T23:15:54.088 INFO:tasks.workunit.client.0.smithi100.stdout:0/368: dread d2/d50/d30/d32/f3b [0,4194304] 0 2024-04-30T23:15:54.091 INFO:tasks.workunit.client.0.smithi100.stdout:3/358: rename d1/d14/d15/d1e to d1/d14/d15/d2c/d68 0 2024-04-30T23:15:54.091 INFO:tasks.workunit.client.0.smithi100.stdout:3/359: read - d1/d14/d15/d32/f63 zero size 2024-04-30T23:15:54.093 INFO:tasks.workunit.client.0.smithi100.stdout:5/333: symlink d1/d12/d1a/d5b/l6e 0 2024-04-30T23:15:54.095 INFO:tasks.workunit.client.0.smithi100.stdout:0/369: creat d2/d50/d38/f7b x:0 0 0 2024-04-30T23:15:54.095 INFO:tasks.workunit.client.0.smithi100.stdout:0/370: write d2/d14/d18/f29 [1052516,56963] 0 2024-04-30T23:15:54.098 INFO:tasks.workunit.client.0.smithi100.stdout:3/360: mknod d1/d38/c69 0 2024-04-30T23:15:54.108 INFO:tasks.workunit.client.0.smithi100.stdout:0/371: dread d2/f2e [0,4194304] 0 2024-04-30T23:15:54.110 INFO:tasks.workunit.client.0.smithi100.stdout:2/331: dwrite d5/f62 [0,4194304] 0 2024-04-30T23:15:54.110 INFO:tasks.workunit.client.0.smithi100.stdout:2/332: write d5/d47/d4c/f4f [456411,45838] 0 2024-04-30T23:15:54.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/334: rename d1/la to d1/d2c/l6f 0 2024-04-30T23:15:54.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/333: rmdir d5 39 2024-04-30T23:15:54.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/415: dread d19/d33/f31 [0,4194304] 0 2024-04-30T23:15:54.121 INFO:tasks.workunit.client.0.smithi100.stdout:6/353: dwrite d7/df/d23/d24/d2e/f56 [0,4194304] 0 2024-04-30T23:15:54.121 INFO:tasks.workunit.client.0.smithi100.stdout:4/416: readlink l10 0 2024-04-30T23:15:54.125 INFO:tasks.workunit.client.0.smithi100.stdout:5/335: dread d1/fe [0,4194304] 0 2024-04-30T23:15:54.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/417: creat d19/d1a/d21/f83 x:0 0 0 2024-04-30T23:15:54.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/418: stat d19/c39 0 2024-04-30T23:15:54.129 INFO:tasks.workunit.client.0.smithi100.stdout:5/336: rename d1/d12/d24/d34/l55 to d1/d2c/d5d/l70 0 2024-04-30T23:15:54.130 INFO:tasks.workunit.client.0.smithi100.stdout:3/361: dwrite d1/d14/f36 [4194304,4194304] 0 2024-04-30T23:15:54.131 INFO:tasks.workunit.client.0.smithi100.stdout:2/334: dread d5/d26/d2f/f36 [0,4194304] 0 2024-04-30T23:15:54.131 INFO:tasks.workunit.client.0.smithi100.stdout:3/362: stat d1/d14/d2b/f53 0 2024-04-30T23:15:54.137 INFO:tasks.workunit.client.0.smithi100.stdout:0/372: dwrite d2/d50/d30/d32/f5b [0,4194304] 0 2024-04-30T23:15:54.137 INFO:tasks.workunit.client.0.smithi100.stdout:0/373: dread - d2/d4c/d68/f69 zero size 2024-04-30T23:15:54.141 INFO:tasks.workunit.client.0.smithi100.stdout:0/374: symlink d2/d5a/l7c 0 2024-04-30T23:15:54.141 INFO:tasks.workunit.client.0.smithi100.stdout:5/337: dread d1/fe [0,4194304] 0 2024-04-30T23:15:54.149 INFO:tasks.workunit.client.0.smithi100.stdout:6/354: dwrite d7/d11/d34/f26 [0,4194304] 0 2024-04-30T23:15:54.149 INFO:tasks.workunit.client.0.smithi100.stdout:3/363: write d1/d14/d15/d2c/d68/d26/f23 [1670655,44784] 0 2024-04-30T23:15:54.154 INFO:tasks.workunit.client.0.smithi100.stdout:5/338: dread d1/d3e/f45 [0,4194304] 0 2024-04-30T23:15:54.155 INFO:tasks.workunit.client.0.smithi100.stdout:6/355: mknod d7/d1a/d3e/d6b/c7a 0 2024-04-30T23:15:54.157 INFO:tasks.workunit.client.0.smithi100.stdout:5/339: mkdir d1/d2c/d60/d66/d71 0 2024-04-30T23:15:54.159 INFO:tasks.workunit.client.0.smithi100.stdout:5/340: creat d1/d2c/d5d/f72 x:0 0 0 2024-04-30T23:15:54.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/335: dwrite d5/d12/d13/f59 [0,4194304] 0 2024-04-30T23:15:54.164 INFO:tasks.workunit.client.0.smithi100.stdout:2/336: creat d5/d26/d2f/f68 x:0 0 0 2024-04-30T23:15:54.164 INFO:tasks.workunit.client.0.smithi100.stdout:2/337: fsync d5/f62 0 2024-04-30T23:15:54.166 INFO:tasks.workunit.client.0.smithi100.stdout:0/375: dwrite d2/f8 [0,4194304] 0 2024-04-30T23:15:54.167 INFO:tasks.workunit.client.0.smithi100.stdout:2/338: creat d5/d47/d66/f69 x:0 0 0 2024-04-30T23:15:54.170 INFO:tasks.workunit.client.0.smithi100.stdout:0/376: symlink d2/d14/d35/d57/d62/d75/l7d 0 2024-04-30T23:15:54.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/339: mknod d5/d58/c6a 0 2024-04-30T23:15:54.176 INFO:tasks.workunit.client.0.smithi100.stdout:3/364: dwrite d1/d14/f19 [0,4194304] 0 2024-04-30T23:15:54.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/365: creat d1/d14/d15/f6a x:0 0 0 2024-04-30T23:15:54.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/366: dread - d1/d14/d15/f6a zero size 2024-04-30T23:15:54.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/367: readlink d1/d14/d15/d2c/d68/d26/l3f 0 2024-04-30T23:15:54.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/368: chown d1/f4a 0 1 2024-04-30T23:15:54.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/369: readlink d1/d14/l58 0 2024-04-30T23:15:54.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/370: rename d1/d14/d2f/f5e to d1/d14/d15/d2c/d68/f6b 0 2024-04-30T23:15:54.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/371: write d1/d14/f19 [4879065,66123] 0 2024-04-30T23:15:54.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/372: chown d1/d14/d15/f44 4098 1 2024-04-30T23:15:54.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/373: write d1/d14/d15/f1b [418862,130508] 0 2024-04-30T23:15:54.180 INFO:tasks.workunit.client.0.smithi100.stdout:5/341: dwrite d1/d12/d1a/f2d [0,4194304] 0 2024-04-30T23:15:54.180 INFO:tasks.workunit.client.0.smithi100.stdout:5/342: chown f0 37328002 1 2024-04-30T23:15:54.180 INFO:tasks.workunit.client.0.smithi100.stdout:5/343: stat f0 0 2024-04-30T23:15:54.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/374: creat d1/d14/d15/d27/d5d/f6c x:0 0 0 2024-04-30T23:15:54.184 INFO:tasks.workunit.client.0.smithi100.stdout:5/344: link d1/d12/f31 d1/d12/f73 0 2024-04-30T23:15:54.184 INFO:tasks.workunit.client.0.smithi100.stdout:5/345: truncate d1/d2c/f49 4455628 0 2024-04-30T23:15:54.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/340: dread d5/d12/d13/d4b/f56 [4194304,4194304] 0 2024-04-30T23:15:54.185 INFO:tasks.workunit.client.0.smithi100.stdout:3/375: mkdir d1/d14/d15/d2c/d68/d6d 0 2024-04-30T23:15:54.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/346: mkdir d1/d12/d74 0 2024-04-30T23:15:54.187 INFO:tasks.workunit.client.0.smithi100.stdout:2/341: unlink d5/d2e/f30 0 2024-04-30T23:15:54.189 INFO:tasks.workunit.client.0.smithi100.stdout:3/376: creat d1/d14/d15/d27/d34/f6e x:0 0 0 2024-04-30T23:15:54.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/347: mkdir d1/d2c/d60/d66/d75 0 2024-04-30T23:15:54.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/348: fsync d1/d2c/d60/f65 0 2024-04-30T23:15:54.193 INFO:tasks.workunit.client.0.smithi100.stdout:0/377: write d2/f3a [4059811,21533] 0 2024-04-30T23:15:54.210 INFO:tasks.workunit.client.0.smithi100.stdout:5/349: dwrite f0 [4194304,4194304] 0 2024-04-30T23:15:54.210 INFO:tasks.workunit.client.0.smithi100.stdout:5/350: write d1/d12/f21 [8912788,51820] 0 2024-04-30T23:15:54.222 INFO:tasks.workunit.client.0.smithi100.stdout:5/351: dread d1/d12/d1a/f26 [0,4194304] 0 2024-04-30T23:15:54.223 INFO:tasks.workunit.client.0.smithi100.stdout:5/352: mkdir d1/d12/d1a/d76 0 2024-04-30T23:15:54.224 INFO:tasks.workunit.client.0.smithi100.stdout:5/353: mkdir d1/d12/d1a/d76/d77 0 2024-04-30T23:15:54.225 INFO:tasks.workunit.client.0.smithi100.stdout:5/354: mkdir d1/d19/d78 0 2024-04-30T23:15:54.226 INFO:tasks.workunit.client.0.smithi100.stdout:5/355: mkdir d1/d19/d78/d79 0 2024-04-30T23:15:54.239 INFO:tasks.workunit.client.0.smithi100.stdout:5/356: dread d1/d19/f1e [4194304,4194304] 0 2024-04-30T23:15:54.239 INFO:tasks.workunit.client.0.smithi100.stdout:5/357: dread d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:15:54.240 INFO:tasks.workunit.client.0.smithi100.stdout:5/358: creat d1/d12/d1a/d76/f7a x:0 0 0 2024-04-30T23:15:54.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/359: getdents d1/d12/d24/d34 0 2024-04-30T23:15:54.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/360: read - d1/d12/d24/f4e zero size 2024-04-30T23:15:54.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/361: write d1/d2c/f33 [769235,56547] 0 2024-04-30T23:15:54.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/362: fdatasync d1/d12/d27/f42 0 2024-04-30T23:15:54.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/363: chown d1/d12/d1a/d76/f7a 481235894 1 2024-04-30T23:15:54.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/364: stat d1/d12/c20 0 2024-04-30T23:15:54.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/365: dread d1/f7 [4194304,4194304] 0 2024-04-30T23:15:54.263 INFO:tasks.workunit.client.0.smithi100.stdout:5/366: read d1/d12/f21 [162907,63568] 0 2024-04-30T23:15:54.264 INFO:tasks.workunit.client.0.smithi100.stdout:5/367: mkdir d1/d12/d1a/d76/d77/d7b 0 2024-04-30T23:15:54.271 INFO:tasks.workunit.client.0.smithi100.stdout:5/368: dread d1/d12/f73 [4194304,4194304] 0 2024-04-30T23:15:54.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/369: mknod d1/d2c/c7c 0 2024-04-30T23:15:54.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/370: dread - d1/d12/d1a/f3d zero size 2024-04-30T23:15:54.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/371: link d1/d2c/l3c d1/d2c/d60/l7d 0 2024-04-30T23:15:54.275 INFO:tasks.workunit.client.0.smithi100.stdout:5/372: rename d1/d2c/f33 to d1/d12/d1a/f7e 0 2024-04-30T23:15:54.294 INFO:tasks.workunit.client.0.smithi100.stdout:5/373: dwrite d1/d3e/f47 [0,4194304] 0 2024-04-30T23:15:54.294 INFO:tasks.workunit.client.0.smithi100.stdout:5/374: chown d1/d3e/f45 18019 1 2024-04-30T23:15:54.312 INFO:tasks.workunit.client.0.smithi100.stdout:5/375: write d1/f5a [1238909,102025] 0 2024-04-30T23:15:54.313 INFO:tasks.workunit.client.0.smithi100.stdout:5/376: truncate d1/d12/f21 2725781 0 2024-04-30T23:15:54.313 INFO:tasks.workunit.client.0.smithi100.stdout:5/377: chown d1/d19/c51 526318249 1 2024-04-30T23:15:54.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/378: dwrite d1/d12/d27/f29 [4194304,4194304] 0 2024-04-30T23:15:54.338 INFO:tasks.workunit.client.0.smithi100.stdout:5/379: unlink d1/d12/d1a/f2d 0 2024-04-30T23:15:54.350 INFO:tasks.workunit.client.0.smithi100.stdout:9/256: sync 2024-04-30T23:15:54.350 INFO:tasks.workunit.client.0.smithi100.stdout:8/251: sync 2024-04-30T23:15:54.350 INFO:tasks.workunit.client.0.smithi100.stdout:7/364: sync 2024-04-30T23:15:54.350 INFO:tasks.workunit.client.0.smithi100.stdout:1/360: sync 2024-04-30T23:15:54.351 INFO:tasks.workunit.client.0.smithi100.stdout:9/257: link d4/f1e d4/d9/d51/f53 0 2024-04-30T23:15:54.351 INFO:tasks.workunit.client.0.smithi100.stdout:7/365: stat d0/d1b/d60/l62 0 2024-04-30T23:15:54.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/361: symlink d3/d16/d20/d24/d69/l6f 0 2024-04-30T23:15:54.355 INFO:tasks.workunit.client.0.smithi100.stdout:9/258: rename f1 to d4/d9/d50/f54 0 2024-04-30T23:15:54.355 INFO:tasks.workunit.client.0.smithi100.stdout:7/366: mknod d0/d1b/d60/d48/c77 0 2024-04-30T23:15:54.372 INFO:tasks.workunit.client.0.smithi100.stdout:9/259: write d4/d9/d10/f4a [2133615,73441] 0 2024-04-30T23:15:54.373 INFO:tasks.workunit.client.0.smithi100.stdout:9/260: mknod d4/c55 0 2024-04-30T23:15:54.374 INFO:tasks.workunit.client.0.smithi100.stdout:8/252: dwrite d2/f9 [0,4194304] 0 2024-04-30T23:15:54.374 INFO:tasks.workunit.client.0.smithi100.stdout:9/261: symlink d4/l56 0 2024-04-30T23:15:54.375 INFO:tasks.workunit.client.0.smithi100.stdout:9/262: readlink d4/d7/l3e 0 2024-04-30T23:15:54.376 INFO:tasks.workunit.client.0.smithi100.stdout:8/253: creat d2/de/f49 x:0 0 0 2024-04-30T23:15:54.377 INFO:tasks.workunit.client.0.smithi100.stdout:9/263: mknod d4/d9/d50/c57 0 2024-04-30T23:15:54.377 INFO:tasks.workunit.client.0.smithi100.stdout:9/264: write d4/fd [1676666,101462] 0 2024-04-30T23:15:54.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/254: rename d2/de/d10/d17/f42 to d2/f4a 0 2024-04-30T23:15:54.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/255: fsync d2/d7/f12 0 2024-04-30T23:15:54.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/265: getdents d4/d9/d51 0 2024-04-30T23:15:54.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/256: rmdir d2/d29 39 2024-04-30T23:15:54.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/257: dread - d2/de/d38/f3f zero size 2024-04-30T23:15:54.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/367: dwrite d0/d1b/d24/d2a/f46 [8388608,4194304] 0 2024-04-30T23:15:54.386 INFO:tasks.workunit.client.0.smithi100.stdout:8/258: rename d2/f4a to d2/d29/f4b 0 2024-04-30T23:15:54.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/368: symlink d0/df/l78 0 2024-04-30T23:15:54.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/369: fsync d0/d1b/d1e/f40 0 2024-04-30T23:15:54.388 INFO:tasks.workunit.client.0.smithi100.stdout:7/370: chown d0/df/l13 2896924 1 2024-04-30T23:15:54.388 INFO:tasks.workunit.client.0.smithi100.stdout:8/259: creat d2/de/d10/d17/f4c x:0 0 0 2024-04-30T23:15:54.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/371: rename d0/d1b/d24 to d0/d1d/d5e/d6a/d4b/d79 0 2024-04-30T23:15:54.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/372: truncate d0/d1b/d1e/f49 1402297 0 2024-04-30T23:15:54.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/373: truncate d0/d1b/f55 864936 0 2024-04-30T23:15:54.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/374: write d0/df/f14 [716945,1443] 0 2024-04-30T23:15:54.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/375: symlink d0/d1b/d2e/l7a 0 2024-04-30T23:15:54.395 INFO:tasks.workunit.client.0.smithi100.stdout:8/260: rename d2/d29/f4b to d2/de/f4d 0 2024-04-30T23:15:54.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/261: truncate d2/d7/f20 163375 0 2024-04-30T23:15:54.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/266: dwrite d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:15:54.397 INFO:tasks.workunit.client.0.smithi100.stdout:8/262: symlink d2/d7/d18/d3a/l4e 0 2024-04-30T23:15:54.400 INFO:tasks.workunit.client.0.smithi100.stdout:9/267: mkdir d4/d7/d8/d37/d58 0 2024-04-30T23:15:54.400 INFO:tasks.workunit.client.0.smithi100.stdout:9/268: write d4/d7/d8/d37/d3d/f40 [9035898,55370] 0 2024-04-30T23:15:54.402 INFO:tasks.workunit.client.0.smithi100.stdout:8/263: creat d2/de/d10/d17/f4f x:0 0 0 2024-04-30T23:15:54.404 INFO:tasks.workunit.client.0.smithi100.stdout:8/264: write d2/d7/f20 [237557,77051] 0 2024-04-30T23:15:54.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/265: rmdir d2/de/d10 39 2024-04-30T23:15:54.409 INFO:tasks.workunit.client.0.smithi100.stdout:8/266: rmdir d2/d7 39 2024-04-30T23:15:54.414 INFO:tasks.workunit.client.0.smithi100.stdout:7/376: dwrite d0/d1b/d60/d48/d4a/f4d [0,4194304] 0 2024-04-30T23:15:54.430 INFO:tasks.workunit.client.0.smithi100.stdout:8/267: dwrite d2/de/d38/f3f [0,4194304] 0 2024-04-30T23:15:54.430 INFO:tasks.workunit.client.0.smithi100.stdout:8/268: fdatasync d2/de/f4d 0 2024-04-30T23:15:54.433 INFO:tasks.workunit.client.0.smithi100.stdout:3/377: sync 2024-04-30T23:15:54.433 INFO:tasks.workunit.client.0.smithi100.stdout:0/378: sync 2024-04-30T23:15:54.433 INFO:tasks.workunit.client.0.smithi100.stdout:6/356: sync 2024-04-30T23:15:54.433 INFO:tasks.workunit.client.0.smithi100.stdout:4/419: sync 2024-04-30T23:15:54.433 INFO:tasks.workunit.client.0.smithi100.stdout:2/342: sync 2024-04-30T23:15:54.434 INFO:tasks.workunit.client.0.smithi100.stdout:4/420: stat d19/d1a/d21/d4a/d53/f76 0 2024-04-30T23:15:54.434 INFO:tasks.workunit.client.0.smithi100.stdout:2/343: rmdir d5/d58 39 2024-04-30T23:15:54.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/379: rmdir d2/d50/d30 39 2024-04-30T23:15:54.435 INFO:tasks.workunit.client.0.smithi100.stdout:0/380: dread - d2/d14/d35/d57/f78 zero size 2024-04-30T23:15:54.436 INFO:tasks.workunit.client.0.smithi100.stdout:6/357: rmdir d7/d11/d77 0 2024-04-30T23:15:54.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/378: truncate d1/ff 137433 0 2024-04-30T23:15:54.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/379: stat d1/d14/d15/d2c/d68/d26/l3f 0 2024-04-30T23:15:54.437 INFO:tasks.workunit.client.0.smithi100.stdout:3/380: read - d1/d14/d15/f6a zero size 2024-04-30T23:15:54.437 INFO:tasks.workunit.client.0.smithi100.stdout:4/421: creat d19/d1a/d6d/d4e/f84 x:0 0 0 2024-04-30T23:15:54.437 INFO:tasks.workunit.client.0.smithi100.stdout:4/422: readlink d19/d1a/d29/d65/l7b 0 2024-04-30T23:15:54.438 INFO:tasks.workunit.client.0.smithi100.stdout:3/381: unlink d1/d14/d15/d2c/d68/d26/c51 0 2024-04-30T23:15:54.448 INFO:tasks.workunit.client.0.smithi100.stdout:6/358: write d7/df/d23/d24/d2e/f69 [187753,88907] 0 2024-04-30T23:15:54.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/359: dread d7/d9/f51 [0,4194304] 0 2024-04-30T23:15:54.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/360: fsync d7/d1a/d1b/d22/f50 0 2024-04-30T23:15:54.464 INFO:tasks.workunit.client.0.smithi100.stdout:4/423: dread d19/d1a/d29/f5f [0,4194304] 0 2024-04-30T23:15:54.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/269: dwrite d2/de/f44 [0,4194304] 0 2024-04-30T23:15:54.465 INFO:tasks.workunit.client.0.smithi100.stdout:6/361: getdents d7/df/d23/d24/d2e/d37 0 2024-04-30T23:15:54.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/381: dwrite d2/f59 [0,4194304] 0 2024-04-30T23:15:54.466 INFO:tasks.workunit.client.0.smithi100.stdout:4/424: link d19/d1a/d6d/l7a d19/d1a/d21/d4a/d53/d5e/l85 0 2024-04-30T23:15:54.468 INFO:tasks.workunit.client.0.smithi100.stdout:6/362: creat d7/d11/d34/d4b/f7b x:0 0 0 2024-04-30T23:15:54.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/382: mknod d2/d4c/c7e 0 2024-04-30T23:15:54.471 INFO:tasks.workunit.client.0.smithi100.stdout:3/382: dwrite d1/d14/d21/f55 [0,4194304] 0 2024-04-30T23:15:54.471 INFO:tasks.workunit.client.0.smithi100.stdout:4/425: creat d19/d33/f86 x:0 0 0 2024-04-30T23:15:54.471 INFO:tasks.workunit.client.0.smithi100.stdout:4/426: chown d19/d1a/d6d/l7a 127190 1 2024-04-30T23:15:54.473 INFO:tasks.workunit.client.0.smithi100.stdout:6/363: creat d7/d1a/d3e/d6b/d75/f7c x:0 0 0 2024-04-30T23:15:54.474 INFO:tasks.workunit.client.0.smithi100.stdout:0/383: dread d2/d50/d30/f3d [0,4194304] 0 2024-04-30T23:15:54.476 INFO:tasks.workunit.client.0.smithi100.stdout:3/383: mkdir d1/d14/d15/d32/d6f 0 2024-04-30T23:15:54.477 INFO:tasks.workunit.client.0.smithi100.stdout:4/427: creat d19/d1a/d6d/d4e/d6e/f87 x:0 0 0 2024-04-30T23:15:54.478 INFO:tasks.workunit.client.0.smithi100.stdout:0/384: unlink d2/d14/d35/d40/l41 0 2024-04-30T23:15:54.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/428: symlink d19/d1a/d6d/d64/l88 0 2024-04-30T23:15:54.480 INFO:tasks.workunit.client.0.smithi100.stdout:8/270: dread d2/f8 [4194304,4194304] 0 2024-04-30T23:15:54.481 INFO:tasks.workunit.client.0.smithi100.stdout:0/385: mknod d2/d4c/d68/c7f 0 2024-04-30T23:15:54.482 INFO:tasks.workunit.client.0.smithi100.stdout:8/271: creat d2/f50 x:0 0 0 2024-04-30T23:15:54.483 INFO:tasks.workunit.client.0.smithi100.stdout:4/429: mknod d19/d1a/d6d/c89 0 2024-04-30T23:15:54.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/272: mkdir d2/de/d51 0 2024-04-30T23:15:54.484 INFO:tasks.workunit.client.0.smithi100.stdout:4/430: rmdir d19/d1a/d21 39 2024-04-30T23:15:54.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/384: dread d1/ff [0,4194304] 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/386: dread d2/d50/d30/f3d [0,4194304] 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/387: truncate d2/d14/d35/d40/f56 1528724 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/273: mkdir d2/de/d10/d52 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/274: write d2/f6 [907699,78261] 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/275: dread - d2/de/d10/d17/f46 zero size 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/388: mknod d2/d4c/d68/c80 0 2024-04-30T23:15:54.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/389: stat d2/d5a 0 2024-04-30T23:15:54.503 INFO:tasks.workunit.client.0.smithi100.stdout:6/364: dwrite d7/df/d23/d24/f5f [0,4194304] 0 2024-04-30T23:15:54.505 INFO:tasks.workunit.client.0.smithi100.stdout:6/365: rename d7/d1a/l2f to d7/d1a/d1b/d22/d38/l7d 0 2024-04-30T23:15:54.505 INFO:tasks.workunit.client.0.smithi100.stdout:6/366: chown d7/df 326782279 1 2024-04-30T23:15:54.505 INFO:tasks.workunit.client.0.smithi100.stdout:0/390: dread d2/d14/d18/f45 [0,4194304] 0 2024-04-30T23:15:54.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/391: mknod d2/c81 0 2024-04-30T23:15:54.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/392: write d2/d5a/f66 [188428,80272] 0 2024-04-30T23:15:54.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/393: chown d2/d14/d35/d40/f56 1481 1 2024-04-30T23:15:54.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/394: stat d2/d50/l4e 0 2024-04-30T23:15:54.514 INFO:tasks.workunit.client.0.smithi100.stdout:8/276: dwrite d2/de/d38/f3f [0,4194304] 0 2024-04-30T23:15:54.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/385: dwrite d1/fa [0,4194304] 0 2024-04-30T23:15:54.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/386: chown d1/f10 117452 1 2024-04-30T23:15:54.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/387: chown d1/d14/d15/f6a 12 1 2024-04-30T23:15:54.522 INFO:tasks.workunit.client.0.smithi100.stdout:6/367: write d7/d1a/d1b/f6f [3513791,71934] 0 2024-04-30T23:15:54.522 INFO:tasks.workunit.client.0.smithi100.stdout:6/368: chown d7/d9/f12 6816845 1 2024-04-30T23:15:54.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/431: dwrite d19/d33/d3f/f41 [0,4194304] 0 2024-04-30T23:15:54.526 INFO:tasks.workunit.client.0.smithi100.stdout:6/369: rename d7/df/l79 to d7/d1a/d1b/l7e 0 2024-04-30T23:15:54.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/370: mkdir d7/d1a/d1b/d22/d7f 0 2024-04-30T23:15:54.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/371: chown d7/df/d23/d4f 619 1 2024-04-30T23:15:54.531 INFO:tasks.workunit.client.0.smithi100.stdout:0/395: dread d2/d14/d35/f39 [0,4194304] 0 2024-04-30T23:15:54.531 INFO:tasks.workunit.client.0.smithi100.stdout:6/372: dread d7/df/d23/d24/d2e/d37/f5e [0,4194304] 0 2024-04-30T23:15:54.531 INFO:tasks.workunit.client.0.smithi100.stdout:6/373: chown d7/df/d23/d2b 121 1 2024-04-30T23:15:54.532 INFO:tasks.workunit.client.0.smithi100.stdout:0/396: symlink d2/d14/d18/l82 0 2024-04-30T23:15:54.545 INFO:tasks.workunit.client.0.smithi100.stdout:8/277: dwrite d2/d7/f45 [0,4194304] 0 2024-04-30T23:15:54.545 INFO:tasks.workunit.client.0.smithi100.stdout:6/374: dread d7/f52 [0,4194304] 0 2024-04-30T23:15:54.546 INFO:tasks.workunit.client.0.smithi100.stdout:3/388: dwrite d1/d14/d15/d27/d34/f54 [0,4194304] 0 2024-04-30T23:15:54.549 INFO:tasks.workunit.client.0.smithi100.stdout:3/389: mknod d1/d14/c70 0 2024-04-30T23:15:54.550 INFO:tasks.workunit.client.0.smithi100.stdout:4/432: dread d19/d1a/d21/d4a/f6a [0,4194304] 0 2024-04-30T23:15:54.550 INFO:tasks.workunit.client.0.smithi100.stdout:6/375: write d7/d1a/d1b/f6f [3565197,84193] 0 2024-04-30T23:15:54.551 INFO:tasks.workunit.client.0.smithi100.stdout:5/380: sync 2024-04-30T23:15:54.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/376: dread d7/df/f53 [0,4194304] 0 2024-04-30T23:15:54.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/377: stat d7/d9/f51 0 2024-04-30T23:15:54.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/378: creat d7/d1a/d1b/d22/d7f/f80 x:0 0 0 2024-04-30T23:15:54.558 INFO:tasks.workunit.client.0.smithi100.stdout:5/381: dread d1/f30 [0,4194304] 0 2024-04-30T23:15:54.558 INFO:tasks.workunit.client.0.smithi100.stdout:5/382: chown d1/d37/d5c 118291 1 2024-04-30T23:15:54.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/379: link d7/db/d3b/l60 d7/df/d23/l81 0 2024-04-30T23:15:54.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/380: fdatasync d7/d1a/d1b/d5a/f66 0 2024-04-30T23:15:54.559 INFO:tasks.workunit.client.0.smithi100.stdout:5/383: unlink d1/d37/l4f 0 2024-04-30T23:15:54.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/381: mknod d7/d9/c82 0 2024-04-30T23:15:54.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/384: mkdir d1/d19/d7f 0 2024-04-30T23:15:54.562 INFO:tasks.workunit.client.0.smithi100.stdout:5/385: symlink d1/d12/d1a/l80 0 2024-04-30T23:15:54.564 INFO:tasks.workunit.client.0.smithi100.stdout:5/386: rmdir d1/d12/d1a/d76/d77/d7b 0 2024-04-30T23:15:54.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/387: symlink d1/d12/d24/d34/l81 0 2024-04-30T23:15:54.567 INFO:tasks.workunit.client.0.smithi100.stdout:5/388: creat d1/d12/d27/f82 x:0 0 0 2024-04-30T23:15:54.568 INFO:tasks.workunit.client.0.smithi100.stdout:5/389: creat d1/d5f/f83 x:0 0 0 2024-04-30T23:15:54.568 INFO:tasks.workunit.client.0.smithi100.stdout:5/390: write d1/d12/d27/f29 [2080529,98852] 0 2024-04-30T23:15:54.570 INFO:tasks.workunit.client.0.smithi100.stdout:5/391: rename f0 to d1/d2c/d60/f84 0 2024-04-30T23:15:54.570 INFO:tasks.workunit.client.0.smithi100.stdout:5/392: readlink d1/d2c/d60/d66/l6c 0 2024-04-30T23:15:54.580 INFO:tasks.workunit.client.0.smithi100.stdout:4/433: dwrite d19/d1a/d21/f25 [0,4194304] 0 2024-04-30T23:15:54.581 INFO:tasks.workunit.client.0.smithi100.stdout:4/434: chown d19/d1a/d21/d4a/d53/d5e/l67 1014416234 1 2024-04-30T23:15:54.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/278: dwrite d2/de/d38/f3f [0,4194304] 0 2024-04-30T23:15:54.581 INFO:tasks.workunit.client.0.smithi100.stdout:4/435: rmdir d19/d1a/d21/d3c 39 2024-04-30T23:15:54.582 INFO:tasks.workunit.client.0.smithi100.stdout:8/279: creat d2/d29/f53 x:0 0 0 2024-04-30T23:15:54.583 INFO:tasks.workunit.client.0.smithi100.stdout:4/436: creat d19/d1a/d6d/d64/f8a x:0 0 0 2024-04-30T23:15:54.583 INFO:tasks.workunit.client.0.smithi100.stdout:4/437: truncate f13 2868807 0 2024-04-30T23:15:54.584 INFO:tasks.workunit.client.0.smithi100.stdout:8/280: creat d2/d7/d18/f54 x:0 0 0 2024-04-30T23:15:54.585 INFO:tasks.workunit.client.0.smithi100.stdout:4/438: creat d19/d1a/d21/f8b x:0 0 0 2024-04-30T23:15:54.585 INFO:tasks.workunit.client.0.smithi100.stdout:8/281: rmdir d2/de/d10 39 2024-04-30T23:15:54.586 INFO:tasks.workunit.client.0.smithi100.stdout:8/282: write d2/de/d10/d17/f1a [1658079,85316] 0 2024-04-30T23:15:54.586 INFO:tasks.workunit.client.0.smithi100.stdout:4/439: mkdir d19/d1a/d6d/d64/d78/d8c 0 2024-04-30T23:15:54.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/382: write d7/df/d23/d24/d2e/d37/f74 [444722,27720] 0 2024-04-30T23:15:54.593 INFO:tasks.workunit.client.0.smithi100.stdout:3/390: dwrite d1/d14/d2b/f4c [0,4194304] 0 2024-04-30T23:15:54.593 INFO:tasks.workunit.client.0.smithi100.stdout:5/393: dwrite d1/d12/d24/f25 [0,4194304] 0 2024-04-30T23:15:54.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/383: creat d7/db/d3b/f83 x:0 0 0 2024-04-30T23:15:54.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/394: mkdir d1/d37/d5c/d85 0 2024-04-30T23:15:54.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/395: stat d1/d12/d1a/d5b 0 2024-04-30T23:15:54.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/396: chown d1/d2c 22 1 2024-04-30T23:15:54.596 INFO:tasks.workunit.client.0.smithi100.stdout:5/397: creat d1/d2c/d60/f86 x:0 0 0 2024-04-30T23:15:54.597 INFO:tasks.workunit.client.0.smithi100.stdout:5/398: mknod d1/d12/d1a/d76/d77/c87 0 2024-04-30T23:15:54.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/399: link d1/c2b d1/d37/d5c/c88 0 2024-04-30T23:15:54.599 INFO:tasks.workunit.client.0.smithi100.stdout:5/400: link d1/d3e/f45 d1/d19/d7f/f89 0 2024-04-30T23:15:54.600 INFO:tasks.workunit.client.0.smithi100.stdout:5/401: chown d1/d12/d27/f29 171659 1 2024-04-30T23:15:54.602 INFO:tasks.workunit.client.0.smithi100.stdout:5/402: rmdir d1/d5e 0 2024-04-30T23:15:54.602 INFO:tasks.workunit.client.0.smithi100.stdout:5/403: chown d1/d12/f18 1440995815 1 2024-04-30T23:15:54.615 INFO:tasks.workunit.client.0.smithi100.stdout:3/391: dwrite d1/d14/d21/f55 [4194304,4194304] 0 2024-04-30T23:15:54.618 INFO:tasks.workunit.client.0.smithi100.stdout:5/404: write d1/d19/f1e [7441440,40293] 0 2024-04-30T23:15:54.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/384: dwrite d7/df/d23/d24/d2e/d37/f68 [0,4194304] 0 2024-04-30T23:15:54.634 INFO:tasks.workunit.client.0.smithi100.stdout:3/392: dread d1/f4a [0,4194304] 0 2024-04-30T23:15:54.639 INFO:tasks.workunit.client.0.smithi100.stdout:6/385: mkdir d7/df/d23/d2b/d42/d84 0 2024-04-30T23:15:54.639 INFO:tasks.workunit.client.0.smithi100.stdout:5/405: dwrite d1/d5f/f83 [0,4194304] 0 2024-04-30T23:15:54.644 INFO:tasks.workunit.client.0.smithi100.stdout:3/393: rename d1/d14/d21/d4d to d1/d14/d15/d32/d71 0 2024-04-30T23:15:54.644 INFO:tasks.workunit.client.0.smithi100.stdout:5/406: mknod d1/d12/d27/c8a 0 2024-04-30T23:15:54.645 INFO:tasks.workunit.client.0.smithi100.stdout:3/394: getdents d1 0 2024-04-30T23:15:54.646 INFO:tasks.workunit.client.0.smithi100.stdout:5/407: rename d1/d37/d5c/c88 to d1/d12/d74/c8b 0 2024-04-30T23:15:54.648 INFO:tasks.workunit.client.0.smithi100.stdout:5/408: unlink d1/l56 0 2024-04-30T23:15:54.648 INFO:tasks.workunit.client.0.smithi100.stdout:5/409: read - d1/d12/d1a/d76/f7a zero size 2024-04-30T23:15:54.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/410: truncate d1/f1b 2610092 0 2024-04-30T23:15:54.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/411: write d1/d12/f23 [1490162,102679] 0 2024-04-30T23:15:54.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/412: chown d1/l10 6 1 2024-04-30T23:15:54.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/413: chown d1/d12/d1a/f32 203908 1 2024-04-30T23:15:54.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/414: mkdir d1/d12/d1a/d76/d77/d8c 0 2024-04-30T23:15:54.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/415: rmdir d1/d12/d1a 39 2024-04-30T23:15:54.660 INFO:tasks.workunit.client.0.smithi100.stdout:6/386: dwrite d7/db/f5c [0,4194304] 0 2024-04-30T23:15:54.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/377: sync 2024-04-30T23:15:54.662 INFO:tasks.workunit.client.0.smithi100.stdout:9/269: sync 2024-04-30T23:15:54.663 INFO:tasks.workunit.client.0.smithi100.stdout:2/344: sync 2024-04-30T23:15:54.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/362: sync 2024-04-30T23:15:54.663 INFO:tasks.workunit.client.0.smithi100.stdout:2/345: dread - d5/d26/d2f/f5b zero size 2024-04-30T23:15:54.664 INFO:tasks.workunit.client.0.smithi100.stdout:2/346: truncate d5/d12/d13/d4b/f56 352426 0 2024-04-30T23:15:54.665 INFO:tasks.workunit.client.0.smithi100.stdout:7/378: rmdir d0 39 2024-04-30T23:15:54.667 INFO:tasks.workunit.client.0.smithi100.stdout:2/347: unlink d5/lf 0 2024-04-30T23:15:54.668 INFO:tasks.workunit.client.0.smithi100.stdout:2/348: stat d5/c6 0 2024-04-30T23:15:54.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/395: dwrite d1/f9 [4194304,4194304] 0 2024-04-30T23:15:54.670 INFO:tasks.workunit.client.0.smithi100.stdout:7/379: unlink d0/d1b/d60/d48/d4a/f4e 0 2024-04-30T23:15:54.670 INFO:tasks.workunit.client.0.smithi100.stdout:7/380: truncate d0/df/f39 1030652 0 2024-04-30T23:15:54.672 INFO:tasks.workunit.client.0.smithi100.stdout:2/349: symlink d5/d47/d4c/l6b 0 2024-04-30T23:15:54.675 INFO:tasks.workunit.client.0.smithi100.stdout:3/396: creat d1/d14/d15/f72 x:0 0 0 2024-04-30T23:15:54.675 INFO:tasks.workunit.client.0.smithi100.stdout:3/397: write d1/d14/d15/f20 [2333397,41337] 0 2024-04-30T23:15:54.675 INFO:tasks.workunit.client.0.smithi100.stdout:3/398: write d1/d14/d15/d27/f33 [2054553,42718] 0 2024-04-30T23:15:54.676 INFO:tasks.workunit.client.0.smithi100.stdout:7/381: creat d0/df/d4f/f7b x:0 0 0 2024-04-30T23:15:54.676 INFO:tasks.workunit.client.0.smithi100.stdout:7/382: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/f52 667347 0 2024-04-30T23:15:54.679 INFO:tasks.workunit.client.0.smithi100.stdout:5/416: dwrite d1/d12/d1a/f7e [0,4194304] 0 2024-04-30T23:15:54.682 INFO:tasks.workunit.client.0.smithi100.stdout:2/350: rmdir d5/d22 39 2024-04-30T23:15:54.682 INFO:tasks.workunit.client.0.smithi100.stdout:2/351: truncate d5/d26/d2f/f68 217314 0 2024-04-30T23:15:54.684 INFO:tasks.workunit.client.0.smithi100.stdout:7/383: getdents d0/d1b 0 2024-04-30T23:15:54.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/417: getdents d1/d19/d7f 0 2024-04-30T23:15:54.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/387: dwrite d7/d1a/d1b/d22/d7f/f80 [0,4194304] 0 2024-04-30T23:15:54.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/388: dread - d7/d1a/d1b/d22/f70 zero size 2024-04-30T23:15:54.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/352: truncate d5/d47/d4c/f51 266122 0 2024-04-30T23:15:54.692 INFO:tasks.workunit.client.0.smithi100.stdout:7/384: rename d0/d1d/d3c/d6f to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c 0 2024-04-30T23:15:54.692 INFO:tasks.workunit.client.0.smithi100.stdout:7/385: chown d0/d1d/d5e/d6a 1724312 1 2024-04-30T23:15:54.692 INFO:tasks.workunit.client.0.smithi100.stdout:7/386: chown d0/l1a 1 1 2024-04-30T23:15:54.703 INFO:tasks.workunit.client.0.smithi100.stdout:3/399: dwrite d1/d38/f60 [0,4194304] 0 2024-04-30T23:15:54.703 INFO:tasks.workunit.client.0.smithi100.stdout:3/400: stat d1/f4a 0 2024-04-30T23:15:54.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/389: write d7/df/d23/d24/d2e/f56 [2438043,15163] 0 2024-04-30T23:15:54.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/390: write d7/d1a/d1b/d22/f50 [4343558,11521] 0 2024-04-30T23:15:54.711 INFO:tasks.workunit.client.0.smithi100.stdout:5/418: dwrite d1/d19/f4a [0,4194304] 0 2024-04-30T23:15:54.713 INFO:tasks.workunit.client.0.smithi100.stdout:5/419: symlink d1/d12/d24/d34/l8d 0 2024-04-30T23:15:54.715 INFO:tasks.workunit.client.0.smithi100.stdout:5/420: mkdir d1/d12/d1a/d76/d8e 0 2024-04-30T23:15:54.715 INFO:tasks.workunit.client.0.smithi100.stdout:5/421: chown d1/d12/d27/f29 63528 1 2024-04-30T23:15:54.715 INFO:tasks.workunit.client.0.smithi100.stdout:5/422: write d1/f1b [806119,107794] 0 2024-04-30T23:15:54.716 INFO:tasks.workunit.client.0.smithi100.stdout:5/423: creat d1/d12/d1a/d5b/f8f x:0 0 0 2024-04-30T23:15:54.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/424: mknod d1/d19/d78/c90 0 2024-04-30T23:15:54.720 INFO:tasks.workunit.client.0.smithi100.stdout:5/425: rename d1/d12/d24/f25 to d1/d37/d5c/f91 0 2024-04-30T23:15:54.721 INFO:tasks.workunit.client.0.smithi100.stdout:2/353: dwrite d5/d26/d2f/f5b [0,4194304] 0 2024-04-30T23:15:54.721 INFO:tasks.workunit.client.0.smithi100.stdout:5/426: link d1/c2b d1/d5f/c92 0 2024-04-30T23:15:54.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/354: rename d5/d12/f1f to d5/d12/f6c 0 2024-04-30T23:15:54.726 INFO:tasks.workunit.client.0.smithi100.stdout:2/355: read d5/d12/d13/d4b/f56 [199258,50693] 0 2024-04-30T23:15:54.727 INFO:tasks.workunit.client.0.smithi100.stdout:2/356: creat d5/f6d x:0 0 0 2024-04-30T23:15:54.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/387: dwrite d0/f8 [0,4194304] 0 2024-04-30T23:15:54.728 INFO:tasks.workunit.client.0.smithi100.stdout:2/357: symlink d5/d26/d2f/d38/l6e 0 2024-04-30T23:15:54.731 INFO:tasks.workunit.client.0.smithi100.stdout:5/427: write d1/fe [509280,3084] 0 2024-04-30T23:15:54.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/388: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d 0 2024-04-30T23:15:54.737 INFO:tasks.workunit.client.0.smithi100.stdout:2/358: mknod d5/d26/c6f 0 2024-04-30T23:15:54.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/389: creat d0/d1d/d5e/d6a/d4b/f7e x:0 0 0 2024-04-30T23:15:54.740 INFO:tasks.workunit.client.0.smithi100.stdout:7/390: getdents d0/d1d/d5e/d6a/d4b/d79/d2a 0 2024-04-30T23:15:54.740 INFO:tasks.workunit.client.0.smithi100.stdout:7/391: truncate d0/d1d/d5e/d6a/f2d 746933 0 2024-04-30T23:15:54.740 INFO:tasks.workunit.client.0.smithi100.stdout:7/392: read - d0/d1b/d2e/f70 zero size 2024-04-30T23:15:54.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/428: dread d1/d3e/f45 [0,4194304] 0 2024-04-30T23:15:54.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/429: write d1/d12/d27/f82 [95429,119895] 0 2024-04-30T23:15:54.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/430: write d1/d12/f21 [3385180,70855] 0 2024-04-30T23:15:54.741 INFO:tasks.workunit.client.0.smithi100.stdout:0/397: sync 2024-04-30T23:15:54.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/398: truncate d2/d14/d18/f45 3629715 0 2024-04-30T23:15:54.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/399: chown d2/f52 16 1 2024-04-30T23:15:54.744 INFO:tasks.workunit.client.0.smithi100.stdout:0/400: mkdir d2/d14/d35/d40/d83 0 2024-04-30T23:15:54.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/401: creat d2/d50/d30/d32/f84 x:0 0 0 2024-04-30T23:15:54.751 INFO:tasks.workunit.client.0.smithi100.stdout:0/402: dread d2/d50/d30/f53 [0,4194304] 0 2024-04-30T23:15:54.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/403: unlink d2/d14/d18/c1c 0 2024-04-30T23:15:54.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/359: dwrite d5/f25 [0,4194304] 0 2024-04-30T23:15:54.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/360: fdatasync d5/d26/f4a 0 2024-04-30T23:15:54.774 INFO:tasks.workunit.client.0.smithi100.stdout:7/393: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f34 [0,4194304] 0 2024-04-30T23:15:54.774 INFO:tasks.workunit.client.0.smithi100.stdout:5/431: dwrite d1/d2c/f59 [0,4194304] 0 2024-04-30T23:15:54.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/394: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f 0 2024-04-30T23:15:54.776 INFO:tasks.workunit.client.0.smithi100.stdout:5/432: creat d1/d12/d74/f93 x:0 0 0 2024-04-30T23:15:54.777 INFO:tasks.workunit.client.0.smithi100.stdout:7/395: mkdir d0/d1b/d60/d80 0 2024-04-30T23:15:54.777 INFO:tasks.workunit.client.0.smithi100.stdout:7/396: fsync d0/f18 0 2024-04-30T23:15:54.778 INFO:tasks.workunit.client.0.smithi100.stdout:7/397: mknod d0/d1b/d60/d48/c81 0 2024-04-30T23:15:54.797 INFO:tasks.workunit.client.0.smithi100.stdout:7/398: write d0/d1d/d5e/d6a/f35 [1317074,41534] 0 2024-04-30T23:15:54.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/433: dwrite d1/d12/d27/f82 [0,4194304] 0 2024-04-30T23:15:54.810 INFO:tasks.workunit.client.0.smithi100.stdout:7/399: dread d0/d1b/d60/d48/d4a/f4c [0,4194304] 0 2024-04-30T23:15:54.811 INFO:tasks.workunit.client.0.smithi100.stdout:7/400: mknod d0/d1d/d5e/d6a/d4b/d79/c82 0 2024-04-30T23:15:54.812 INFO:tasks.workunit.client.0.smithi100.stdout:5/434: dread d1/d12/f23 [0,4194304] 0 2024-04-30T23:15:54.816 INFO:tasks.workunit.client.0.smithi100.stdout:7/401: dread d0/f18 [0,4194304] 0 2024-04-30T23:15:54.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/402: symlink d0/d1b/d60/l83 0 2024-04-30T23:15:54.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/403: dread - d0/d1b/d2e/f70 zero size 2024-04-30T23:15:54.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/404: fsync d0/f8 0 2024-04-30T23:15:54.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/405: readlink d0/d1b/d2e/d3d/l5d 0 2024-04-30T23:15:54.818 INFO:tasks.workunit.client.0.smithi100.stdout:7/406: truncate d0/df/f29 347010 0 2024-04-30T23:15:54.819 INFO:tasks.workunit.client.0.smithi100.stdout:7/407: link d0/d1d/c41 d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/c84 0 2024-04-30T23:15:54.841 INFO:tasks.workunit.client.0.smithi100.stdout:7/408: dwrite d0/d1b/d60/d48/d4a/f4c [4194304,4194304] 0 2024-04-30T23:15:54.842 INFO:tasks.workunit.client.0.smithi100.stdout:7/409: mkdir d0/d1b/d85 0 2024-04-30T23:15:54.842 INFO:tasks.workunit.client.0.smithi100.stdout:7/410: dread - d0/d1d/d5e/d6a/d4b/f7e zero size 2024-04-30T23:15:54.842 INFO:tasks.workunit.client.0.smithi100.stdout:7/411: chown d0/d1d/f6e 2440 1 2024-04-30T23:15:54.844 INFO:tasks.workunit.client.0.smithi100.stdout:7/412: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/f52 470164 0 2024-04-30T23:15:54.844 INFO:tasks.workunit.client.0.smithi100.stdout:7/413: stat d0/d1b/d2e/d3d/l5d 0 2024-04-30T23:15:54.844 INFO:tasks.workunit.client.0.smithi100.stdout:7/414: getdents d0/d1d/d5e/d6a/d4b/d79/d2a 0 2024-04-30T23:15:54.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/415: link d0/d1b/d60/l62 d0/d1d/d5e/d6a/d4b/d79/l86 0 2024-04-30T23:15:54.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/416: chown d0/l33 26763 1 2024-04-30T23:15:54.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/417: chown d0/d1b 15684115 1 2024-04-30T23:15:54.846 INFO:tasks.workunit.client.0.smithi100.stdout:7/418: mkdir d0/d1b/d60/d48/d4a/d87 0 2024-04-30T23:15:54.857 INFO:tasks.workunit.client.0.smithi100.stdout:7/419: dread d0/d1b/d2e/f32 [4194304,4194304] 0 2024-04-30T23:15:54.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/283: sync 2024-04-30T23:15:54.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/284: chown d2/de/d10/d17/l2f 0 1 2024-04-30T23:15:54.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/285: write d2/f3e [960651,89710] 0 2024-04-30T23:15:54.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/286: symlink d2/de/d10/l55 0 2024-04-30T23:15:54.964 INFO:tasks.workunit.client.0.smithi100.stdout:4/440: sync 2024-04-30T23:15:54.978 INFO:tasks.workunit.client.0.smithi100.stdout:4/441: read d19/d33/f5a [694782,9834] 0 2024-04-30T23:15:54.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/442: mknod d19/d33/d3f/c8d 0 2024-04-30T23:15:54.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/443: chown d19/c2e 1398116290 1 2024-04-30T23:15:54.996 INFO:tasks.workunit.client.0.smithi100.stdout:4/444: dwrite d19/f27 [0,4194304] 0 2024-04-30T23:15:54.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/445: unlink l10 0 2024-04-30T23:15:55.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/446: dwrite d19/d1a/d21/f2b [0,4194304] 0 2024-04-30T23:15:55.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/447: read - d19/d1a/d21/d4a/d53/d5d/f72 zero size 2024-04-30T23:15:55.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:54 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:55.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:54 smithi104 ceph-mon[32987]: pgmap v442: 129 pgs: 129 active+clean; 581 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 66 MiB/s wr, 404 op/s 2024-04-30T23:15:55.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/448: dwrite d19/d1a/d21/d4a/d53/d5d/f72 [0,4194304] 0 2024-04-30T23:15:55.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/449: mknod d19/d33/d3f/d40/c8e 0 2024-04-30T23:15:55.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:54 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:55.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:54 smithi183 ceph-mon[33560]: pgmap v442: 129 pgs: 129 active+clean; 581 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 66 MiB/s wr, 404 op/s 2024-04-30T23:15:55.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/450: dwrite d19/d1a/d21/f25 [0,4194304] 0 2024-04-30T23:15:55.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/451: fsync d19/f2f 0 2024-04-30T23:15:55.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/452: rmdir d19/d33/d3f/d40 39 2024-04-30T23:15:55.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:54 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:15:55.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:54 smithi100 ceph-mon[29745]: pgmap v442: 129 pgs: 129 active+clean; 581 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s rd, 66 MiB/s wr, 404 op/s 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:9/270: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:1/363: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:3/401: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:8/287: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:5/435: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:7/420: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:8/288: read d2/d7/f26 [3758849,14037] 0 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:0/404: sync 2024-04-30T23:15:55.079 INFO:tasks.workunit.client.0.smithi100.stdout:8/289: write d2/f3e [1338943,93861] 0 2024-04-30T23:15:55.080 INFO:tasks.workunit.client.0.smithi100.stdout:0/405: write d2/d14/d35/d57/f78 [21016,48414] 0 2024-04-30T23:15:55.080 INFO:tasks.workunit.client.0.smithi100.stdout:6/391: sync 2024-04-30T23:15:55.080 INFO:tasks.workunit.client.0.smithi100.stdout:2/361: sync 2024-04-30T23:15:55.080 INFO:tasks.workunit.client.0.smithi100.stdout:9/271: unlink d4/d7/c46 0 2024-04-30T23:15:55.081 INFO:tasks.workunit.client.0.smithi100.stdout:3/402: link d1/f13 d1/d14/f73 0 2024-04-30T23:15:55.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/403: readlink d1/d14/d15/d32/l4b 0 2024-04-30T23:15:55.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/404: chown d1/d14/d15/d2c/l56 781439814 1 2024-04-30T23:15:55.082 INFO:tasks.workunit.client.0.smithi100.stdout:8/290: mknod d2/de/d10/c56 0 2024-04-30T23:15:55.082 INFO:tasks.workunit.client.0.smithi100.stdout:8/291: chown d2/de/d10/c28 28879553 1 2024-04-30T23:15:55.083 INFO:tasks.workunit.client.0.smithi100.stdout:0/406: symlink d2/d4c/d68/l85 0 2024-04-30T23:15:55.084 INFO:tasks.workunit.client.0.smithi100.stdout:6/392: unlink d7/df/d23/f4e 0 2024-04-30T23:15:55.085 INFO:tasks.workunit.client.0.smithi100.stdout:4/453: dread d19/d33/f31 [0,4194304] 0 2024-04-30T23:15:55.085 INFO:tasks.workunit.client.0.smithi100.stdout:9/272: creat d4/d7/d8/d37/f59 x:0 0 0 2024-04-30T23:15:55.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/405: link d1/d14/d15/d27/d34/f6e d1/d14/d15/d2c/d68/f74 0 2024-04-30T23:15:55.087 INFO:tasks.workunit.client.0.smithi100.stdout:3/406: fdatasync d1/d14/d2b/f4c 0 2024-04-30T23:15:55.087 INFO:tasks.workunit.client.0.smithi100.stdout:8/292: symlink d2/d29/l57 0 2024-04-30T23:15:55.088 INFO:tasks.workunit.client.0.smithi100.stdout:0/407: mknod d2/d14/d35/d40/c86 0 2024-04-30T23:15:55.089 INFO:tasks.workunit.client.0.smithi100.stdout:6/393: rename d7/d11/d57 to d7/df/d23/d24/d2e/d37/d85 0 2024-04-30T23:15:55.090 INFO:tasks.workunit.client.0.smithi100.stdout:2/362: mkdir d5/d12/d70 0 2024-04-30T23:15:55.090 INFO:tasks.workunit.client.0.smithi100.stdout:2/363: fsync d5/d26/d2f/d38/f43 0 2024-04-30T23:15:55.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/273: unlink d4/l48 0 2024-04-30T23:15:55.094 INFO:tasks.workunit.client.0.smithi100.stdout:0/408: symlink d2/d50/d38/d5d/l87 0 2024-04-30T23:15:55.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/364: rmdir d5/d26 39 2024-04-30T23:15:55.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/365: readlink d5/d26/d2f/d38/l6e 0 2024-04-30T23:15:55.097 INFO:tasks.workunit.client.0.smithi100.stdout:9/274: truncate f2 2131332 0 2024-04-30T23:15:55.101 INFO:tasks.workunit.client.0.smithi100.stdout:6/394: truncate d7/db/d3b/f58 4013430 0 2024-04-30T23:15:55.102 INFO:tasks.workunit.client.0.smithi100.stdout:6/395: dread - d7/db/d3b/f6d zero size 2024-04-30T23:15:55.103 INFO:tasks.workunit.client.0.smithi100.stdout:2/366: symlink d5/d12/l71 0 2024-04-30T23:15:55.103 INFO:tasks.workunit.client.0.smithi100.stdout:2/367: read f1 [4079537,69054] 0 2024-04-30T23:15:55.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/364: dread d3/f5 [0,4194304] 0 2024-04-30T23:15:55.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/365: fdatasync d3/d16/d20/d24/d69/f46 0 2024-04-30T23:15:55.106 INFO:tasks.workunit.client.0.smithi100.stdout:2/368: mkdir d5/d12/d13/d72 0 2024-04-30T23:15:55.112 INFO:tasks.workunit.client.0.smithi100.stdout:1/366: unlink d3/d18/f5b 0 2024-04-30T23:15:55.114 INFO:tasks.workunit.client.0.smithi100.stdout:2/369: mkdir d5/d12/d73 0 2024-04-30T23:15:55.117 INFO:tasks.workunit.client.0.smithi100.stdout:2/370: truncate d5/d12/f3c 382424 0 2024-04-30T23:15:55.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/421: dwrite d0/d1d/d5e/d6a/d4b/d79/f2f [0,4194304] 0 2024-04-30T23:15:55.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/422: fsync d0/d1d/d5e/d6a/f35 0 2024-04-30T23:15:55.119 INFO:tasks.workunit.client.0.smithi100.stdout:7/423: fdatasync d0/d1b/d2e/f70 0 2024-04-30T23:15:55.122 INFO:tasks.workunit.client.0.smithi100.stdout:5/436: dwrite d1/d12/d27/f29 [0,4194304] 0 2024-04-30T23:15:55.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/371: rename d5/cb to d5/d12/d13/c74 0 2024-04-30T23:15:55.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/372: chown d5/d58/f65 1 1 2024-04-30T23:15:55.124 INFO:tasks.workunit.client.0.smithi100.stdout:4/454: dwrite f9 [4194304,4194304] 0 2024-04-30T23:15:55.125 INFO:tasks.workunit.client.0.smithi100.stdout:3/407: dwrite d1/d14/d15/d32/f40 [0,4194304] 0 2024-04-30T23:15:55.126 INFO:tasks.workunit.client.0.smithi100.stdout:1/367: dread d3/f4d [0,4194304] 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:6/396: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:6/397: stat d7/df/d23/d2b/d42/d84 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:6/398: readlink l2 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:7/424: creat d0/d1d/d5e/d6a/d4b/d79/d2a/f88 x:0 0 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:7/425: readlink d0/d1b/l44 0 2024-04-30T23:15:55.132 INFO:tasks.workunit.client.0.smithi100.stdout:8/293: dwrite d2/d29/f53 [0,4194304] 0 2024-04-30T23:15:55.133 INFO:tasks.workunit.client.0.smithi100.stdout:5/437: creat d1/d2c/d60/d66/d71/f94 x:0 0 0 2024-04-30T23:15:55.133 INFO:tasks.workunit.client.0.smithi100.stdout:5/438: chown d1/d12/d1a/d76/d8e 27205293 1 2024-04-30T23:15:55.136 INFO:tasks.workunit.client.0.smithi100.stdout:2/373: rename d5/d12/d13/d4b/f56 to d5/d26/d2f/d38/f75 0 2024-04-30T23:15:55.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/408: rename d1/d14/d15 to d1/d14/d15/d27/d5d/d75 22 2024-04-30T23:15:55.139 INFO:tasks.workunit.client.0.smithi100.stdout:6/399: rmdir d7/d1a/d1b/d22 39 2024-04-30T23:15:55.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/275: dwrite d4/d9/d10/f3a [0,4194304] 0 2024-04-30T23:15:55.142 INFO:tasks.workunit.client.0.smithi100.stdout:7/426: symlink d0/d1d/d3f/l89 0 2024-04-30T23:15:55.144 INFO:tasks.workunit.client.0.smithi100.stdout:0/409: dwrite d2/f65 [0,4194304] 0 2024-04-30T23:15:55.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/427: write d0/df/f29 [196950,89930] 0 2024-04-30T23:15:55.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/294: rmdir d2/de/d51 0 2024-04-30T23:15:55.148 INFO:tasks.workunit.client.0.smithi100.stdout:5/439: rename d1/d12/d1a/d5b/f8f to d1/d37/d5c/f95 0 2024-04-30T23:15:55.149 INFO:tasks.workunit.client.0.smithi100.stdout:3/409: rename d1/d14/f19 to d1/d14/f76 0 2024-04-30T23:15:55.151 INFO:tasks.workunit.client.0.smithi100.stdout:2/374: symlink d5/d58/l76 0 2024-04-30T23:15:55.151 INFO:tasks.workunit.client.0.smithi100.stdout:2/375: fdatasync d5/d26/f4a 0 2024-04-30T23:15:55.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/276: symlink d4/d7/d8/d19/l5a 0 2024-04-30T23:15:55.158 INFO:tasks.workunit.client.0.smithi100.stdout:7/428: symlink d0/d1d/d3c/l8a 0 2024-04-30T23:15:55.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/295: creat d2/d29/f58 x:0 0 0 2024-04-30T23:15:55.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/296: write d2/f9 [4450039,108959] 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/410: read d2/f65 [651645,26404] 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/411: read - d2/d50/f71 zero size 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/455: dwrite d19/d33/f86 [0,4194304] 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/412: write d2/d14/d35/d57/f78 [469910,119148] 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/413: fsync d2/d14/d35/d57/f60 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:6/400: rename d7/d1a to d7/d9/d86 0 2024-04-30T23:15:55.162 INFO:tasks.workunit.client.0.smithi100.stdout:6/401: write d7/df/d23/d24/d2e/d37/f74 [641361,89128] 0 2024-04-30T23:15:55.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/376: unlink d5/d12/d13/f17 0 2024-04-30T23:15:55.164 INFO:tasks.workunit.client.0.smithi100.stdout:9/277: mknod d4/d7/c5b 0 2024-04-30T23:15:55.165 INFO:tasks.workunit.client.0.smithi100.stdout:7/429: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/l8b 0 2024-04-30T23:15:55.167 INFO:tasks.workunit.client.0.smithi100.stdout:1/368: dwrite d3/d18/f5d [0,4194304] 0 2024-04-30T23:15:55.167 INFO:tasks.workunit.client.0.smithi100.stdout:1/369: fsync d3/f4 0 2024-04-30T23:15:55.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/440: write d1/d5f/f83 [3385860,27151] 0 2024-04-30T23:15:55.167 INFO:tasks.workunit.client.0.smithi100.stdout:8/297: link d2/d7/l23 d2/d7/d18/d3a/l59 0 2024-04-30T23:15:55.171 INFO:tasks.workunit.client.0.smithi100.stdout:4/456: unlink d19/d1a/d21/d4a/d53/d5e/l85 0 2024-04-30T23:15:55.171 INFO:tasks.workunit.client.0.smithi100.stdout:4/457: fdatasync d19/d1a/d21/d4a/d53/f70 0 2024-04-30T23:15:55.172 INFO:tasks.workunit.client.0.smithi100.stdout:0/414: rmdir d2/d50 39 2024-04-30T23:15:55.174 INFO:tasks.workunit.client.0.smithi100.stdout:6/402: unlink d7/d9/d86/d1b/d3f/l6a 0 2024-04-30T23:15:55.175 INFO:tasks.workunit.client.0.smithi100.stdout:9/278: symlink d4/d9/l5c 0 2024-04-30T23:15:55.175 INFO:tasks.workunit.client.0.smithi100.stdout:9/279: truncate d4/fd 2607992 0 2024-04-30T23:15:55.176 INFO:tasks.workunit.client.0.smithi100.stdout:9/280: fsync d4/d7/d8/d37/f59 0 2024-04-30T23:15:55.176 INFO:tasks.workunit.client.0.smithi100.stdout:9/281: chown d4/d9/l5c 2140405469 1 2024-04-30T23:15:55.176 INFO:tasks.workunit.client.0.smithi100.stdout:3/410: dwrite d1/d14/d15/d2c/d68/d26/f23 [0,4194304] 0 2024-04-30T23:15:55.180 INFO:tasks.workunit.client.0.smithi100.stdout:1/370: creat d3/d16/d20/d24/d51/f70 x:0 0 0 2024-04-30T23:15:55.181 INFO:tasks.workunit.client.0.smithi100.stdout:5/441: mknod d1/d12/d1a/d76/c96 0 2024-04-30T23:15:55.182 INFO:tasks.workunit.client.0.smithi100.stdout:8/298: getdents d2/de/d38 0 2024-04-30T23:15:55.183 INFO:tasks.workunit.client.0.smithi100.stdout:4/458: creat d19/d1a/d21/d4a/d53/f8f x:0 0 0 2024-04-30T23:15:55.185 INFO:tasks.workunit.client.0.smithi100.stdout:6/403: mkdir d7/df/d23/d2b/d42/d87 0 2024-04-30T23:15:55.188 INFO:tasks.workunit.client.0.smithi100.stdout:1/371: creat d3/d16/d20/d24/d69/f71 x:0 0 0 2024-04-30T23:15:55.188 INFO:tasks.workunit.client.0.smithi100.stdout:1/372: chown d3/d16/l49 15638 1 2024-04-30T23:15:55.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/377: dwrite d5/d26/d2f/d38/f75 [0,4194304] 0 2024-04-30T23:15:55.190 INFO:tasks.workunit.client.0.smithi100.stdout:2/378: chown d5/c6 197194774 1 2024-04-30T23:15:55.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/442: creat d1/d12/d1a/d76/d77/f97 x:0 0 0 2024-04-30T23:15:55.192 INFO:tasks.workunit.client.0.smithi100.stdout:4/459: mknod d19/d1a/d21/d4a/d53/c90 0 2024-04-30T23:15:55.192 INFO:tasks.workunit.client.0.smithi100.stdout:8/299: dread d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:55.193 INFO:tasks.workunit.client.0.smithi100.stdout:8/300: chown d2/f3e 95801519 1 2024-04-30T23:15:55.193 INFO:tasks.workunit.client.0.smithi100.stdout:6/404: creat d7/d9/d86/d1b/f88 x:0 0 0 2024-04-30T23:15:55.195 INFO:tasks.workunit.client.0.smithi100.stdout:2/379: creat d5/d26/f77 x:0 0 0 2024-04-30T23:15:55.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/443: truncate d1/d12/f23 1066987 0 2024-04-30T23:15:55.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/411: dread d1/d14/d15/d2c/d68/f39 [0,4194304] 0 2024-04-30T23:15:55.197 INFO:tasks.workunit.client.0.smithi100.stdout:8/301: creat d2/de/d10/d17/f5a x:0 0 0 2024-04-30T23:15:55.200 INFO:tasks.workunit.client.0.smithi100.stdout:6/405: creat d7/f89 x:0 0 0 2024-04-30T23:15:55.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/302: mknod d2/de/d10/d52/c5b 0 2024-04-30T23:15:55.203 INFO:tasks.workunit.client.0.smithi100.stdout:5/444: dread d1/d12/f15 [0,4194304] 0 2024-04-30T23:15:55.203 INFO:tasks.workunit.client.0.smithi100.stdout:5/445: chown d1/c2b 282700270 1 2024-04-30T23:15:55.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/415: dwrite d2/d50/d30/d32/f3b [4194304,4194304] 0 2024-04-30T23:15:55.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/416: fsync d2/d14/d18/f2d 0 2024-04-30T23:15:55.205 INFO:tasks.workunit.client.0.smithi100.stdout:0/417: stat d2/d4c/d68/c80 0 2024-04-30T23:15:55.205 INFO:tasks.workunit.client.0.smithi100.stdout:0/418: read d2/f23 [3597628,74083] 0 2024-04-30T23:15:55.205 INFO:tasks.workunit.client.0.smithi100.stdout:6/406: unlink d7/d9/d86/d1b/d22/f50 0 2024-04-30T23:15:55.207 INFO:tasks.workunit.client.0.smithi100.stdout:9/282: dwrite d4/d7/d8/f36 [0,4194304] 0 2024-04-30T23:15:55.208 INFO:tasks.workunit.client.0.smithi100.stdout:4/460: dread d19/f2f [0,4194304] 0 2024-04-30T23:15:55.209 INFO:tasks.workunit.client.0.smithi100.stdout:8/303: link d2/d29/l57 d2/d7/d18/d3a/l5c 0 2024-04-30T23:15:55.210 INFO:tasks.workunit.client.0.smithi100.stdout:2/380: dread d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:15:55.210 INFO:tasks.workunit.client.0.smithi100.stdout:2/381: read d5/d26/d2f/d38/f43 [4052032,8407] 0 2024-04-30T23:15:55.210 INFO:tasks.workunit.client.0.smithi100.stdout:5/446: symlink d1/d12/d24/l98 0 2024-04-30T23:15:55.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/419: symlink d2/d14/d35/d57/l88 0 2024-04-30T23:15:55.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/420: dread - d2/f52 zero size 2024-04-30T23:15:55.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/421: chown d2/d14/d18/l54 26253196 1 2024-04-30T23:15:55.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/407: symlink d7/df/d23/d2b/l8a 0 2024-04-30T23:15:55.217 INFO:tasks.workunit.client.0.smithi100.stdout:9/283: mkdir d4/d7/d5d 0 2024-04-30T23:15:55.219 INFO:tasks.workunit.client.0.smithi100.stdout:4/461: dread d19/d1a/f48 [0,4194304] 0 2024-04-30T23:15:55.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/304: unlink d2/de/fa 0 2024-04-30T23:15:55.220 INFO:tasks.workunit.client.0.smithi100.stdout:3/412: dread d1/d14/d15/f44 [0,4194304] 0 2024-04-30T23:15:55.221 INFO:tasks.workunit.client.0.smithi100.stdout:5/447: mkdir d1/d3e/d99 0 2024-04-30T23:15:55.221 INFO:tasks.workunit.client.0.smithi100.stdout:1/373: dwrite d3/f58 [0,4194304] 0 2024-04-30T23:15:55.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/382: dread d5/fe [0,4194304] 0 2024-04-30T23:15:55.223 INFO:tasks.workunit.client.0.smithi100.stdout:6/408: creat d7/df/d23/d2b/d42/d87/f8b x:0 0 0 2024-04-30T23:15:55.224 INFO:tasks.workunit.client.0.smithi100.stdout:8/305: symlink d2/d29/l5d 0 2024-04-30T23:15:55.227 INFO:tasks.workunit.client.0.smithi100.stdout:3/413: link d1/d14/d15/d2c/d68/f6b d1/d14/d21/d67/f77 0 2024-04-30T23:15:55.230 INFO:tasks.workunit.client.0.smithi100.stdout:5/448: unlink d1/d12/d1a/f3d 0 2024-04-30T23:15:55.235 INFO:tasks.workunit.client.0.smithi100.stdout:6/409: link d7/d9/l17 d7/d9/d86/d1b/d5a/l8c 0 2024-04-30T23:15:55.235 INFO:tasks.workunit.client.0.smithi100.stdout:4/462: dread d19/d1a/d21/d3c/f55 [0,4194304] 0 2024-04-30T23:15:55.236 INFO:tasks.workunit.client.0.smithi100.stdout:2/383: mknod d5/d26/c78 0 2024-04-30T23:15:55.236 INFO:tasks.workunit.client.0.smithi100.stdout:2/384: chown d5/d2e/c67 2731 1 2024-04-30T23:15:55.238 INFO:tasks.workunit.client.0.smithi100.stdout:8/306: rename d2/d7/l27 to d2/d7/d18/l5e 0 2024-04-30T23:15:55.239 INFO:tasks.workunit.client.0.smithi100.stdout:9/284: dread f0 [0,4194304] 0 2024-04-30T23:15:55.243 INFO:tasks.workunit.client.0.smithi100.stdout:3/414: truncate d1/d14/d15/d27/f33 476489 0 2024-04-30T23:15:55.244 INFO:tasks.workunit.client.0.smithi100.stdout:5/449: mknod d1/d12/c9a 0 2024-04-30T23:15:55.245 INFO:tasks.workunit.client.0.smithi100.stdout:4/463: rename d19/d33/c81 to d19/d33/d3f/c91 0 2024-04-30T23:15:55.246 INFO:tasks.workunit.client.0.smithi100.stdout:7/430: dwrite d0/d1d/d5e/d6a/f2d [0,4194304] 0 2024-04-30T23:15:55.247 INFO:tasks.workunit.client.0.smithi100.stdout:0/422: dread d2/d14/d35/f39 [0,4194304] 0 2024-04-30T23:15:55.247 INFO:tasks.workunit.client.0.smithi100.stdout:9/285: rename d4/f2a to d4/f5e 0 2024-04-30T23:15:55.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/374: dwrite d3/d16/d20/d24/f6e [0,4194304] 0 2024-04-30T23:15:55.251 INFO:tasks.workunit.client.0.smithi100.stdout:3/415: unlink d1/d14/d15/d2c/d68/d26/l5b 0 2024-04-30T23:15:55.252 INFO:tasks.workunit.client.0.smithi100.stdout:5/450: mkdir d1/d3e/d9b 0 2024-04-30T23:15:55.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/464: rmdir d19/d1a/d21 39 2024-04-30T23:15:55.261 INFO:tasks.workunit.client.0.smithi100.stdout:7/431: creat d0/d1b/d60/d48/d4a/d87/f8c x:0 0 0 2024-04-30T23:15:55.261 INFO:tasks.workunit.client.0.smithi100.stdout:7/432: chown d0/d1b/d85 86284 1 2024-04-30T23:15:55.262 INFO:tasks.workunit.client.0.smithi100.stdout:8/307: dread d2/d7/f45 [0,4194304] 0 2024-04-30T23:15:55.266 INFO:tasks.workunit.client.0.smithi100.stdout:3/416: creat d1/d38/f78 x:0 0 0 2024-04-30T23:15:55.266 INFO:tasks.workunit.client.0.smithi100.stdout:5/451: chown d1/l13 976200 1 2024-04-30T23:15:55.269 INFO:tasks.workunit.client.0.smithi100.stdout:8/308: truncate d2/d29/f47 5331694 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/385: dwrite d5/d2e/f35 [0,4194304] 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/286: write f0 [5141100,87492] 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/287: write d4/f5e [330626,27892] 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/288: chown d4/d7/d8/d37/l43 5950852 1 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/289: write d4/d7/d8/d37/f4b [75794,41939] 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:8/309: write d2/d7/d18/d3a/f3d [132398,50431] 0 2024-04-30T23:15:55.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/452: creat d1/d12/d1a/d76/d77/d8c/f9c x:0 0 0 2024-04-30T23:15:55.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/453: dread - d1/d2c/d60/f86 zero size 2024-04-30T23:15:55.273 INFO:tasks.workunit.client.0.smithi100.stdout:4/465: creat d19/d1a/d45/f92 x:0 0 0 2024-04-30T23:15:55.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/433: dread d0/d1b/d1e/f28 [0,4194304] 0 2024-04-30T23:15:55.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/386: creat d5/d12/d13/f79 x:0 0 0 2024-04-30T23:15:55.275 INFO:tasks.workunit.client.0.smithi100.stdout:9/290: creat d4/d9/d50/f5f x:0 0 0 2024-04-30T23:15:55.275 INFO:tasks.workunit.client.0.smithi100.stdout:9/291: readlink d4/d7/l20 0 2024-04-30T23:15:55.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/387: write d5/d26/d2f/f36 [1622471,84005] 0 2024-04-30T23:15:55.276 INFO:tasks.workunit.client.0.smithi100.stdout:8/310: symlink d2/de/d10/d17/l5f 0 2024-04-30T23:15:55.276 INFO:tasks.workunit.client.0.smithi100.stdout:8/311: chown d2/de/d38 19137247 1 2024-04-30T23:15:55.277 INFO:tasks.workunit.client.0.smithi100.stdout:5/454: creat d1/d37/f9d x:0 0 0 2024-04-30T23:15:55.278 INFO:tasks.workunit.client.0.smithi100.stdout:4/466: creat d19/f93 x:0 0 0 2024-04-30T23:15:55.279 INFO:tasks.workunit.client.0.smithi100.stdout:7/434: rmdir d0/d1d/d5e/d6a/d4b 39 2024-04-30T23:15:55.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/312: link d2/d7/d18/f54 d2/d29/f60 0 2024-04-30T23:15:55.282 INFO:tasks.workunit.client.0.smithi100.stdout:4/467: symlink d19/d1a/d45/l94 0 2024-04-30T23:15:55.282 INFO:tasks.workunit.client.0.smithi100.stdout:4/468: read - d19/d1a/d21/d4a/d53/f70 zero size 2024-04-30T23:15:55.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/292: dread f2 [0,4194304] 0 2024-04-30T23:15:55.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/435: mknod d0/d1d/d5e/c8d 0 2024-04-30T23:15:55.284 INFO:tasks.workunit.client.0.smithi100.stdout:7/436: write d0/df/d4f/f7b [164630,76638] 0 2024-04-30T23:15:55.285 INFO:tasks.workunit.client.0.smithi100.stdout:8/313: creat d2/d29/f61 x:0 0 0 2024-04-30T23:15:55.288 INFO:tasks.workunit.client.0.smithi100.stdout:7/437: creat d0/d1b/d60/d48/f8e x:0 0 0 2024-04-30T23:15:55.289 INFO:tasks.workunit.client.0.smithi100.stdout:7/438: read - d0/d1d/d5e/d6a/d4b/f7e zero size 2024-04-30T23:15:55.289 INFO:tasks.workunit.client.0.smithi100.stdout:7/439: write d0/d1b/d60/d48/f64 [2864497,120093] 0 2024-04-30T23:15:55.290 INFO:tasks.workunit.client.0.smithi100.stdout:8/314: mknod d2/c62 0 2024-04-30T23:15:55.290 INFO:tasks.workunit.client.0.smithi100.stdout:8/315: rename d2 to d2/de/d38/d63 22 2024-04-30T23:15:55.291 INFO:tasks.workunit.client.0.smithi100.stdout:4/469: mkdir d19/d1a/d95 0 2024-04-30T23:15:55.292 INFO:tasks.workunit.client.0.smithi100.stdout:3/417: dwrite d1/fa [0,4194304] 0 2024-04-30T23:15:55.292 INFO:tasks.workunit.client.0.smithi100.stdout:3/418: write d1/d14/d15/f72 [663420,44543] 0 2024-04-30T23:15:55.292 INFO:tasks.workunit.client.0.smithi100.stdout:3/419: chown d1/ff 191 1 2024-04-30T23:15:55.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/440: creat d0/d1b/d60/d80/f8f x:0 0 0 2024-04-30T23:15:55.294 INFO:tasks.workunit.client.0.smithi100.stdout:9/293: dread d4/d7/f38 [0,4194304] 0 2024-04-30T23:15:55.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/316: mknod d2/de/d10/c64 0 2024-04-30T23:15:55.295 INFO:tasks.workunit.client.0.smithi100.stdout:4/470: creat d19/d1a/d21/d4a/d53/d5d/f96 x:0 0 0 2024-04-30T23:15:55.297 INFO:tasks.workunit.client.0.smithi100.stdout:2/388: read d5/d2e/f35 [3634739,95292] 0 2024-04-30T23:15:55.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/441: creat d0/d1b/d60/d80/f90 x:0 0 0 2024-04-30T23:15:55.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/442: fdatasync d0/d1b/d60/d48/f50 0 2024-04-30T23:15:55.298 INFO:tasks.workunit.client.0.smithi100.stdout:8/317: rename d2/de/d10/d17/f5a to d2/de/d10/d52/f65 0 2024-04-30T23:15:55.299 INFO:tasks.workunit.client.0.smithi100.stdout:4/471: creat d19/d33/d3f/d40/f97 x:0 0 0 2024-04-30T23:15:55.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/389: symlink d5/d22/l7a 0 2024-04-30T23:15:55.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/390: chown d5/d22/f40 93790 1 2024-04-30T23:15:55.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/455: dread d1/d2c/d60/f84 [0,4194304] 0 2024-04-30T23:15:55.302 INFO:tasks.workunit.client.0.smithi100.stdout:5/456: dread - d1/d12/d1a/d76/d77/f97 zero size 2024-04-30T23:15:55.302 INFO:tasks.workunit.client.0.smithi100.stdout:7/443: unlink d0/df/l45 0 2024-04-30T23:15:55.304 INFO:tasks.workunit.client.0.smithi100.stdout:5/457: symlink d1/d12/d24/l9e 0 2024-04-30T23:15:55.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/458: dread d1/f30 [0,4194304] 0 2024-04-30T23:15:55.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/459: write d1/d12/f73 [6740372,106704] 0 2024-04-30T23:15:55.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/460: stat d1/d12/d27/f29 0 2024-04-30T23:15:55.312 INFO:tasks.workunit.client.0.smithi100.stdout:8/318: dread d2/de/d10/f19 [0,4194304] 0 2024-04-30T23:15:55.312 INFO:tasks.workunit.client.0.smithi100.stdout:8/319: truncate d2/de/d10/d17/f4f 672182 0 2024-04-30T23:15:55.318 INFO:tasks.workunit.client.0.smithi100.stdout:9/294: read d4/d7/d8/d19/f29 [3896275,120448] 0 2024-04-30T23:15:55.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/461: write d1/d19/f46 [1206853,20538] 0 2024-04-30T23:15:55.321 INFO:tasks.workunit.client.0.smithi100.stdout:5/462: readlink d1/l13 0 2024-04-30T23:15:55.321 INFO:tasks.workunit.client.0.smithi100.stdout:9/295: mkdir d4/d7/d60 0 2024-04-30T23:15:55.321 INFO:tasks.workunit.client.0.smithi100.stdout:3/420: dwrite d1/d14/d15/d32/f40 [4194304,4194304] 0 2024-04-30T23:15:55.321 INFO:tasks.workunit.client.0.smithi100.stdout:3/421: fsync d1/d14/d15/d27/d34/f54 0 2024-04-30T23:15:55.324 INFO:tasks.workunit.client.0.smithi100.stdout:9/296: creat d4/d9/d51/f61 x:0 0 0 2024-04-30T23:15:55.325 INFO:tasks.workunit.client.0.smithi100.stdout:5/463: dread d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:15:55.327 INFO:tasks.workunit.client.0.smithi100.stdout:3/422: mkdir d1/d38/d79 0 2024-04-30T23:15:55.328 INFO:tasks.workunit.client.0.smithi100.stdout:9/297: creat d4/d7/f62 x:0 0 0 2024-04-30T23:15:55.328 INFO:tasks.workunit.client.0.smithi100.stdout:9/298: truncate d4/d9/d51/f61 491383 0 2024-04-30T23:15:55.331 INFO:tasks.workunit.client.0.smithi100.stdout:8/320: write d2/f8 [6618444,67594] 0 2024-04-30T23:15:55.331 INFO:tasks.workunit.client.0.smithi100.stdout:8/321: truncate d2/de/d10/d17/f4f 825449 0 2024-04-30T23:15:55.332 INFO:tasks.workunit.client.0.smithi100.stdout:4/472: dwrite d19/d33/d3f/d40/f97 [0,4194304] 0 2024-04-30T23:15:55.335 INFO:tasks.workunit.client.0.smithi100.stdout:7/444: dread d0/df/d4f/f7b [0,4194304] 0 2024-04-30T23:15:55.335 INFO:tasks.workunit.client.0.smithi100.stdout:7/445: write d0/df/d4f/f7b [928047,22746] 0 2024-04-30T23:15:55.336 INFO:tasks.workunit.client.0.smithi100.stdout:5/464: creat d1/d12/d24/d34/f9f x:0 0 0 2024-04-30T23:15:55.337 INFO:tasks.workunit.client.0.smithi100.stdout:2/391: dwrite d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/322: rename d2/de/f44 to d2/de/d10/d17/f66 0 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/323: dread - d2/d7/d18/f54 zero size 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/324: chown d2/de 34517 1 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/325: chown d2/d29/f2e 583 1 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/326: fsync d2/d7/f3c 0 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/327: chown d2/d29/f58 384774 1 2024-04-30T23:15:55.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/328: write d2/d7/f26 [1060910,126753] 0 2024-04-30T23:15:55.341 INFO:tasks.workunit.client.0.smithi100.stdout:4/473: symlink d19/d1a/d95/l98 0 2024-04-30T23:15:55.344 INFO:tasks.workunit.client.0.smithi100.stdout:7/446: mkdir d0/d1b/d60/d80/d91 0 2024-04-30T23:15:55.352 INFO:tasks.workunit.client.0.smithi100.stdout:3/423: dwrite d1/f4a [4194304,4194304] 0 2024-04-30T23:15:55.358 INFO:tasks.workunit.client.0.smithi100.stdout:2/392: link d5/d22/f42 d5/d47/f7b 0 2024-04-30T23:15:55.358 INFO:tasks.workunit.client.0.smithi100.stdout:2/393: fdatasync d5/f62 0 2024-04-30T23:15:55.358 INFO:tasks.workunit.client.0.smithi100.stdout:9/299: dwrite d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:15:55.358 INFO:tasks.workunit.client.0.smithi100.stdout:5/465: dread d1/d12/d27/f82 [0,4194304] 0 2024-04-30T23:15:55.359 INFO:tasks.workunit.client.0.smithi100.stdout:8/329: mkdir d2/d29/d67 0 2024-04-30T23:15:55.361 INFO:tasks.workunit.client.0.smithi100.stdout:7/447: link d0/d1d/d5e/d6a/d4b/f7e d0/d1b/d60/d48/d4a/f92 0 2024-04-30T23:15:55.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/394: symlink d5/d58/l7c 0 2024-04-30T23:15:55.364 INFO:tasks.workunit.client.0.smithi100.stdout:9/300: rmdir d4/d7/d8/d37/d3d 39 2024-04-30T23:15:55.365 INFO:tasks.workunit.client.0.smithi100.stdout:5/466: creat d1/d2c/d5d/fa0 x:0 0 0 2024-04-30T23:15:55.367 INFO:tasks.workunit.client.0.smithi100.stdout:4/474: rename d19/d1a/d21/d4a/d53/c75 to d19/d1a/d6d/d4e/d6e/c99 0 2024-04-30T23:15:55.367 INFO:tasks.workunit.client.0.smithi100.stdout:8/330: dread d2/de/f40 [0,4194304] 0 2024-04-30T23:15:55.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/448: unlink d0/d1b/l44 0 2024-04-30T23:15:55.370 INFO:tasks.workunit.client.0.smithi100.stdout:2/395: creat d5/d12/f7d x:0 0 0 2024-04-30T23:15:55.371 INFO:tasks.workunit.client.0.smithi100.stdout:9/301: mknod d4/d9/d51/c63 0 2024-04-30T23:15:55.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/467: creat d1/d2c/d5d/fa1 x:0 0 0 2024-04-30T23:15:55.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/468: readlink d1/d12/d1a/l52 0 2024-04-30T23:15:55.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/469: fsync d1/d2c/d60/f84 0 2024-04-30T23:15:55.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/470: getdents d1/d2c/d60/d66/d75 0 2024-04-30T23:15:55.374 INFO:tasks.workunit.client.0.smithi100.stdout:7/449: mkdir d0/df/d4f/d93 0 2024-04-30T23:15:55.374 INFO:tasks.workunit.client.0.smithi100.stdout:7/450: chown d0/df/f14 9 1 2024-04-30T23:15:55.374 INFO:tasks.workunit.client.0.smithi100.stdout:7/451: readlink d0/d1b/d60/d48/d4a/d5b/l66 0 2024-04-30T23:15:55.374 INFO:tasks.workunit.client.0.smithi100.stdout:2/396: mknod d5/d12/d13/d72/c7e 0 2024-04-30T23:15:55.375 INFO:tasks.workunit.client.0.smithi100.stdout:9/302: creat d4/d7/d5d/f64 x:0 0 0 2024-04-30T23:15:55.376 INFO:tasks.workunit.client.0.smithi100.stdout:5/471: creat d1/fa2 x:0 0 0 2024-04-30T23:15:55.376 INFO:tasks.workunit.client.0.smithi100.stdout:5/472: write d1/d3e/f45 [95521,33796] 0 2024-04-30T23:15:55.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/331: rename d2/f4 to d2/d7/f68 0 2024-04-30T23:15:55.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/332: truncate d2/d29/f47 6161291 0 2024-04-30T23:15:55.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/333: readlink d2/l3b 0 2024-04-30T23:15:55.379 INFO:tasks.workunit.client.0.smithi100.stdout:5/473: write d1/d12/f15 [793314,69423] 0 2024-04-30T23:15:55.380 INFO:tasks.workunit.client.0.smithi100.stdout:2/397: mknod d5/d12/d13/d4b/c7f 0 2024-04-30T23:15:55.382 INFO:tasks.workunit.client.0.smithi100.stdout:9/303: link d4/d7/d8/d37/f42 d4/d7/d8/d37/f65 0 2024-04-30T23:15:55.382 INFO:tasks.workunit.client.0.smithi100.stdout:9/304: chown d4/d9/d50/f5f 13852297 1 2024-04-30T23:15:55.383 INFO:tasks.workunit.client.0.smithi100.stdout:8/334: mkdir d2/d69 0 2024-04-30T23:15:55.384 INFO:tasks.workunit.client.0.smithi100.stdout:5/474: rename d1/d12/d27/c8a to d1/d12/d1a/d76/d77/d8c/ca3 0 2024-04-30T23:15:55.386 INFO:tasks.workunit.client.0.smithi100.stdout:2/398: link d5/d12/d13/f59 d5/f80 0 2024-04-30T23:15:55.387 INFO:tasks.workunit.client.0.smithi100.stdout:9/305: creat d4/d7/d8/f66 x:0 0 0 2024-04-30T23:15:55.388 INFO:tasks.workunit.client.0.smithi100.stdout:5/475: rmdir d1/d12/d1a/d5b 39 2024-04-30T23:15:55.388 INFO:tasks.workunit.client.0.smithi100.stdout:4/475: dwrite d19/d1a/d45/f92 [0,4194304] 0 2024-04-30T23:15:55.389 INFO:tasks.workunit.client.0.smithi100.stdout:5/476: truncate d1/d2c/f49 164443 0 2024-04-30T23:15:55.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/452: dwrite d0/d1b/d60/d48/f50 [0,4194304] 0 2024-04-30T23:15:55.409 INFO:tasks.workunit.client.0.smithi100.stdout:7/453: creat d0/d1b/d60/d48/d4a/f94 x:0 0 0 2024-04-30T23:15:55.410 INFO:tasks.workunit.client.0.smithi100.stdout:4/476: dread d19/d33/d3f/d40/f97 [0,4194304] 0 2024-04-30T23:15:55.412 INFO:tasks.workunit.client.0.smithi100.stdout:7/454: mknod d0/d1d/d3f/c95 0 2024-04-30T23:15:55.415 INFO:tasks.workunit.client.0.smithi100.stdout:7/455: rename d0/d1b/f55 to d0/d1d/d5e/d6a/d4b/d79/d2a/f96 0 2024-04-30T23:15:55.417 INFO:tasks.workunit.client.0.smithi100.stdout:7/456: mkdir d0/d1b/d2e/d97 0 2024-04-30T23:15:55.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/306: dwrite f3 [0,4194304] 0 2024-04-30T23:15:55.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/307: truncate d4/d7/d8/f66 363315 0 2024-04-30T23:15:55.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/335: dwrite d2/de/d38/f39 [0,4194304] 0 2024-04-30T23:15:55.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/336: write d2/de/d10/d17/f46 [1009435,129080] 0 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/399: dwrite d5/d2e/f50 [0,4194304] 0 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/400: stat d5/d12/d13/c27 0 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/401: truncate d5/f28 657024 0 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/402: chown d5/d12/f3c 775845 1 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/403: fdatasync d5/d26/f54 0 2024-04-30T23:15:55.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/404: readlink d5/d12/l5e 0 2024-04-30T23:15:55.423 INFO:tasks.workunit.client.0.smithi100.stdout:2/405: truncate d5/f2d 3138281 0 2024-04-30T23:15:55.426 INFO:tasks.workunit.client.0.smithi100.stdout:2/406: symlink d5/d47/d4c/l81 0 2024-04-30T23:15:55.427 INFO:tasks.workunit.client.0.smithi100.stdout:5/477: dwrite d1/d37/f6d [0,4194304] 0 2024-04-30T23:15:55.427 INFO:tasks.workunit.client.0.smithi100.stdout:5/478: stat d1/l13 0 2024-04-30T23:15:55.432 INFO:tasks.workunit.client.0.smithi100.stdout:5/479: mknod d1/d3e/d9b/ca4 0 2024-04-30T23:15:55.434 INFO:tasks.workunit.client.0.smithi100.stdout:5/480: symlink d1/d19/la5 0 2024-04-30T23:15:55.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/477: dwrite d19/d1a/d21/f2b [0,4194304] 0 2024-04-30T23:15:55.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/478: readlink d19/d1a/d21/d4a/d53/d5e/l67 0 2024-04-30T23:15:55.436 INFO:tasks.workunit.client.0.smithi100.stdout:5/481: getdents d1/d3e 0 2024-04-30T23:15:55.437 INFO:tasks.workunit.client.0.smithi100.stdout:5/482: stat d1/d12/d1a/f7e 0 2024-04-30T23:15:55.437 INFO:tasks.workunit.client.0.smithi100.stdout:5/483: fdatasync d1/d12/d24/f4e 0 2024-04-30T23:15:55.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/457: dread d0/d1b/d2e/f32 [0,4194304] 0 2024-04-30T23:15:55.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/458: dread - d0/d1d/d5e/d6a/f6d zero size 2024-04-30T23:15:55.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/459: fdatasync d0/d1b/d1e/f49 0 2024-04-30T23:15:55.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/484: link d1/d2c/d60/d66/l6c d1/d3e/d9b/la6 0 2024-04-30T23:15:55.447 INFO:tasks.workunit.client.0.smithi100.stdout:7/460: mkdir d0/df/d4f/d98 0 2024-04-30T23:15:55.448 INFO:tasks.workunit.client.0.smithi100.stdout:5/485: mknod d1/d12/d1a/ca7 0 2024-04-30T23:15:55.448 INFO:tasks.workunit.client.0.smithi100.stdout:2/407: dwrite d5/d12/f3c [0,4194304] 0 2024-04-30T23:15:55.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/337: creat d2/d7/f6a x:0 0 0 2024-04-30T23:15:55.470 INFO:tasks.workunit.client.0.smithi100.stdout:7/461: link d0/d1d/d5e/d6a/d4b/d79/c26 d0/d1b/d60/d48/c99 0 2024-04-30T23:15:55.470 INFO:tasks.workunit.client.0.smithi100.stdout:5/486: dread d1/d12/d27/f29 [4194304,4194304] 0 2024-04-30T23:15:55.470 INFO:tasks.workunit.client.0.smithi100.stdout:5/487: stat d1/d12/f21 0 2024-04-30T23:15:55.470 INFO:tasks.workunit.client.0.smithi100.stdout:7/462: stat d0/d1d/d5e/d6a/d4b/d79/c26 0 2024-04-30T23:15:55.470 INFO:tasks.workunit.client.0.smithi100.stdout:7/463: stat d0/l1a 0 2024-04-30T23:15:55.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/464: creat d0/d1b/d60/f9a x:0 0 0 2024-04-30T23:15:55.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/465: truncate d0/d1b/d2e/f70 426951 0 2024-04-30T23:15:55.473 INFO:tasks.workunit.client.0.smithi100.stdout:7/466: rmdir d0/d1d/d3c 39 2024-04-30T23:15:55.474 INFO:tasks.workunit.client.0.smithi100.stdout:2/408: symlink d5/l82 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/467: link d0/df/f29 d0/d1b/d2e/d3d/f9b 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/468: write d0/d1b/d1e/f40 [238930,108894] 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/469: stat d0/cc 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/470: write d0/df/d4f/f7b [1574336,104516] 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/471: readlink d0/df/l78 0 2024-04-30T23:15:55.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/472: write d0/d1d/d5e/d6a/d4b/f56 [4993457,121340] 0 2024-04-30T23:15:55.483 INFO:tasks.workunit.client.0.smithi100.stdout:7/473: creat d0/d1b/d60/d80/f9c x:0 0 0 2024-04-30T23:15:55.483 INFO:tasks.workunit.client.0.smithi100.stdout:7/474: write d0/d1b/d60/d80/f9c [759658,8064] 0 2024-04-30T23:15:55.483 INFO:tasks.workunit.client.0.smithi100.stdout:7/475: read - d0/d1b/d60/d48/d4a/f92 zero size 2024-04-30T23:15:55.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/476: dread d0/d1b/d2e/f70 [0,4194304] 0 2024-04-30T23:15:55.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/488: dread d1/d12/d27/f44 [0,4194304] 0 2024-04-30T23:15:55.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/489: dread - d1/d37/d5c/f95 zero size 2024-04-30T23:15:55.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/490: chown d1/d12/d1a/c64 1028448 1 2024-04-30T23:15:55.489 INFO:tasks.workunit.client.0.smithi100.stdout:2/409: dread f1 [0,4194304] 0 2024-04-30T23:15:55.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/410: readlink d5/d58/l7c 0 2024-04-30T23:15:55.491 INFO:tasks.workunit.client.0.smithi100.stdout:7/477: link d0/d1d/c23 d0/d1b/d60/d48/d4a/c9d 0 2024-04-30T23:15:55.491 INFO:tasks.workunit.client.0.smithi100.stdout:7/478: write d0/d1b/d2e/d3d/f9b [836631,64257] 0 2024-04-30T23:15:55.492 INFO:tasks.workunit.client.0.smithi100.stdout:5/491: creat d1/d12/d27/fa8 x:0 0 0 2024-04-30T23:15:55.492 INFO:tasks.workunit.client.0.smithi100.stdout:5/492: write d1/d2c/d60/f65 [431863,100620] 0 2024-04-30T23:15:55.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/493: rmdir d1/d12/d1a/d5b 39 2024-04-30T23:15:55.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/494: write d1/d12/d74/f93 [76951,94077] 0 2024-04-30T23:15:55.504 INFO:tasks.workunit.client.0.smithi100.stdout:8/338: dwrite d2/f8 [8388608,4194304] 0 2024-04-30T23:15:55.512 INFO:tasks.workunit.client.0.smithi100.stdout:8/339: write d2/d7/f3c [383006,107313] 0 2024-04-30T23:15:55.514 INFO:tasks.workunit.client.0.smithi100.stdout:8/340: mknod d2/de/d38/c6b 0 2024-04-30T23:15:55.516 INFO:tasks.workunit.client.0.smithi100.stdout:8/341: unlink d2/c43 0 2024-04-30T23:15:55.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/495: dwrite d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:55.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/496: readlink d1/d19/l4d 0 2024-04-30T23:15:55.523 INFO:tasks.workunit.client.0.smithi100.stdout:2/411: dwrite d5/d26/d2f/f68 [0,4194304] 0 2024-04-30T23:15:55.525 INFO:tasks.workunit.client.0.smithi100.stdout:5/497: getdents d1/d2c/d60/d66 0 2024-04-30T23:15:55.529 INFO:tasks.workunit.client.0.smithi100.stdout:2/412: symlink d5/d47/d4c/l83 0 2024-04-30T23:15:55.529 INFO:tasks.workunit.client.0.smithi100.stdout:2/413: stat d5/d12/d13/d4b/l5d 0 2024-04-30T23:15:55.530 INFO:tasks.workunit.client.0.smithi100.stdout:7/479: dwrite d0/f16 [0,4194304] 0 2024-04-30T23:15:55.530 INFO:tasks.workunit.client.0.smithi100.stdout:7/480: readlink d0/d1b/d60/l61 0 2024-04-30T23:15:55.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/498: getdents d1/d2c/d5d 0 2024-04-30T23:15:55.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/499: write d1/d2c/d60/f84 [409582,75893] 0 2024-04-30T23:15:55.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/500: chown d1/d19/f4a 713 1 2024-04-30T23:15:55.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/501: chown d1/d2c/d60/d66 2 1 2024-04-30T23:15:55.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/479: dwrite f13 [0,4194304] 0 2024-04-30T23:15:55.538 INFO:tasks.workunit.client.0.smithi100.stdout:7/481: creat d0/d1d/d5e/d6a/d4b/f9e x:0 0 0 2024-04-30T23:15:55.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/342: dwrite d2/f8 [0,4194304] 0 2024-04-30T23:15:55.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/343: fdatasync d2/de/d10/d52/f65 0 2024-04-30T23:15:55.542 INFO:tasks.workunit.client.0.smithi100.stdout:4/480: creat d19/d1a/d6d/d4e/f9a x:0 0 0 2024-04-30T23:15:55.544 INFO:tasks.workunit.client.0.smithi100.stdout:7/482: symlink d0/d1b/d60/d48/d4a/l9f 0 2024-04-30T23:15:55.549 INFO:tasks.workunit.client.0.smithi100.stdout:7/483: rename d0/df/d4f/d53/l5c to d0/d1b/d2e/la0 0 2024-04-30T23:15:55.551 INFO:tasks.workunit.client.0.smithi100.stdout:4/481: unlink d19/d1a/d29/d65/l7b 0 2024-04-30T23:15:55.552 INFO:tasks.workunit.client.0.smithi100.stdout:0/423: sync 2024-04-30T23:15:55.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/410: sync 2024-04-30T23:15:55.553 INFO:tasks.workunit.client.0.smithi100.stdout:7/484: creat d0/d1b/d60/d48/d4a/fa1 x:0 0 0 2024-04-30T23:15:55.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/414: dwrite d5/d12/d13/f59 [0,4194304] 0 2024-04-30T23:15:55.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/482: creat d19/d1a/d6d/d4e/d6e/f9b x:0 0 0 2024-04-30T23:15:55.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/483: dread - d19/d1a/d21/f83 zero size 2024-04-30T23:15:55.556 INFO:tasks.workunit.client.0.smithi100.stdout:0/424: creat d2/d4c/f89 x:0 0 0 2024-04-30T23:15:55.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/411: truncate d7/d9/d86/d1b/f39 1038199 0 2024-04-30T23:15:55.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/415: symlink d5/d47/l84 0 2024-04-30T23:15:55.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/485: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/fa2 x:0 0 0 2024-04-30T23:15:55.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/486: chown d0/d1d/d5e/d6a/d4b/d79/f2f 76 1 2024-04-30T23:15:55.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/487: fsync d0/d1d/d5e/d6a/d4b/d79/d2a/f52 0 2024-04-30T23:15:55.562 INFO:tasks.workunit.client.0.smithi100.stdout:6/412: link d7/d9/d86/d1b/d3f/c5b d7/df/d23/d24/c8d 0 2024-04-30T23:15:55.562 INFO:tasks.workunit.client.0.smithi100.stdout:6/413: dread - d7/d9/d86/f73 zero size 2024-04-30T23:15:55.563 INFO:tasks.workunit.client.0.smithi100.stdout:7/488: unlink d0/d1d/d3f/l89 0 2024-04-30T23:15:55.564 INFO:tasks.workunit.client.0.smithi100.stdout:4/484: link c5 d19/d1a/c9c 0 2024-04-30T23:15:55.564 INFO:tasks.workunit.client.0.smithi100.stdout:4/485: readlink d19/d33/d3f/l60 0 2024-04-30T23:15:55.564 INFO:tasks.workunit.client.0.smithi100.stdout:4/486: chown d19/d1a/d6d/c89 0 1 2024-04-30T23:15:55.565 INFO:tasks.workunit.client.0.smithi100.stdout:6/414: rename d7/d9/d86/d1b/d22/d7f to d7/d9/d8e 0 2024-04-30T23:15:55.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/489: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3 0 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/344: dwrite d2/d7/d18/d3a/f3d [0,4194304] 0 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/345: chown d2/de/f40 8 1 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/346: fdatasync d2/de/d10/d17/f4f 0 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/347: chown d2/d29/f53 1 1 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/348: chown d2/de/d10/d52 22 1 2024-04-30T23:15:55.567 INFO:tasks.workunit.client.0.smithi100.stdout:5/502: dwrite d1/d12/d24/d34/f9f [0,4194304] 0 2024-04-30T23:15:55.568 INFO:tasks.workunit.client.0.smithi100.stdout:4/487: truncate d19/d33/f31 41525 0 2024-04-30T23:15:55.568 INFO:tasks.workunit.client.0.smithi100.stdout:6/415: symlink d7/df/d23/d4f/l8f 0 2024-04-30T23:15:55.568 INFO:tasks.workunit.client.0.smithi100.stdout:4/488: fdatasync d19/d1a/d21/f2b 0 2024-04-30T23:15:55.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/490: rename d0/d1d/d5e/d6a/d4b/f7e to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fa4 0 2024-04-30T23:15:55.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/491: write d0/d1d/d5e/d6a/d4b/f56 [6194031,29427] 0 2024-04-30T23:15:55.572 INFO:tasks.workunit.client.0.smithi100.stdout:8/349: creat d2/de/f6c x:0 0 0 2024-04-30T23:15:55.580 INFO:tasks.workunit.client.0.smithi100.stdout:2/416: dread d5/d26/d2f/f36 [0,4194304] 0 2024-04-30T23:15:55.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/416: rename d7/df/d23/d24/d2e/d37/f5e to d7/df/d23/d24/f90 0 2024-04-30T23:15:55.581 INFO:tasks.workunit.client.0.smithi100.stdout:0/425: dwrite d2/d14/d35/d40/f49 [0,4194304] 0 2024-04-30T23:15:55.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/350: rmdir d2/de/d10 39 2024-04-30T23:15:55.584 INFO:tasks.workunit.client.0.smithi100.stdout:6/417: creat d7/d9/d86/d3e/f91 x:0 0 0 2024-04-30T23:15:55.593 INFO:tasks.workunit.client.0.smithi100.stdout:4/489: dread d19/d33/f31 [0,4194304] 0 2024-04-30T23:15:55.600 INFO:tasks.workunit.client.0.smithi100.stdout:7/492: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f96 [0,4194304] 0 2024-04-30T23:15:55.600 INFO:tasks.workunit.client.0.smithi100.stdout:7/493: write d0/d1d/d5e/d6a/f5f [855839,8118] 0 2024-04-30T23:15:55.603 INFO:tasks.workunit.client.0.smithi100.stdout:0/426: read d2/d14/d35/d57/f60 [4116167,127281] 0 2024-04-30T23:15:55.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/503: dwrite d1/d2c/d5d/fa1 [0,4194304] 0 2024-04-30T23:15:55.603 INFO:tasks.workunit.client.0.smithi100.stdout:7/494: link d0/d1b/c67 d0/d1b/d60/d80/d91/ca5 0 2024-04-30T23:15:55.604 INFO:tasks.workunit.client.0.smithi100.stdout:2/417: write d5/d26/d2f/f5b [1304561,9949] 0 2024-04-30T23:15:55.606 INFO:tasks.workunit.client.0.smithi100.stdout:7/495: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6 0 2024-04-30T23:15:55.606 INFO:tasks.workunit.client.0.smithi100.stdout:7/496: chown d0/d1b/c2c 226 1 2024-04-30T23:15:55.606 INFO:tasks.workunit.client.0.smithi100.stdout:7/497: stat d0/d1b/d2e/d3d 0 2024-04-30T23:15:55.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/351: dwrite d2/de/d10/d17/f66 [0,4194304] 0 2024-04-30T23:15:55.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/418: read d7/df/d23/d24/d2e/d37/f68 [764605,90302] 0 2024-04-30T23:15:55.614 INFO:tasks.workunit.client.0.smithi100.stdout:2/418: mknod d5/d47/d4c/c85 0 2024-04-30T23:15:55.615 INFO:tasks.workunit.client.0.smithi100.stdout:4/490: write d19/d33/d3f/f51 [900289,98287] 0 2024-04-30T23:15:55.616 INFO:tasks.workunit.client.0.smithi100.stdout:6/419: rename d7/c2a to d7/d9/d86/d3e/c92 0 2024-04-30T23:15:55.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/491: rmdir d19/d33/d3f 39 2024-04-30T23:15:55.619 INFO:tasks.workunit.client.0.smithi100.stdout:2/419: rename d5/d26/c78 to d5/d47/c86 0 2024-04-30T23:15:55.619 INFO:tasks.workunit.client.0.smithi100.stdout:2/420: chown d5/d12 10 1 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/420: creat d7/df/d23/d2b/d42/d84/f93 x:0 0 0 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/421: write d7/df/f41 [861401,119216] 0 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:4/492: creat d19/d1a/f9d x:0 0 0 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:4/493: chown f12 47 1 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/427: write d2/fc [1799883,15852] 0 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/428: chown d2/d50/d38 0 1 2024-04-30T23:15:55.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/429: chown d2/d50/d38/d6c 2 1 2024-04-30T23:15:55.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/421: getdents d5/d2e 0 2024-04-30T23:15:55.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/422: dread - d5/d26/f4a zero size 2024-04-30T23:15:55.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/423: write d5/d26/f77 [953399,10158] 0 2024-04-30T23:15:55.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/498: dwrite d0/d1b/d1e/f40 [0,4194304] 0 2024-04-30T23:15:55.629 INFO:tasks.workunit.client.0.smithi100.stdout:4/494: truncate d19/d1a/d21/f2b 3495184 0 2024-04-30T23:15:55.631 INFO:tasks.workunit.client.0.smithi100.stdout:1/375: sync 2024-04-30T23:15:55.631 INFO:tasks.workunit.client.0.smithi100.stdout:3/424: sync 2024-04-30T23:15:55.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/499: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/fa7 x:0 0 0 2024-04-30T23:15:55.632 INFO:tasks.workunit.client.0.smithi100.stdout:4/495: rmdir d19/d1a/d6d/d4e 39 2024-04-30T23:15:55.632 INFO:tasks.workunit.client.0.smithi100.stdout:4/496: fdatasync d19/d33/d3f/f56 0 2024-04-30T23:15:55.634 INFO:tasks.workunit.client.0.smithi100.stdout:3/425: link d1/d38/l52 d1/d14/d15/d32/d6f/l7a 0 2024-04-30T23:15:55.634 INFO:tasks.workunit.client.0.smithi100.stdout:3/426: fdatasync d1/d14/d15/f72 0 2024-04-30T23:15:55.637 INFO:tasks.workunit.client.0.smithi100.stdout:7/500: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/fa8 x:0 0 0 2024-04-30T23:15:55.637 INFO:tasks.workunit.client.0.smithi100.stdout:7/501: write d0/d1b/d2e/f70 [631154,124970] 0 2024-04-30T23:15:55.637 INFO:tasks.workunit.client.0.smithi100.stdout:7/502: fsync d0/f16 0 2024-04-30T23:15:55.638 INFO:tasks.workunit.client.0.smithi100.stdout:7/503: dread - d0/d1b/d60/d80/f8f zero size 2024-04-30T23:15:55.638 INFO:tasks.workunit.client.0.smithi100.stdout:7/504: stat d0/d1b/d1e/f49 0 2024-04-30T23:15:55.638 INFO:tasks.workunit.client.0.smithi100.stdout:4/497: mknod d19/d33/d7d/c9e 0 2024-04-30T23:15:55.640 INFO:tasks.workunit.client.0.smithi100.stdout:3/427: mkdir d1/d14/d15/d2c/d68/d6d/d7b 0 2024-04-30T23:15:55.640 INFO:tasks.workunit.client.0.smithi100.stdout:3/428: chown d1/d14/d15/d32/f63 4641969 1 2024-04-30T23:15:55.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/505: rename d0/df/d4f/d98 to d0/df/d4f/d53/da9 0 2024-04-30T23:15:55.645 INFO:tasks.workunit.client.0.smithi100.stdout:2/424: dwrite d5/f80 [4194304,4194304] 0 2024-04-30T23:15:55.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/352: dread d2/d7/d18/d3a/f3d [0,4194304] 0 2024-04-30T23:15:55.646 INFO:tasks.workunit.client.0.smithi100.stdout:7/506: unlink d0/d1d/d5e/d6a/f3a 0 2024-04-30T23:15:55.646 INFO:tasks.workunit.client.0.smithi100.stdout:7/507: fsync d0/d1d/d5e/d6a/d4b/d79/d2a/f96 0 2024-04-30T23:15:55.646 INFO:tasks.workunit.client.0.smithi100.stdout:7/508: write d0/d1b/d60/d48/f76 [222834,6575] 0 2024-04-30T23:15:55.649 INFO:tasks.workunit.client.0.smithi100.stdout:2/425: link d5/d58/l64 d5/d47/d66/l87 0 2024-04-30T23:15:55.649 INFO:tasks.workunit.client.0.smithi100.stdout:2/426: fsync d5/d26/d2f/d38/f61 0 2024-04-30T23:15:55.651 INFO:tasks.workunit.client.0.smithi100.stdout:7/509: fdatasync d0/d1b/d60/d48/f76 0 2024-04-30T23:15:55.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/430: dwrite d2/f65 [0,4194304] 0 2024-04-30T23:15:55.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/431: write d2/d50/d38/f7a [812317,109434] 0 2024-04-30T23:15:55.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/432: readlink d2/d14/d35/l48 0 2024-04-30T23:15:55.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/510: creat d0/df/d4f/d53/da9/faa x:0 0 0 2024-04-30T23:15:55.653 INFO:tasks.workunit.client.0.smithi100.stdout:1/376: write d3/db/f39 [1939865,38230] 0 2024-04-30T23:15:55.655 INFO:tasks.workunit.client.0.smithi100.stdout:8/353: symlink d2/d7/l6d 0 2024-04-30T23:15:55.657 INFO:tasks.workunit.client.0.smithi100.stdout:7/511: symlink d0/df/d4f/lab 0 2024-04-30T23:15:55.663 INFO:tasks.workunit.client.0.smithi100.stdout:8/354: mkdir d2/de/d10/d6e 0 2024-04-30T23:15:55.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/427: dread d5/d22/f4e [0,4194304] 0 2024-04-30T23:15:55.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/428: read d5/f14 [2039708,27207] 0 2024-04-30T23:15:55.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/429: dread - d5/d22/f42 zero size 2024-04-30T23:15:55.674 INFO:tasks.workunit.client.0.smithi100.stdout:4/498: dwrite d19/d1a/d21/d4a/d53/d5d/f96 [0,4194304] 0 2024-04-30T23:15:55.674 INFO:tasks.workunit.client.0.smithi100.stdout:2/430: rename d5/d12/d13/c74 to d5/d47/d66/c88 0 2024-04-30T23:15:55.674 INFO:tasks.workunit.client.0.smithi100.stdout:2/431: write d5/d47/d66/f69 [591029,12524] 0 2024-04-30T23:15:55.674 INFO:tasks.workunit.client.0.smithi100.stdout:2/432: stat d5/d2e/c67 0 2024-04-30T23:15:55.676 INFO:tasks.workunit.client.0.smithi100.stdout:8/355: write d2/d29/f2b [312697,67712] 0 2024-04-30T23:15:55.676 INFO:tasks.workunit.client.0.smithi100.stdout:0/433: dread d2/d14/d35/f39 [4194304,4194304] 0 2024-04-30T23:15:55.676 INFO:tasks.workunit.client.0.smithi100.stdout:3/429: dwrite d1/d14/d15/d2c/d68/f74 [0,4194304] 0 2024-04-30T23:15:55.677 INFO:tasks.workunit.client.0.smithi100.stdout:0/434: getdents d2/d50/d38/d6c/d6e/d70 0 2024-04-30T23:15:55.677 INFO:tasks.workunit.client.0.smithi100.stdout:0/435: fsync d2/d14/d35/d57/f78 0 2024-04-30T23:15:55.677 INFO:tasks.workunit.client.0.smithi100.stdout:0/436: chown d2/d14/d35/c37 32734 1 2024-04-30T23:15:55.677 INFO:tasks.workunit.client.0.smithi100.stdout:0/437: fsync d2/d14/d35/f39 0 2024-04-30T23:15:55.677 INFO:tasks.workunit.client.0.smithi100.stdout:4/499: creat d19/d1a/d6d/d4e/d6e/f9f x:0 0 0 2024-04-30T23:15:55.678 INFO:tasks.workunit.client.0.smithi100.stdout:8/356: rmdir d2/d7/d18 39 2024-04-30T23:15:55.681 INFO:tasks.workunit.client.0.smithi100.stdout:3/430: creat d1/d14/d2f/f7c x:0 0 0 2024-04-30T23:15:55.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/357: symlink d2/d7/d18/l6f 0 2024-04-30T23:15:55.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/358: chown d2/de/d10/d6e 1734 1 2024-04-30T23:15:55.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/377: dwrite d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:15:55.684 INFO:tasks.workunit.client.0.smithi100.stdout:8/359: write d2/d29/f47 [6066968,83873] 0 2024-04-30T23:15:55.684 INFO:tasks.workunit.client.0.smithi100.stdout:8/360: fdatasync d2/f6 0 2024-04-30T23:15:55.684 INFO:tasks.workunit.client.0.smithi100.stdout:6/422: dwrite d7/d9/d86/d1b/f39 [0,4194304] 0 2024-04-30T23:15:55.686 INFO:tasks.workunit.client.0.smithi100.stdout:8/361: unlink d2/d7/l1e 0 2024-04-30T23:15:55.686 INFO:tasks.workunit.client.0.smithi100.stdout:8/362: stat d2/de/f4d 0 2024-04-30T23:15:55.686 INFO:tasks.workunit.client.0.smithi100.stdout:8/363: chown d2/de/d10/c28 15419488 1 2024-04-30T23:15:55.686 INFO:tasks.workunit.client.0.smithi100.stdout:8/364: write d2/f3 [2456834,58398] 0 2024-04-30T23:15:55.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/433: write d5/d12/f3d [1063568,48557] 0 2024-04-30T23:15:55.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/434: chown d5/d12/d13/f79 10873800 1 2024-04-30T23:15:55.690 INFO:tasks.workunit.client.0.smithi100.stdout:6/423: symlink d7/df/d23/d24/l94 0 2024-04-30T23:15:55.690 INFO:tasks.workunit.client.0.smithi100.stdout:6/424: dread - d7/f89 zero size 2024-04-30T23:15:55.694 INFO:tasks.workunit.client.0.smithi100.stdout:8/365: symlink d2/de/d10/d6e/l70 0 2024-04-30T23:15:55.695 INFO:tasks.workunit.client.0.smithi100.stdout:8/366: dread d2/de/d10/d17/f4f [0,4194304] 0 2024-04-30T23:15:55.698 INFO:tasks.workunit.client.0.smithi100.stdout:0/438: dwrite d2/d14/d18/f33 [0,4194304] 0 2024-04-30T23:15:55.701 INFO:tasks.workunit.client.0.smithi100.stdout:8/367: mkdir d2/d29/d71 0 2024-04-30T23:15:55.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/435: write d5/d26/d2f/f68 [3611339,112782] 0 2024-04-30T23:15:55.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/436: fsync d5/d47/d4c/f51 0 2024-04-30T23:15:55.705 INFO:tasks.workunit.client.0.smithi100.stdout:2/437: rename d5/d12/c5c to d5/d12/d13/c89 0 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:2/438: readlink d5/d12/d13/l1c 0 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:2/439: write d5/d12/d13/f59 [8951866,30317] 0 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:2/440: write d5/f80 [9773062,117942] 0 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:8/368: rmdir d2 39 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:8/369: truncate d2/de/d10/d17/f46 2105182 0 2024-04-30T23:15:55.706 INFO:tasks.workunit.client.0.smithi100.stdout:8/370: chown d2/d7/f68 387 1 2024-04-30T23:15:55.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/441: rename d5/c29 to d5/d22/c8a 0 2024-04-30T23:15:55.708 INFO:tasks.workunit.client.0.smithi100.stdout:8/371: mkdir d2/de/d72 0 2024-04-30T23:15:55.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/372: mkdir d2/d29/d67/d73 0 2024-04-30T23:15:55.710 INFO:tasks.workunit.client.0.smithi100.stdout:8/373: rmdir d2/d29 39 2024-04-30T23:15:55.711 INFO:tasks.workunit.client.0.smithi100.stdout:8/374: readlink d2/d7/l23 0 2024-04-30T23:15:55.714 INFO:tasks.workunit.client.0.smithi100.stdout:9/308: sync 2024-04-30T23:15:55.715 INFO:tasks.workunit.client.0.smithi100.stdout:9/309: write d4/d9/d50/f5f [170127,12180] 0 2024-04-30T23:15:55.720 INFO:tasks.workunit.client.0.smithi100.stdout:0/439: dwrite d2/d14/d35/f5e [0,4194304] 0 2024-04-30T23:15:55.731 INFO:tasks.workunit.client.0.smithi100.stdout:9/310: write d4/d7/d8/d37/f65 [3148497,89872] 0 2024-04-30T23:15:55.732 INFO:tasks.workunit.client.0.smithi100.stdout:9/311: creat d4/d7/d60/f67 x:0 0 0 2024-04-30T23:15:55.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/312: unlink d4/d9/d51/f61 0 2024-04-30T23:15:55.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/375: dwrite d2/d29/f2e [4194304,4194304] 0 2024-04-30T23:15:55.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/376: truncate d2/de/d10/d17/f66 4703764 0 2024-04-30T23:15:55.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/377: dread - d2/de/f4d zero size 2024-04-30T23:15:55.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/440: dwrite d2/fb [0,4194304] 0 2024-04-30T23:15:55.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/441: readlink d2/d14/d18/l44 0 2024-04-30T23:15:55.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/378: read d2/f6 [599625,18343] 0 2024-04-30T23:15:55.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/379: truncate d2/de/d10/d17/f4f 1825459 0 2024-04-30T23:15:55.746 INFO:tasks.workunit.client.0.smithi100.stdout:0/442: creat d2/d50/d38/d6c/d6e/f8a x:0 0 0 2024-04-30T23:15:55.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/380: mknod d2/de/d10/c74 0 2024-04-30T23:15:55.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/381: chown d2/de/d10/d17/f4f 741 1 2024-04-30T23:15:55.748 INFO:tasks.workunit.client.0.smithi100.stdout:8/382: rmdir d2/de/d38 39 2024-04-30T23:15:55.755 INFO:tasks.workunit.client.0.smithi100.stdout:9/313: dwrite d4/d9/d50/f54 [0,4194304] 0 2024-04-30T23:15:55.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/443: dwrite d2/d4c/d68/f72 [4194304,4194304] 0 2024-04-30T23:15:55.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/444: write d2/f73 [967167,54914] 0 2024-04-30T23:15:55.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/445: write d2/f73 [940570,29751] 0 2024-04-30T23:15:55.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/383: dwrite d2/de/d10/d17/f66 [0,4194304] 0 2024-04-30T23:15:55.772 INFO:tasks.workunit.client.0.smithi100.stdout:9/314: write d4/d9/d10/f3a [1249534,115737] 0 2024-04-30T23:15:55.773 INFO:tasks.workunit.client.0.smithi100.stdout:8/384: rmdir d2/de/d10 39 2024-04-30T23:15:55.773 INFO:tasks.workunit.client.0.smithi100.stdout:8/385: write d2/d7/d18/d3a/f3d [5015764,81166] 0 2024-04-30T23:15:55.773 INFO:tasks.workunit.client.0.smithi100.stdout:8/386: stat d2/d7/f6a 0 2024-04-30T23:15:55.774 INFO:tasks.workunit.client.0.smithi100.stdout:8/387: dread - d2/f50 zero size 2024-04-30T23:15:55.774 INFO:tasks.workunit.client.0.smithi100.stdout:8/388: symlink d2/d29/d71/l75 0 2024-04-30T23:15:55.774 INFO:tasks.workunit.client.0.smithi100.stdout:8/389: read d2/d7/f3c [252000,105699] 0 2024-04-30T23:15:55.776 INFO:tasks.workunit.client.0.smithi100.stdout:8/390: creat d2/f76 x:0 0 0 2024-04-30T23:15:55.781 INFO:tasks.workunit.client.0.smithi100.stdout:8/391: truncate d2/f8 11269790 0 2024-04-30T23:15:55.782 INFO:tasks.workunit.client.0.smithi100.stdout:8/392: creat d2/d29/d71/f77 x:0 0 0 2024-04-30T23:15:55.792 INFO:tasks.workunit.client.0.smithi100.stdout:0/446: dwrite d2/d50/d38/d6c/f74 [0,4194304] 0 2024-04-30T23:15:55.794 INFO:tasks.workunit.client.0.smithi100.stdout:9/315: dwrite d4/d9/d50/f54 [0,4194304] 0 2024-04-30T23:15:55.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/316: fdatasync f3 0 2024-04-30T23:15:55.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/317: truncate d4/d7/d8/f66 735931 0 2024-04-30T23:15:55.795 INFO:tasks.workunit.client.0.smithi100.stdout:0/447: unlink d2/d5a/l67 0 2024-04-30T23:15:55.796 INFO:tasks.workunit.client.0.smithi100.stdout:9/318: creat d4/f68 x:0 0 0 2024-04-30T23:15:55.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/448: symlink d2/d4c/d68/l8b 0 2024-04-30T23:15:55.797 INFO:tasks.workunit.client.0.smithi100.stdout:9/319: mkdir d4/d7/d60/d69 0 2024-04-30T23:15:55.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/393: dwrite d2/d7/d18/f54 [0,4194304] 0 2024-04-30T23:15:55.808 INFO:tasks.workunit.client.0.smithi100.stdout:8/394: rmdir d2/d7 39 2024-04-30T23:15:55.808 INFO:tasks.workunit.client.0.smithi100.stdout:0/449: write d2/d14/d18/f45 [779189,124394] 0 2024-04-30T23:15:55.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/450: unlink d2/c10 0 2024-04-30T23:15:55.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/451: write d2/d50/d38/f3f [3752655,71088] 0 2024-04-30T23:15:55.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/452: write d2/d14/d18/f45 [4498852,32920] 0 2024-04-30T23:15:55.814 INFO:tasks.workunit.client.0.smithi100.stdout:0/453: read d2/d50/d38/f7a [581355,5956] 0 2024-04-30T23:15:55.815 INFO:tasks.workunit.client.0.smithi100.stdout:0/454: link d2/d14/d35/f39 d2/d50/d38/d5d/f8c 0 2024-04-30T23:15:55.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/395: write d2/d7/d18/d3a/f3d [858061,128805] 0 2024-04-30T23:15:55.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/396: write d2/ff [5147842,94225] 0 2024-04-30T23:15:55.817 INFO:tasks.workunit.client.0.smithi100.stdout:0/455: mknod d2/d14/d35/c8d 0 2024-04-30T23:15:55.819 INFO:tasks.workunit.client.0.smithi100.stdout:0/456: creat d2/d14/d35/f8e x:0 0 0 2024-04-30T23:15:55.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/457: symlink d2/d5a/l8f 0 2024-04-30T23:15:55.821 INFO:tasks.workunit.client.0.smithi100.stdout:0/458: link d2/d50/d38/d5d/f8c d2/d50/d38/d6c/d6e/d70/f90 0 2024-04-30T23:15:55.821 INFO:tasks.workunit.client.0.smithi100.stdout:0/459: chown d2/d50/d38/d5d/f76 0 1 2024-04-30T23:15:55.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/397: read d2/d29/f2e [7393730,1480] 0 2024-04-30T23:15:55.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/398: write d2/de/d10/d17/f66 [4241361,124678] 0 2024-04-30T23:15:55.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/399: unlink d2/de/d10/d17/l2f 0 2024-04-30T23:15:55.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/400: creat d2/f78 x:0 0 0 2024-04-30T23:15:55.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/401: chown d2/f9 382517037 1 2024-04-30T23:15:55.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/402: write d2/d7/f68 [6099234,45720] 0 2024-04-30T23:15:55.831 INFO:tasks.workunit.client.0.smithi100.stdout:8/403: mknod d2/d29/d71/c79 0 2024-04-30T23:15:55.831 INFO:tasks.workunit.client.0.smithi100.stdout:8/404: getdents d2/d69 0 2024-04-30T23:15:55.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/460: dread d2/f5 [0,4194304] 0 2024-04-30T23:15:55.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/461: chown d2/f1e 2125791488 1 2024-04-30T23:15:55.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/405: write d2/de/d10/d17/f46 [1629693,125757] 0 2024-04-30T23:15:55.834 INFO:tasks.workunit.client.0.smithi100.stdout:0/462: rename d2/fb to d2/d14/d35/d57/f91 0 2024-04-30T23:15:55.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/406: mknod d2/d29/d67/c7a 0 2024-04-30T23:15:55.835 INFO:tasks.workunit.client.0.smithi100.stdout:0/463: creat d2/d5a/f92 x:0 0 0 2024-04-30T23:15:55.835 INFO:tasks.workunit.client.0.smithi100.stdout:0/464: chown d2/d14/d35/d40 24478543 1 2024-04-30T23:15:55.836 INFO:tasks.workunit.client.0.smithi100.stdout:8/407: creat d2/d29/d67/d73/f7b x:0 0 0 2024-04-30T23:15:55.836 INFO:tasks.workunit.client.0.smithi100.stdout:0/465: creat d2/d14/d18/f93 x:0 0 0 2024-04-30T23:15:55.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/408: rename d2/f9 to d2/de/d38/f7c 0 2024-04-30T23:15:55.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/409: creat d2/d29/f7d x:0 0 0 2024-04-30T23:15:55.844 INFO:tasks.workunit.client.0.smithi100.stdout:0/466: rename d2/d50/d38/d6c/d6e/d70 to d2/d4c/d68/d94 0 2024-04-30T23:15:55.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/410: link d2/de/d38/f7c d2/d29/f7e 0 2024-04-30T23:15:55.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/411: rename d2/de/d38 to d2/de/d7f 0 2024-04-30T23:15:55.855 INFO:tasks.workunit.client.0.smithi100.stdout:8/412: truncate d2/de/f6c 743972 0 2024-04-30T23:15:55.857 INFO:tasks.workunit.client.0.smithi100.stdout:0/467: read d2/f59 [185628,125737] 0 2024-04-30T23:15:55.858 INFO:tasks.workunit.client.0.smithi100.stdout:0/468: creat d2/d14/d35/d57/f95 x:0 0 0 2024-04-30T23:15:55.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/469: link d2/f65 d2/d50/d30/d32/f96 0 2024-04-30T23:15:55.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/470: readlink d2/d14/l22 0 2024-04-30T23:15:55.877 INFO:tasks.workunit.client.0.smithi100.stdout:8/413: dwrite d2/d29/f60 [0,4194304] 0 2024-04-30T23:15:55.879 INFO:tasks.workunit.client.0.smithi100.stdout:8/414: rename d2/d29/l5d to d2/de/d10/l80 0 2024-04-30T23:15:55.880 INFO:tasks.workunit.client.0.smithi100.stdout:8/415: mknod d2/d29/d67/d73/c81 0 2024-04-30T23:15:55.881 INFO:tasks.workunit.client.0.smithi100.stdout:0/471: dwrite d2/d14/d35/f4b [0,4194304] 0 2024-04-30T23:15:55.884 INFO:tasks.workunit.client.0.smithi100.stdout:0/472: link d2/d4c/d68/c80 d2/d5a/c97 0 2024-04-30T23:15:55.893 INFO:tasks.workunit.client.0.smithi100.stdout:8/416: dread d2/de/d7f/f7c [0,4194304] 0 2024-04-30T23:15:55.894 INFO:tasks.workunit.client.0.smithi100.stdout:8/417: getdents d2/d7/d18 0 2024-04-30T23:15:55.896 INFO:tasks.workunit.client.0.smithi100.stdout:8/418: symlink d2/d7/d18/l82 0 2024-04-30T23:15:55.908 INFO:tasks.workunit.client.0.smithi100.stdout:0/473: dwrite d2/d50/d30/f3d [0,4194304] 0 2024-04-30T23:15:55.926 INFO:tasks.workunit.client.0.smithi100.stdout:8/419: dwrite d2/d7/f12 [0,4194304] 0 2024-04-30T23:15:55.927 INFO:tasks.workunit.client.0.smithi100.stdout:8/420: readlink d2/d7/d18/d3a/l5c 0 2024-04-30T23:15:55.928 INFO:tasks.workunit.client.0.smithi100.stdout:0/474: dwrite d2/d4c/d68/f72 [4194304,4194304] 0 2024-04-30T23:15:55.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/475: symlink d2/d14/d35/d57/l98 0 2024-04-30T23:15:55.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/476: fdatasync d2/f8 0 2024-04-30T23:15:55.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/477: fsync d2/d14/d35/d57/f91 0 2024-04-30T23:15:55.930 INFO:tasks.workunit.client.0.smithi100.stdout:0/478: write d2/d50/f71 [561218,100593] 0 2024-04-30T23:15:55.939 INFO:tasks.workunit.client.0.smithi100.stdout:8/421: write d2/de/d10/d17/f1b [610191,21565] 0 2024-04-30T23:15:55.940 INFO:tasks.workunit.client.0.smithi100.stdout:8/422: symlink d2/de/l83 0 2024-04-30T23:15:55.940 INFO:tasks.workunit.client.0.smithi100.stdout:8/423: readlink d2/l3b 0 2024-04-30T23:15:55.940 INFO:tasks.workunit.client.0.smithi100.stdout:8/424: fdatasync d2/f78 0 2024-04-30T23:15:55.943 INFO:tasks.workunit.client.0.smithi100.stdout:0/479: dread d2/d50/d38/d6c/f74 [0,4194304] 0 2024-04-30T23:15:55.944 INFO:tasks.workunit.client.0.smithi100.stdout:0/480: getdents d2/d14/d35/d57 0 2024-04-30T23:15:55.945 INFO:tasks.workunit.client.0.smithi100.stdout:0/481: getdents d2/d14/d35 0 2024-04-30T23:15:55.946 INFO:tasks.workunit.client.0.smithi100.stdout:0/482: symlink d2/d14/d18/l99 0 2024-04-30T23:15:55.946 INFO:tasks.workunit.client.0.smithi100.stdout:8/425: dread d2/f3e [0,4194304] 0 2024-04-30T23:15:55.947 INFO:tasks.workunit.client.0.smithi100.stdout:8/426: creat d2/d7/d18/d3a/f84 x:0 0 0 2024-04-30T23:15:55.948 INFO:tasks.workunit.client.0.smithi100.stdout:8/427: creat d2/d7/d18/d3a/f85 x:0 0 0 2024-04-30T23:15:55.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/428: fsync d2/f8 0 2024-04-30T23:15:55.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/429: fdatasync d2/de/d10/d17/f4f 0 2024-04-30T23:15:55.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/430: readlink d2/de/d10/d17/l35 0 2024-04-30T23:15:55.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/431: fsync d2/f78 0 2024-04-30T23:15:55.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/432: mkdir d2/d29/d71/d86 0 2024-04-30T23:15:55.953 INFO:tasks.workunit.client.0.smithi100.stdout:8/433: dread d2/f6 [0,4194304] 0 2024-04-30T23:15:55.954 INFO:tasks.workunit.client.0.smithi100.stdout:8/434: creat d2/de/d10/d17/f87 x:0 0 0 2024-04-30T23:15:55.955 INFO:tasks.workunit.client.0.smithi100.stdout:8/435: unlink d2/d7/d18/l82 0 2024-04-30T23:15:55.955 INFO:tasks.workunit.client.0.smithi100.stdout:8/436: dread - d2/f50 zero size 2024-04-30T23:15:55.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/437: fdatasync d2/de/d7f/f7c 0 2024-04-30T23:15:55.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/438: rmdir d2/d29/d67 39 2024-04-30T23:15:55.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/439: mknod d2/d69/c88 0 2024-04-30T23:15:55.963 INFO:tasks.workunit.client.0.smithi100.stdout:8/440: rename d2/de to d2/d89 0 2024-04-30T23:15:55.965 INFO:tasks.workunit.client.0.smithi100.stdout:8/441: mknod d2/d7/c8a 0 2024-04-30T23:15:55.966 INFO:tasks.workunit.client.0.smithi100.stdout:0/483: dwrite d2/f73 [0,4194304] 0 2024-04-30T23:15:55.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/484: rename d2/d50/d30/d32/f96 to d2/d4c/f9a 0 2024-04-30T23:15:55.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/485: write d2/d50/d38/f3f [2118843,17074] 0 2024-04-30T23:15:55.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/486: dread - d2/d14/d35/d57/f95 zero size 2024-04-30T23:15:55.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/487: write d2/d14/d18/f93 [151702,100360] 0 2024-04-30T23:15:55.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/488: readlink l0 0 2024-04-30T23:15:55.973 INFO:tasks.workunit.client.0.smithi100.stdout:0/489: creat d2/d14/d35/d40/f9b x:0 0 0 2024-04-30T23:15:55.973 INFO:tasks.workunit.client.0.smithi100.stdout:0/490: write d2/d50/d38/d6c/f74 [4692657,94429] 0 2024-04-30T23:15:55.974 INFO:tasks.workunit.client.0.smithi100.stdout:0/491: creat d2/d5a/f9c x:0 0 0 2024-04-30T23:15:55.975 INFO:tasks.workunit.client.0.smithi100.stdout:0/492: creat d2/d50/d30/d32/f9d x:0 0 0 2024-04-30T23:15:55.975 INFO:tasks.workunit.client.0.smithi100.stdout:0/493: chown d2/d50 141806 1 2024-04-30T23:15:55.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/494: creat d2/d14/d35/d57/d62/f9e x:0 0 0 2024-04-30T23:15:55.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/495: fdatasync d2/d50/d30/d32/f63 0 2024-04-30T23:15:55.985 INFO:tasks.workunit.client.0.smithi100.stdout:8/442: dwrite d2/d29/d71/f77 [0,4194304] 0 2024-04-30T23:15:55.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/504: sync 2024-04-30T23:15:55.987 INFO:tasks.workunit.client.0.smithi100.stdout:8/443: mkdir d2/d29/d8b 0 2024-04-30T23:15:55.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/505: mkdir d1/d12/d1a/d76/da9 0 2024-04-30T23:15:55.989 INFO:tasks.workunit.client.0.smithi100.stdout:8/444: creat d2/d89/d10/d17/f8c x:0 0 0 2024-04-30T23:15:55.990 INFO:tasks.workunit.client.0.smithi100.stdout:8/445: chown d2/d29/d67/d73/c81 81740 1 2024-04-30T23:15:55.999 INFO:tasks.workunit.client.0.smithi100.stdout:5/506: dread d1/d5f/f83 [0,4194304] 0 2024-04-30T23:15:56.012 INFO:tasks.workunit.client.0.smithi100.stdout:8/446: dwrite d2/d7/d18/f54 [0,4194304] 0 2024-04-30T23:15:56.014 INFO:tasks.workunit.client.0.smithi100.stdout:8/447: rename d2/d29/d71/l75 to d2/d29/d8b/l8d 0 2024-04-30T23:15:56.015 INFO:tasks.workunit.client.0.smithi100.stdout:5/507: dread d1/d12/f16 [0,4194304] 0 2024-04-30T23:15:56.015 INFO:tasks.workunit.client.0.smithi100.stdout:5/508: chown d1/d12/d74/f93 0 1 2024-04-30T23:15:56.015 INFO:tasks.workunit.client.0.smithi100.stdout:5/509: dread - d1/d2c/d5d/fa0 zero size 2024-04-30T23:15:56.015 INFO:tasks.workunit.client.0.smithi100.stdout:5/510: write d1/d12/d1a/d76/d77/f97 [841860,37229] 0 2024-04-30T23:15:56.016 INFO:tasks.workunit.client.0.smithi100.stdout:8/448: mkdir d2/d29/d8b/d8e 0 2024-04-30T23:15:56.016 INFO:tasks.workunit.client.0.smithi100.stdout:5/511: mkdir d1/d3e/daa 0 2024-04-30T23:15:56.016 INFO:tasks.workunit.client.0.smithi100.stdout:5/512: fdatasync d1/d37/f6d 0 2024-04-30T23:15:56.017 INFO:tasks.workunit.client.0.smithi100.stdout:8/449: mkdir d2/d89/d10/d17/d8f 0 2024-04-30T23:15:56.017 INFO:tasks.workunit.client.0.smithi100.stdout:8/450: write d2/d7/d18/d3a/f85 [169669,62325] 0 2024-04-30T23:15:56.018 INFO:tasks.workunit.client.0.smithi100.stdout:5/513: creat d1/d12/d1a/d76/fab x:0 0 0 2024-04-30T23:15:56.018 INFO:tasks.workunit.client.0.smithi100.stdout:5/514: getdents d1/d2c/d5d 0 2024-04-30T23:15:56.020 INFO:tasks.workunit.client.0.smithi100.stdout:5/515: mkdir d1/d2c/dac 0 2024-04-30T23:15:56.021 INFO:tasks.workunit.client.0.smithi100.stdout:5/516: truncate d1/d12/f16 2176330 0 2024-04-30T23:15:56.021 INFO:tasks.workunit.client.0.smithi100.stdout:5/517: rmdir d1/d12 39 2024-04-30T23:15:56.022 INFO:tasks.workunit.client.0.smithi100.stdout:5/518: symlink d1/d3e/d9b/lad 0 2024-04-30T23:15:56.023 INFO:tasks.workunit.client.0.smithi100.stdout:5/519: symlink d1/d12/d27/lae 0 2024-04-30T23:15:56.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/451: write d2/d89/d7f/f7c [16386,94040] 0 2024-04-30T23:15:56.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/452: readlink d2/d29/l41 0 2024-04-30T23:15:56.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/453: dread - d2/d89/d10/d17/f4c zero size 2024-04-30T23:15:56.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/454: fdatasync d2/d89/d10/d17/f87 0 2024-04-30T23:15:56.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/455: stat d2/d89 0 2024-04-30T23:15:56.028 INFO:tasks.workunit.client.0.smithi100.stdout:5/520: getdents d1/d2c 0 2024-04-30T23:15:56.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/521: unlink d1/d12/d24/l98 0 2024-04-30T23:15:56.030 INFO:tasks.workunit.client.0.smithi100.stdout:5/522: stat d1/c4 0 2024-04-30T23:15:56.032 INFO:tasks.workunit.client.0.smithi100.stdout:5/523: rmdir d1/d2c/d60/d66 39 2024-04-30T23:15:56.032 INFO:tasks.workunit.client.0.smithi100.stdout:5/524: fsync d1/d12/d27/fa8 0 2024-04-30T23:15:56.045 INFO:tasks.workunit.client.0.smithi100.stdout:5/525: write d1/d37/d5c/f91 [783272,26641] 0 2024-04-30T23:15:56.045 INFO:tasks.workunit.client.0.smithi100.stdout:5/526: write d1/d12/d24/f4e [18135,1036] 0 2024-04-30T23:15:56.048 INFO:tasks.workunit.client.0.smithi100.stdout:8/456: dwrite d2/d89/d10/d17/f87 [0,4194304] 0 2024-04-30T23:15:56.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/457: dwrite d2/f3 [4194304,4194304] 0 2024-04-30T23:15:56.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/458: dread - d2/d29/f61 zero size 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/459: rmdir d2/d89/d10 39 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/460: stat d2/d29 0 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/461: dread - d2/d29/f61 zero size 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/462: read - d2/d29/f58 zero size 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/463: write d2/d29/f58 [302719,123620] 0 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/464: write d2/ff [8528610,62909] 0 2024-04-30T23:15:56.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/465: dread - d2/d89/f4d zero size 2024-04-30T23:15:56.071 INFO:tasks.workunit.client.0.smithi100.stdout:7/512: sync 2024-04-30T23:15:56.071 INFO:tasks.workunit.client.0.smithi100.stdout:4/500: sync 2024-04-30T23:15:56.089 INFO:tasks.workunit.client.0.smithi100.stdout:7/513: dread d0/f8 [0,4194304] 0 2024-04-30T23:15:56.089 INFO:tasks.workunit.client.0.smithi100.stdout:7/514: chown d0/d1b/d60/d80/d91/ca5 5 1 2024-04-30T23:15:56.089 INFO:tasks.workunit.client.0.smithi100.stdout:7/515: truncate d0/d1d/d5e/d6a/d4b/f9e 481593 0 2024-04-30T23:15:56.090 INFO:tasks.workunit.client.0.smithi100.stdout:4/501: dwrite d19/d1a/d6d/d4e/d6e/f80 [0,4194304] 0 2024-04-30T23:15:56.090 INFO:tasks.workunit.client.0.smithi100.stdout:4/502: fsync d19/d33/d3f/f56 0 2024-04-30T23:15:56.108 INFO:tasks.workunit.client.0.smithi100.stdout:4/503: dwrite d19/d1a/d21/f8b [0,4194304] 0 2024-04-30T23:15:56.110 INFO:tasks.workunit.client.0.smithi100.stdout:4/504: creat d19/d1a/d21/d4a/fa0 x:0 0 0 2024-04-30T23:15:56.112 INFO:tasks.workunit.client.0.smithi100.stdout:4/505: link d19/d1a/l28 d19/d1a/d95/la1 0 2024-04-30T23:15:56.113 INFO:tasks.workunit.client.0.smithi100.stdout:4/506: mkdir d19/d33/d3f/d40/da2 0 2024-04-30T23:15:56.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/320: sync 2024-04-30T23:15:56.191 INFO:tasks.workunit.client.0.smithi100.stdout:6/425: sync 2024-04-30T23:15:56.191 INFO:tasks.workunit.client.0.smithi100.stdout:3/431: sync 2024-04-30T23:15:56.191 INFO:tasks.workunit.client.0.smithi100.stdout:1/378: sync 2024-04-30T23:15:56.191 INFO:tasks.workunit.client.0.smithi100.stdout:0/496: sync 2024-04-30T23:15:56.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/426: fsync d7/df/d23/d24/d2e/d37/f74 0 2024-04-30T23:15:56.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/427: chown d7/d9/l3a 1069457870 1 2024-04-30T23:15:56.192 INFO:tasks.workunit.client.0.smithi100.stdout:2/442: sync 2024-04-30T23:15:56.192 INFO:tasks.workunit.client.0.smithi100.stdout:2/443: chown d5/d12/d13/d4b 10191322 1 2024-04-30T23:15:56.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/321: link d4/d7/d8/d19/f4e d4/d7/d8/d37/d58/f6a 0 2024-04-30T23:15:56.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/379: creat d3/d16/d20/d24/d69/f72 x:0 0 0 2024-04-30T23:15:56.195 INFO:tasks.workunit.client.0.smithi100.stdout:0/497: symlink d2/d50/d38/d5d/l9f 0 2024-04-30T23:15:56.196 INFO:tasks.workunit.client.0.smithi100.stdout:6/428: creat d7/df/d23/d24/f95 x:0 0 0 2024-04-30T23:15:56.196 INFO:tasks.workunit.client.0.smithi100.stdout:9/322: truncate d4/d7/f38 3802421 0 2024-04-30T23:15:56.197 INFO:tasks.workunit.client.0.smithi100.stdout:1/380: truncate d3/d16/d20/d24/f48 1182299 0 2024-04-30T23:15:56.198 INFO:tasks.workunit.client.0.smithi100.stdout:9/323: rename d4/d7/d8/d37/c4c to d4/d7/d8/d37/c6b 0 2024-04-30T23:15:56.199 INFO:tasks.workunit.client.0.smithi100.stdout:1/381: creat d3/d16/d20/d24/d51/d59/f73 x:0 0 0 2024-04-30T23:15:56.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/324: creat d4/d7/d8/d37/f6c x:0 0 0 2024-04-30T23:15:56.202 INFO:tasks.workunit.client.0.smithi100.stdout:1/382: dread d3/d16/f3c [0,4194304] 0 2024-04-30T23:15:56.202 INFO:tasks.workunit.client.0.smithi100.stdout:1/383: readlink d3/l13 0 2024-04-30T23:15:56.203 INFO:tasks.workunit.client.0.smithi100.stdout:1/384: creat d3/d16/d20/d24/d69/f74 x:0 0 0 2024-04-30T23:15:56.206 INFO:tasks.workunit.client.0.smithi100.stdout:9/325: write d4/f5 [683642,13178] 0 2024-04-30T23:15:56.207 INFO:tasks.workunit.client.0.smithi100.stdout:9/326: symlink d4/l6d 0 2024-04-30T23:15:56.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/327: symlink d4/d7/l6e 0 2024-04-30T23:15:56.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/385: getdents d3/d16/d20/d24/d51/d59 0 2024-04-30T23:15:56.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/386: truncate d3/f9 1734573 0 2024-04-30T23:15:56.211 INFO:tasks.workunit.client.0.smithi100.stdout:9/328: mkdir d4/d9/d6f 0 2024-04-30T23:15:56.214 INFO:tasks.workunit.client.0.smithi100.stdout:9/329: mknod d4/d9/d50/c70 0 2024-04-30T23:15:56.216 INFO:tasks.workunit.client.0.smithi100.stdout:1/387: mknod d3/d18/c75 0 2024-04-30T23:15:56.218 INFO:tasks.workunit.client.0.smithi100.stdout:9/330: symlink d4/d7/d8/d37/d58/l71 0 2024-04-30T23:15:56.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/331: mknod d4/d9/d6f/c72 0 2024-04-30T23:15:56.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/332: dread - d4/d7/d8/d37/f6c zero size 2024-04-30T23:15:56.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/432: dwrite d1/d14/d21/f48 [0,4194304] 0 2024-04-30T23:15:56.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/444: dwrite d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:15:56.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/433: mkdir d1/d14/d15/d32/d7d 0 2024-04-30T23:15:56.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/434: chown d1/d14/d15/d32/d7d 6600 1 2024-04-30T23:15:56.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/498: dwrite d2/d14/d35/d57/f6b [0,4194304] 0 2024-04-30T23:15:56.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/499: chown d2/d50/d30/d32/f63 37027554 1 2024-04-30T23:15:56.229 INFO:tasks.workunit.client.0.smithi100.stdout:2/445: creat d5/d47/f8b x:0 0 0 2024-04-30T23:15:56.229 INFO:tasks.workunit.client.0.smithi100.stdout:2/446: fdatasync d5/d12/f2b 0 2024-04-30T23:15:56.233 INFO:tasks.workunit.client.0.smithi100.stdout:2/447: symlink d5/d22/l8c 0 2024-04-30T23:15:56.237 INFO:tasks.workunit.client.0.smithi100.stdout:2/448: rename d5/fe to d5/d12/d73/f8d 0 2024-04-30T23:15:56.237 INFO:tasks.workunit.client.0.smithi100.stdout:2/449: dread - d5/d12/f7d zero size 2024-04-30T23:15:56.242 INFO:tasks.workunit.client.0.smithi100.stdout:9/333: dread d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:56.242 INFO:tasks.workunit.client.0.smithi100.stdout:2/450: write d5/f16 [1146263,8194] 0 2024-04-30T23:15:56.243 INFO:tasks.workunit.client.0.smithi100.stdout:2/451: readlink d5/d47/l84 0 2024-04-30T23:15:56.244 INFO:tasks.workunit.client.0.smithi100.stdout:0/500: write d2/d4c/f9a [2848164,95179] 0 2024-04-30T23:15:56.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/334: symlink d4/d9/d51/l73 0 2024-04-30T23:15:56.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/335: fdatasync d4/d7/f62 0 2024-04-30T23:15:56.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/501: symlink d2/d50/d38/la0 0 2024-04-30T23:15:56.247 INFO:tasks.workunit.client.0.smithi100.stdout:9/336: symlink d4/d9/d50/l74 0 2024-04-30T23:15:56.249 INFO:tasks.workunit.client.0.smithi100.stdout:3/435: write d1/f9 [4680437,53875] 0 2024-04-30T23:15:56.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/452: mkdir d5/d12/d8e 0 2024-04-30T23:15:56.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/453: chown d5/d47/d4c/l83 20318 1 2024-04-30T23:15:56.250 INFO:tasks.workunit.client.0.smithi100.stdout:0/502: creat d2/fa1 x:0 0 0 2024-04-30T23:15:56.250 INFO:tasks.workunit.client.0.smithi100.stdout:0/503: dread - d2/d14/d35/f8e zero size 2024-04-30T23:15:56.251 INFO:tasks.workunit.client.0.smithi100.stdout:9/337: creat d4/d7/d5d/f75 x:0 0 0 2024-04-30T23:15:56.252 INFO:tasks.workunit.client.0.smithi100.stdout:2/454: mkdir d5/d8f 0 2024-04-30T23:15:56.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/338: symlink d4/d7/l76 0 2024-04-30T23:15:56.255 INFO:tasks.workunit.client.0.smithi100.stdout:2/455: unlink d5/l1d 0 2024-04-30T23:15:56.256 INFO:tasks.workunit.client.0.smithi100.stdout:2/456: symlink d5/d12/d8e/l90 0 2024-04-30T23:15:56.261 INFO:tasks.workunit.client.0.smithi100.stdout:0/504: write d2/d14/d18/f2d [1991029,88890] 0 2024-04-30T23:15:56.261 INFO:tasks.workunit.client.0.smithi100.stdout:0/505: write d2/d14/d35/d40/f9b [105023,107330] 0 2024-04-30T23:15:56.263 INFO:tasks.workunit.client.0.smithi100.stdout:0/506: mknod d2/d50/d30/d32/ca2 0 2024-04-30T23:15:56.264 INFO:tasks.workunit.client.0.smithi100.stdout:9/339: dread d4/d7/f38 [0,4194304] 0 2024-04-30T23:15:56.265 INFO:tasks.workunit.client.0.smithi100.stdout:9/340: readlink d4/d7/d8/d37/d58/l71 0 2024-04-30T23:15:56.265 INFO:tasks.workunit.client.0.smithi100.stdout:0/507: rename d2/d14/l22 to d2/d14/d18/la3 0 2024-04-30T23:15:56.266 INFO:tasks.workunit.client.0.smithi100.stdout:0/508: rmdir d2/d14/d35 39 2024-04-30T23:15:56.266 INFO:tasks.workunit.client.0.smithi100.stdout:0/509: write d2/d14/d35/f8e [242859,20731] 0 2024-04-30T23:15:56.266 INFO:tasks.workunit.client.0.smithi100.stdout:0/510: chown d2/d14/d35/l48 4451890 1 2024-04-30T23:15:56.266 INFO:tasks.workunit.client.0.smithi100.stdout:0/511: write d2/fa1 [968629,10460] 0 2024-04-30T23:15:56.267 INFO:tasks.workunit.client.0.smithi100.stdout:0/512: link d2/d50/d30/f6f d2/d50/d38/d6c/fa4 0 2024-04-30T23:15:56.267 INFO:tasks.workunit.client.0.smithi100.stdout:0/513: truncate d2/d50/d38/d6c/d6e/f8a 884073 0 2024-04-30T23:15:56.268 INFO:tasks.workunit.client.0.smithi100.stdout:0/514: mknod d2/d14/d35/d40/d83/ca5 0 2024-04-30T23:15:56.272 INFO:tasks.workunit.client.0.smithi100.stdout:3/436: dwrite d1/d14/d15/d2c/d68/f74 [0,4194304] 0 2024-04-30T23:15:56.272 INFO:tasks.workunit.client.0.smithi100.stdout:3/437: fsync d1/d14/d15/f20 0 2024-04-30T23:15:56.273 INFO:tasks.workunit.client.0.smithi100.stdout:3/438: chown d1/d14/d2b/f4c 201 1 2024-04-30T23:15:56.275 INFO:tasks.workunit.client.0.smithi100.stdout:3/439: rename d1/d14/d2f/f65 to d1/d14/d15/d2c/f7e 0 2024-04-30T23:15:56.281 INFO:tasks.workunit.client.0.smithi100.stdout:9/341: write d4/f33 [1699813,23004] 0 2024-04-30T23:15:56.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/457: dwrite d5/d12/f2b [0,4194304] 0 2024-04-30T23:15:56.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/458: fsync d5/f6d 0 2024-04-30T23:15:56.285 INFO:tasks.workunit.client.0.smithi100.stdout:9/342: stat d4/d9/d10/l3f 0 2024-04-30T23:15:56.301 INFO:tasks.workunit.client.0.smithi100.stdout:0/515: dwrite d2/f59 [0,4194304] 0 2024-04-30T23:15:56.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/459: dread f1 [0,4194304] 0 2024-04-30T23:15:56.303 INFO:tasks.workunit.client.0.smithi100.stdout:0/516: unlink d2/d50/d30/d32/f63 0 2024-04-30T23:15:56.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/440: dwrite d1/d14/d15/f1b [4194304,4194304] 0 2024-04-30T23:15:56.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/441: fdatasync d1/d14/d15/d27/d34/f6e 0 2024-04-30T23:15:56.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/460: creat d5/d26/d2f/f91 x:0 0 0 2024-04-30T23:15:56.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/461: dread - d5/d58/f65 zero size 2024-04-30T23:15:56.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/462: chown d5/d12/d13/l20 1968 1 2024-04-30T23:15:56.315 INFO:tasks.workunit.client.0.smithi100.stdout:0/517: write d2/d14/d18/f33 [3983726,22717] 0 2024-04-30T23:15:56.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/518: link d2/d14/d35/d57/l88 d2/d50/la6 0 2024-04-30T23:15:56.319 INFO:tasks.workunit.client.0.smithi100.stdout:0/519: rename d2/d50/d30/f53 to d2/d14/d35/fa7 0 2024-04-30T23:15:56.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/520: rename d2/d14/d35/d57/d62/f9e to d2/d4c/d68/d94/fa8 0 2024-04-30T23:15:56.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/521: fsync d2/d4c/d68/f69 0 2024-04-30T23:15:56.321 INFO:tasks.workunit.client.0.smithi100.stdout:2/463: dread d5/d26/d2f/f5b [0,4194304] 0 2024-04-30T23:15:56.321 INFO:tasks.workunit.client.0.smithi100.stdout:3/442: dread d1/d14/d21/f55 [0,4194304] 0 2024-04-30T23:15:56.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/464: creat d5/d47/d4c/f92 x:0 0 0 2024-04-30T23:15:56.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/465: read f1 [2041560,118920] 0 2024-04-30T23:15:56.322 INFO:tasks.workunit.client.0.smithi100.stdout:3/443: rmdir d1/d14/d21/d67 39 2024-04-30T23:15:56.324 INFO:tasks.workunit.client.0.smithi100.stdout:3/444: unlink d1/d14/f36 0 2024-04-30T23:15:56.325 INFO:tasks.workunit.client.0.smithi100.stdout:2/466: write d5/d22/f2c [124739,54306] 0 2024-04-30T23:15:56.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/522: write d2/d14/d35/fa7 [1016319,15229] 0 2024-04-30T23:15:56.326 INFO:tasks.workunit.client.0.smithi100.stdout:2/467: creat d5/d12/d8e/f93 x:0 0 0 2024-04-30T23:15:56.327 INFO:tasks.workunit.client.0.smithi100.stdout:0/523: link d2/f23 d2/d50/d30/d32/fa9 0 2024-04-30T23:15:56.332 INFO:tasks.workunit.client.0.smithi100.stdout:5/527: sync 2024-04-30T23:15:56.334 INFO:tasks.workunit.client.0.smithi100.stdout:5/528: link d1/d2c/l3f d1/d3e/laf 0 2024-04-30T23:15:56.338 INFO:tasks.workunit.client.0.smithi100.stdout:3/445: write d1/d14/d15/d2c/f47 [1010594,22125] 0 2024-04-30T23:15:56.339 INFO:tasks.workunit.client.0.smithi100.stdout:2/468: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:56.339 INFO:tasks.workunit.client.0.smithi100.stdout:2/469: write d5/f6d [980095,9128] 0 2024-04-30T23:15:56.340 INFO:tasks.workunit.client.0.smithi100.stdout:3/446: unlink d1/f4e 0 2024-04-30T23:15:56.341 INFO:tasks.workunit.client.0.smithi100.stdout:2/470: mknod d5/d26/d2f/c94 0 2024-04-30T23:15:56.341 INFO:tasks.workunit.client.0.smithi100.stdout:2/471: write d5/d47/d66/f69 [1632693,17812] 0 2024-04-30T23:15:56.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/472: write d5/d12/f7d [860528,29314] 0 2024-04-30T23:15:56.342 INFO:tasks.workunit.client.0.smithi100.stdout:3/447: creat d1/d14/d15/f7f x:0 0 0 2024-04-30T23:15:56.343 INFO:tasks.workunit.client.0.smithi100.stdout:2/473: creat d5/d58/f95 x:0 0 0 2024-04-30T23:15:56.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/448: getdents d1/d14/d15/d2c 0 2024-04-30T23:15:56.347 INFO:tasks.workunit.client.0.smithi100.stdout:5/529: dread d1/d19/f1e [0,4194304] 0 2024-04-30T23:15:56.347 INFO:tasks.workunit.client.0.smithi100.stdout:5/530: dread - d1/d12/d1a/d76/f7a zero size 2024-04-30T23:15:56.348 INFO:tasks.workunit.client.0.smithi100.stdout:5/531: symlink d1/d3e/lb0 0 2024-04-30T23:15:56.349 INFO:tasks.workunit.client.0.smithi100.stdout:3/449: write d1/d38/f5c [854691,83261] 0 2024-04-30T23:15:56.349 INFO:tasks.workunit.client.0.smithi100.stdout:3/450: chown d1/d38/l64 61826 1 2024-04-30T23:15:56.350 INFO:tasks.workunit.client.0.smithi100.stdout:3/451: rename d1/f13 to d1/d14/d2b/d57/f80 0 2024-04-30T23:15:56.351 INFO:tasks.workunit.client.0.smithi100.stdout:5/532: dread d1/d12/f23 [0,4194304] 0 2024-04-30T23:15:56.351 INFO:tasks.workunit.client.0.smithi100.stdout:5/533: write d1/f5a [1914033,30071] 0 2024-04-30T23:15:56.352 INFO:tasks.workunit.client.0.smithi100.stdout:3/452: truncate d1/d14/d15/d2c/d68/d26/f28 2970129 0 2024-04-30T23:15:56.353 INFO:tasks.workunit.client.0.smithi100.stdout:5/534: symlink d1/d12/d1a/d76/lb1 0 2024-04-30T23:15:56.354 INFO:tasks.workunit.client.0.smithi100.stdout:3/453: unlink d1/d14/f76 0 2024-04-30T23:15:56.358 INFO:tasks.workunit.client.0.smithi100.stdout:3/454: mkdir d1/d14/d15/d2c/d68/d6d/d81 0 2024-04-30T23:15:56.370 INFO:tasks.workunit.client.0.smithi100.stdout:2/474: dwrite d5/d47/f7b [0,4194304] 0 2024-04-30T23:15:56.375 INFO:tasks.workunit.client.0.smithi100.stdout:2/475: write d5/d12/f7d [85797,24371] 0 2024-04-30T23:15:56.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/476: getdents d5/d58 0 2024-04-30T23:15:56.385 INFO:tasks.workunit.client.0.smithi100.stdout:3/455: dwrite d1/d14/d15/f16 [0,4194304] 0 2024-04-30T23:15:56.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/456: mknod d1/d38/c82 0 2024-04-30T23:15:56.387 INFO:tasks.workunit.client.0.smithi100.stdout:3/457: symlink d1/d14/d15/d2c/d68/d6d/l83 0 2024-04-30T23:15:56.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/458: creat d1/d14/d15/d32/d7d/f84 x:0 0 0 2024-04-30T23:15:56.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/459: chown d1/d14/d15/d2c/d68/d26/f23 15 1 2024-04-30T23:15:56.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/460: chown d1/d14/d15 5158 1 2024-04-30T23:15:56.389 INFO:tasks.workunit.client.0.smithi100.stdout:3/461: chown d1/d38/c82 32 1 2024-04-30T23:15:56.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/462: write d1/f10 [1394855,45047] 0 2024-04-30T23:15:56.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/463: stat d1/f9 0 2024-04-30T23:15:56.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/477: dwrite d5/f2d [0,4194304] 0 2024-04-30T23:15:56.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/478: fsync d5/f14 0 2024-04-30T23:15:56.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/479: write d5/d22/f40 [1934304,853] 0 2024-04-30T23:15:56.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/464: link d1/d14/d21/l3c d1/d14/d15/d27/d34/l85 0 2024-04-30T23:15:56.402 INFO:tasks.workunit.client.0.smithi100.stdout:2/480: creat d5/d47/d66/f96 x:0 0 0 2024-04-30T23:15:56.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/466: sync 2024-04-30T23:15:56.408 INFO:tasks.workunit.client.0.smithi100.stdout:7/516: sync 2024-04-30T23:15:56.408 INFO:tasks.workunit.client.0.smithi100.stdout:7/517: readlink d0/d1b/d60/d48/d4a/d5b/l66 0 2024-04-30T23:15:56.409 INFO:tasks.workunit.client.0.smithi100.stdout:7/518: symlink d0/d1b/d85/lac 0 2024-04-30T23:15:56.410 INFO:tasks.workunit.client.0.smithi100.stdout:8/467: symlink d2/d29/d67/d73/l90 0 2024-04-30T23:15:56.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/468: unlink d2/d29/f7d 0 2024-04-30T23:15:56.414 INFO:tasks.workunit.client.0.smithi100.stdout:8/469: link d2/d29/l57 d2/d89/d10/d52/l91 0 2024-04-30T23:15:56.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/465: dwrite d1/d14/d15/d32/d7d/f84 [0,4194304] 0 2024-04-30T23:15:56.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/466: write d1/d14/d15/f6a [400214,74027] 0 2024-04-30T23:15:56.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/519: dread d0/d1b/d1e/f40 [0,4194304] 0 2024-04-30T23:15:56.424 INFO:tasks.workunit.client.0.smithi100.stdout:3/467: symlink d1/d14/d21/d67/l86 0 2024-04-30T23:15:56.426 INFO:tasks.workunit.client.0.smithi100.stdout:3/468: truncate d1/d14/d15/d2c/f47 1860206 0 2024-04-30T23:15:56.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/481: dwrite d5/d22/f60 [0,4194304] 0 2024-04-30T23:15:56.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/482: stat d5/d12/d13/c27 0 2024-04-30T23:15:56.431 INFO:tasks.workunit.client.0.smithi100.stdout:7/520: write d0/d1d/d3c/f47 [523319,14771] 0 2024-04-30T23:15:56.442 INFO:tasks.workunit.client.0.smithi100.stdout:8/470: dwrite d2/d89/d10/d17/f1a [0,4194304] 0 2024-04-30T23:15:56.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/483: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:56.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/484: chown d5/d12/d70 44 1 2024-04-30T23:15:56.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/469: dwrite d1/d14/d15/d32/f3e [0,4194304] 0 2024-04-30T23:15:56.450 INFO:tasks.workunit.client.0.smithi100.stdout:7/521: write d0/d1d/d5e/d6a/f2d [3458920,19597] 0 2024-04-30T23:15:56.452 INFO:tasks.workunit.client.0.smithi100.stdout:7/522: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad 0 2024-04-30T23:15:56.453 INFO:tasks.workunit.client.0.smithi100.stdout:7/523: creat d0/d1d/d3c/fae x:0 0 0 2024-04-30T23:15:56.454 INFO:tasks.workunit.client.0.smithi100.stdout:7/524: symlink d0/d1d/d3f/laf 0 2024-04-30T23:15:56.454 INFO:tasks.workunit.client.0.smithi100.stdout:7/525: chown d0/d1b/d2e/c43 14667960 1 2024-04-30T23:15:56.455 INFO:tasks.workunit.client.0.smithi100.stdout:2/485: dread d5/d12/d73/f8d [0,4194304] 0 2024-04-30T23:15:56.455 INFO:tasks.workunit.client.0.smithi100.stdout:7/526: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db0 0 2024-04-30T23:15:56.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/471: dread d2/d89/d7f/f39 [0,4194304] 0 2024-04-30T23:15:56.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/472: symlink d2/d29/d67/d73/l92 0 2024-04-30T23:15:56.464 INFO:tasks.workunit.client.0.smithi100.stdout:3/470: dread d1/d14/d2b/f4c [0,4194304] 0 2024-04-30T23:15:56.466 INFO:tasks.workunit.client.0.smithi100.stdout:3/471: rename d1/d14/d15/d32/l4b to d1/d14/d15/d2c/d68/l87 0 2024-04-30T23:15:56.467 INFO:tasks.workunit.client.0.smithi100.stdout:3/472: creat d1/d14/d15/d27/f88 x:0 0 0 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/473: truncate d1/d14/d15/d2c/f47 1765213 0 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:7/527: dread d0/d1b/d2e/f32 [4194304,4194304] 0 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/474: rmdir d1/d14/d15/d32/d7d 39 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/475: readlink d1/d14/d2b/l46 0 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/476: chown d1/d14/d15/d27/d5d 431245037 1 2024-04-30T23:15:56.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/477: write d1/d14/d15/d2c/d68/d26/f28 [376971,83430] 0 2024-04-30T23:15:56.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/528: write d0/d1b/d60/d48/d4a/f4d [3800244,66475] 0 2024-04-30T23:15:56.480 INFO:tasks.workunit.client.0.smithi100.stdout:7/529: unlink d0/d1d/c23 0 2024-04-30T23:15:56.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/530: mkdir d0/df/d4f/d93/db1 0 2024-04-30T23:15:56.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/531: fdatasync d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/fa8 0 2024-04-30T23:15:56.482 INFO:tasks.workunit.client.0.smithi100.stdout:7/532: creat d0/d1b/d60/fb2 x:0 0 0 2024-04-30T23:15:56.482 INFO:tasks.workunit.client.0.smithi100.stdout:8/473: dwrite d2/f3e [0,4194304] 0 2024-04-30T23:15:56.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/533: creat d0/d1d/fb3 x:0 0 0 2024-04-30T23:15:56.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/474: mkdir d2/d89/d72/d93 0 2024-04-30T23:15:56.487 INFO:tasks.workunit.client.0.smithi100.stdout:7/534: getdents d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d 0 2024-04-30T23:15:56.487 INFO:tasks.workunit.client.0.smithi100.stdout:3/478: dwrite d1/d14/f5f [0,4194304] 0 2024-04-30T23:15:56.488 INFO:tasks.workunit.client.0.smithi100.stdout:8/475: creat d2/d29/d71/d86/f94 x:0 0 0 2024-04-30T23:15:56.488 INFO:tasks.workunit.client.0.smithi100.stdout:8/476: write d2/d89/d10/f19 [4230229,42074] 0 2024-04-30T23:15:56.492 INFO:tasks.workunit.client.0.smithi100.stdout:3/479: creat d1/d14/d15/d2c/d68/d26/f89 x:0 0 0 2024-04-30T23:15:56.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/480: mknod d1/d14/d15/d32/c8a 0 2024-04-30T23:15:56.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/535: write d0/d1b/d60/d48/f50 [1778341,868] 0 2024-04-30T23:15:56.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/536: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4 0 2024-04-30T23:15:56.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/537: dread d0/d1b/f2b [0,4194304] 0 2024-04-30T23:15:56.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/538: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5 0 2024-04-30T23:15:56.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/539: chown d0/d1b/d60/d48/d4a/l9f 2343418 1 2024-04-30T23:15:56.515 INFO:tasks.workunit.client.0.smithi100.stdout:7/540: unlink d0/d1d/d3c/l8a 0 2024-04-30T23:15:56.518 INFO:tasks.workunit.client.0.smithi100.stdout:3/481: dwrite d1/d14/d21/f2d [0,4194304] 0 2024-04-30T23:15:56.518 INFO:tasks.workunit.client.0.smithi100.stdout:3/482: chown d1/d14/d21/f2d 9840776 1 2024-04-30T23:15:56.529 INFO:tasks.workunit.client.0.smithi100.stdout:3/483: write d1/d14/d21/f48 [47427,104956] 0 2024-04-30T23:15:56.529 INFO:tasks.workunit.client.0.smithi100.stdout:3/484: readlink d1/d14/d15/d2c/l56 0 2024-04-30T23:15:56.531 INFO:tasks.workunit.client.0.smithi100.stdout:3/485: rename d1/d14/d15/d2c/c66 to d1/d14/d15/d2c/d68/d26/c8b 0 2024-04-30T23:15:56.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/486: mkdir d1/d14/d15/d2c/d68/d8c 0 2024-04-30T23:15:56.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/487: write d1/d38/f5c [572649,43950] 0 2024-04-30T23:15:56.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/488: write d1/d14/d15/d2c/f47 [1192708,124320] 0 2024-04-30T23:15:56.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/489: creat d1/f8d x:0 0 0 2024-04-30T23:15:56.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/490: read - d1/d14/d2b/f53 zero size 2024-04-30T23:15:56.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/491: write d1/d14/d2f/f7c [508319,113625] 0 2024-04-30T23:15:56.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/492: stat d1/d14/d21/f31 0 2024-04-30T23:15:56.534 INFO:tasks.workunit.client.0.smithi100.stdout:7/541: dwrite d0/d1d/fb3 [0,4194304] 0 2024-04-30T23:15:56.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/493: rmdir d1/d14/d15/d2c/d68/d26 39 2024-04-30T23:15:56.535 INFO:tasks.workunit.client.0.smithi100.stdout:7/542: stat d0/c11 0 2024-04-30T23:15:56.535 INFO:tasks.workunit.client.0.smithi100.stdout:7/543: write d0/f16 [4517759,78774] 0 2024-04-30T23:15:56.536 INFO:tasks.workunit.client.0.smithi100.stdout:3/494: creat d1/d14/d21/f8e x:0 0 0 2024-04-30T23:15:56.536 INFO:tasks.workunit.client.0.smithi100.stdout:7/544: symlink d0/d1d/d5e/d6a/d4b/d79/lb6 0 2024-04-30T23:15:56.538 INFO:tasks.workunit.client.0.smithi100.stdout:3/495: rmdir d1/d14/d15/d2c/d68/d8c 0 2024-04-30T23:15:56.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/545: link d0/df/d4f/lab d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/lb7 0 2024-04-30T23:15:56.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/546: fsync d0/d1b/d60/f54 0 2024-04-30T23:15:56.541 INFO:tasks.workunit.client.0.smithi100.stdout:7/547: truncate d0/df/f14 313735 0 2024-04-30T23:15:56.541 INFO:tasks.workunit.client.0.smithi100.stdout:7/548: truncate d0/d1d/d5e/d6a/d4b/f9e 958243 0 2024-04-30T23:15:56.542 INFO:tasks.workunit.client.0.smithi100.stdout:7/549: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/db8 0 2024-04-30T23:15:56.542 INFO:tasks.workunit.client.0.smithi100.stdout:7/550: chown d0/d1b/d60/d48 1206029 1 2024-04-30T23:15:56.543 INFO:tasks.workunit.client.0.smithi100.stdout:7/551: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/lb9 0 2024-04-30T23:15:56.559 INFO:tasks.workunit.client.0.smithi100.stdout:3/496: dwrite d1/d14/d2b/f53 [0,4194304] 0 2024-04-30T23:15:56.559 INFO:tasks.workunit.client.0.smithi100.stdout:3/497: fsync d1/d14/d15/d32/f3e 0 2024-04-30T23:15:56.560 INFO:tasks.workunit.client.0.smithi100.stdout:7/552: dread d0/d1b/d60/d48/f50 [0,4194304] 0 2024-04-30T23:15:56.560 INFO:tasks.workunit.client.0.smithi100.stdout:7/553: stat d0/d1d/fb3 0 2024-04-30T23:15:56.565 INFO:tasks.workunit.client.0.smithi100.stdout:3/498: mknod d1/d14/d15/d27/d5d/c8f 0 2024-04-30T23:15:56.567 INFO:tasks.workunit.client.0.smithi100.stdout:7/554: rename d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/fa2 to d0/df/d4f/d53/da9/fba 0 2024-04-30T23:15:56.569 INFO:tasks.workunit.client.0.smithi100.stdout:7/555: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb 0 2024-04-30T23:15:56.569 INFO:tasks.workunit.client.0.smithi100.stdout:7/556: write d0/d1b/d2e/f63 [803262,67085] 0 2024-04-30T23:15:56.571 INFO:tasks.workunit.client.0.smithi100.stdout:7/557: creat d0/df/d4f/fbc x:0 0 0 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/558: mknod d0/d1d/d5e/d6a/cbd 0 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/559: write d0/d1b/d60/d80/f90 [406268,58061] 0 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/560: read d0/d1b/d2e/f63 [838873,92899] 0 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/561: chown d0/d1d/d3f 5 1 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/562: read d0/d1b/d2e/f32 [6147634,3183] 0 2024-04-30T23:15:56.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/563: truncate d0/d1b/d60/d48/f8e 324671 0 2024-04-30T23:15:56.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/564: mkdir d0/d1b/d60/dbe 0 2024-04-30T23:15:56.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/565: truncate d0/df/f14 4311 0 2024-04-30T23:15:56.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/566: fsync d0/d1b/d60/f54 0 2024-04-30T23:15:56.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/567: rename d0/f18 to d0/d1d/d5e/d6a/d4b/d79/d2a/fbf 0 2024-04-30T23:15:56.578 INFO:tasks.workunit.client.0.smithi100.stdout:3/499: read d1/d14/d2b/f53 [2412150,74091] 0 2024-04-30T23:15:56.579 INFO:tasks.workunit.client.0.smithi100.stdout:3/500: rmdir d1/d14/d2f 39 2024-04-30T23:15:56.579 INFO:tasks.workunit.client.0.smithi100.stdout:3/501: chown d1/d14/c70 7978109 1 2024-04-30T23:15:56.580 INFO:tasks.workunit.client.0.smithi100.stdout:3/502: mkdir d1/d14/d15/d2c/d68/d6d/d7b/d90 0 2024-04-30T23:15:56.581 INFO:tasks.workunit.client.0.smithi100.stdout:3/503: mknod d1/d14/d15/d32/d71/c91 0 2024-04-30T23:15:56.582 INFO:tasks.workunit.client.0.smithi100.stdout:3/504: mkdir d1/d14/d15/d32/d92 0 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:1/388: sync 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:4/507: sync 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/343: sync 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:1/389: chown d3/l65 61254 1 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/429: sync 2024-04-30T23:15:56.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/344: write d4/d7/d8/d37/f59 [545457,30686] 0 2024-04-30T23:15:56.595 INFO:tasks.workunit.client.0.smithi100.stdout:4/508: symlink d19/d1a/d6d/d4e/la3 0 2024-04-30T23:15:56.596 INFO:tasks.workunit.client.0.smithi100.stdout:7/568: dwrite d0/d1d/fb3 [0,4194304] 0 2024-04-30T23:15:56.596 INFO:tasks.workunit.client.0.smithi100.stdout:1/390: unlink d3/d16/d20/d24/f2b 0 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/345: creat d4/d7/d8/d37/d58/f77 x:0 0 0 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/346: fsync d4/d7/f38 0 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/347: chown d4/l6d 10 1 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/348: fsync d4/d7/d8/f36 0 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:3/505: dread d1/d38/f60 [0,4194304] 0 2024-04-30T23:15:56.597 INFO:tasks.workunit.client.0.smithi100.stdout:6/430: creat d7/d9/d8e/f96 x:0 0 0 2024-04-30T23:15:56.598 INFO:tasks.workunit.client.0.smithi100.stdout:4/509: creat d19/d1a/d21/d4a/fa4 x:0 0 0 2024-04-30T23:15:56.599 INFO:tasks.workunit.client.0.smithi100.stdout:4/510: truncate f3 1722855 0 2024-04-30T23:15:56.599 INFO:tasks.workunit.client.0.smithi100.stdout:4/511: chown d19/f2f 5207 1 2024-04-30T23:15:56.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/569: link d0/d1b/f2b d0/df/d4f/d53/fc0 0 2024-04-30T23:15:56.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/349: rmdir d4/d7/d60 39 2024-04-30T23:15:56.601 INFO:tasks.workunit.client.0.smithi100.stdout:6/431: mknod d7/d9/c97 0 2024-04-30T23:15:56.602 INFO:tasks.workunit.client.0.smithi100.stdout:4/512: chown d19/d1a/c1d 301 1 2024-04-30T23:15:56.602 INFO:tasks.workunit.client.0.smithi100.stdout:7/570: stat d0/d1b/d60/d48/c99 0 2024-04-30T23:15:56.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/391: truncate d3/d18/d60/f64 2479216 0 2024-04-30T23:15:56.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/392: readlink d3/d16/d20/l55 0 2024-04-30T23:15:56.604 INFO:tasks.workunit.client.0.smithi100.stdout:9/350: creat d4/d9/d10/f78 x:0 0 0 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/432: dread d7/df/d23/d24/d2e/f69 [0,4194304] 0 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/433: chown d7/df/d23/d4f 45 1 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/434: stat d7/d11 0 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/435: write d7/df/d23/d24/d2e/f69 [578208,71379] 0 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:4/513: mknod d19/d33/d7d/ca5 0 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:4/514: read - d19/d1a/d6d/d4e/d6e/f9f zero size 2024-04-30T23:15:56.605 INFO:tasks.workunit.client.0.smithi100.stdout:7/571: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/fc1 x:0 0 0 2024-04-30T23:15:56.607 INFO:tasks.workunit.client.0.smithi100.stdout:9/351: symlink d4/d9/l79 0 2024-04-30T23:15:56.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/436: mkdir d7/d9/d86/d1b/d59/d98 0 2024-04-30T23:15:56.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/515: creat d19/d1a/d21/d4a/fa6 x:0 0 0 2024-04-30T23:15:56.615 INFO:tasks.workunit.client.0.smithi100.stdout:3/506: dwrite d1/d14/d15/f72 [0,4194304] 0 2024-04-30T23:15:56.617 INFO:tasks.workunit.client.0.smithi100.stdout:9/352: symlink d4/d9/d6f/l7a 0 2024-04-30T23:15:56.617 INFO:tasks.workunit.client.0.smithi100.stdout:9/353: truncate d4/d7/d5d/f75 217629 0 2024-04-30T23:15:56.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/437: rename d7/d9/d86/d1b/d22/d38/l49 to d7/df/d23/d24/d2e/d37/l99 0 2024-04-30T23:15:56.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/438: stat d7/db/d3b/c54 0 2024-04-30T23:15:56.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/439: chown d7/df/f53 0 1 2024-04-30T23:15:56.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/440: readlink d7/l8 0 2024-04-30T23:15:56.621 INFO:tasks.workunit.client.0.smithi100.stdout:4/516: unlink cf 0 2024-04-30T23:15:56.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/572: dwrite d0/d1d/d5e/d6a/f6d [0,4194304] 0 2024-04-30T23:15:56.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/573: dread - d0/d1b/d60/f54 zero size 2024-04-30T23:15:56.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/507: symlink d1/d14/d2b/d57/l93 0 2024-04-30T23:15:56.626 INFO:tasks.workunit.client.0.smithi100.stdout:9/354: rename d4/d7/d8/d37/f42 to d4/d7/d8/f7b 0 2024-04-30T23:15:56.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/441: symlink d7/d9/d86/d1b/d5a/l9a 0 2024-04-30T23:15:56.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/442: stat d7/f21 0 2024-04-30T23:15:56.630 INFO:tasks.workunit.client.0.smithi100.stdout:1/393: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:15:56.636 INFO:tasks.workunit.client.0.smithi100.stdout:4/517: creat d19/d1a/d21/d4a/d53/d5e/d7e/fa7 x:0 0 0 2024-04-30T23:15:56.636 INFO:tasks.workunit.client.0.smithi100.stdout:7/574: symlink d0/df/d4f/d53/da9/lc2 0 2024-04-30T23:15:56.636 INFO:tasks.workunit.client.0.smithi100.stdout:4/518: truncate d19/f6f 646184 0 2024-04-30T23:15:56.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/443: write d7/db/d3b/f58 [1224182,129565] 0 2024-04-30T23:15:56.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/444: dread - d7/d9/d86/d1b/d5a/f66 zero size 2024-04-30T23:15:56.647 INFO:tasks.workunit.client.0.smithi100.stdout:4/519: creat d19/d1a/d6d/d4e/d6e/fa8 x:0 0 0 2024-04-30T23:15:56.652 INFO:tasks.workunit.client.0.smithi100.stdout:6/445: creat d7/df/d23/d24/d2e/d37/f9b x:0 0 0 2024-04-30T23:15:56.654 INFO:tasks.workunit.client.0.smithi100.stdout:4/520: symlink d19/d33/d3f/la9 0 2024-04-30T23:15:56.655 INFO:tasks.workunit.client.0.smithi100.stdout:6/446: getdents d7/d9/d86/d1b/d3f 0 2024-04-30T23:15:56.657 INFO:tasks.workunit.client.0.smithi100.stdout:6/447: mknod d7/d9/d86/d62/c9c 0 2024-04-30T23:15:56.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/524: sync 2024-04-30T23:15:56.660 INFO:tasks.workunit.client.0.smithi100.stdout:2/486: sync 2024-04-30T23:15:56.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/477: sync 2024-04-30T23:15:56.660 INFO:tasks.workunit.client.0.smithi100.stdout:5/535: sync 2024-04-30T23:15:56.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/478: write d2/d89/d10/d52/f65 [872640,71875] 0 2024-04-30T23:15:56.660 INFO:tasks.workunit.client.0.smithi100.stdout:5/536: write d1/d5f/f83 [2610815,111207] 0 2024-04-30T23:15:56.662 INFO:tasks.workunit.client.0.smithi100.stdout:8/479: mknod d2/d29/d71/c95 0 2024-04-30T23:15:56.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/575: dwrite d0/d1d/d5e/d6a/d4b/d79/f75 [0,4194304] 0 2024-04-30T23:15:56.662 INFO:tasks.workunit.client.0.smithi100.stdout:1/394: dwrite d3/f4f [0,4194304] 0 2024-04-30T23:15:56.662 INFO:tasks.workunit.client.0.smithi100.stdout:9/355: dwrite d4/d9/d10/f3a [0,4194304] 0 2024-04-30T23:15:56.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/487: write d5/f49 [273650,103691] 0 2024-04-30T23:15:56.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/488: chown d5/d22/c24 1486532 1 2024-04-30T23:15:56.666 INFO:tasks.workunit.client.0.smithi100.stdout:5/537: mkdir d1/d12/d24/d34/db2 0 2024-04-30T23:15:56.666 INFO:tasks.workunit.client.0.smithi100.stdout:8/480: creat d2/d29/d8b/d8e/f96 x:0 0 0 2024-04-30T23:15:56.666 INFO:tasks.workunit.client.0.smithi100.stdout:8/481: readlink d2/d7/l6d 0 2024-04-30T23:15:56.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/576: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/lc3 0 2024-04-30T23:15:56.668 INFO:tasks.workunit.client.0.smithi100.stdout:5/538: creat d1/d3e/fb3 x:0 0 0 2024-04-30T23:15:56.668 INFO:tasks.workunit.client.0.smithi100.stdout:5/539: chown d1/d2c/l43 138 1 2024-04-30T23:15:56.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/577: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/fc4 x:0 0 0 2024-04-30T23:15:56.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/525: dread d2/d14/d35/f39 [4194304,4194304] 0 2024-04-30T23:15:56.683 INFO:tasks.workunit.client.0.smithi100.stdout:7/578: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/dc5 0 2024-04-30T23:15:56.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/526: symlink d2/d14/d35/d57/d62/laa 0 2024-04-30T23:15:56.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/356: dread d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:56.688 INFO:tasks.workunit.client.0.smithi100.stdout:4/521: dwrite f12 [0,4194304] 0 2024-04-30T23:15:56.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/357: write d4/f5e [3300734,103514] 0 2024-04-30T23:15:56.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/358: write d4/d7/d8/d37/f4b [211562,125756] 0 2024-04-30T23:15:56.691 INFO:tasks.workunit.client.0.smithi100.stdout:6/448: dwrite d7/d9/f28 [8388608,4194304] 0 2024-04-30T23:15:56.692 INFO:tasks.workunit.client.0.smithi100.stdout:6/449: symlink d7/d9/d86/d3e/l9d 0 2024-04-30T23:15:56.697 INFO:tasks.workunit.client.0.smithi100.stdout:8/482: dwrite d2/d89/d10/d17/f87 [0,4194304] 0 2024-04-30T23:15:56.697 INFO:tasks.workunit.client.0.smithi100.stdout:5/540: dread d1/d12/f31 [0,4194304] 0 2024-04-30T23:15:56.697 INFO:tasks.workunit.client.0.smithi100.stdout:5/541: fsync d1/d12/d24/f4e 0 2024-04-30T23:15:56.697 INFO:tasks.workunit.client.0.smithi100.stdout:5/542: chown d1/c4 0 1 2024-04-30T23:15:56.701 INFO:tasks.workunit.client.0.smithi100.stdout:2/489: dread d5/d22/f42 [0,4194304] 0 2024-04-30T23:15:56.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/490: rmdir d5/d12/d13/d72 39 2024-04-30T23:15:56.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/491: chown d5/d12/d73/f8d 29 1 2024-04-30T23:15:56.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/492: rename d5/d12/d13/d72/c7e to d5/d12/c97 0 2024-04-30T23:15:56.708 INFO:tasks.workunit.client.0.smithi100.stdout:2/493: creat d5/d12/d8e/f98 x:0 0 0 2024-04-30T23:15:56.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/494: unlink d5/d47/d4c/l83 0 2024-04-30T23:15:56.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/495: chown d5/d47/d66/c88 15838723 1 2024-04-30T23:15:56.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/496: fdatasync d5/f16 0 2024-04-30T23:15:56.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/497: chown d5/d22/f2c 5174 1 2024-04-30T23:15:56.711 INFO:tasks.workunit.client.0.smithi100.stdout:1/395: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:15:56.712 INFO:tasks.workunit.client.0.smithi100.stdout:4/522: dread d19/d33/f86 [0,4194304] 0 2024-04-30T23:15:56.712 INFO:tasks.workunit.client.0.smithi100.stdout:4/523: fdatasync d19/d1a/d21/d4a/d53/d5d/f68 0 2024-04-30T23:15:56.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/498: creat d5/d12/d13/d4b/f99 x:0 0 0 2024-04-30T23:15:56.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/450: write d7/d9/f51 [3348098,110352] 0 2024-04-30T23:15:56.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/396: symlink d3/d16/d20/d24/d69/l76 0 2024-04-30T23:15:56.715 INFO:tasks.workunit.client.0.smithi100.stdout:4/524: symlink d19/d1a/d29/laa 0 2024-04-30T23:15:56.716 INFO:tasks.workunit.client.0.smithi100.stdout:9/359: dwrite d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:56.716 INFO:tasks.workunit.client.0.smithi100.stdout:2/499: creat d5/d12/f9a x:0 0 0 2024-04-30T23:15:56.717 INFO:tasks.workunit.client.0.smithi100.stdout:6/451: symlink d7/d9/d86/d3e/d6b/l9e 0 2024-04-30T23:15:56.717 INFO:tasks.workunit.client.0.smithi100.stdout:1/397: mknod d3/d16/d20/d24/d51/c77 0 2024-04-30T23:15:56.719 INFO:tasks.workunit.client.0.smithi100.stdout:9/360: mkdir d4/d9/d51/d7c 0 2024-04-30T23:15:56.720 INFO:tasks.workunit.client.0.smithi100.stdout:2/500: mkdir d5/d26/d9b 0 2024-04-30T23:15:56.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/579: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/fc1 [0,4194304] 0 2024-04-30T23:15:56.721 INFO:tasks.workunit.client.0.smithi100.stdout:0/527: dwrite d2/f8 [0,4194304] 0 2024-04-30T23:15:56.722 INFO:tasks.workunit.client.0.smithi100.stdout:6/452: mkdir d7/df/d23/d24/d2e/d9f 0 2024-04-30T23:15:56.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/398: symlink d3/d16/d20/d24/d51/d59/l78 0 2024-04-30T23:15:56.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/361: rename d4/d7/f12 to d4/d9/f7d 0 2024-04-30T23:15:56.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/580: getdents d0/d1b/d2e/d3d 0 2024-04-30T23:15:56.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/362: dread - d4/d7/d5d/f64 zero size 2024-04-30T23:15:56.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/581: write d0/d1b/d60/d48/f8e [479536,118462] 0 2024-04-30T23:15:56.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/363: creat d4/d9/d10/f7e x:0 0 0 2024-04-30T23:15:56.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/501: rename d5/d12/d13/l1c to d5/d26/d2f/d38/l9c 0 2024-04-30T23:15:56.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/502: write d5/d12/d13/d4b/f99 [384638,43790] 0 2024-04-30T23:15:56.734 INFO:tasks.workunit.client.0.smithi100.stdout:8/483: dwrite d2/d89/d10/d17/f66 [0,4194304] 0 2024-04-30T23:15:56.735 INFO:tasks.workunit.client.0.smithi100.stdout:5/543: dwrite d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:15:56.738 INFO:tasks.workunit.client.0.smithi100.stdout:9/364: rename d4/d9/d51/d7c to d4/d9/d10/d7f 0 2024-04-30T23:15:56.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/484: unlink d2/d89/d10/d17/c31 0 2024-04-30T23:15:56.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/485: chown d2/d89/d10/d17/d8f 93 1 2024-04-30T23:15:56.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/486: truncate d2/f78 826248 0 2024-04-30T23:15:56.741 INFO:tasks.workunit.client.0.smithi100.stdout:1/399: dwrite d3/d16/d20/f22 [0,4194304] 0 2024-04-30T23:15:56.741 INFO:tasks.workunit.client.0.smithi100.stdout:2/503: mknod d5/d12/c9d 0 2024-04-30T23:15:56.741 INFO:tasks.workunit.client.0.smithi100.stdout:2/504: fdatasync d5/d47/d4c/f4f 0 2024-04-30T23:15:56.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/528: dread d2/d14/d35/f5e [0,4194304] 0 2024-04-30T23:15:56.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/365: dread d4/d7/d8/d37/f59 [0,4194304] 0 2024-04-30T23:15:56.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/366: read d4/d7/d5d/f75 [198239,77768] 0 2024-04-30T23:15:56.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/367: write d4/d7/d8/f7b [5022099,98117] 0 2024-04-30T23:15:56.744 INFO:tasks.workunit.client.0.smithi100.stdout:9/368: chown d4/d7/d8/d19/f29 2166 1 2024-04-30T23:15:56.744 INFO:tasks.workunit.client.0.smithi100.stdout:5/544: mknod d1/d3e/cb4 0 2024-04-30T23:15:56.744 INFO:tasks.workunit.client.0.smithi100.stdout:5/545: write d1/d2c/d60/f84 [1166577,1761] 0 2024-04-30T23:15:56.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/453: dread d7/d9/d86/f30 [0,4194304] 0 2024-04-30T23:15:56.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/487: mkdir d2/d97 0 2024-04-30T23:15:56.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/488: write d2/d89/d10/d17/f4c [196391,52879] 0 2024-04-30T23:15:56.755 INFO:tasks.workunit.client.0.smithi100.stdout:2/505: mkdir d5/d12/d13/d9e 0 2024-04-30T23:15:56.755 INFO:tasks.workunit.client.0.smithi100.stdout:2/506: write d5/d22/f40 [5049590,84860] 0 2024-04-30T23:15:56.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/529: mknod d2/d14/d35/d40/cab 0 2024-04-30T23:15:56.756 INFO:tasks.workunit.client.0.smithi100.stdout:9/369: mknod d4/d9/d51/c80 0 2024-04-30T23:15:56.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/400: dread d3/db/f40 [0,4194304] 0 2024-04-30T23:15:56.758 INFO:tasks.workunit.client.0.smithi100.stdout:6/454: link c4 d7/d9/d86/d3e/d6b/d75/ca0 0 2024-04-30T23:15:56.761 INFO:tasks.workunit.client.0.smithi100.stdout:8/489: rename d2/d89/d7f/f7c to d2/d29/d71/d86/f98 0 2024-04-30T23:15:56.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/507: mknod d5/d26/d2f/d38/c9f 0 2024-04-30T23:15:56.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/508: write d5/d47/d4c/f92 [735778,56445] 0 2024-04-30T23:15:56.769 INFO:tasks.workunit.client.0.smithi100.stdout:0/530: rename d2/d4c/d68/c80 to d2/d14/d35/d57/cac 0 2024-04-30T23:15:56.769 INFO:tasks.workunit.client.0.smithi100.stdout:9/370: link d4/d9/ce d4/d7/d60/c81 0 2024-04-30T23:15:56.769 INFO:tasks.workunit.client.0.smithi100.stdout:8/490: creat d2/d29/d67/f99 x:0 0 0 2024-04-30T23:15:56.770 INFO:tasks.workunit.client.0.smithi100.stdout:5/546: dwrite d1/d12/f73 [0,4194304] 0 2024-04-30T23:15:56.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/371: rename d4/d7/d8/l3c to d4/d7/d8/l82 0 2024-04-30T23:15:56.774 INFO:tasks.workunit.client.0.smithi100.stdout:8/491: write d2/d89/d10/d17/f46 [122798,97641] 0 2024-04-30T23:15:56.775 INFO:tasks.workunit.client.0.smithi100.stdout:8/492: chown d2/d29/f30 472297 1 2024-04-30T23:15:56.775 INFO:tasks.workunit.client.0.smithi100.stdout:8/493: readlink d2/d7/d18/d3a/l4e 0 2024-04-30T23:15:56.775 INFO:tasks.workunit.client.0.smithi100.stdout:5/547: creat d1/d3e/d9b/fb5 x:0 0 0 2024-04-30T23:15:56.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/494: mkdir d2/d89/d10/d52/d9a 0 2024-04-30T23:15:56.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/495: readlink d2/d89/d10/d17/l5f 0 2024-04-30T23:15:56.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/496: write d2/d89/d10/d17/f8c [739365,52934] 0 2024-04-30T23:15:56.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/497: chown d2/d29/f60 3 1 2024-04-30T23:15:56.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/498: fsync d2/d29/f60 0 2024-04-30T23:15:56.780 INFO:tasks.workunit.client.0.smithi100.stdout:0/531: dread d2/d50/d30/d32/f3b [0,4194304] 0 2024-04-30T23:15:56.781 INFO:tasks.workunit.client.0.smithi100.stdout:0/532: read - d2/d14/d35/d57/f95 zero size 2024-04-30T23:15:56.781 INFO:tasks.workunit.client.0.smithi100.stdout:0/533: truncate d2/d5a/f9c 786267 0 2024-04-30T23:15:56.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/548: unlink d1/d2c/d5d/l70 0 2024-04-30T23:15:56.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/549: chown d1/d12/d1a/c64 74 1 2024-04-30T23:15:56.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/550: write d1/d5f/f83 [2774301,57110] 0 2024-04-30T23:15:56.783 INFO:tasks.workunit.client.0.smithi100.stdout:8/499: unlink d2/d7/f20 0 2024-04-30T23:15:56.784 INFO:tasks.workunit.client.0.smithi100.stdout:5/551: mkdir d1/d2c/d60/d66/d71/db6 0 2024-04-30T23:15:56.784 INFO:tasks.workunit.client.0.smithi100.stdout:5/552: truncate d1/d12/f23 1643059 0 2024-04-30T23:15:56.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/534: read d2/d14/d18/f93 [62982,59412] 0 2024-04-30T23:15:56.785 INFO:tasks.workunit.client.0.smithi100.stdout:2/509: dwrite d5/d47/d4c/f4f [0,4194304] 0 2024-04-30T23:15:56.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/455: dwrite d7/df/d23/d24/f95 [0,4194304] 0 2024-04-30T23:15:56.786 INFO:tasks.workunit.client.0.smithi100.stdout:2/510: write d5/d12/f2b [4813061,68651] 0 2024-04-30T23:15:56.786 INFO:tasks.workunit.client.0.smithi100.stdout:2/511: chown d5/d47/d66/f96 1847 1 2024-04-30T23:15:56.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/500: creat d2/d89/d72/f9b x:0 0 0 2024-04-30T23:15:56.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/501: write d2/d89/d7f/f39 [4335238,4288] 0 2024-04-30T23:15:56.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/553: mknod d1/d12/d27/cb7 0 2024-04-30T23:15:56.787 INFO:tasks.workunit.client.0.smithi100.stdout:0/535: mkdir d2/d50/d38/d6c/d6e/dad 0 2024-04-30T23:15:56.792 INFO:tasks.workunit.client.0.smithi100.stdout:6/456: creat d7/db/d3b/fa1 x:0 0 0 2024-04-30T23:15:56.793 INFO:tasks.workunit.client.0.smithi100.stdout:6/457: stat d7/db/d3b/f83 0 2024-04-30T23:15:56.793 INFO:tasks.workunit.client.0.smithi100.stdout:6/458: chown d7/d9/d86/d1b/d22 3 1 2024-04-30T23:15:56.794 INFO:tasks.workunit.client.0.smithi100.stdout:2/512: creat d5/d12/d13/fa0 x:0 0 0 2024-04-30T23:15:56.796 INFO:tasks.workunit.client.0.smithi100.stdout:8/502: link d2/d7/d18/d3a/f84 d2/d29/d71/f9c 0 2024-04-30T23:15:56.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/554: rmdir d1/d12/d27 39 2024-04-30T23:15:56.798 INFO:tasks.workunit.client.0.smithi100.stdout:6/459: creat d7/d9/d86/d1b/d59/d98/fa2 x:0 0 0 2024-04-30T23:15:56.800 INFO:tasks.workunit.client.0.smithi100.stdout:2/513: rename d5/d47/d4c/l6b to d5/d12/d73/la1 0 2024-04-30T23:15:56.806 INFO:tasks.workunit.client.0.smithi100.stdout:0/536: dwrite d2/d14/d35/d40/f56 [0,4194304] 0 2024-04-30T23:15:56.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/555: mknod d1/d2c/cb8 0 2024-04-30T23:15:56.807 INFO:tasks.workunit.client.0.smithi100.stdout:8/503: truncate d2/d29/f47 2504955 0 2024-04-30T23:15:56.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/460: symlink d7/df/d23/d24/d2e/d9f/la3 0 2024-04-30T23:15:56.807 INFO:tasks.workunit.client.0.smithi100.stdout:8/504: write d2/d29/d71/f77 [4700693,120771] 0 2024-04-30T23:15:56.807 INFO:tasks.workunit.client.0.smithi100.stdout:8/505: read - d2/d29/d71/f9c zero size 2024-04-30T23:15:56.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/461: mknod d7/d9/d86/d1b/d22/ca4 0 2024-04-30T23:15:56.815 INFO:tasks.workunit.client.0.smithi100.stdout:6/462: write d7/db/f44 [159035,90227] 0 2024-04-30T23:15:56.815 INFO:tasks.workunit.client.0.smithi100.stdout:6/463: dread - d7/d9/d86/d3e/f91 zero size 2024-04-30T23:15:56.815 INFO:tasks.workunit.client.0.smithi100.stdout:6/464: chown l2 803972 1 2024-04-30T23:15:56.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/372: write d4/d9/f7d [934926,41069] 0 2024-04-30T23:15:56.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/373: chown d4/d7/f38 10 1 2024-04-30T23:15:56.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/506: fsync d2/d29/d71/f9c 0 2024-04-30T23:15:56.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/507: stat d2/d89/d10/d17/f1b 0 2024-04-30T23:15:56.821 INFO:tasks.workunit.client.0.smithi100.stdout:6/465: rmdir d7/df/d23/d24/d6e 0 2024-04-30T23:15:56.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/374: symlink d4/d9/d6f/l83 0 2024-04-30T23:15:56.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/375: chown d4/d9/d50/f54 28 1 2024-04-30T23:15:56.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/376: truncate d4/d7/d60/f67 1017503 0 2024-04-30T23:15:56.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/377: write d4/d7/d8/d37/d58/f77 [176425,56970] 0 2024-04-30T23:15:56.824 INFO:tasks.workunit.client.0.smithi100.stdout:2/514: dwrite d5/d47/f7b [0,4194304] 0 2024-04-30T23:15:56.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/508: creat d2/d97/f9d x:0 0 0 2024-04-30T23:15:56.826 INFO:tasks.workunit.client.0.smithi100.stdout:6/466: link d7/d11/d34/c71 d7/df/d23/d2b/d42/d84/ca5 0 2024-04-30T23:15:56.829 INFO:tasks.workunit.client.0.smithi100.stdout:9/378: creat d4/d9/d51/f84 x:0 0 0 2024-04-30T23:15:56.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/467: mknod d7/d9/d86/d1b/ca6 0 2024-04-30T23:15:56.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/468: stat d7/db/f16 0 2024-04-30T23:15:56.840 INFO:tasks.workunit.client.0.smithi100.stdout:5/556: dwrite d1/d3e/fb3 [0,4194304] 0 2024-04-30T23:15:56.840 INFO:tasks.workunit.client.0.smithi100.stdout:5/557: chown d1/d12/d27/f42 101 1 2024-04-30T23:15:56.841 INFO:tasks.workunit.client.0.smithi100.stdout:0/537: dwrite d2/d14/d35/d57/f60 [0,4194304] 0 2024-04-30T23:15:56.841 INFO:tasks.workunit.client.0.smithi100.stdout:0/538: read d2/d50/d38/f7a [350226,52835] 0 2024-04-30T23:15:56.843 INFO:tasks.workunit.client.0.smithi100.stdout:5/558: mknod d1/d2c/d60/d66/d71/db6/cb9 0 2024-04-30T23:15:56.844 INFO:tasks.workunit.client.0.smithi100.stdout:0/539: mkdir d2/d50/d38/d5d/dae 0 2024-04-30T23:15:56.844 INFO:tasks.workunit.client.0.smithi100.stdout:5/559: getdents d1/d12/d1a/d76/d77 0 2024-04-30T23:15:56.846 INFO:tasks.workunit.client.0.smithi100.stdout:0/540: creat d2/d14/d35/d40/d83/faf x:0 0 0 2024-04-30T23:15:56.848 INFO:tasks.workunit.client.0.smithi100.stdout:5/560: getdents d1/d12/d1a/d76 0 2024-04-30T23:15:56.848 INFO:tasks.workunit.client.0.smithi100.stdout:5/561: chown d1/d12/d74 1 1 2024-04-30T23:15:56.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/515: dwrite d5/d2e/f50 [0,4194304] 0 2024-04-30T23:15:56.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/516: chown d5/la 403407 1 2024-04-30T23:15:56.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/562: creat d1/d12/d1a/d76/da9/fba x:0 0 0 2024-04-30T23:15:56.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/379: dread d4/d7/d8/f36 [0,4194304] 0 2024-04-30T23:15:56.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/380: stat d4/d7/d8/d37/d3d 0 2024-04-30T23:15:56.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/381: chown d4/d7/l6e 1539 1 2024-04-30T23:15:56.853 INFO:tasks.workunit.client.0.smithi100.stdout:9/382: truncate d4/d7/d8/f66 1587175 0 2024-04-30T23:15:56.853 INFO:tasks.workunit.client.0.smithi100.stdout:9/383: write d4/d7/d8/d37/f6c [835495,119283] 0 2024-04-30T23:15:56.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/563: creat d1/d3e/fbb x:0 0 0 2024-04-30T23:15:56.854 INFO:tasks.workunit.client.0.smithi100.stdout:9/384: creat d4/d7/d8/d37/f85 x:0 0 0 2024-04-30T23:15:56.856 INFO:tasks.workunit.client.0.smithi100.stdout:5/564: getdents d1/d3e/d9b 0 2024-04-30T23:15:56.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/385: creat d4/d7/d8/f86 x:0 0 0 2024-04-30T23:15:56.859 INFO:tasks.workunit.client.0.smithi100.stdout:5/565: rename d1/d12/d1a/f26 to d1/d12/d1a/d5b/fbc 0 2024-04-30T23:15:56.861 INFO:tasks.workunit.client.0.smithi100.stdout:9/386: mknod d4/d7/d60/c87 0 2024-04-30T23:15:56.862 INFO:tasks.workunit.client.0.smithi100.stdout:5/566: mknod d1/d2c/d60/d66/d75/cbd 0 2024-04-30T23:15:56.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/517: write d5/d22/f2c [4043977,51237] 0 2024-04-30T23:15:56.863 INFO:tasks.workunit.client.0.smithi100.stdout:5/567: symlink d1/d19/d7f/lbe 0 2024-04-30T23:15:56.865 INFO:tasks.workunit.client.0.smithi100.stdout:5/568: mkdir d1/d3e/d99/dbf 0 2024-04-30T23:15:56.865 INFO:tasks.workunit.client.0.smithi100.stdout:5/569: read - d1/d12/d1a/d76/fab zero size 2024-04-30T23:15:56.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/541: dwrite d2/d5a/f66 [0,4194304] 0 2024-04-30T23:15:56.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/542: write d2/fa1 [1763434,76912] 0 2024-04-30T23:15:56.866 INFO:tasks.workunit.client.0.smithi100.stdout:2/518: rename d5/d12/l18 to d5/d12/d13/d72/la2 0 2024-04-30T23:15:56.867 INFO:tasks.workunit.client.0.smithi100.stdout:5/570: mkdir d1/d12/d1a/d5b/dc0 0 2024-04-30T23:15:56.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/543: symlink d2/d14/lb0 0 2024-04-30T23:15:56.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/544: fsync d2/d14/d35/fa7 0 2024-04-30T23:15:56.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/545: dread - d2/d4c/f89 zero size 2024-04-30T23:15:56.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/546: symlink d2/d4c/lb1 0 2024-04-30T23:15:56.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/547: fsync d2/d14/d18/f2d 0 2024-04-30T23:15:56.879 INFO:tasks.workunit.client.0.smithi100.stdout:5/571: dread d1/f5a [0,4194304] 0 2024-04-30T23:15:56.879 INFO:tasks.workunit.client.0.smithi100.stdout:5/572: fdatasync d1/d12/d1a/f22 0 2024-04-30T23:15:56.880 INFO:tasks.workunit.client.0.smithi100.stdout:5/573: read d1/fe [3241949,52786] 0 2024-04-30T23:15:56.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/574: creat d1/d37/d5c/fc1 x:0 0 0 2024-04-30T23:15:56.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/575: dread - d1/d2c/d60/d66/d71/f94 zero size 2024-04-30T23:15:56.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/576: readlink d1/d12/d24/d34/l81 0 2024-04-30T23:15:56.883 INFO:tasks.workunit.client.0.smithi100.stdout:5/577: rmdir d1/d12/d24/d34/db2 0 2024-04-30T23:15:56.894 INFO:tasks.workunit.client.0.smithi100.stdout:9/387: dwrite d4/d9/d10/f3a [4194304,4194304] 0 2024-04-30T23:15:56.894 INFO:tasks.workunit.client.0.smithi100.stdout:9/388: dread - d4/f52 zero size 2024-04-30T23:15:56.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/519: dwrite d5/f25 [4194304,4194304] 0 2024-04-30T23:15:56.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/520: mknod d5/d22/ca3 0 2024-04-30T23:15:56.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/521: fdatasync d5/d22/f4e 0 2024-04-30T23:15:56.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/578: dread d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:15:56.906 INFO:tasks.workunit.client.0.smithi100.stdout:0/548: dwrite d2/d14/d35/d40/f49 [0,4194304] 0 2024-04-30T23:15:56.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/579: write d1/fe [997892,110716] 0 2024-04-30T23:15:56.908 INFO:tasks.workunit.client.0.smithi100.stdout:0/549: creat d2/d50/d38/fb2 x:0 0 0 2024-04-30T23:15:56.909 INFO:tasks.workunit.client.0.smithi100.stdout:0/550: creat d2/d14/d35/fb3 x:0 0 0 2024-04-30T23:15:56.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/551: write d2/d50/d38/f7a [1221005,117060] 0 2024-04-30T23:15:56.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/552: write d2/fc [5178188,83486] 0 2024-04-30T23:15:56.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/553: creat d2/d14/d35/fb4 x:0 0 0 2024-04-30T23:15:56.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/554: write d2/d14/d35/f43 [1524476,51605] 0 2024-04-30T23:15:56.923 INFO:tasks.workunit.client.0.smithi100.stdout:5/580: dread d1/d12/d1a/d5b/fbc [0,4194304] 0 2024-04-30T23:15:56.925 INFO:tasks.workunit.client.0.smithi100.stdout:2/522: dwrite d5/d26/d2f/d38/f61 [4194304,4194304] 0 2024-04-30T23:15:56.925 INFO:tasks.workunit.client.0.smithi100.stdout:2/523: fdatasync d5/d12/f6c 0 2024-04-30T23:15:56.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/581: rename d1/d12/d1a/f7e to d1/d3e/d99/fc2 0 2024-04-30T23:15:56.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/582: write d1/d12/d27/fa8 [484388,106935] 0 2024-04-30T23:15:56.926 INFO:tasks.workunit.client.0.smithi100.stdout:9/389: dwrite d4/d7/d8/d37/f6c [0,4194304] 0 2024-04-30T23:15:56.926 INFO:tasks.workunit.client.0.smithi100.stdout:2/524: creat d5/fa4 x:0 0 0 2024-04-30T23:15:56.927 INFO:tasks.workunit.client.0.smithi100.stdout:5/583: mknod d1/d2c/d60/d66/d71/db6/cc3 0 2024-04-30T23:15:56.927 INFO:tasks.workunit.client.0.smithi100.stdout:0/555: read d2/d14/d35/d57/f91 [728543,6985] 0 2024-04-30T23:15:56.929 INFO:tasks.workunit.client.0.smithi100.stdout:9/390: truncate d4/d7/d8/f36 3369006 0 2024-04-30T23:15:56.930 INFO:tasks.workunit.client.0.smithi100.stdout:0/556: truncate d2/d14/d18/f33 2861110 0 2024-04-30T23:15:56.931 INFO:tasks.workunit.client.0.smithi100.stdout:9/391: symlink d4/d9/d10/d7f/l88 0 2024-04-30T23:15:56.931 INFO:tasks.workunit.client.0.smithi100.stdout:9/392: chown d4/d7/d8/d37/d58/l71 119 1 2024-04-30T23:15:56.932 INFO:tasks.workunit.client.0.smithi100.stdout:0/557: mknod d2/d4c/d68/d94/cb5 0 2024-04-30T23:15:56.932 INFO:tasks.workunit.client.0.smithi100.stdout:9/393: mkdir d4/d9/d51/d89 0 2024-04-30T23:15:56.933 INFO:tasks.workunit.client.0.smithi100.stdout:9/394: mkdir d4/d7/d8/d37/d58/d8a 0 2024-04-30T23:15:56.935 INFO:tasks.workunit.client.0.smithi100.stdout:9/395: truncate d4/d9/f16 1226881 0 2024-04-30T23:15:56.940 INFO:tasks.workunit.client.0.smithi100.stdout:2/525: dread d5/d12/d13/f59 [0,4194304] 0 2024-04-30T23:15:56.940 INFO:tasks.workunit.client.0.smithi100.stdout:2/526: truncate d5/d22/f42 4208368 0 2024-04-30T23:15:56.940 INFO:tasks.workunit.client.0.smithi100.stdout:2/527: fdatasync d5/d12/d13/d4b/f52 0 2024-04-30T23:15:56.946 INFO:tasks.workunit.client.0.smithi100.stdout:2/528: symlink d5/d12/d8e/la5 0 2024-04-30T23:15:56.947 INFO:tasks.workunit.client.0.smithi100.stdout:2/529: write d5/d12/d8e/f93 [253011,52450] 0 2024-04-30T23:15:56.947 INFO:tasks.workunit.client.0.smithi100.stdout:2/530: chown d5/d22/l8c 8 1 2024-04-30T23:15:56.947 INFO:tasks.workunit.client.0.smithi100.stdout:5/584: dread d1/fe [0,4194304] 0 2024-04-30T23:15:56.947 INFO:tasks.workunit.client.0.smithi100.stdout:5/585: truncate d1/d2c/f49 1034495 0 2024-04-30T23:15:56.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/531: mkdir d5/d22/da6 0 2024-04-30T23:15:56.952 INFO:tasks.workunit.client.0.smithi100.stdout:2/532: rename d5/d26/d2f/d38/l6e to d5/d12/d70/la7 0 2024-04-30T23:15:56.961 INFO:tasks.workunit.client.0.smithi100.stdout:9/396: dwrite d4/d7/d8/d19/f29 [0,4194304] 0 2024-04-30T23:15:56.963 INFO:tasks.workunit.client.0.smithi100.stdout:9/397: mknod d4/d7/d60/d69/c8b 0 2024-04-30T23:15:56.965 INFO:tasks.workunit.client.0.smithi100.stdout:2/533: write d5/f2d [815267,11221] 0 2024-04-30T23:15:56.970 INFO:tasks.workunit.client.0.smithi100.stdout:0/558: dwrite d2/d14/f19 [0,4194304] 0 2024-04-30T23:15:56.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/559: rmdir d2/d50 39 2024-04-30T23:15:56.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/560: chown d2/d14/d18/la3 448 1 2024-04-30T23:15:56.981 INFO:tasks.workunit.client.0.smithi100.stdout:0/561: creat d2/d50/d38/d6c/fb6 x:0 0 0 2024-04-30T23:15:56.981 INFO:tasks.workunit.client.0.smithi100.stdout:0/562: dread - d2/d5a/f92 zero size 2024-04-30T23:15:56.988 INFO:tasks.workunit.client.0.smithi100.stdout:9/398: dwrite d4/d7/d8/d37/d58/f6a [0,4194304] 0 2024-04-30T23:15:56.988 INFO:tasks.workunit.client.0.smithi100.stdout:9/399: write d4/d9/d10/f7e [389131,107097] 0 2024-04-30T23:15:56.991 INFO:tasks.workunit.client.0.smithi100.stdout:9/400: link d4/d7/d8/d37/f59 d4/d7/d8/d19/f8c 0 2024-04-30T23:15:56.995 INFO:tasks.workunit.client.0.smithi100.stdout:2/534: dwrite d5/d12/d13/d4b/f99 [0,4194304] 0 2024-04-30T23:15:56.995 INFO:tasks.workunit.client.0.smithi100.stdout:2/535: chown d5/d26/d2f/d38/c57 2970183 1 2024-04-30T23:15:56.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/536: creat d5/d22/fa8 x:0 0 0 2024-04-30T23:15:57.000 INFO:tasks.workunit.client.0.smithi100.stdout:0/563: dread d2/d50/d30/d32/f5b [0,4194304] 0 2024-04-30T23:15:57.000 INFO:tasks.workunit.client.0.smithi100.stdout:0/564: write d2/d14/d35/d40/d83/faf [190566,24432] 0 2024-04-30T23:15:57.000 INFO:tasks.workunit.client.0.smithi100.stdout:0/565: chown d2/d4c/d68/f69 131191142 1 2024-04-30T23:15:57.001 INFO:tasks.workunit.client.0.smithi100.stdout:0/566: mkdir d2/d50/d38/d5d/dae/db7 0 2024-04-30T23:15:57.001 INFO:tasks.workunit.client.0.smithi100.stdout:0/567: read - d2/d5a/f92 zero size 2024-04-30T23:15:57.004 INFO:tasks.workunit.client.0.smithi100.stdout:9/401: dread d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:15:57.005 INFO:tasks.workunit.client.0.smithi100.stdout:9/402: mkdir d4/d7/d8d 0 2024-04-30T23:15:57.022 INFO:tasks.workunit.client.0.smithi100.stdout:2/537: dwrite d5/d26/d2f/f68 [4194304,4194304] 0 2024-04-30T23:15:57.023 INFO:tasks.workunit.client.0.smithi100.stdout:2/538: mkdir d5/d58/da9 0 2024-04-30T23:15:57.027 INFO:tasks.workunit.client.0.smithi100.stdout:9/403: dwrite d4/d9/d50/f54 [0,4194304] 0 2024-04-30T23:15:57.028 INFO:tasks.workunit.client.0.smithi100.stdout:9/404: mkdir d4/d9/d8e 0 2024-04-30T23:15:57.046 INFO:tasks.workunit.client.0.smithi100.stdout:9/405: dwrite d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:57.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/508: sync 2024-04-30T23:15:57.046 INFO:tasks.workunit.client.0.smithi100.stdout:4/525: sync 2024-04-30T23:15:57.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/509: dread - d1/d14/d15/d27/d5d/f6c zero size 2024-04-30T23:15:57.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/510: truncate d1/d14/d15/d2c/d68/d26/f89 59670 0 2024-04-30T23:15:57.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:56 smithi104 ceph-mon[32987]: pgmap v443: 129 pgs: 129 active+clean; 892 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 110 MiB/s wr, 421 op/s 2024-04-30T23:15:57.047 INFO:tasks.workunit.client.0.smithi100.stdout:3/511: stat d1/d14/d15/d27/d34/l85 0 2024-04-30T23:15:57.047 INFO:tasks.workunit.client.0.smithi100.stdout:3/512: getdents d1/d14/d2b/d57 0 2024-04-30T23:15:57.050 INFO:tasks.workunit.client.0.smithi100.stdout:3/513: write d1/d14/d15/d27/f33 [213173,111643] 0 2024-04-30T23:15:57.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:56 smithi183 ceph-mon[33560]: pgmap v443: 129 pgs: 129 active+clean; 892 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 110 MiB/s wr, 421 op/s 2024-04-30T23:15:57.061 INFO:tasks.workunit.client.0.smithi100.stdout:4/526: read d19/d1a/d21/f2b [2594188,16007] 0 2024-04-30T23:15:57.063 INFO:tasks.workunit.client.0.smithi100.stdout:4/527: creat d19/d33/fab x:0 0 0 2024-04-30T23:15:57.063 INFO:tasks.workunit.client.0.smithi100.stdout:4/528: write d19/d1a/d6d/d4e/f9a [215444,91396] 0 2024-04-30T23:15:57.063 INFO:tasks.workunit.client.0.smithi100.stdout:4/529: readlink d19/d1a/l28 0 2024-04-30T23:15:57.064 INFO:tasks.workunit.client.0.smithi100.stdout:3/514: read d1/d14/d21/f2d [3233686,63933] 0 2024-04-30T23:15:57.064 INFO:tasks.workunit.client.0.smithi100.stdout:3/515: mknod d1/d14/d15/d32/d7d/c94 0 2024-04-30T23:15:57.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/406: dwrite d4/d7/d8/d37/f59 [0,4194304] 0 2024-04-30T23:15:57.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/516: creat d1/d14/d15/d2c/f95 x:0 0 0 2024-04-30T23:15:57.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/517: stat d1/d14/d15/f44 0 2024-04-30T23:15:57.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/518: fsync d1/d14/d15/d2c/f47 0 2024-04-30T23:15:57.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/519: dread - d1/f8d zero size 2024-04-30T23:15:57.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/407: creat d4/d9/d51/f8f x:0 0 0 2024-04-30T23:15:57.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/408: stat d4/d7/d60/f67 0 2024-04-30T23:15:57.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/409: chown d4/d7/d8/d37/f4b 2876546 1 2024-04-30T23:15:57.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/410: chown d4/d7/d8/d19/f8c 2940185 1 2024-04-30T23:15:57.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/520: symlink d1/d14/d15/d32/d71/l96 0 2024-04-30T23:15:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:56 smithi100 ceph-mon[29745]: pgmap v443: 129 pgs: 129 active+clean; 892 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 110 MiB/s wr, 421 op/s 2024-04-30T23:15:57.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/530: dread d19/d1a/d29/f5f [0,4194304] 0 2024-04-30T23:15:57.078 INFO:tasks.workunit.client.0.smithi100.stdout:4/531: symlink d19/d1a/d45/lac 0 2024-04-30T23:15:57.078 INFO:tasks.workunit.client.0.smithi100.stdout:4/532: chown d19/d33/d3f 186004 1 2024-04-30T23:15:57.079 INFO:tasks.workunit.client.0.smithi100.stdout:4/533: creat d19/d33/d3f/d40/da2/fad x:0 0 0 2024-04-30T23:15:57.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/534: mkdir d19/d1a/d29/dae 0 2024-04-30T23:15:57.082 INFO:tasks.workunit.client.0.smithi100.stdout:4/535: creat d19/d33/d7d/faf x:0 0 0 2024-04-30T23:15:57.084 INFO:tasks.workunit.client.0.smithi100.stdout:3/521: read d1/d38/f60 [2025385,78655] 0 2024-04-30T23:15:57.084 INFO:tasks.workunit.client.0.smithi100.stdout:3/522: dread - d1/d14/d15/f62 zero size 2024-04-30T23:15:57.085 INFO:tasks.workunit.client.0.smithi100.stdout:3/523: creat d1/d14/d15/d27/d34/f97 x:0 0 0 2024-04-30T23:15:57.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/524: creat d1/d14/d15/d2c/d68/d26/f98 x:0 0 0 2024-04-30T23:15:57.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/525: chown d1/d14/d15/d32/d71 114 1 2024-04-30T23:15:57.089 INFO:tasks.workunit.client.0.smithi100.stdout:9/411: dwrite d4/d9/d10/f7e [0,4194304] 0 2024-04-30T23:15:57.091 INFO:tasks.workunit.client.0.smithi100.stdout:9/412: creat d4/d9/d6f/f90 x:0 0 0 2024-04-30T23:15:57.092 INFO:tasks.workunit.client.0.smithi100.stdout:9/413: symlink d4/d7/d60/d69/l91 0 2024-04-30T23:15:57.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/414: mknod d4/d7/c92 0 2024-04-30T23:15:57.093 INFO:tasks.workunit.client.0.smithi100.stdout:3/526: dread d1/d14/d2f/f7c [0,4194304] 0 2024-04-30T23:15:57.093 INFO:tasks.workunit.client.0.smithi100.stdout:3/527: fsync d1/d14/f73 0 2024-04-30T23:15:57.094 INFO:tasks.workunit.client.0.smithi100.stdout:9/415: mkdir d4/d9/d93 0 2024-04-30T23:15:57.095 INFO:tasks.workunit.client.0.smithi100.stdout:3/528: creat d1/d38/f99 x:0 0 0 2024-04-30T23:15:57.104 INFO:tasks.workunit.client.0.smithi100.stdout:4/536: dwrite d19/d1a/d6d/d4e/f84 [0,4194304] 0 2024-04-30T23:15:57.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/537: truncate f13 1604516 0 2024-04-30T23:15:57.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/529: dwrite d1/d14/d15/d2c/d68/d26/f23 [0,4194304] 0 2024-04-30T23:15:57.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/530: chown d1/d14/d21/f48 520873978 1 2024-04-30T23:15:57.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/416: dwrite d4/d7/d8/d37/f6c [0,4194304] 0 2024-04-30T23:15:57.122 INFO:tasks.workunit.client.0.smithi100.stdout:3/531: link d1/d14/d15/d2c/f7e d1/d14/d15/d2c/d68/d26/f9a 0 2024-04-30T23:15:57.123 INFO:tasks.workunit.client.0.smithi100.stdout:9/417: mknod d4/d7/d8/d37/d58/d8a/c94 0 2024-04-30T23:15:57.126 INFO:tasks.workunit.client.0.smithi100.stdout:3/532: rename d1/d14/c2a to d1/d14/d15/d27/d5d/c9b 0 2024-04-30T23:15:57.135 INFO:tasks.workunit.client.0.smithi100.stdout:4/538: dwrite f13 [0,4194304] 0 2024-04-30T23:15:57.138 INFO:tasks.workunit.client.0.smithi100.stdout:4/539: rename f3 to d19/d1a/d29/dae/fb0 0 2024-04-30T23:15:57.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/540: creat d19/d1a/d29/d65/fb1 x:0 0 0 2024-04-30T23:15:57.155 INFO:tasks.workunit.client.0.smithi100.stdout:4/541: dread d19/d1a/d6d/d4e/d6e/f80 [0,4194304] 0 2024-04-30T23:15:57.156 INFO:tasks.workunit.client.0.smithi100.stdout:4/542: symlink d19/d1a/d21/d4a/d53/d5e/lb2 0 2024-04-30T23:15:57.156 INFO:tasks.workunit.client.0.smithi100.stdout:4/543: write d19/d1a/d6d/d64/f8a [273737,110882] 0 2024-04-30T23:15:57.157 INFO:tasks.workunit.client.0.smithi100.stdout:4/544: creat d19/d33/d7d/fb3 x:0 0 0 2024-04-30T23:15:57.158 INFO:tasks.workunit.client.0.smithi100.stdout:4/545: read - d19/d1a/d6d/d4e/d6e/fa8 zero size 2024-04-30T23:15:57.158 INFO:tasks.workunit.client.0.smithi100.stdout:4/546: creat d19/d1a/d21/d4a/d53/d5e/fb4 x:0 0 0 2024-04-30T23:15:57.160 INFO:tasks.workunit.client.0.smithi100.stdout:4/547: unlink d19/d33/f31 0 2024-04-30T23:15:57.161 INFO:tasks.workunit.client.0.smithi100.stdout:4/548: creat d19/d1a/d95/fb5 x:0 0 0 2024-04-30T23:15:57.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/549: getdents d19/d1a/d6d/d64/d78 0 2024-04-30T23:15:57.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/550: write d19/d1a/d21/d4a/d53/d5d/f72 [4969665,14569] 0 2024-04-30T23:15:57.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/551: write d19/d1a/d6d/d4e/f84 [4881016,71154] 0 2024-04-30T23:15:57.169 INFO:tasks.workunit.client.0.smithi100.stdout:9/418: dwrite d4/d7/d8/f25 [0,4194304] 0 2024-04-30T23:15:57.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/419: dwrite d4/d7/d8/f36 [0,4194304] 0 2024-04-30T23:15:57.247 INFO:tasks.workunit.client.0.smithi100.stdout:9/420: write d4/d7/d8/f7b [1882880,114287] 0 2024-04-30T23:15:57.247 INFO:tasks.workunit.client.0.smithi100.stdout:9/421: stat d4/d7/d60/f67 0 2024-04-30T23:15:57.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/422: link d4/d7/d8/d19/f4e d4/d9/d10/d7f/f95 0 2024-04-30T23:15:57.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/423: stat d4/d9/d6f/l7a 0 2024-04-30T23:15:57.251 INFO:tasks.workunit.client.0.smithi100.stdout:9/424: creat d4/f96 x:0 0 0 2024-04-30T23:15:57.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/425: creat d4/d7/d60/d69/f97 x:0 0 0 2024-04-30T23:15:57.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/426: read f3 [5028612,128157] 0 2024-04-30T23:15:57.254 INFO:tasks.workunit.client.0.smithi100.stdout:9/427: stat d4/d9/d51/l73 0 2024-04-30T23:15:57.254 INFO:tasks.workunit.client.0.smithi100.stdout:7/582: sync 2024-04-30T23:15:57.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/583: getdents d0/df/d4f 0 2024-04-30T23:15:57.256 INFO:tasks.workunit.client.0.smithi100.stdout:7/584: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dc6 0 2024-04-30T23:15:57.257 INFO:tasks.workunit.client.0.smithi100.stdout:7/585: creat d0/d1d/fc7 x:0 0 0 2024-04-30T23:15:57.261 INFO:tasks.workunit.client.0.smithi100.stdout:7/586: dread d0/d1d/d5e/d6a/f5f [0,4194304] 0 2024-04-30T23:15:57.261 INFO:tasks.workunit.client.0.smithi100.stdout:7/587: write d0/df/f39 [112946,56447] 0 2024-04-30T23:15:57.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/588: symlink d0/d1b/d60/d48/d4a/lc8 0 2024-04-30T23:15:57.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/589: stat d0/d1b/d60/d48/d4a/d87 0 2024-04-30T23:15:57.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/590: dread - d0/df/d4f/d53/da9/fba zero size 2024-04-30T23:15:57.264 INFO:tasks.workunit.client.0.smithi100.stdout:7/591: dread d0/df/d4f/d53/f59 [0,4194304] 0 2024-04-30T23:15:57.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/592: dwrite d0/d1b/d60/d48/d4a/d87/f8c [0,4194304] 0 2024-04-30T23:15:57.295 INFO:tasks.workunit.client.0.smithi100.stdout:6/469: sync 2024-04-30T23:15:57.296 INFO:tasks.workunit.client.0.smithi100.stdout:1/401: sync 2024-04-30T23:15:57.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/470: stat d7/d9/d86/d1b/f39 0 2024-04-30T23:15:57.296 INFO:tasks.workunit.client.0.smithi100.stdout:1/402: readlink d3/d16/d20/d24/l35 0 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:1/403: stat d3/d18/f53 0 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:1/404: chown d3/d16/d20/d24/d69/d5e 5902955 1 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/593: write d0/f16 [243787,34113] 0 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/594: read d0/d1d/d3c/f47 [2500529,19073] 0 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:6/471: truncate d7/df/f3c 1747878 0 2024-04-30T23:15:57.297 INFO:tasks.workunit.client.0.smithi100.stdout:1/405: symlink d3/d16/d20/d24/d69/d63/l79 0 2024-04-30T23:15:57.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/595: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/lc9 0 2024-04-30T23:15:57.299 INFO:tasks.workunit.client.0.smithi100.stdout:1/406: mkdir d3/d16/d20/d24/d69/d5e/d7a 0 2024-04-30T23:15:57.300 INFO:tasks.workunit.client.0.smithi100.stdout:7/596: dread d0/df/f14 [0,4194304] 0 2024-04-30T23:15:57.300 INFO:tasks.workunit.client.0.smithi100.stdout:7/597: readlink d0/d1d/d5e/d6a/d4b/d79/d2a/l73 0 2024-04-30T23:15:57.301 INFO:tasks.workunit.client.0.smithi100.stdout:7/598: write d0/d1b/d2e/d3d/f9b [1916859,114013] 0 2024-04-30T23:15:57.301 INFO:tasks.workunit.client.0.smithi100.stdout:7/599: write d0/d1b/d60/d48/f8e [969181,41135] 0 2024-04-30T23:15:57.301 INFO:tasks.workunit.client.0.smithi100.stdout:7/600: write d0/d1d/d5e/d6a/d4b/d79/d2a/f34 [932646,17208] 0 2024-04-30T23:15:57.314 INFO:tasks.workunit.client.0.smithi100.stdout:7/601: write d0/f8 [4140086,35707] 0 2024-04-30T23:15:57.315 INFO:tasks.workunit.client.0.smithi100.stdout:6/472: dwrite d7/d9/f51 [4194304,4194304] 0 2024-04-30T23:15:57.316 INFO:tasks.workunit.client.0.smithi100.stdout:7/602: creat d0/d1b/d60/d48/d4a/d5b/fca x:0 0 0 2024-04-30T23:15:57.317 INFO:tasks.workunit.client.0.smithi100.stdout:6/473: mknod d7/d9/d86/d3e/ca7 0 2024-04-30T23:15:57.317 INFO:tasks.workunit.client.0.smithi100.stdout:6/474: write d7/d9/d86/d3e/f91 [86266,123120] 0 2024-04-30T23:15:57.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/603: mkdir d0/d1d/d5e/d6a/d4b/dcb 0 2024-04-30T23:15:57.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/604: write d0/d1b/d60/d48/f50 [2286856,101843] 0 2024-04-30T23:15:57.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/605: stat d0/d1d/d5e/d6a/d4b/d79/d2a/l73 0 2024-04-30T23:15:57.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/606: fdatasync d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fa4 0 2024-04-30T23:15:57.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/607: creat d0/d1b/fcc x:0 0 0 2024-04-30T23:15:57.319 INFO:tasks.workunit.client.0.smithi100.stdout:7/608: chown d0/d1b/d1e/f49 858372848 1 2024-04-30T23:15:57.319 INFO:tasks.workunit.client.0.smithi100.stdout:7/609: fdatasync d0/d1b/d60/d48/f76 0 2024-04-30T23:15:57.319 INFO:tasks.workunit.client.0.smithi100.stdout:7/610: stat d0/d1b/d2e/c43 0 2024-04-30T23:15:57.320 INFO:tasks.workunit.client.0.smithi100.stdout:7/611: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/fcd x:0 0 0 2024-04-30T23:15:57.321 INFO:tasks.workunit.client.0.smithi100.stdout:7/612: rename d0/d1d/d5e/d6a/d4b/d79/c82 to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db0/cce 0 2024-04-30T23:15:57.323 INFO:tasks.workunit.client.0.smithi100.stdout:7/613: mknod d0/df/d4f/d93/ccf 0 2024-04-30T23:15:57.323 INFO:tasks.workunit.client.0.smithi100.stdout:7/614: chown d0/d1b/d60/d48/d4a/d87 24 1 2024-04-30T23:15:57.324 INFO:tasks.workunit.client.0.smithi100.stdout:7/615: read d0/d1b/d2e/d3d/f9b [405878,61625] 0 2024-04-30T23:15:57.325 INFO:tasks.workunit.client.0.smithi100.stdout:7/616: mkdir d0/d1d/d5e/d6a/d4b/d79/dd0 0 2024-04-30T23:15:57.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/617: symlink d0/d1d/d3c/ld1 0 2024-04-30T23:15:57.335 INFO:tasks.workunit.client.0.smithi100.stdout:7/618: write d0/d1d/fb3 [317160,17451] 0 2024-04-30T23:15:57.336 INFO:tasks.workunit.client.0.smithi100.stdout:6/475: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:15:57.337 INFO:tasks.workunit.client.0.smithi100.stdout:7/619: write d0/d1d/d5e/d6a/d4b/d79/d2a/fbf [240438,9124] 0 2024-04-30T23:15:57.342 INFO:tasks.workunit.client.0.smithi100.stdout:7/620: write d0/d1d/d5e/d6a/d4b/d79/d2a/fbf [1356606,70929] 0 2024-04-30T23:15:57.344 INFO:tasks.workunit.client.0.smithi100.stdout:7/621: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6 39 2024-04-30T23:15:57.344 INFO:tasks.workunit.client.0.smithi100.stdout:7/622: write d0/d1b/d1e/f28 [1668106,46509] 0 2024-04-30T23:15:57.352 INFO:tasks.workunit.client.0.smithi100.stdout:7/623: rename d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db0 to d0/df/d4f/d53/dd2 0 2024-04-30T23:15:57.352 INFO:tasks.workunit.client.0.smithi100.stdout:7/624: dread - d0/d1b/d60/f9a zero size 2024-04-30T23:15:57.358 INFO:tasks.workunit.client.0.smithi100.stdout:6/476: dwrite d7/df/d23/d24/d2e/f56 [0,4194304] 0 2024-04-30T23:15:57.358 INFO:tasks.workunit.client.0.smithi100.stdout:6/477: chown d7/df/f41 2041193 1 2024-04-30T23:15:57.360 INFO:tasks.workunit.client.0.smithi100.stdout:6/478: creat d7/db/fa8 x:0 0 0 2024-04-30T23:15:57.361 INFO:tasks.workunit.client.0.smithi100.stdout:6/479: creat d7/d9/d86/d3e/d6b/fa9 x:0 0 0 2024-04-30T23:15:57.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/480: creat d7/d9/d86/d62/faa x:0 0 0 2024-04-30T23:15:57.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/481: read - d7/d9/d86/d3e/d6b/fa9 zero size 2024-04-30T23:15:57.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/482: fsync f5 0 2024-04-30T23:15:57.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/483: dread - d7/d9/d86/d3e/d6b/d75/f7c zero size 2024-04-30T23:15:57.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/484: readlink d7/df/d23/d4f/l8f 0 2024-04-30T23:15:57.363 INFO:tasks.workunit.client.0.smithi100.stdout:6/485: symlink d7/df/d23/d2b/d42/lab 0 2024-04-30T23:15:57.363 INFO:tasks.workunit.client.0.smithi100.stdout:6/486: creat d7/d9/fac x:0 0 0 2024-04-30T23:15:57.364 INFO:tasks.workunit.client.0.smithi100.stdout:6/487: symlink d7/df/lad 0 2024-04-30T23:15:57.365 INFO:tasks.workunit.client.0.smithi100.stdout:7/625: dread d0/d1d/d5e/d6a/d4b/d79/d2a/f46 [8388608,4194304] 0 2024-04-30T23:15:57.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/488: symlink d7/d9/d86/lae 0 2024-04-30T23:15:57.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/626: rmdir d0/d1b/d1e 39 2024-04-30T23:15:57.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/627: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/fcd zero size 2024-04-30T23:15:57.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/628: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3/fa8 zero size 2024-04-30T23:15:57.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/629: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fa4 zero size 2024-04-30T23:15:57.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/630: link d0/d1b/d2e/d3d/l5d d0/df/d4f/d53/ld3 0 2024-04-30T23:15:57.390 INFO:tasks.workunit.client.0.smithi100.stdout:7/631: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f96 [0,4194304] 0 2024-04-30T23:15:57.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/632: dread - d0/d1b/d60/d48/d4a/fa1 zero size 2024-04-30T23:15:57.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/633: getdents d0/d1d/d5e/d6a/d4b/d79/d2a 0 2024-04-30T23:15:57.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/634: chown d0/df/d4f/d53/da9/fba 87942217 1 2024-04-30T23:15:57.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/635: write d0/df/d4f/d53/fc0 [1667439,83896] 0 2024-04-30T23:15:57.403 INFO:tasks.workunit.client.0.smithi100.stdout:7/636: write d0/d1b/d1e/f40 [1706813,101993] 0 2024-04-30T23:15:57.404 INFO:tasks.workunit.client.0.smithi100.stdout:7/637: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72 39 2024-04-30T23:15:57.405 INFO:tasks.workunit.client.0.smithi100.stdout:7/638: unlink d0/d1b/d60/d48/d4a/d5b/c74 0 2024-04-30T23:15:57.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/639: dwrite d0/d1d/d3c/f47 [0,4194304] 0 2024-04-30T23:15:57.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/640: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/f88 zero size 2024-04-30T23:15:57.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/641: write d0/d1b/fcc [871498,110728] 0 2024-04-30T23:15:57.435 INFO:tasks.workunit.client.0.smithi100.stdout:7/642: dread d0/d1b/d1e/f28 [0,4194304] 0 2024-04-30T23:15:57.436 INFO:tasks.workunit.client.0.smithi100.stdout:8/509: sync 2024-04-30T23:15:57.436 INFO:tasks.workunit.client.0.smithi100.stdout:7/643: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dd4 0 2024-04-30T23:15:57.437 INFO:tasks.workunit.client.0.smithi100.stdout:7/644: mkdir d0/d1b/d60/dbe/dd5 0 2024-04-30T23:15:57.437 INFO:tasks.workunit.client.0.smithi100.stdout:7/645: getdents d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/db8 0 2024-04-30T23:15:57.438 INFO:tasks.workunit.client.0.smithi100.stdout:7/646: dread d0/d1d/d5e/d6a/d4b/d79/d2a/f52 [0,4194304] 0 2024-04-30T23:15:57.440 INFO:tasks.workunit.client.0.smithi100.stdout:7/647: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fd6 x:0 0 0 2024-04-30T23:15:57.440 INFO:tasks.workunit.client.0.smithi100.stdout:7/648: fdatasync d0/df/d4f/d53/da9/fba 0 2024-04-30T23:15:57.441 INFO:tasks.workunit.client.0.smithi100.stdout:7/649: creat d0/d1d/d5e/d6a/d4b/d79/dd0/fd7 x:0 0 0 2024-04-30T23:15:57.441 INFO:tasks.workunit.client.0.smithi100.stdout:7/650: read - d0/d1b/d2e/d3d/f57 zero size 2024-04-30T23:15:57.441 INFO:tasks.workunit.client.0.smithi100.stdout:7/651: truncate d0/d1d/d3c/f47 5172195 0 2024-04-30T23:15:57.460 INFO:tasks.workunit.client.0.smithi100.stdout:7/652: dwrite d0/d1d/d5e/d6a/f2d [0,4194304] 0 2024-04-30T23:15:57.482 INFO:tasks.workunit.client.0.smithi100.stdout:7/653: dwrite d0/d1d/f6e [0,4194304] 0 2024-04-30T23:15:57.482 INFO:tasks.workunit.client.0.smithi100.stdout:7/654: write d0/d1b/f2b [1841305,111463] 0 2024-04-30T23:15:57.486 INFO:tasks.workunit.client.0.smithi100.stdout:7/655: mkdir d0/d1b/d2e/dd8 0 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:7/656: symlink d0/d1b/d60/ld9 0 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/428: sync 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/552: sync 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:5/586: sync 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/429: fsync d4/fd 0 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/553: stat d19/d1a/d45/lac 0 2024-04-30T23:15:57.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/430: readlink d4/d7/l3e 0 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/587: chown d1/d2c/d60/l7d 2739709 1 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/588: write d1/d12/d27/f82 [4758446,129419] 0 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/407: sync 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:0/568: sync 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:2/539: sync 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:3/533: sync 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/589: fdatasync d1/d12/d24/d34/f69 0 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:3/534: stat d1/d14/d15/d2c/d68/f74 0 2024-04-30T23:15:57.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/408: write d3/d16/d20/d24/f44 [331411,104395] 0 2024-04-30T23:15:57.490 INFO:tasks.workunit.client.0.smithi100.stdout:7/657: symlink d0/d1b/d60/lda 0 2024-04-30T23:15:57.490 INFO:tasks.workunit.client.0.smithi100.stdout:9/431: mknod d4/d7/d8/d19/c98 0 2024-04-30T23:15:57.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/540: creat d5/d12/d13/d4b/faa x:0 0 0 2024-04-30T23:15:57.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/541: readlink d5/d12/d70/la7 0 2024-04-30T23:15:57.492 INFO:tasks.workunit.client.0.smithi100.stdout:5/590: symlink d1/d12/d27/lc4 0 2024-04-30T23:15:57.493 INFO:tasks.workunit.client.0.smithi100.stdout:0/569: symlink d2/d50/d38/d6c/d6e/lb8 0 2024-04-30T23:15:57.494 INFO:tasks.workunit.client.0.smithi100.stdout:7/658: mknod d0/d1d/d3f/cdb 0 2024-04-30T23:15:57.496 INFO:tasks.workunit.client.0.smithi100.stdout:2/542: rename d5/d12/d13/d72 to d5/d47/d4c/dab 0 2024-04-30T23:15:57.496 INFO:tasks.workunit.client.0.smithi100.stdout:2/543: chown d5/f25 0 1 2024-04-30T23:15:57.496 INFO:tasks.workunit.client.0.smithi100.stdout:5/591: mknod d1/d19/d78/cc5 0 2024-04-30T23:15:57.498 INFO:tasks.workunit.client.0.smithi100.stdout:0/570: symlink d2/d14/d35/d57/lb9 0 2024-04-30T23:15:57.498 INFO:tasks.workunit.client.0.smithi100.stdout:0/571: write d2/fc [1114762,37640] 0 2024-04-30T23:15:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/592: read d1/d19/f4a [2533426,15194] 0 2024-04-30T23:15:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/593: fdatasync d1/f7 0 2024-04-30T23:15:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/594: dread - d1/d2c/d60/f86 zero size 2024-04-30T23:15:57.512 INFO:tasks.workunit.client.0.smithi100.stdout:5/595: unlink d1/d12/d1a/l52 0 2024-04-30T23:15:57.512 INFO:tasks.workunit.client.0.smithi100.stdout:5/596: read d1/d12/f73 [6558996,7982] 0 2024-04-30T23:15:57.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/597: creat d1/d37/fc6 x:0 0 0 2024-04-30T23:15:57.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/598: write d1/d12/f21 [3337041,45959] 0 2024-04-30T23:15:57.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/599: write d1/d2c/f59 [8004220,35023] 0 2024-04-30T23:15:57.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/600: write d1/d3e/fb3 [5048236,1528] 0 2024-04-30T23:15:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:4/554: dread d19/d1a/d6d/d64/d78/f82 [0,4194304] 0 2024-04-30T23:15:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:4/555: write d19/d1a/d6d/d64/f8a [1346998,121496] 0 2024-04-30T23:15:57.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/432: dwrite d4/d9/d50/f5f [0,4194304] 0 2024-04-30T23:15:57.526 INFO:tasks.workunit.client.0.smithi100.stdout:7/659: dwrite d0/d1d/d5e/d6a/d4b/f56 [4194304,4194304] 0 2024-04-30T23:15:57.528 INFO:tasks.workunit.client.0.smithi100.stdout:3/535: dwrite d1/d14/d21/f2d [4194304,4194304] 0 2024-04-30T23:15:57.529 INFO:tasks.workunit.client.0.smithi100.stdout:0/572: dwrite d2/d14/d35/d57/f60 [0,4194304] 0 2024-04-30T23:15:57.530 INFO:tasks.workunit.client.0.smithi100.stdout:9/433: creat d4/d7/d8/d37/d58/f99 x:0 0 0 2024-04-30T23:15:57.534 INFO:tasks.workunit.client.0.smithi100.stdout:0/573: mkdir d2/dba 0 2024-04-30T23:15:57.538 INFO:tasks.workunit.client.0.smithi100.stdout:9/434: unlink d4/d7/d8/f36 0 2024-04-30T23:15:57.539 INFO:tasks.workunit.client.0.smithi100.stdout:0/574: rmdir d2/d14/d35/d57/d62 39 2024-04-30T23:15:57.539 INFO:tasks.workunit.client.0.smithi100.stdout:0/575: chown d2/d5a/l7c 2338131 1 2024-04-30T23:15:57.539 INFO:tasks.workunit.client.0.smithi100.stdout:0/576: write d2/d50/d38/fb2 [442160,67338] 0 2024-04-30T23:15:57.539 INFO:tasks.workunit.client.0.smithi100.stdout:0/577: fdatasync d2/d4c/f89 0 2024-04-30T23:15:57.541 INFO:tasks.workunit.client.0.smithi100.stdout:9/435: creat d4/d9/d10/d7f/f9a x:0 0 0 2024-04-30T23:15:57.541 INFO:tasks.workunit.client.0.smithi100.stdout:0/578: write d2/d50/d38/d6c/d6e/f8a [478460,74148] 0 2024-04-30T23:15:57.544 INFO:tasks.workunit.client.0.smithi100.stdout:0/579: symlink d2/d50/d30/d32/lbb 0 2024-04-30T23:15:57.544 INFO:tasks.workunit.client.0.smithi100.stdout:0/580: write d2/d50/d30/d32/f9d [616236,40196] 0 2024-04-30T23:15:57.544 INFO:tasks.workunit.client.0.smithi100.stdout:0/581: fdatasync d2/d50/d38/d5d/f8c 0 2024-04-30T23:15:57.545 INFO:tasks.workunit.client.0.smithi100.stdout:0/582: creat d2/dba/fbc x:0 0 0 2024-04-30T23:15:57.546 INFO:tasks.workunit.client.0.smithi100.stdout:0/583: creat d2/d50/d30/fbd x:0 0 0 2024-04-30T23:15:57.546 INFO:tasks.workunit.client.0.smithi100.stdout:0/584: chown d2/d50/d38/d6c/d6e/dad 31208 1 2024-04-30T23:15:57.547 INFO:tasks.workunit.client.0.smithi100.stdout:0/585: readlink d2/d50/d38/d5d/l87 0 2024-04-30T23:15:57.547 INFO:tasks.workunit.client.0.smithi100.stdout:0/586: fdatasync d2/d14/d18/f93 0 2024-04-30T23:15:57.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/601: dwrite d1/d2c/d5d/fa0 [0,4194304] 0 2024-04-30T23:15:57.550 INFO:tasks.workunit.client.0.smithi100.stdout:3/536: dwrite d1/d14/d15/d2c/d68/d26/f45 [8388608,4194304] 0 2024-04-30T23:15:57.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/602: mknod d1/d2c/d60/d66/cc7 0 2024-04-30T23:15:57.551 INFO:tasks.workunit.client.0.smithi100.stdout:4/556: dwrite f12 [0,4194304] 0 2024-04-30T23:15:57.552 INFO:tasks.workunit.client.0.smithi100.stdout:3/537: mknod d1/d14/d21/d67/c9c 0 2024-04-30T23:15:57.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/660: dread d0/f17 [0,4194304] 0 2024-04-30T23:15:57.553 INFO:tasks.workunit.client.0.smithi100.stdout:4/557: mknod d19/d1a/d6d/d4e/cb6 0 2024-04-30T23:15:57.554 INFO:tasks.workunit.client.0.smithi100.stdout:3/538: creat d1/d14/d15/d32/d92/f9d x:0 0 0 2024-04-30T23:15:57.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/558: mknod d19/d1a/d21/d4a/cb7 0 2024-04-30T23:15:57.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/559: write d19/d1a/d21/d4a/fa0 [577967,82489] 0 2024-04-30T23:15:57.556 INFO:tasks.workunit.client.0.smithi100.stdout:4/560: unlink d19/d1a/d6d/d4e/d6e/c99 0 2024-04-30T23:15:57.557 INFO:tasks.workunit.client.0.smithi100.stdout:4/561: truncate d19/d1a/d6d/f3d 60564 0 2024-04-30T23:15:57.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/562: link d19/d1a/d95/la1 d19/d1a/d6d/d64/d78/lb8 0 2024-04-30T23:15:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:3/539: write d1/d14/d15/d2c/d68/f74 [3411235,23834] 0 2024-04-30T23:15:57.573 INFO:tasks.workunit.client.0.smithi100.stdout:9/436: dwrite d4/f52 [0,4194304] 0 2024-04-30T23:15:57.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/603: dread d1/d12/f31 [4194304,4194304] 0 2024-04-30T23:15:57.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/604: creat d1/d12/d27/fc8 x:0 0 0 2024-04-30T23:15:57.576 INFO:tasks.workunit.client.0.smithi100.stdout:0/587: dwrite d2/d4c/d68/d94/fa8 [0,4194304] 0 2024-04-30T23:15:57.577 INFO:tasks.workunit.client.0.smithi100.stdout:9/437: symlink d4/d9/d93/l9b 0 2024-04-30T23:15:57.577 INFO:tasks.workunit.client.0.smithi100.stdout:9/438: readlink d4/l6d 0 2024-04-30T23:15:57.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/661: dread d0/d1b/d60/d48/d4a/d87/f8c [0,4194304] 0 2024-04-30T23:15:57.582 INFO:tasks.workunit.client.0.smithi100.stdout:9/439: creat d4/d9/d93/f9c x:0 0 0 2024-04-30T23:15:57.582 INFO:tasks.workunit.client.0.smithi100.stdout:9/440: fdatasync d4/f5 0 2024-04-30T23:15:57.583 INFO:tasks.workunit.client.0.smithi100.stdout:7/662: creat d0/d1d/fdc x:0 0 0 2024-04-30T23:15:57.585 INFO:tasks.workunit.client.0.smithi100.stdout:9/441: creat d4/f9d x:0 0 0 2024-04-30T23:15:57.586 INFO:tasks.workunit.client.0.smithi100.stdout:9/442: stat d4/d9/d93 0 2024-04-30T23:15:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:9/443: symlink d4/d7/d8/d19/l9e 0 2024-04-30T23:15:57.592 INFO:tasks.workunit.client.0.smithi100.stdout:4/563: dwrite d19/d1a/d21/d4a/d53/d5e/fb4 [0,4194304] 0 2024-04-30T23:15:57.592 INFO:tasks.workunit.client.0.smithi100.stdout:4/564: readlink d19/l5c 0 2024-04-30T23:15:57.596 INFO:tasks.workunit.client.0.smithi100.stdout:0/588: dread d2/d14/d35/d57/f6b [0,4194304] 0 2024-04-30T23:15:57.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/444: symlink d4/d9/d8e/l9f 0 2024-04-30T23:15:57.602 INFO:tasks.workunit.client.0.smithi100.stdout:3/540: dwrite d1/d14/d21/d67/f77 [0,4194304] 0 2024-04-30T23:15:57.602 INFO:tasks.workunit.client.0.smithi100.stdout:7/663: dread d0/d1d/d5e/d6a/d4b/f56 [0,4194304] 0 2024-04-30T23:15:57.603 INFO:tasks.workunit.client.0.smithi100.stdout:7/664: chown d0/df/d4f/d93/db1 4496 1 2024-04-30T23:15:57.603 INFO:tasks.workunit.client.0.smithi100.stdout:3/541: write d1/f8d [321188,80281] 0 2024-04-30T23:15:57.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/665: creat d0/d1b/d60/fdd x:0 0 0 2024-04-30T23:15:57.608 INFO:tasks.workunit.client.0.smithi100.stdout:6/489: sync 2024-04-30T23:15:57.608 INFO:tasks.workunit.client.0.smithi100.stdout:6/490: chown d7/db/f5c 0 1 2024-04-30T23:15:57.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/491: mkdir d7/db/daf 0 2024-04-30T23:15:57.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/492: write d7/d9/d86/d1b/f36 [284005,57722] 0 2024-04-30T23:15:57.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/493: rename d7/d11/d34/d4b to d7/d9/d86/db0 0 2024-04-30T23:15:57.611 INFO:tasks.workunit.client.0.smithi100.stdout:6/494: rename d7/d9/d8e/f80 to d7/d9/d86/d1b/d5a/fb1 0 2024-04-30T23:15:57.613 INFO:tasks.workunit.client.0.smithi100.stdout:6/495: creat d7/df/d23/d24/d2e/d37/fb2 x:0 0 0 2024-04-30T23:15:57.614 INFO:tasks.workunit.client.0.smithi100.stdout:6/496: creat d7/df/d23/d24/d2e/d37/d85/fb3 x:0 0 0 2024-04-30T23:15:57.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/565: dread d19/d33/d3f/f41 [0,4194304] 0 2024-04-30T23:15:57.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/566: unlink d19/d1a/d29/laa 0 2024-04-30T23:15:57.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/567: dread - d19/d1a/d6d/d4e/d6e/fa8 zero size 2024-04-30T23:15:57.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/568: chown d19/d33/d3f/f41 261253116 1 2024-04-30T23:15:57.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/569: read - d19/d1a/d6d/d4e/d6e/f9f zero size 2024-04-30T23:15:57.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/542: dwrite d1/d14/d15/d27/f33 [0,4194304] 0 2024-04-30T23:15:57.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/543: truncate d1/d14/d21/f8e 169074 0 2024-04-30T23:15:57.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/544: creat d1/d14/d15/d2c/d68/d26/f9e x:0 0 0 2024-04-30T23:15:57.630 INFO:tasks.workunit.client.0.smithi100.stdout:9/445: write d4/d9/d50/f5f [1414507,11394] 0 2024-04-30T23:15:57.633 INFO:tasks.workunit.client.0.smithi100.stdout:9/446: mkdir d4/d7/d8/d37/da0 0 2024-04-30T23:15:57.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/666: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f46 [12582912,4194304] 0 2024-04-30T23:15:57.638 INFO:tasks.workunit.client.0.smithi100.stdout:9/447: unlink d4/d7/d8/f7b 0 2024-04-30T23:15:57.643 INFO:tasks.workunit.client.0.smithi100.stdout:6/497: dwrite d7/d9/f31 [0,4194304] 0 2024-04-30T23:15:57.644 INFO:tasks.workunit.client.0.smithi100.stdout:4/570: dwrite d19/d1a/d6d/d4e/d6e/f9f [0,4194304] 0 2024-04-30T23:15:57.646 INFO:tasks.workunit.client.0.smithi100.stdout:6/498: mkdir d7/df/d23/d24/d2e/d37/d85/db4 0 2024-04-30T23:15:57.646 INFO:tasks.workunit.client.0.smithi100.stdout:3/545: read d1/d14/d15/d2c/d68/d26/f45 [33958,50152] 0 2024-04-30T23:15:57.647 INFO:tasks.workunit.client.0.smithi100.stdout:4/571: unlink d19/d1a/d6d/d4e/f84 0 2024-04-30T23:15:57.648 INFO:tasks.workunit.client.0.smithi100.stdout:6/499: getdents d7/db/d3b 0 2024-04-30T23:15:57.650 INFO:tasks.workunit.client.0.smithi100.stdout:3/546: symlink d1/d14/d15/d2c/l9f 0 2024-04-30T23:15:57.650 INFO:tasks.workunit.client.0.smithi100.stdout:4/572: chown d19/d1a/c61 12497253 1 2024-04-30T23:15:57.655 INFO:tasks.workunit.client.0.smithi100.stdout:6/500: rename d7/d9/d86/d1b/f39 to d7/d9/d86/d62/fb5 0 2024-04-30T23:15:57.657 INFO:tasks.workunit.client.0.smithi100.stdout:4/573: creat d19/d1a/d21/d3c/fb9 x:0 0 0 2024-04-30T23:15:57.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/501: symlink d7/d9/lb6 0 2024-04-30T23:15:57.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/502: write d7/db/f44 [982071,75446] 0 2024-04-30T23:15:57.662 INFO:tasks.workunit.client.0.smithi100.stdout:4/574: mkdir d19/dba 0 2024-04-30T23:15:57.663 INFO:tasks.workunit.client.0.smithi100.stdout:6/503: creat d7/df/d23/d24/d2e/fb7 x:0 0 0 2024-04-30T23:15:57.665 INFO:tasks.workunit.client.0.smithi100.stdout:9/448: dwrite d4/d9/d10/f7e [4194304,4194304] 0 2024-04-30T23:15:57.665 INFO:tasks.workunit.client.0.smithi100.stdout:7/667: dwrite d0/df/d4f/d53/f5a [0,4194304] 0 2024-04-30T23:15:57.667 INFO:tasks.workunit.client.0.smithi100.stdout:4/575: rename d19/d33/f77 to d19/d1a/d21/d3c/fbb 0 2024-04-30T23:15:57.668 INFO:tasks.workunit.client.0.smithi100.stdout:6/504: creat d7/d9/d86/d3e/d6b/fb8 x:0 0 0 2024-04-30T23:15:57.668 INFO:tasks.workunit.client.0.smithi100.stdout:6/505: write d7/df/d23/d24/d2e/d37/d85/fb3 [1048118,26854] 0 2024-04-30T23:15:57.669 INFO:tasks.workunit.client.0.smithi100.stdout:9/449: mknod d4/d9/d51/d89/ca1 0 2024-04-30T23:15:57.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/668: rename d0/df/l58 to d0/d1d/d3f/lde 0 2024-04-30T23:15:57.671 INFO:tasks.workunit.client.0.smithi100.stdout:4/576: readlink d19/d1a/l57 0 2024-04-30T23:15:57.682 INFO:tasks.workunit.client.0.smithi100.stdout:9/450: getdents d4/d9/d10 0 2024-04-30T23:15:57.686 INFO:tasks.workunit.client.0.smithi100.stdout:6/506: rename d7/df/d23/d2b/d42/f43 to d7/d9/d86/d3e/d6b/fb9 0 2024-04-30T23:15:57.686 INFO:tasks.workunit.client.0.smithi100.stdout:6/507: chown d7/d9/c97 198864865 1 2024-04-30T23:15:57.688 INFO:tasks.workunit.client.0.smithi100.stdout:7/669: unlink d0/d1b/d60/d48/d4a/lc8 0 2024-04-30T23:15:57.688 INFO:tasks.workunit.client.0.smithi100.stdout:7/670: write d0/d1b/d60/fdd [363397,59447] 0 2024-04-30T23:15:57.689 INFO:tasks.workunit.client.0.smithi100.stdout:9/451: creat d4/d9/d10/fa2 x:0 0 0 2024-04-30T23:15:57.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/577: dwrite d19/d1a/d6d/f3d [0,4194304] 0 2024-04-30T23:15:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:4/578: link d19/d1a/d45/l94 d19/d33/d7d/lbc 0 2024-04-30T23:15:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:4/579: write d19/d33/f5a [3143773,124791] 0 2024-04-30T23:15:57.700 INFO:tasks.workunit.client.0.smithi100.stdout:8/510: sync 2024-04-30T23:15:57.700 INFO:tasks.workunit.client.0.smithi100.stdout:8/511: fdatasync d2/d89/f6c 0 2024-04-30T23:15:57.700 INFO:tasks.workunit.client.0.smithi100.stdout:8/512: write d2/d29/d67/f99 [9451,84114] 0 2024-04-30T23:15:57.703 INFO:tasks.workunit.client.0.smithi100.stdout:8/513: mkdir d2/d29/d9e 0 2024-04-30T23:15:57.709 INFO:tasks.workunit.client.0.smithi100.stdout:9/452: dread d4/d9/d10/f7e [0,4194304] 0 2024-04-30T23:15:57.710 INFO:tasks.workunit.client.0.smithi100.stdout:9/453: truncate d4/d7/d8/d37/f59 4892901 0 2024-04-30T23:15:57.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/671: dread d0/d1d/d5e/d6a/f2d [0,4194304] 0 2024-04-30T23:15:57.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/672: fsync d0/df/d4f/fbc 0 2024-04-30T23:15:57.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/673: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/f34 1922948 0 2024-04-30T23:15:57.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/674: creat d0/df/d4f/d53/dd2/fdf x:0 0 0 2024-04-30T23:15:57.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/675: dread - d0/d1b/d60/d48/d4a/f94 zero size 2024-04-30T23:15:57.715 INFO:tasks.workunit.client.0.smithi100.stdout:7/676: rename d0/d1d/d3c/ld1 to d0/df/d4f/d53/dd2/le0 0 2024-04-30T23:15:57.717 INFO:tasks.workunit.client.0.smithi100.stdout:7/677: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fe1 x:0 0 0 2024-04-30T23:15:57.718 INFO:tasks.workunit.client.0.smithi100.stdout:7/678: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a 39 2024-04-30T23:15:57.720 INFO:tasks.workunit.client.0.smithi100.stdout:6/508: dwrite d7/d9/f28 [0,4194304] 0 2024-04-30T23:15:57.720 INFO:tasks.workunit.client.0.smithi100.stdout:6/509: fsync d7/df/d23/d24/f95 0 2024-04-30T23:15:57.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/510: creat d7/df/d23/d24/d2e/fba x:0 0 0 2024-04-30T23:15:57.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/511: write d7/db/d3b/fa1 [341363,13551] 0 2024-04-30T23:15:57.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/512: write d7/df/d23/d24/d2e/d37/fb2 [892487,29202] 0 2024-04-30T23:15:57.723 INFO:tasks.workunit.client.0.smithi100.stdout:6/513: creat d7/d9/d86/d3e/d6b/fbb x:0 0 0 2024-04-30T23:15:57.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/514: creat d7/d9/d86/d1b/d22/fbc x:0 0 0 2024-04-30T23:15:57.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/514: dwrite d2/d89/d10/d17/f1a [0,4194304] 0 2024-04-30T23:15:57.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/515: chown d2/d89/f49 239 1 2024-04-30T23:15:57.727 INFO:tasks.workunit.client.0.smithi100.stdout:8/516: symlink d2/d97/l9f 0 2024-04-30T23:15:57.741 INFO:tasks.workunit.client.0.smithi100.stdout:8/517: dread d2/d89/d7f/f3f [0,4194304] 0 2024-04-30T23:15:57.743 INFO:tasks.workunit.client.0.smithi100.stdout:8/518: mkdir d2/d89/d10/d6e/da0 0 2024-04-30T23:15:57.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/519: mknod d2/d29/d9e/ca1 0 2024-04-30T23:15:57.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/520: fdatasync d2/d29/d67/f99 0 2024-04-30T23:15:57.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/679: dwrite d0/d1b/d60/d48/d4a/d5b/fca [0,4194304] 0 2024-04-30T23:15:57.744 INFO:tasks.workunit.client.0.smithi100.stdout:9/454: dwrite d4/d9/d10/f4a [4194304,4194304] 0 2024-04-30T23:15:57.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/680: rename d0/df/f39 to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/fe2 0 2024-04-30T23:15:57.749 INFO:tasks.workunit.client.0.smithi100.stdout:9/455: rmdir d4/d9/d93 39 2024-04-30T23:15:57.750 INFO:tasks.workunit.client.0.smithi100.stdout:9/456: symlink d4/d9/d50/la3 0 2024-04-30T23:15:57.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/515: dwrite d7/df/f41 [0,4194304] 0 2024-04-30T23:15:57.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/516: stat d7/d9/d86/d1b 0 2024-04-30T23:15:57.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/517: chown d7/df/d23/d4f 143950310 1 2024-04-30T23:15:57.755 INFO:tasks.workunit.client.0.smithi100.stdout:6/518: creat d7/df/d23/d4f/fbd x:0 0 0 2024-04-30T23:15:57.757 INFO:tasks.workunit.client.0.smithi100.stdout:6/519: creat d7/db/d3b/fbe x:0 0 0 2024-04-30T23:15:57.758 INFO:tasks.workunit.client.0.smithi100.stdout:6/520: mkdir d7/df/d23/d24/dbf 0 2024-04-30T23:15:57.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/521: symlink d7/d9/d8e/lc0 0 2024-04-30T23:15:57.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/522: chown d7/d9/f28 44699 1 2024-04-30T23:15:57.760 INFO:tasks.workunit.client.0.smithi100.stdout:8/521: dread d2/d89/d10/d17/f87 [0,4194304] 0 2024-04-30T23:15:57.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/523: fsync d7/df/d23/d24/d2e/f69 0 2024-04-30T23:15:57.761 INFO:tasks.workunit.client.0.smithi100.stdout:8/522: readlink d2/d7/d18/l5e 0 2024-04-30T23:15:57.764 INFO:tasks.workunit.client.0.smithi100.stdout:6/524: symlink d7/df/d23/d24/lc1 0 2024-04-30T23:15:57.764 INFO:tasks.workunit.client.0.smithi100.stdout:6/525: read - d7/d9/d86/d3e/d6b/fbb zero size 2024-04-30T23:15:57.764 INFO:tasks.workunit.client.0.smithi100.stdout:9/457: write f3 [6049428,130425] 0 2024-04-30T23:15:57.766 INFO:tasks.workunit.client.0.smithi100.stdout:6/526: rename d7/db/daf to d7/d9/d86/d3e/d6b/dc2 0 2024-04-30T23:15:57.766 INFO:tasks.workunit.client.0.smithi100.stdout:6/527: chown d7/db 490747 1 2024-04-30T23:15:57.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/681: dwrite d0/d1d/fb3 [0,4194304] 0 2024-04-30T23:15:57.768 INFO:tasks.workunit.client.0.smithi100.stdout:9/458: creat d4/d7/d60/d69/fa4 x:0 0 0 2024-04-30T23:15:57.769 INFO:tasks.workunit.client.0.smithi100.stdout:8/523: link d2/d7/c48 d2/d7/d18/ca2 0 2024-04-30T23:15:57.772 INFO:tasks.workunit.client.0.smithi100.stdout:6/528: rename d7/df/d23/d24/d2e/d9f/la3 to d7/df/d23/d24/d2e/d37/d85/db4/lc3 0 2024-04-30T23:15:57.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/459: rmdir d4/d9/d8e 39 2024-04-30T23:15:57.775 INFO:tasks.workunit.client.0.smithi100.stdout:8/524: mknod d2/d29/d71/ca3 0 2024-04-30T23:15:57.777 INFO:tasks.workunit.client.0.smithi100.stdout:9/460: symlink d4/d7/d60/d69/la5 0 2024-04-30T23:15:57.783 INFO:tasks.workunit.client.0.smithi100.stdout:9/461: rename d4/d7/d8/d37/d58/f6a to d4/d9/d10/d7f/fa6 0 2024-04-30T23:15:57.789 INFO:tasks.workunit.client.0.smithi100.stdout:7/682: dwrite d0/d1d/d5e/d6a/f2d [0,4194304] 0 2024-04-30T23:15:57.792 INFO:tasks.workunit.client.0.smithi100.stdout:7/683: mknod d0/d1b/ce3 0 2024-04-30T23:15:57.794 INFO:tasks.workunit.client.0.smithi100.stdout:7/684: link d0/d1b/d60/d48/c81 d0/df/d4f/d93/ce4 0 2024-04-30T23:15:57.794 INFO:tasks.workunit.client.0.smithi100.stdout:7/685: write d0/f16 [4945617,76044] 0 2024-04-30T23:15:57.794 INFO:tasks.workunit.client.0.smithi100.stdout:7/686: readlink d0/df/d4f/d53/dd2/le0 0 2024-04-30T23:15:57.794 INFO:tasks.workunit.client.0.smithi100.stdout:7/687: chown d0/d1d/fb3 4 1 2024-04-30T23:15:57.800 INFO:tasks.workunit.client.0.smithi100.stdout:6/529: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:15:57.803 INFO:tasks.workunit.client.0.smithi100.stdout:8/525: dwrite d2/d89/d72/f9b [0,4194304] 0 2024-04-30T23:15:57.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/462: dwrite d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:15:57.807 INFO:tasks.workunit.client.0.smithi100.stdout:1/409: sync 2024-04-30T23:15:57.807 INFO:tasks.workunit.client.0.smithi100.stdout:2/544: sync 2024-04-30T23:15:57.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/526: mkdir d2/d7/d18/d3a/da4 0 2024-04-30T23:15:57.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/527: write d2/d29/f2b [349858,98193] 0 2024-04-30T23:15:57.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/528: chown d2/d89/d7f/c6b 34004 1 2024-04-30T23:15:57.810 INFO:tasks.workunit.client.0.smithi100.stdout:9/463: write d4/d7/d8/d37/d3d/f41 [759335,65305] 0 2024-04-30T23:15:57.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/545: rename d5/d47/f7b to d5/d12/d8e/fac 0 2024-04-30T23:15:57.812 INFO:tasks.workunit.client.0.smithi100.stdout:1/410: mknod d3/d16/d20/d24/c7b 0 2024-04-30T23:15:57.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/464: mkdir d4/d7/da7 0 2024-04-30T23:15:57.821 INFO:tasks.workunit.client.0.smithi100.stdout:2/546: link d5/d47/c86 d5/d26/d2f/d38/cad 0 2024-04-30T23:15:57.822 INFO:tasks.workunit.client.0.smithi100.stdout:8/529: symlink d2/d7/d18/la5 0 2024-04-30T23:15:57.822 INFO:tasks.workunit.client.0.smithi100.stdout:8/530: chown d2/d89/d10/c56 735 1 2024-04-30T23:15:57.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/465: mknod d4/d7/d5d/ca8 0 2024-04-30T23:15:57.823 INFO:tasks.workunit.client.0.smithi100.stdout:6/530: dwrite d7/d9/d86/d3e/f91 [0,4194304] 0 2024-04-30T23:15:57.823 INFO:tasks.workunit.client.0.smithi100.stdout:6/531: readlink d7/db/lc 0 2024-04-30T23:15:57.824 INFO:tasks.workunit.client.0.smithi100.stdout:2/547: mkdir d5/d12/d8e/dae 0 2024-04-30T23:15:57.826 INFO:tasks.workunit.client.0.smithi100.stdout:9/466: creat d4/d9/d51/d89/fa9 x:0 0 0 2024-04-30T23:15:57.829 INFO:tasks.workunit.client.0.smithi100.stdout:1/411: write d3/f8 [859467,12210] 0 2024-04-30T23:15:57.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/688: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f96 [0,4194304] 0 2024-04-30T23:15:57.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/531: rename d2/ff to d2/d7/d18/fa6 0 2024-04-30T23:15:57.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/532: truncate d2/d89/d10/d17/f4f 1850344 0 2024-04-30T23:15:57.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/533: read - d2/d89/f49 zero size 2024-04-30T23:15:57.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/534: stat d2/d89/d10/d52 0 2024-04-30T23:15:57.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/535: chown d2/d89/f4d 13887 1 2024-04-30T23:15:57.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/412: creat d3/d16/d20/d24/f7c x:0 0 0 2024-04-30T23:15:57.834 INFO:tasks.workunit.client.0.smithi100.stdout:7/689: unlink d0/d1b/l30 0 2024-04-30T23:15:57.834 INFO:tasks.workunit.client.0.smithi100.stdout:7/690: stat d0 0 2024-04-30T23:15:57.834 INFO:tasks.workunit.client.0.smithi100.stdout:7/691: chown d0/d1d/d5e/d6a/d4b/d79/d2a/fbf 0 1 2024-04-30T23:15:57.835 INFO:tasks.workunit.client.0.smithi100.stdout:9/467: rename d4/d9/d51/f8f to d4/d9/d50/faa 0 2024-04-30T23:15:57.836 INFO:tasks.workunit.client.0.smithi100.stdout:8/536: truncate d2/f8 5305114 0 2024-04-30T23:15:57.838 INFO:tasks.workunit.client.0.smithi100.stdout:7/692: mknod d0/d1b/d1e/ce5 0 2024-04-30T23:15:57.838 INFO:tasks.workunit.client.0.smithi100.stdout:7/693: truncate d0/df/d4f/d53/dd2/fdf 100672 0 2024-04-30T23:15:57.838 INFO:tasks.workunit.client.0.smithi100.stdout:7/694: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fa4 zero size 2024-04-30T23:15:57.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/537: rename d2/d7/l23 to d2/d7/d18/la7 0 2024-04-30T23:15:57.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/538: chown d2/d89/d10/d17/f1a 2956 1 2024-04-30T23:15:57.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/539: stat d2/f3e 0 2024-04-30T23:15:57.839 INFO:tasks.workunit.client.0.smithi100.stdout:2/548: dread d5/d12/f2b [0,4194304] 0 2024-04-30T23:15:57.840 INFO:tasks.workunit.client.0.smithi100.stdout:2/549: chown d5/d26 705 1 2024-04-30T23:15:57.840 INFO:tasks.workunit.client.0.smithi100.stdout:8/540: creat d2/d97/fa8 x:0 0 0 2024-04-30T23:15:57.841 INFO:tasks.workunit.client.0.smithi100.stdout:2/550: rmdir d5/d47 39 2024-04-30T23:15:57.841 INFO:tasks.workunit.client.0.smithi100.stdout:2/551: read - d5/d12/f9a zero size 2024-04-30T23:15:57.841 INFO:tasks.workunit.client.0.smithi100.stdout:2/552: write d5/d22/f60 [5197869,57730] 0 2024-04-30T23:15:57.842 INFO:tasks.workunit.client.0.smithi100.stdout:2/553: creat d5/d26/d2f/d38/faf x:0 0 0 2024-04-30T23:15:57.842 INFO:tasks.workunit.client.0.smithi100.stdout:2/554: dread - d5/d26/d2f/d38/faf zero size 2024-04-30T23:15:57.844 INFO:tasks.workunit.client.0.smithi100.stdout:8/541: mknod d2/d7/d18/ca9 0 2024-04-30T23:15:57.844 INFO:tasks.workunit.client.0.smithi100.stdout:8/542: chown d2/d89/l21 1987821602 1 2024-04-30T23:15:57.846 INFO:tasks.workunit.client.0.smithi100.stdout:1/413: write d3/d18/d60/f64 [2297254,98949] 0 2024-04-30T23:15:57.846 INFO:tasks.workunit.client.0.smithi100.stdout:8/543: link d2/d29/d67/c7a d2/d89/d72/d93/caa 0 2024-04-30T23:15:57.848 INFO:tasks.workunit.client.0.smithi100.stdout:8/544: mknod d2/d89/d10/d52/cab 0 2024-04-30T23:15:57.848 INFO:tasks.workunit.client.0.smithi100.stdout:8/545: dread - d2/f76 zero size 2024-04-30T23:15:57.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/546: creat d2/d89/d10/d17/d8f/fac x:0 0 0 2024-04-30T23:15:57.849 INFO:tasks.workunit.client.0.smithi100.stdout:1/414: write d3/d16/d20/d24/f48 [959622,65445] 0 2024-04-30T23:15:57.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/547: mkdir d2/d89/d10/d6e/dad 0 2024-04-30T23:15:57.852 INFO:tasks.workunit.client.0.smithi100.stdout:8/548: creat d2/d89/d10/d17/fae x:0 0 0 2024-04-30T23:15:57.852 INFO:tasks.workunit.client.0.smithi100.stdout:8/549: stat d2/d89/d10/d17/l35 0 2024-04-30T23:15:57.854 INFO:tasks.workunit.client.0.smithi100.stdout:2/555: dread d5/d26/f54 [0,4194304] 0 2024-04-30T23:15:57.854 INFO:tasks.workunit.client.0.smithi100.stdout:2/556: write d5/d26/d2f/d38/f61 [1573004,69420] 0 2024-04-30T23:15:57.855 INFO:tasks.workunit.client.0.smithi100.stdout:2/557: truncate d5/d12/d13/f59 8694827 0 2024-04-30T23:15:57.869 INFO:tasks.workunit.client.0.smithi100.stdout:2/558: dread f1 [0,4194304] 0 2024-04-30T23:15:57.870 INFO:tasks.workunit.client.0.smithi100.stdout:2/559: creat d5/fb0 x:0 0 0 2024-04-30T23:15:57.870 INFO:tasks.workunit.client.0.smithi100.stdout:2/560: chown f1 5075740 1 2024-04-30T23:15:57.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/561: dread d5/d12/d13/d4b/f52 [0,4194304] 0 2024-04-30T23:15:57.913 INFO:tasks.workunit.client.0.smithi100.stdout:2/562: dwrite d5/d26/f54 [0,4194304] 0 2024-04-30T23:15:57.928 INFO:tasks.workunit.client.0.smithi100.stdout:2/563: read d5/d26/f54 [1801070,51024] 0 2024-04-30T23:15:57.930 INFO:tasks.workunit.client.0.smithi100.stdout:2/564: rename d5/d12/c39 to d5/d47/d4c/dab/cb1 0 2024-04-30T23:15:57.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/565: dread d5/d12/d13/d4b/f99 [0,4194304] 0 2024-04-30T23:15:57.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/566: dread - d5/d12/d8e/f98 zero size 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/605: sync 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/606: write d1/f30 [654622,55961] 0 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:0/589: sync 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:2/567: write d5/d2e/f35 [8073418,115687] 0 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:2/568: readlink d5/d47/d4c/l81 0 2024-04-30T23:15:57.958 INFO:tasks.workunit.client.0.smithi100.stdout:2/569: readlink d5/d12/l15 0 2024-04-30T23:15:57.960 INFO:tasks.workunit.client.0.smithi100.stdout:5/607: mknod d1/d12/d74/cc9 0 2024-04-30T23:15:57.963 INFO:tasks.workunit.client.0.smithi100.stdout:1/415: dwrite d3/d16/d20/d24/f5c [0,4194304] 0 2024-04-30T23:15:57.963 INFO:tasks.workunit.client.0.smithi100.stdout:5/608: creat d1/d2c/fca x:0 0 0 2024-04-30T23:15:57.963 INFO:tasks.workunit.client.0.smithi100.stdout:5/609: fsync d1/d37/d5c/f91 0 2024-04-30T23:15:57.963 INFO:tasks.workunit.client.0.smithi100.stdout:5/610: fsync d1/d12/f15 0 2024-04-30T23:15:57.964 INFO:tasks.workunit.client.0.smithi100.stdout:7/695: dwrite d0/df/d4f/d53/fc0 [0,4194304] 0 2024-04-30T23:15:57.969 INFO:tasks.workunit.client.0.smithi100.stdout:1/416: fdatasync d3/d18/f5d 0 2024-04-30T23:15:57.971 INFO:tasks.workunit.client.0.smithi100.stdout:5/611: mknod d1/d19/ccb 0 2024-04-30T23:15:57.973 INFO:tasks.workunit.client.0.smithi100.stdout:0/590: dread d2/d14/d18/f2d [0,4194304] 0 2024-04-30T23:15:57.974 INFO:tasks.workunit.client.0.smithi100.stdout:0/591: write d2/f52 [725048,15443] 0 2024-04-30T23:15:57.978 INFO:tasks.workunit.client.0.smithi100.stdout:5/612: mknod d1/d19/d78/ccc 0 2024-04-30T23:15:57.979 INFO:tasks.workunit.client.0.smithi100.stdout:0/592: truncate d2/d50/d38/f3f 4546987 0 2024-04-30T23:15:57.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/417: rmdir d3/d16/d20 39 2024-04-30T23:15:57.981 INFO:tasks.workunit.client.0.smithi100.stdout:7/696: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 x:0 0 0 2024-04-30T23:15:57.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/613: rename d1/d37/d5c to d1/d3e/daa/dcd 0 2024-04-30T23:15:57.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/570: dwrite d5/d47/f8b [0,4194304] 0 2024-04-30T23:15:57.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/571: truncate d5/f28 1631653 0 2024-04-30T23:15:57.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/572: write d5/d22/f60 [1645436,1548] 0 2024-04-30T23:15:57.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/573: read d5/d26/f54 [1798771,105334] 0 2024-04-30T23:15:57.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/418: creat d3/d16/d20/d24/d51/d59/d5f/f7d x:0 0 0 2024-04-30T23:15:57.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/419: fdatasync d3/d16/f3c 0 2024-04-30T23:15:57.986 INFO:tasks.workunit.client.0.smithi100.stdout:7/697: dread - d0/d1b/d60/fb2 zero size 2024-04-30T23:15:57.991 INFO:tasks.workunit.client.0.smithi100.stdout:2/574: mknod d5/d47/d4c/dab/cb2 0 2024-04-30T23:15:57.991 INFO:tasks.workunit.client.0.smithi100.stdout:1/420: symlink d3/d16/d20/d24/d51/d59/d5f/l7e 0 2024-04-30T23:15:57.991 INFO:tasks.workunit.client.0.smithi100.stdout:1/421: fsync d3/f8 0 2024-04-30T23:15:57.991 INFO:tasks.workunit.client.0.smithi100.stdout:1/422: truncate d3/d16/d20/d24/d69/f74 540276 0 2024-04-30T23:15:57.991 INFO:tasks.workunit.client.0.smithi100.stdout:1/423: write d3/d16/d20/d24/d69/f46 [302048,81251] 0 2024-04-30T23:15:57.992 INFO:tasks.workunit.client.0.smithi100.stdout:8/550: dread d2/f8 [0,4194304] 0 2024-04-30T23:15:57.992 INFO:tasks.workunit.client.0.smithi100.stdout:7/698: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/le7 0 2024-04-30T23:15:58.000 INFO:tasks.workunit.client.0.smithi100.stdout:8/551: mkdir d2/d29/d9e/daf 0 2024-04-30T23:15:58.000 INFO:tasks.workunit.client.0.smithi100.stdout:1/424: creat d3/db/f7f x:0 0 0 2024-04-30T23:15:58.002 INFO:tasks.workunit.client.0.smithi100.stdout:5/614: dread d1/d12/d1a/d5b/fbc [0,4194304] 0 2024-04-30T23:15:58.002 INFO:tasks.workunit.client.0.smithi100.stdout:5/615: write d1/d12/d27/f4c [995979,81301] 0 2024-04-30T23:15:58.002 INFO:tasks.workunit.client.0.smithi100.stdout:1/425: mkdir d3/d16/d20/d24/d51/d80 0 2024-04-30T23:15:58.005 INFO:tasks.workunit.client.0.smithi100.stdout:1/426: creat d3/d16/d20/f81 x:0 0 0 2024-04-30T23:15:58.017 INFO:tasks.workunit.client.0.smithi100.stdout:3/547: sync 2024-04-30T23:15:58.017 INFO:tasks.workunit.client.0.smithi100.stdout:4/580: sync 2024-04-30T23:15:58.020 INFO:tasks.workunit.client.0.smithi100.stdout:0/593: dwrite d2/d50/d30/d32/f84 [0,4194304] 0 2024-04-30T23:15:58.031 INFO:tasks.workunit.client.0.smithi100.stdout:7/699: dwrite d0/d1b/d60/d48/d4a/d5b/f6c [0,4194304] 0 2024-04-30T23:15:58.035 INFO:tasks.workunit.client.0.smithi100.stdout:1/427: dread d3/d16/d20/d24/f44 [0,4194304] 0 2024-04-30T23:15:58.035 INFO:tasks.workunit.client.0.smithi100.stdout:1/428: readlink d3/d16/d20/l55 0 2024-04-30T23:15:58.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/429: mknod d3/d16/d20/d24/d51/d59/d5f/c82 0 2024-04-30T23:15:58.040 INFO:tasks.workunit.client.0.smithi100.stdout:8/552: dwrite d2/d29/f2b [0,4194304] 0 2024-04-30T23:15:58.040 INFO:tasks.workunit.client.0.smithi100.stdout:2/575: dwrite d5/d26/d2f/f5b [0,4194304] 0 2024-04-30T23:15:58.040 INFO:tasks.workunit.client.0.smithi100.stdout:1/430: symlink d3/d18/d60/l83 0 2024-04-30T23:15:58.044 INFO:tasks.workunit.client.0.smithi100.stdout:8/553: getdents d2/d29/d8b 0 2024-04-30T23:15:58.045 INFO:tasks.workunit.client.0.smithi100.stdout:1/431: truncate d3/f9 1891693 0 2024-04-30T23:15:58.048 INFO:tasks.workunit.client.0.smithi100.stdout:4/581: write d19/d1a/d21/f8b [62104,96143] 0 2024-04-30T23:15:58.048 INFO:tasks.workunit.client.0.smithi100.stdout:4/582: write d19/d1a/d21/d3c/fb9 [751699,23009] 0 2024-04-30T23:15:58.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/583: getdents d19/d33 0 2024-04-30T23:15:58.052 INFO:tasks.workunit.client.0.smithi100.stdout:3/548: write d1/d14/d15/d2c/d68/f6b [2861400,126280] 0 2024-04-30T23:15:58.052 INFO:tasks.workunit.client.0.smithi100.stdout:5/616: dwrite d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:15:58.054 INFO:tasks.workunit.client.0.smithi100.stdout:4/584: rmdir d19/dba 0 2024-04-30T23:15:58.055 INFO:tasks.workunit.client.0.smithi100.stdout:0/594: read d2/f3a [3030625,93275] 0 2024-04-30T23:15:58.055 INFO:tasks.workunit.client.0.smithi100.stdout:0/595: truncate d2/d14/d35/d40/d83/faf 225875 0 2024-04-30T23:15:58.057 INFO:tasks.workunit.client.0.smithi100.stdout:1/432: dread d3/f26 [0,4194304] 0 2024-04-30T23:15:58.057 INFO:tasks.workunit.client.0.smithi100.stdout:1/433: fsync d3/d16/d20/d24/f44 0 2024-04-30T23:15:58.059 INFO:tasks.workunit.client.0.smithi100.stdout:3/549: getdents d1/d14/d15/d32/d7d 0 2024-04-30T23:15:58.059 INFO:tasks.workunit.client.0.smithi100.stdout:3/550: write d1/d14/d15/f44 [4962610,13340] 0 2024-04-30T23:15:58.060 INFO:tasks.workunit.client.0.smithi100.stdout:3/551: read d1/d14/d15/d2c/d68/d26/f28 [2573851,79496] 0 2024-04-30T23:15:58.060 INFO:tasks.workunit.client.0.smithi100.stdout:3/552: stat d1/d14/d2b/d57/f80 0 2024-04-30T23:15:58.061 INFO:tasks.workunit.client.0.smithi100.stdout:2/576: write d5/d22/f42 [1250249,47114] 0 2024-04-30T23:15:58.061 INFO:tasks.workunit.client.0.smithi100.stdout:2/577: write d5/f6d [1214015,105056] 0 2024-04-30T23:15:58.063 INFO:tasks.workunit.client.0.smithi100.stdout:4/585: creat d19/d33/fbd x:0 0 0 2024-04-30T23:15:58.063 INFO:tasks.workunit.client.0.smithi100.stdout:3/553: fsync d1/d14/d15/d2c/d68/f6b 0 2024-04-30T23:15:58.066 INFO:tasks.workunit.client.0.smithi100.stdout:2/578: symlink d5/d58/lb3 0 2024-04-30T23:15:58.067 INFO:tasks.workunit.client.0.smithi100.stdout:4/586: rmdir d19/d1a/d21/d3c 39 2024-04-30T23:15:58.067 INFO:tasks.workunit.client.0.smithi100.stdout:4/587: dread - d19/d1a/d29/d65/fb1 zero size 2024-04-30T23:15:58.069 INFO:tasks.workunit.client.0.smithi100.stdout:3/554: mknod d1/ca0 0 2024-04-30T23:15:58.070 INFO:tasks.workunit.client.0.smithi100.stdout:2/579: rename d5/d47/d4c/dab/cb2 to d5/d22/cb4 0 2024-04-30T23:15:58.072 INFO:tasks.workunit.client.0.smithi100.stdout:0/596: dread d2/d50/d30/f3d [0,4194304] 0 2024-04-30T23:15:58.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/588: creat d19/d1a/d6d/fbe x:0 0 0 2024-04-30T23:15:58.073 INFO:tasks.workunit.client.0.smithi100.stdout:3/555: creat d1/d14/d2b/d57/fa1 x:0 0 0 2024-04-30T23:15:58.074 INFO:tasks.workunit.client.0.smithi100.stdout:4/589: dread d19/d1a/f48 [0,4194304] 0 2024-04-30T23:15:58.075 INFO:tasks.workunit.client.0.smithi100.stdout:2/580: link d5/d22/f2c d5/d47/d4c/fb5 0 2024-04-30T23:15:58.077 INFO:tasks.workunit.client.0.smithi100.stdout:1/434: dread d3/f4f [0,4194304] 0 2024-04-30T23:15:58.077 INFO:tasks.workunit.client.0.smithi100.stdout:1/435: fsync d3/d16/d20/f27 0 2024-04-30T23:15:58.077 INFO:tasks.workunit.client.0.smithi100.stdout:1/436: truncate d3/d16/d20/d24/d69/f71 239300 0 2024-04-30T23:15:58.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/581: symlink d5/d12/d13/d9e/lb6 0 2024-04-30T23:15:58.079 INFO:tasks.workunit.client.0.smithi100.stdout:5/617: dwrite d1/d12/f15 [0,4194304] 0 2024-04-30T23:15:58.079 INFO:tasks.workunit.client.0.smithi100.stdout:5/618: chown d1/d12/d27/l63 58523 1 2024-04-30T23:15:58.080 INFO:tasks.workunit.client.0.smithi100.stdout:1/437: rename d3/d16/d20/d24/d69/f74 to d3/d16/f84 0 2024-04-30T23:15:58.080 INFO:tasks.workunit.client.0.smithi100.stdout:1/438: chown d3/d18/d60 38130957 1 2024-04-30T23:15:58.080 INFO:tasks.workunit.client.0.smithi100.stdout:1/439: write d3/d16/d20/d24/d51/d59/f73 [462879,102944] 0 2024-04-30T23:15:58.080 INFO:tasks.workunit.client.0.smithi100.stdout:6/532: sync 2024-04-30T23:15:58.080 INFO:tasks.workunit.client.0.smithi100.stdout:9/468: sync 2024-04-30T23:15:58.081 INFO:tasks.workunit.client.0.smithi100.stdout:2/582: truncate d5/d47/d4c/f92 215254 0 2024-04-30T23:15:58.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/619: mknod d1/d19/d7f/cce 0 2024-04-30T23:15:58.088 INFO:tasks.workunit.client.0.smithi100.stdout:1/440: stat d3/f9 0 2024-04-30T23:15:58.088 INFO:tasks.workunit.client.0.smithi100.stdout:0/597: dread d2/d14/d35/d40/f56 [0,4194304] 0 2024-04-30T23:15:58.089 INFO:tasks.workunit.client.0.smithi100.stdout:9/469: fdatasync d4/d7/d8/d37/f4b 0 2024-04-30T23:15:58.091 INFO:tasks.workunit.client.0.smithi100.stdout:6/533: getdents d7/d9 0 2024-04-30T23:15:58.091 INFO:tasks.workunit.client.0.smithi100.stdout:6/534: chown d7/d9/d86/d3e/d6b/fb9 15432767 1 2024-04-30T23:15:58.092 INFO:tasks.workunit.client.0.smithi100.stdout:2/583: mknod d5/d26/d2f/d38/cb7 0 2024-04-30T23:15:58.092 INFO:tasks.workunit.client.0.smithi100.stdout:2/584: write d5/d26/f4a [1022220,64067] 0 2024-04-30T23:15:58.092 INFO:tasks.workunit.client.0.smithi100.stdout:2/585: dread - d5/d12/d13/d4b/faa zero size 2024-04-30T23:15:58.093 INFO:tasks.workunit.client.0.smithi100.stdout:5/620: mkdir d1/d2c/d60/d66/d71/dcf 0 2024-04-30T23:15:58.093 INFO:tasks.workunit.client.0.smithi100.stdout:5/621: fdatasync d1/d3e/daa/dcd/f91 0 2024-04-30T23:15:58.095 INFO:tasks.workunit.client.0.smithi100.stdout:6/535: creat d7/df/d23/d24/fc4 x:0 0 0 2024-04-30T23:15:58.097 INFO:tasks.workunit.client.0.smithi100.stdout:1/441: dread d3/f8 [0,4194304] 0 2024-04-30T23:15:58.097 INFO:tasks.workunit.client.0.smithi100.stdout:4/590: dwrite d19/d1a/d21/d4a/f6a [0,4194304] 0 2024-04-30T23:15:58.097 INFO:tasks.workunit.client.0.smithi100.stdout:4/591: fsync d19/d1a/d21/d4a/fa0 0 2024-04-30T23:15:58.097 INFO:tasks.workunit.client.0.smithi100.stdout:2/586: rmdir d5/d58/da9 0 2024-04-30T23:15:58.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/622: mkdir d1/d3e/d99/dbf/dd0 0 2024-04-30T23:15:58.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/470: rename d4/d7/d8/d37/da0 to d4/d7/dab 0 2024-04-30T23:15:58.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/536: rmdir d7/d9/d86/d1b/d59/d98 39 2024-04-30T23:15:58.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/537: stat d7/df/d23/d2b/d42 0 2024-04-30T23:15:58.105 INFO:tasks.workunit.client.0.smithi100.stdout:2/587: write d5/d47/d66/f69 [1407772,22775] 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/592: readlink d19/d1a/l6c 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/538: rename d7/d9/d86/d3e/d6b/l9e to d7/d11/d34/lc5 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/593: creat d19/d1a/d29/dae/fbf x:0 0 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/594: mknod d19/d1a/d21/d4a/cc0 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/595: readlink d19/d1a/d6d/d64/d78/lb8 0 2024-04-30T23:15:58.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/596: creat d19/d1a/d6d/d4e/fc1 x:0 0 0 2024-04-30T23:15:58.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/588: write d5/d26/d2f/f36 [404018,656] 0 2024-04-30T23:15:58.118 INFO:tasks.workunit.client.0.smithi100.stdout:5/623: dread d1/d12/f23 [0,4194304] 0 2024-04-30T23:15:58.118 INFO:tasks.workunit.client.0.smithi100.stdout:0/598: dwrite d2/d14/d35/d57/f78 [0,4194304] 0 2024-04-30T23:15:58.118 INFO:tasks.workunit.client.0.smithi100.stdout:5/624: getdents d1/d3e/daa/dcd/d85 0 2024-04-30T23:15:58.123 INFO:tasks.workunit.client.0.smithi100.stdout:1/442: dwrite d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:58.125 INFO:tasks.workunit.client.0.smithi100.stdout:1/443: rmdir d3 39 2024-04-30T23:15:58.125 INFO:tasks.workunit.client.0.smithi100.stdout:9/471: write d4/d7/d8/f25 [572120,41471] 0 2024-04-30T23:15:58.125 INFO:tasks.workunit.client.0.smithi100.stdout:9/472: stat d4/d7/d8 0 2024-04-30T23:15:58.128 INFO:tasks.workunit.client.0.smithi100.stdout:9/473: link d4/d7/d60/c81 d4/d7/d5d/cac 0 2024-04-30T23:15:58.130 INFO:tasks.workunit.client.0.smithi100.stdout:9/474: link d4/d7/d8/d19/f4e d4/d7/d60/fad 0 2024-04-30T23:15:58.131 INFO:tasks.workunit.client.0.smithi100.stdout:9/475: fdatasync d4/d9/d10/f78 0 2024-04-30T23:15:58.131 INFO:tasks.workunit.client.0.smithi100.stdout:9/476: dread - d4/f96 zero size 2024-04-30T23:15:58.139 INFO:tasks.workunit.client.0.smithi100.stdout:4/597: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:58.140 INFO:tasks.workunit.client.0.smithi100.stdout:4/598: fsync d19/d1a/d6d/d4e/d6e/f9f 0 2024-04-30T23:15:58.141 INFO:tasks.workunit.client.0.smithi100.stdout:4/599: creat d19/d1a/d21/fc2 x:0 0 0 2024-04-30T23:15:58.143 INFO:tasks.workunit.client.0.smithi100.stdout:2/589: write d5/d12/f6c [129760,93972] 0 2024-04-30T23:15:58.144 INFO:tasks.workunit.client.0.smithi100.stdout:5/625: dwrite d1/d12/f18 [4194304,4194304] 0 2024-04-30T23:15:58.146 INFO:tasks.workunit.client.0.smithi100.stdout:5/626: creat d1/d12/d74/fd1 x:0 0 0 2024-04-30T23:15:58.148 INFO:tasks.workunit.client.0.smithi100.stdout:5/627: unlink d1/d2c/f59 0 2024-04-30T23:15:58.148 INFO:tasks.workunit.client.0.smithi100.stdout:5/628: chown d1/d2c/d60/d66/d71 187 1 2024-04-30T23:15:58.149 INFO:tasks.workunit.client.0.smithi100.stdout:0/599: dwrite d2/fc [0,4194304] 0 2024-04-30T23:15:58.150 INFO:tasks.workunit.client.0.smithi100.stdout:0/600: mkdir d2/d14/d35/d40/dbe 0 2024-04-30T23:15:58.153 INFO:tasks.workunit.client.0.smithi100.stdout:1/444: dwrite d3/d16/d20/d24/d69/f46 [0,4194304] 0 2024-04-30T23:15:58.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/445: unlink d3/d16/d20/d24/f44 0 2024-04-30T23:15:58.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/446: fdatasync d3/d16/f36 0 2024-04-30T23:15:58.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/447: write d3/d16/d20/d24/f48 [723678,100911] 0 2024-04-30T23:15:58.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/448: chown d3/db/c41 72781 1 2024-04-30T23:15:58.165 INFO:tasks.workunit.client.0.smithi100.stdout:0/601: write d2/f73 [1580666,100649] 0 2024-04-30T23:15:58.165 INFO:tasks.workunit.client.0.smithi100.stdout:0/602: write d2/d14/d35/d40/f56 [4850646,28456] 0 2024-04-30T23:15:58.169 INFO:tasks.workunit.client.0.smithi100.stdout:2/590: write d5/f80 [4770642,66652] 0 2024-04-30T23:15:58.170 INFO:tasks.workunit.client.0.smithi100.stdout:1/449: dread d3/db/f39 [0,4194304] 0 2024-04-30T23:15:58.170 INFO:tasks.workunit.client.0.smithi100.stdout:2/591: unlink d5/d26/d2f/c94 0 2024-04-30T23:15:58.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/592: rmdir d5/d2e 39 2024-04-30T23:15:58.172 INFO:tasks.workunit.client.0.smithi100.stdout:2/593: creat d5/d47/d4c/dab/fb8 x:0 0 0 2024-04-30T23:15:58.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/600: dwrite d19/d1a/d6d/d4e/fc1 [0,4194304] 0 2024-04-30T23:15:58.173 INFO:tasks.workunit.client.0.smithi100.stdout:2/594: creat d5/d47/d4c/fb9 x:0 0 0 2024-04-30T23:15:58.173 INFO:tasks.workunit.client.0.smithi100.stdout:2/595: readlink d5/d47/d4c/dab/la2 0 2024-04-30T23:15:58.175 INFO:tasks.workunit.client.0.smithi100.stdout:4/601: creat d19/d1a/fc3 x:0 0 0 2024-04-30T23:15:58.176 INFO:tasks.workunit.client.0.smithi100.stdout:2/596: rmdir d5/d12/d73 39 2024-04-30T23:15:58.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/603: read d2/d14/d35/d40/f56 [3360812,75554] 0 2024-04-30T23:15:58.176 INFO:tasks.workunit.client.0.smithi100.stdout:5/629: dwrite d1/d3e/d99/fc2 [4194304,4194304] 0 2024-04-30T23:15:58.177 INFO:tasks.workunit.client.0.smithi100.stdout:4/602: symlink d19/d33/d3f/d40/da2/lc4 0 2024-04-30T23:15:58.179 INFO:tasks.workunit.client.0.smithi100.stdout:0/604: mkdir d2/d14/d35/d57/d62/d75/dbf 0 2024-04-30T23:15:58.181 INFO:tasks.workunit.client.0.smithi100.stdout:5/630: write d1/d12/d74/fd1 [904263,130401] 0 2024-04-30T23:15:58.182 INFO:tasks.workunit.client.0.smithi100.stdout:4/603: creat d19/d33/d3f/fc5 x:0 0 0 2024-04-30T23:15:58.182 INFO:tasks.workunit.client.0.smithi100.stdout:4/604: chown d19/d33/fab 4152364 1 2024-04-30T23:15:58.182 INFO:tasks.workunit.client.0.smithi100.stdout:4/605: readlink d19/d1a/l57 0 2024-04-30T23:15:58.183 INFO:tasks.workunit.client.0.smithi100.stdout:0/605: rename d2/d50/d38/d5d/l87 to d2/d14/lc0 0 2024-04-30T23:15:58.184 INFO:tasks.workunit.client.0.smithi100.stdout:5/631: creat d1/d12/d1a/d76/fd2 x:0 0 0 2024-04-30T23:15:58.185 INFO:tasks.workunit.client.0.smithi100.stdout:4/606: symlink d19/d1a/d29/d65/lc6 0 2024-04-30T23:15:58.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/450: dread d3/d16/d20/f2a [4194304,4194304] 0 2024-04-30T23:15:58.186 INFO:tasks.workunit.client.0.smithi100.stdout:0/606: symlink d2/d50/d38/d5d/lc1 0 2024-04-30T23:15:58.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/451: write d3/d18/f6d [150956,114593] 0 2024-04-30T23:15:58.189 INFO:tasks.workunit.client.0.smithi100.stdout:0/607: creat d2/d14/d35/d57/d62/fc2 x:0 0 0 2024-04-30T23:15:58.191 INFO:tasks.workunit.client.0.smithi100.stdout:5/632: link d1/d3e/laf d1/d12/d1a/d76/d77/ld3 0 2024-04-30T23:15:58.192 INFO:tasks.workunit.client.0.smithi100.stdout:5/633: write d1/d12/d1a/d5b/fbc [4569380,77023] 0 2024-04-30T23:15:58.195 INFO:tasks.workunit.client.0.smithi100.stdout:2/597: write d5/d26/d2f/d38/f75 [2833538,91609] 0 2024-04-30T23:15:58.195 INFO:tasks.workunit.client.0.smithi100.stdout:2/598: readlink d5/d12/d13/l34 0 2024-04-30T23:15:58.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/608: rename d2/d14/d18/la3 to d2/d50/d38/d5d/lc3 0 2024-04-30T23:15:58.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/609: stat d2/d14/d35/fb4 0 2024-04-30T23:15:58.199 INFO:tasks.workunit.client.0.smithi100.stdout:2/599: creat d5/d26/d9b/fba x:0 0 0 2024-04-30T23:15:58.200 INFO:tasks.workunit.client.0.smithi100.stdout:0/610: rename d2/d14/d35/d57/d62/d75/dbf to d2/d50/d38/d5d/dc4 0 2024-04-30T23:15:58.202 INFO:tasks.workunit.client.0.smithi100.stdout:2/600: creat d5/fbb x:0 0 0 2024-04-30T23:15:58.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/611: rmdir d2/d50/d38/d5d/dae/db7 0 2024-04-30T23:15:58.213 INFO:tasks.workunit.client.0.smithi100.stdout:1/452: dwrite d3/d16/f84 [0,4194304] 0 2024-04-30T23:15:58.213 INFO:tasks.workunit.client.0.smithi100.stdout:1/453: chown d3/db/c41 56235 1 2024-04-30T23:15:58.213 INFO:tasks.workunit.client.0.smithi100.stdout:1/454: dread - d3/d16/d20/d24/d69/d63/f6c zero size 2024-04-30T23:15:58.215 INFO:tasks.workunit.client.0.smithi100.stdout:1/455: getdents d3/db/d4b 0 2024-04-30T23:15:58.215 INFO:tasks.workunit.client.0.smithi100.stdout:1/456: truncate d3/f26 2060230 0 2024-04-30T23:15:58.215 INFO:tasks.workunit.client.0.smithi100.stdout:1/457: write d3/d16/d20/d24/d51/f70 [391992,120897] 0 2024-04-30T23:15:58.216 INFO:tasks.workunit.client.0.smithi100.stdout:1/458: unlink d3/db/f7f 0 2024-04-30T23:15:58.218 INFO:tasks.workunit.client.0.smithi100.stdout:1/459: mknod d3/d16/d20/d24/d51/c85 0 2024-04-30T23:15:58.221 INFO:tasks.workunit.client.0.smithi100.stdout:1/460: creat d3/d16/d20/d24/f86 x:0 0 0 2024-04-30T23:15:58.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/461: mkdir d3/d18/d60/d87 0 2024-04-30T23:15:58.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/462: truncate d3/f2f 4591007 0 2024-04-30T23:15:58.224 INFO:tasks.workunit.client.0.smithi100.stdout:1/463: fdatasync d3/d16/d20/d24/f7c 0 2024-04-30T23:15:58.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/612: write d2/d5a/f66 [329304,112143] 0 2024-04-30T23:15:58.233 INFO:tasks.workunit.client.0.smithi100.stdout:2/601: dwrite d5/d2e/f35 [0,4194304] 0 2024-04-30T23:15:58.234 INFO:tasks.workunit.client.0.smithi100.stdout:2/602: readlink d5/d58/l76 0 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/464: dread d3/d16/d20/d24/d51/f70 [0,4194304] 0 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/465: read d3/db/f39 [676884,122707] 0 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:2/603: rename d5/d12/d13/d4b/c7f to d5/d47/d4c/cbc 0 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:2/604: chown d5/d12/f1e 5 1 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:2/605: write d5/d22/fa8 [656351,39454] 0 2024-04-30T23:15:58.235 INFO:tasks.workunit.client.0.smithi100.stdout:2/606: write d5/f80 [4534609,9198] 0 2024-04-30T23:15:58.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/466: symlink d3/d16/d20/d24/d69/d63/l88 0 2024-04-30T23:15:58.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/607: dread d5/d22/fa8 [0,4194304] 0 2024-04-30T23:15:58.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/608: chown d5/d26/d2f 879016 1 2024-04-30T23:15:58.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/609: chown d5/d2e/c5f 981988076 1 2024-04-30T23:15:58.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/467: write d3/f5 [3691809,97276] 0 2024-04-30T23:15:58.258 INFO:tasks.workunit.client.0.smithi100.stdout:0/613: dwrite d2/d14/d35/d40/d83/faf [0,4194304] 0 2024-04-30T23:15:58.258 INFO:tasks.workunit.client.0.smithi100.stdout:0/614: write d2/f2e [3697922,76314] 0 2024-04-30T23:15:58.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/610: dwrite d5/d26/d9b/fba [0,4194304] 0 2024-04-30T23:15:58.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/611: chown d5/d12/l5e 89443862 1 2024-04-30T23:15:58.274 INFO:tasks.workunit.client.0.smithi100.stdout:2/612: getdents d5/d12/d13/d9e 0 2024-04-30T23:15:58.274 INFO:tasks.workunit.client.0.smithi100.stdout:2/613: creat d5/d2e/fbd x:0 0 0 2024-04-30T23:15:58.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/614: creat d5/d47/fbe x:0 0 0 2024-04-30T23:15:58.276 INFO:tasks.workunit.client.0.smithi100.stdout:1/468: dread d3/db/f3d [0,4194304] 0 2024-04-30T23:15:58.276 INFO:tasks.workunit.client.0.smithi100.stdout:2/615: truncate d5/d26/d2f/d38/f43 381386 0 2024-04-30T23:15:58.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/469: truncate d3/db/f40 517697 0 2024-04-30T23:15:58.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/470: chown d3/d16/d20/d24/f5c 246840761 1 2024-04-30T23:15:58.277 INFO:tasks.workunit.client.0.smithi100.stdout:2/616: mkdir d5/d12/d8e/dae/dbf 0 2024-04-30T23:15:58.279 INFO:tasks.workunit.client.0.smithi100.stdout:2/617: creat d5/d47/d4c/dab/fc0 x:0 0 0 2024-04-30T23:15:58.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/615: dwrite d2/d14/d35/d57/f78 [0,4194304] 0 2024-04-30T23:15:58.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/616: write d2/d50/d30/f6f [194931,25542] 0 2024-04-30T23:15:58.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/617: fdatasync d2/f52 0 2024-04-30T23:15:58.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/618: dread d5/d47/f8b [0,4194304] 0 2024-04-30T23:15:58.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/619: readlink d5/d26/d2f/d38/l9c 0 2024-04-30T23:15:58.296 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:57 smithi104 ceph-mon[32987]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 120 MiB/s wr, 349 op/s 2024-04-30T23:15:58.301 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:57 smithi183 ceph-mon[33560]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 120 MiB/s wr, 349 op/s 2024-04-30T23:15:58.305 INFO:tasks.workunit.client.0.smithi100.stdout:0/618: dwrite d2/d50/d30/d32/f84 [0,4194304] 0 2024-04-30T23:15:58.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/620: dread d5/f14 [0,4194304] 0 2024-04-30T23:15:58.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/621: stat d5/d12/d13 0 2024-04-30T23:15:58.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/622: write d5/d12/d13/f59 [6184470,52962] 0 2024-04-30T23:15:58.307 INFO:tasks.workunit.client.0.smithi100.stdout:1/471: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:15:58.307 INFO:tasks.workunit.client.0.smithi100.stdout:1/472: truncate d3/f6a 27802 0 2024-04-30T23:15:58.308 INFO:tasks.workunit.client.0.smithi100.stdout:1/473: symlink d3/d16/d20/d24/d51/l89 0 2024-04-30T23:15:58.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/474: fsync d3/d16/f36 0 2024-04-30T23:15:58.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/475: write d3/d18/d60/f64 [3125601,13666] 0 2024-04-30T23:15:58.310 INFO:tasks.workunit.client.0.smithi100.stdout:2/623: link d5/d22/f4e d5/d12/fc1 0 2024-04-30T23:15:58.310 INFO:tasks.workunit.client.0.smithi100.stdout:2/624: stat d5/d47/d4c/l81 0 2024-04-30T23:15:58.312 INFO:tasks.workunit.client.0.smithi100.stdout:1/476: dread d3/d16/d20/f33 [0,4194304] 0 2024-04-30T23:15:58.312 INFO:tasks.workunit.client.0.smithi100.stdout:1/477: getdents d3/db 0 2024-04-30T23:15:58.312 INFO:tasks.workunit.client.0.smithi100.stdout:1/478: getdents d3/d18/d60/d87 0 2024-04-30T23:15:58.314 INFO:tasks.workunit.client.0.smithi100.stdout:2/625: dread d5/d12/d13/d4b/f52 [0,4194304] 0 2024-04-30T23:15:58.314 INFO:tasks.workunit.client.0.smithi100.stdout:2/626: readlink d5/d12/l71 0 2024-04-30T23:15:58.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:57 smithi100 ceph-mon[29745]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 120 MiB/s wr, 349 op/s 2024-04-30T23:15:58.329 INFO:tasks.workunit.client.0.smithi100.stdout:0/619: dwrite d2/d14/d35/fa7 [0,4194304] 0 2024-04-30T23:15:58.330 INFO:tasks.workunit.client.0.smithi100.stdout:0/620: write d2/f1e [4605280,6921] 0 2024-04-30T23:15:58.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/621: rmdir d2/d14/d18 39 2024-04-30T23:15:58.333 INFO:tasks.workunit.client.0.smithi100.stdout:0/622: rename d2/d14/d35/c61 to d2/d50/d38/d5d/cc5 0 2024-04-30T23:15:58.335 INFO:tasks.workunit.client.0.smithi100.stdout:0/623: mkdir d2/d50/d38/d5d/dc6 0 2024-04-30T23:15:58.335 INFO:tasks.workunit.client.0.smithi100.stdout:1/479: dwrite d3/d16/d20/f22 [0,4194304] 0 2024-04-30T23:15:58.336 INFO:tasks.workunit.client.0.smithi100.stdout:1/480: chown d3/d16 229 1 2024-04-30T23:15:58.338 INFO:tasks.workunit.client.0.smithi100.stdout:0/624: rename d2/d4c/d68/d94 to d2/d50/d30/dc7 0 2024-04-30T23:15:58.338 INFO:tasks.workunit.client.0.smithi100.stdout:0/625: write d2/d4c/f9a [595213,122070] 0 2024-04-30T23:15:58.338 INFO:tasks.workunit.client.0.smithi100.stdout:2/627: dwrite d5/f25 [0,4194304] 0 2024-04-30T23:15:58.338 INFO:tasks.workunit.client.0.smithi100.stdout:2/628: read d5/d12/f1e [1969107,78763] 0 2024-04-30T23:15:58.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/481: mknod d3/d16/d20/d24/d69/d5e/c8a 0 2024-04-30T23:15:58.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/482: read - d3/d16/d20/d24/f86 zero size 2024-04-30T23:15:58.340 INFO:tasks.workunit.client.0.smithi100.stdout:1/483: dread d3/d16/d20/d24/d69/f71 [0,4194304] 0 2024-04-30T23:15:58.350 INFO:tasks.workunit.client.0.smithi100.stdout:2/629: mknod d5/d26/d2f/cc2 0 2024-04-30T23:15:58.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/484: creat d3/d16/d20/d24/d69/d5e/f8b x:0 0 0 2024-04-30T23:15:58.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/485: fsync d3/d16/f36 0 2024-04-30T23:15:58.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/486: dread - d3/d16/d20/f81 zero size 2024-04-30T23:15:58.357 INFO:tasks.workunit.client.0.smithi100.stdout:0/626: dwrite d2/d14/d35/d57/f60 [4194304,4194304] 0 2024-04-30T23:15:58.360 INFO:tasks.workunit.client.0.smithi100.stdout:0/627: link d2/d4c/f89 d2/d14/d35/d57/d62/d75/fc8 0 2024-04-30T23:15:58.361 INFO:tasks.workunit.client.0.smithi100.stdout:0/628: unlink d2/d4c/d68/l8b 0 2024-04-30T23:15:58.367 INFO:tasks.workunit.client.0.smithi100.stdout:8/554: sync 2024-04-30T23:15:58.367 INFO:tasks.workunit.client.0.smithi100.stdout:3/556: sync 2024-04-30T23:15:58.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/700: sync 2024-04-30T23:15:58.368 INFO:tasks.workunit.client.0.smithi100.stdout:6/539: sync 2024-04-30T23:15:58.368 INFO:tasks.workunit.client.0.smithi100.stdout:9/477: sync 2024-04-30T23:15:58.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/557: unlink d1/d14/d15/d2c/f47 0 2024-04-30T23:15:58.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/558: getdents d1/d14/d15/d2c/d68/d6d/d81 0 2024-04-30T23:15:58.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/559: fsync d1/d14/f73 0 2024-04-30T23:15:58.372 INFO:tasks.workunit.client.0.smithi100.stdout:7/701: rename d0/d1b/d1e/f49 to d0/d1d/d5e/d6a/d4b/dcb/fe8 0 2024-04-30T23:15:58.373 INFO:tasks.workunit.client.0.smithi100.stdout:9/478: creat d4/d7/d60/fae x:0 0 0 2024-04-30T23:15:58.374 INFO:tasks.workunit.client.0.smithi100.stdout:9/479: truncate d4/d9/d6f/f90 315314 0 2024-04-30T23:15:58.376 INFO:tasks.workunit.client.0.smithi100.stdout:1/487: dwrite d3/d16/d20/d24/d69/f71 [0,4194304] 0 2024-04-30T23:15:58.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/702: rename d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/lc3 to d0/df/d4f/le9 0 2024-04-30T23:15:58.378 INFO:tasks.workunit.client.0.smithi100.stdout:9/480: symlink d4/d7/d8/d37/laf 0 2024-04-30T23:15:58.378 INFO:tasks.workunit.client.0.smithi100.stdout:2/630: dwrite d5/d12/d13/d4b/f99 [0,4194304] 0 2024-04-30T23:15:58.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/481: creat d4/fb0 x:0 0 0 2024-04-30T23:15:58.380 INFO:tasks.workunit.client.0.smithi100.stdout:8/555: dread d2/d7/d18/fa6 [0,4194304] 0 2024-04-30T23:15:58.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/556: write d2/d7/d18/d3a/f85 [1012495,50910] 0 2024-04-30T23:15:58.381 INFO:tasks.workunit.client.0.smithi100.stdout:1/488: dread d3/d18/f6d [0,4194304] 0 2024-04-30T23:15:58.382 INFO:tasks.workunit.client.0.smithi100.stdout:9/482: chown d4/d9/d10/f27 10181 1 2024-04-30T23:15:58.382 INFO:tasks.workunit.client.0.smithi100.stdout:9/483: fdatasync d4/d7/d8/d37/d58/f77 0 2024-04-30T23:15:58.383 INFO:tasks.workunit.client.0.smithi100.stdout:8/557: symlink d2/d97/lb0 0 2024-04-30T23:15:58.385 INFO:tasks.workunit.client.0.smithi100.stdout:1/489: creat d3/d18/d60/f8c x:0 0 0 2024-04-30T23:15:58.385 INFO:tasks.workunit.client.0.smithi100.stdout:1/490: write d3/d18/d60/f64 [3308895,32435] 0 2024-04-30T23:15:58.388 INFO:tasks.workunit.client.0.smithi100.stdout:1/491: truncate d3/f4f 3348376 0 2024-04-30T23:15:58.388 INFO:tasks.workunit.client.0.smithi100.stdout:8/558: dread d2/f6 [0,4194304] 0 2024-04-30T23:15:58.389 INFO:tasks.workunit.client.0.smithi100.stdout:7/703: dread d0/df/d4f/d53/fc0 [0,4194304] 0 2024-04-30T23:15:58.391 INFO:tasks.workunit.client.0.smithi100.stdout:8/559: rename d2/d29/f60 to d2/d89/d10/d17/d8f/fb1 0 2024-04-30T23:15:58.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/540: dwrite d7/df/f3c [0,4194304] 0 2024-04-30T23:15:58.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/629: dwrite d2/d4c/f89 [0,4194304] 0 2024-04-30T23:15:58.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/704: symlink d0/d1b/d2e/d97/lea 0 2024-04-30T23:15:58.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/705: read - d0/df/d4f/d53/da9/fba zero size 2024-04-30T23:15:58.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/706: fsync d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fd6 0 2024-04-30T23:15:58.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/560: creat d2/d7/d18/d3a/da4/fb2 x:0 0 0 2024-04-30T23:15:58.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/561: stat d2/d89/l21 0 2024-04-30T23:15:58.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/541: mkdir d7/df/d23/d24/d2e/d37/d85/db4/dc6 0 2024-04-30T23:15:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:9/484: write d4/d7/d8/d19/f8c [399091,42144] 0 2024-04-30T23:15:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:9/485: write d4/f1e [2813747,3254] 0 2024-04-30T23:15:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:9/486: chown d4/d7/f38 1 1 2024-04-30T23:15:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:6/542: mkdir d7/d9/d86/dc7 0 2024-04-30T23:15:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:6/543: stat d7/d9/d86/d3e/d6b 0 2024-04-30T23:15:58.410 INFO:tasks.workunit.client.0.smithi100.stdout:2/631: dwrite d5/d47/d4c/fb5 [0,4194304] 0 2024-04-30T23:15:58.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/630: write d2/d50/d30/dc7/fa8 [2416095,8956] 0 2024-04-30T23:15:58.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/631: write d2/f2e [3263696,6705] 0 2024-04-30T23:15:58.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/634: sync 2024-04-30T23:15:58.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/607: sync 2024-04-30T23:15:58.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/608: mknod d19/d1a/d6d/d64/d78/cc7 0 2024-04-30T23:15:58.420 INFO:tasks.workunit.client.0.smithi100.stdout:4/609: mkdir d19/d1a/d6d/d64/dc8 0 2024-04-30T23:15:58.422 INFO:tasks.workunit.client.0.smithi100.stdout:4/610: creat d19/d1a/d29/dae/fc9 x:0 0 0 2024-04-30T23:15:58.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/707: dwrite d0/d1d/fdc [0,4194304] 0 2024-04-30T23:15:58.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/708: dread - d0/df/d4f/d53/da9/fba zero size 2024-04-30T23:15:58.429 INFO:tasks.workunit.client.0.smithi100.stdout:4/611: rename d19/d1a/d6d/d4e/d6e/f87 to d19/d1a/d29/dae/fca 0 2024-04-30T23:15:58.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/487: dread d4/d9/d10/f3a [0,4194304] 0 2024-04-30T23:15:58.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/488: write d4/d9/d10/d7f/f9a [723117,19116] 0 2024-04-30T23:15:58.433 INFO:tasks.workunit.client.0.smithi100.stdout:8/562: dwrite d2/d29/d67/f99 [0,4194304] 0 2024-04-30T23:15:58.434 INFO:tasks.workunit.client.0.smithi100.stdout:4/612: mkdir d19/d1a/d6d/d4e/d6e/dcb 0 2024-04-30T23:15:58.436 INFO:tasks.workunit.client.0.smithi100.stdout:8/563: symlink d2/d29/d71/d86/lb3 0 2024-04-30T23:15:58.436 INFO:tasks.workunit.client.0.smithi100.stdout:8/564: fsync d2/d89/f49 0 2024-04-30T23:15:58.438 INFO:tasks.workunit.client.0.smithi100.stdout:4/613: symlink d19/d1a/d21/d4a/d53/d5e/lcc 0 2024-04-30T23:15:58.438 INFO:tasks.workunit.client.0.smithi100.stdout:8/565: symlink d2/d89/lb4 0 2024-04-30T23:15:58.439 INFO:tasks.workunit.client.0.smithi100.stdout:8/566: mknod d2/d89/d7f/cb5 0 2024-04-30T23:15:58.441 INFO:tasks.workunit.client.0.smithi100.stdout:4/614: mkdir d19/d1a/dcd 0 2024-04-30T23:15:58.441 INFO:tasks.workunit.client.0.smithi100.stdout:4/615: write d19/d1a/d21/d4a/d53/d5d/f72 [5208601,49891] 0 2024-04-30T23:15:58.441 INFO:tasks.workunit.client.0.smithi100.stdout:4/616: readlink d19/d1a/l28 0 2024-04-30T23:15:58.442 INFO:tasks.workunit.client.0.smithi100.stdout:8/567: link d2/d29/l57 d2/d89/d10/d52/lb6 0 2024-04-30T23:15:58.442 INFO:tasks.workunit.client.0.smithi100.stdout:5/635: dwrite d1/d3e/f47 [0,4194304] 0 2024-04-30T23:15:58.444 INFO:tasks.workunit.client.0.smithi100.stdout:0/632: dwrite d2/d14/d35/d40/f9b [0,4194304] 0 2024-04-30T23:15:58.444 INFO:tasks.workunit.client.0.smithi100.stdout:0/633: write d2/d50/d30/d32/f9d [941462,120643] 0 2024-04-30T23:15:58.444 INFO:tasks.workunit.client.0.smithi100.stdout:0/634: dread - d2/d5a/f92 zero size 2024-04-30T23:15:58.444 INFO:tasks.workunit.client.0.smithi100.stdout:0/635: fdatasync d2/d50/f4f 0 2024-04-30T23:15:58.444 INFO:tasks.workunit.client.0.smithi100.stdout:0/636: stat d2/d50/d30 0 2024-04-30T23:15:58.445 INFO:tasks.workunit.client.0.smithi100.stdout:4/617: creat d19/d1a/d6d/d64/d78/d8c/fce x:0 0 0 2024-04-30T23:15:58.445 INFO:tasks.workunit.client.0.smithi100.stdout:4/618: truncate d19/d1a/d21/d4a/fa0 1402194 0 2024-04-30T23:15:58.445 INFO:tasks.workunit.client.0.smithi100.stdout:1/492: dwrite d3/f4f [0,4194304] 0 2024-04-30T23:15:58.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/632: dwrite d5/f14 [0,4194304] 0 2024-04-30T23:15:58.445 INFO:tasks.workunit.client.0.smithi100.stdout:5/636: readlink d1/l13 0 2024-04-30T23:15:58.451 INFO:tasks.workunit.client.0.smithi100.stdout:0/637: rename d2/d50/l4e to d2/d14/d35/d57/lc9 0 2024-04-30T23:15:58.451 INFO:tasks.workunit.client.0.smithi100.stdout:4/619: getdents d19/d1a/d6d/d64 0 2024-04-30T23:15:58.451 INFO:tasks.workunit.client.0.smithi100.stdout:4/620: chown d19/d1a/d6d/d64/d78/d8c 24615275 1 2024-04-30T23:15:58.453 INFO:tasks.workunit.client.0.smithi100.stdout:2/633: mkdir d5/d12/d70/dc3 0 2024-04-30T23:15:58.453 INFO:tasks.workunit.client.0.smithi100.stdout:2/634: dread - d5/d26/d2f/f63 zero size 2024-04-30T23:15:58.453 INFO:tasks.workunit.client.0.smithi100.stdout:2/635: fsync d5/d2e/f50 0 2024-04-30T23:15:58.457 INFO:tasks.workunit.client.0.smithi100.stdout:8/568: dread d2/d29/d67/f99 [0,4194304] 0 2024-04-30T23:15:58.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/489: dwrite d4/d7/d8/d37/f4b [0,4194304] 0 2024-04-30T23:15:58.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/490: getdents d4/d7/d8d 0 2024-04-30T23:15:58.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/491: fsync d4/d7/d60/f67 0 2024-04-30T23:15:58.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/492: chown d4/d7/d8/d19/c98 1257984 1 2024-04-30T23:15:58.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/636: unlink d5/d47/d4c/cbc 0 2024-04-30T23:15:58.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/569: rmdir d2/d29/d8b/d8e 39 2024-04-30T23:15:58.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/570: read - d2/d29/d67/d73/f7b zero size 2024-04-30T23:15:58.467 INFO:tasks.workunit.client.0.smithi100.stdout:9/493: dread d4/d9/f16 [0,4194304] 0 2024-04-30T23:15:58.467 INFO:tasks.workunit.client.0.smithi100.stdout:9/494: write d4/fb0 [835967,107250] 0 2024-04-30T23:15:58.468 INFO:tasks.workunit.client.0.smithi100.stdout:8/571: creat d2/d89/d10/d17/d8f/fb7 x:0 0 0 2024-04-30T23:15:58.469 INFO:tasks.workunit.client.0.smithi100.stdout:2/637: mkdir d5/d12/dc4 0 2024-04-30T23:15:58.469 INFO:tasks.workunit.client.0.smithi100.stdout:2/638: write d5/d26/d2f/d38/f43 [1110685,130618] 0 2024-04-30T23:15:58.470 INFO:tasks.workunit.client.0.smithi100.stdout:9/495: mknod d4/d9/d51/d89/cb1 0 2024-04-30T23:15:58.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/493: dwrite d3/d16/d20/d24/f86 [0,4194304] 0 2024-04-30T23:15:58.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/494: write d3/d16/d20/d24/d69/d5e/f8b [3782,78991] 0 2024-04-30T23:15:58.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/496: unlink d4/f96 0 2024-04-30T23:15:58.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/497: stat d4/d7/d8/f25 0 2024-04-30T23:15:58.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/495: creat d3/d18/d60/d87/f8d x:0 0 0 2024-04-30T23:15:58.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/496: fsync d3/d18/d60/f64 0 2024-04-30T23:15:58.476 INFO:tasks.workunit.client.0.smithi100.stdout:9/498: rmdir d4/d9/d10/d7f 39 2024-04-30T23:15:58.477 INFO:tasks.workunit.client.0.smithi100.stdout:1/497: symlink d3/db/d4b/l8e 0 2024-04-30T23:15:58.477 INFO:tasks.workunit.client.0.smithi100.stdout:1/498: fsync d3/d16/d20/d24/f6e 0 2024-04-30T23:15:58.478 INFO:tasks.workunit.client.0.smithi100.stdout:9/499: mknod d4/d9/d51/d89/cb2 0 2024-04-30T23:15:58.479 INFO:tasks.workunit.client.0.smithi100.stdout:9/500: creat d4/fb3 x:0 0 0 2024-04-30T23:15:58.479 INFO:tasks.workunit.client.0.smithi100.stdout:0/638: dwrite d2/d50/d30/d32/fa9 [0,4194304] 0 2024-04-30T23:15:58.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/621: dwrite f12 [4194304,4194304] 0 2024-04-30T23:15:58.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/622: dread - d19/d1a/d21/d4a/d53/f76 zero size 2024-04-30T23:15:58.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/623: chown d19/d1a/d29/dae/fbf 0 1 2024-04-30T23:15:58.480 INFO:tasks.workunit.client.0.smithi100.stdout:9/501: mkdir d4/d7/dab/db4 0 2024-04-30T23:15:58.483 INFO:tasks.workunit.client.0.smithi100.stdout:0/639: creat d2/d14/fca x:0 0 0 2024-04-30T23:15:58.483 INFO:tasks.workunit.client.0.smithi100.stdout:0/640: write d2/d4c/f9a [2523784,94644] 0 2024-04-30T23:15:58.484 INFO:tasks.workunit.client.0.smithi100.stdout:4/624: creat d19/d1a/d6d/d64/d78/d8c/fcf x:0 0 0 2024-04-30T23:15:58.485 INFO:tasks.workunit.client.0.smithi100.stdout:9/502: truncate d4/d7/d8/d19/f4e 1132732 0 2024-04-30T23:15:58.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/641: unlink d2/d14/d35/f4b 0 2024-04-30T23:15:58.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/642: chown d2/d50/d38/d5d/lc3 5063 1 2024-04-30T23:15:58.492 INFO:tasks.workunit.client.0.smithi100.stdout:5/637: dwrite d1/d19/f1e [4194304,4194304] 0 2024-04-30T23:15:58.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/572: write d2/f3e [2106228,63080] 0 2024-04-30T23:15:58.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/573: chown d2/d89/d10/d17/l5f 254968802 1 2024-04-30T23:15:58.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/574: fsync d2/d89/d10/d17/f4c 0 2024-04-30T23:15:58.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/575: chown d2/d29/d71/ca3 0 1 2024-04-30T23:15:58.501 INFO:tasks.workunit.client.0.smithi100.stdout:8/576: link d2/d7/c8a d2/d29/cb8 0 2024-04-30T23:15:58.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/499: dread d3/d16/d20/f2a [0,4194304] 0 2024-04-30T23:15:58.504 INFO:tasks.workunit.client.0.smithi100.stdout:2/639: dwrite d5/f16 [4194304,4194304] 0 2024-04-30T23:15:58.508 INFO:tasks.workunit.client.0.smithi100.stdout:2/640: creat d5/d22/fc5 x:0 0 0 2024-04-30T23:15:58.508 INFO:tasks.workunit.client.0.smithi100.stdout:2/641: truncate d5/d58/f65 947888 0 2024-04-30T23:15:58.508 INFO:tasks.workunit.client.0.smithi100.stdout:4/625: write d19/d1a/d6d/d4e/d6e/f9f [1943071,78254] 0 2024-04-30T23:15:58.510 INFO:tasks.workunit.client.0.smithi100.stdout:2/642: creat d5/d22/fc6 x:0 0 0 2024-04-30T23:15:58.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/626: truncate d19/d1a/d21/d3c/fbb 1637260 0 2024-04-30T23:15:58.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/643: truncate d5/d12/f3d 2108393 0 2024-04-30T23:15:58.512 INFO:tasks.workunit.client.0.smithi100.stdout:2/644: rmdir d5/d26 39 2024-04-30T23:15:58.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/638: write d1/d37/f6d [1282964,13782] 0 2024-04-30T23:15:58.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/500: dread d3/db/f3e [0,4194304] 0 2024-04-30T23:15:58.515 INFO:tasks.workunit.client.0.smithi100.stdout:5/639: read - d1/fa2 zero size 2024-04-30T23:15:58.515 INFO:tasks.workunit.client.0.smithi100.stdout:5/640: fsync d1/d12/f16 0 2024-04-30T23:15:58.516 INFO:tasks.workunit.client.0.smithi100.stdout:1/501: creat d3/d16/d20/d24/d51/d59/d5f/f8f x:0 0 0 2024-04-30T23:15:58.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/641: unlink d1/d3e/f47 0 2024-04-30T23:15:58.519 INFO:tasks.workunit.client.0.smithi100.stdout:1/502: getdents d3/d16/d20/d24/d69 0 2024-04-30T23:15:58.525 INFO:tasks.workunit.client.0.smithi100.stdout:0/643: dwrite d2/d14/d18/f2d [0,4194304] 0 2024-04-30T23:15:58.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/503: dwrite d4/d7/d60/fae [0,4194304] 0 2024-04-30T23:15:58.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/504: fdatasync d4/d7/d8/d19/f29 0 2024-04-30T23:15:58.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/505: dread - d4/d9/d10/f78 zero size 2024-04-30T23:15:58.526 INFO:tasks.workunit.client.0.smithi100.stdout:9/506: dread - d4/d7/d5d/f64 zero size 2024-04-30T23:15:58.529 INFO:tasks.workunit.client.0.smithi100.stdout:2/645: write d5/d22/f4e [471745,84118] 0 2024-04-30T23:15:58.529 INFO:tasks.workunit.client.0.smithi100.stdout:5/642: rename d1/d3e/daa/dcd to d1/d2c/d60/d66/d71/db6/dd4 0 2024-04-30T23:15:58.531 INFO:tasks.workunit.client.0.smithi100.stdout:0/644: link d2/d50/d30/d32/f3b d2/d50/d38/d6c/fcb 0 2024-04-30T23:15:58.533 INFO:tasks.workunit.client.0.smithi100.stdout:0/645: write d2/d50/d30/d32/f9d [1891773,36348] 0 2024-04-30T23:15:58.534 INFO:tasks.workunit.client.0.smithi100.stdout:0/646: fsync d2/d14/d35/f43 0 2024-04-30T23:15:58.534 INFO:tasks.workunit.client.0.smithi100.stdout:0/647: readlink l0 0 2024-04-30T23:15:58.534 INFO:tasks.workunit.client.0.smithi100.stdout:4/627: dread d19/f2f [0,4194304] 0 2024-04-30T23:15:58.534 INFO:tasks.workunit.client.0.smithi100.stdout:4/628: write d19/d1a/fc3 [524869,54532] 0 2024-04-30T23:15:58.534 INFO:tasks.workunit.client.0.smithi100.stdout:2/646: mknod d5/d26/d2f/cc7 0 2024-04-30T23:15:58.535 INFO:tasks.workunit.client.0.smithi100.stdout:2/647: fsync d5/d22/f60 0 2024-04-30T23:15:58.536 INFO:tasks.workunit.client.0.smithi100.stdout:9/507: dread d4/d7/d8/d37/f59 [0,4194304] 0 2024-04-30T23:15:58.536 INFO:tasks.workunit.client.0.smithi100.stdout:0/648: truncate d2/d5a/f9c 536707 0 2024-04-30T23:15:58.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/649: dread - d2/d14/d35/d57/f95 zero size 2024-04-30T23:15:58.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/629: getdents d19/d1a/d6d 0 2024-04-30T23:15:58.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/630: write f8 [2268924,9809] 0 2024-04-30T23:15:58.542 INFO:tasks.workunit.client.0.smithi100.stdout:9/508: write d4/fb0 [555547,113571] 0 2024-04-30T23:15:58.542 INFO:tasks.workunit.client.0.smithi100.stdout:9/509: chown d4/d9/d10/f4a 14 1 2024-04-30T23:15:58.544 INFO:tasks.workunit.client.0.smithi100.stdout:9/510: mknod d4/d9/d51/d89/cb5 0 2024-04-30T23:15:58.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/643: write d1/d12/d27/f29 [6659390,1341] 0 2024-04-30T23:15:58.545 INFO:tasks.workunit.client.0.smithi100.stdout:9/511: creat d4/d7/fb6 x:0 0 0 2024-04-30T23:15:58.546 INFO:tasks.workunit.client.0.smithi100.stdout:5/644: mknod d1/d12/d1a/d5b/cd5 0 2024-04-30T23:15:58.547 INFO:tasks.workunit.client.0.smithi100.stdout:9/512: rmdir d4/d7/d60 39 2024-04-30T23:15:58.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/645: symlink d1/d12/d1a/d76/d77/d8c/ld6 0 2024-04-30T23:15:58.549 INFO:tasks.workunit.client.0.smithi100.stdout:2/648: dread d5/d47/d4c/f4f [0,4194304] 0 2024-04-30T23:15:58.549 INFO:tasks.workunit.client.0.smithi100.stdout:2/649: readlink d5/la 0 2024-04-30T23:15:58.550 INFO:tasks.workunit.client.0.smithi100.stdout:1/503: dwrite d3/d16/d20/d24/d69/d63/f6c [0,4194304] 0 2024-04-30T23:15:58.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/650: dread d5/d58/f65 [0,4194304] 0 2024-04-30T23:15:58.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/513: mkdir d4/db7 0 2024-04-30T23:15:58.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/651: write d5/d12/f6c [3135682,129036] 0 2024-04-30T23:15:58.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/652: chown d5/d12/d8e 12592117 1 2024-04-30T23:15:58.552 INFO:tasks.workunit.client.0.smithi100.stdout:0/650: write d2/d14/d35/d57/f78 [1904403,85292] 0 2024-04-30T23:15:58.552 INFO:tasks.workunit.client.0.smithi100.stdout:0/651: chown l0 1073305 1 2024-04-30T23:15:58.556 INFO:tasks.workunit.client.0.smithi100.stdout:5/646: fsync d1/d37/f6d 0 2024-04-30T23:15:58.558 INFO:tasks.workunit.client.0.smithi100.stdout:5/647: dread d1/d12/d24/f4e [0,4194304] 0 2024-04-30T23:15:58.561 INFO:tasks.workunit.client.0.smithi100.stdout:1/504: creat d3/d18/f90 x:0 0 0 2024-04-30T23:15:58.561 INFO:tasks.workunit.client.0.smithi100.stdout:1/505: readlink d3/d16/d20/d24/d51/d59/d5f/l7e 0 2024-04-30T23:15:58.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/506: readlink d3/d16/d20/d24/d69/d63/l88 0 2024-04-30T23:15:58.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/631: dwrite d19/d33/d7d/fb3 [0,4194304] 0 2024-04-30T23:15:58.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/632: fsync d19/d1a/d45/f92 0 2024-04-30T23:15:58.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/633: stat d19/d1a/d21/f2b 0 2024-04-30T23:15:58.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/514: link d4/d7/d60/d69/c8b d4/d7/d8/d37/d58/d8a/cb8 0 2024-04-30T23:15:58.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/515: truncate d4/d9/d50/faa 999961 0 2024-04-30T23:15:58.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/648: mkdir d1/d12/d1a/d76/dd7 0 2024-04-30T23:15:58.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/634: rmdir d19/d1a/d21 39 2024-04-30T23:15:58.568 INFO:tasks.workunit.client.0.smithi100.stdout:5/649: unlink d1/d3e/lb0 0 2024-04-30T23:15:58.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/650: write d1/d12/d74/fd1 [997537,79055] 0 2024-04-30T23:15:58.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/651: write d1/d12/d27/f82 [5785526,64929] 0 2024-04-30T23:15:58.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/635: creat d19/d33/d3f/fd0 x:0 0 0 2024-04-30T23:15:58.571 INFO:tasks.workunit.client.0.smithi100.stdout:9/516: mkdir d4/d9/d10/db9 0 2024-04-30T23:15:58.571 INFO:tasks.workunit.client.0.smithi100.stdout:2/653: dwrite d5/d22/f2c [4194304,4194304] 0 2024-04-30T23:15:58.571 INFO:tasks.workunit.client.0.smithi100.stdout:0/652: write d2/d50/d30/f3d [2070806,110222] 0 2024-04-30T23:15:58.571 INFO:tasks.workunit.client.0.smithi100.stdout:2/654: chown f1 359 1 2024-04-30T23:15:58.571 INFO:tasks.workunit.client.0.smithi100.stdout:0/653: chown d2/l2c 6162594 1 2024-04-30T23:15:58.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/652: unlink d1/d3e/fbb 0 2024-04-30T23:15:58.580 INFO:tasks.workunit.client.0.smithi100.stdout:9/517: creat d4/d9/d51/fba x:0 0 0 2024-04-30T23:15:58.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/653: dread - d1/d12/d1a/d76/da9/fba zero size 2024-04-30T23:15:58.589 INFO:tasks.workunit.client.0.smithi100.stdout:2/655: link d5/d26/f54 d5/d2e/fc8 0 2024-04-30T23:15:58.594 INFO:tasks.workunit.client.0.smithi100.stdout:2/656: creat d5/d12/d13/d9e/fc9 x:0 0 0 2024-04-30T23:15:58.600 INFO:tasks.workunit.client.0.smithi100.stdout:1/507: dwrite d3/d16/f3c [0,4194304] 0 2024-04-30T23:15:58.600 INFO:tasks.workunit.client.0.smithi100.stdout:4/636: dwrite d19/d1a/d6d/d64/d78/d8c/fce [0,4194304] 0 2024-04-30T23:15:58.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/654: dread d2/d14/d35/d40/f49 [4194304,4194304] 0 2024-04-30T23:15:58.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/655: write d2/d50/d30/f6f [1195214,114226] 0 2024-04-30T23:15:58.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/656: write d2/f59 [4535695,46513] 0 2024-04-30T23:15:58.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/657: readlink d2/d14/d18/l44 0 2024-04-30T23:15:58.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/658: chown d2/fc 1828733 1 2024-04-30T23:15:58.602 INFO:tasks.workunit.client.0.smithi100.stdout:2/657: dread d5/f49 [0,4194304] 0 2024-04-30T23:15:58.602 INFO:tasks.workunit.client.0.smithi100.stdout:1/508: read d3/d18/f6d [40847,61101] 0 2024-04-30T23:15:58.602 INFO:tasks.workunit.client.0.smithi100.stdout:1/509: readlink d3/d16/l49 0 2024-04-30T23:15:58.614 INFO:tasks.workunit.client.0.smithi100.stdout:9/518: dread d4/d7/d60/fae [0,4194304] 0 2024-04-30T23:15:58.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/637: unlink d19/d1a/d21/c4f 0 2024-04-30T23:15:58.618 INFO:tasks.workunit.client.0.smithi100.stdout:5/654: dwrite d1/d12/d1a/f32 [0,4194304] 0 2024-04-30T23:15:58.618 INFO:tasks.workunit.client.0.smithi100.stdout:5/655: fsync d1/d12/d74/f93 0 2024-04-30T23:15:58.619 INFO:tasks.workunit.client.0.smithi100.stdout:0/659: symlink d2/d50/d38/d5d/dc6/lcc 0 2024-04-30T23:15:58.619 INFO:tasks.workunit.client.0.smithi100.stdout:0/660: write d2/d50/d38/fb2 [1430766,54028] 0 2024-04-30T23:15:58.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/658: link d5/d47/d4c/f4f d5/d26/d2f/d38/fca 0 2024-04-30T23:15:58.624 INFO:tasks.workunit.client.0.smithi100.stdout:4/638: mknod d19/d1a/d6d/d4e/cd1 0 2024-04-30T23:15:58.624 INFO:tasks.workunit.client.0.smithi100.stdout:1/510: dwrite d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:15:58.629 INFO:tasks.workunit.client.0.smithi100.stdout:2/659: creat d5/d2e/fcb x:0 0 0 2024-04-30T23:15:58.629 INFO:tasks.workunit.client.0.smithi100.stdout:0/661: dread d2/d14/d35/d57/f78 [0,4194304] 0 2024-04-30T23:15:58.630 INFO:tasks.workunit.client.0.smithi100.stdout:4/639: truncate f13 3796461 0 2024-04-30T23:15:58.632 INFO:tasks.workunit.client.0.smithi100.stdout:1/511: creat d3/d16/d20/d24/d69/d63/f91 x:0 0 0 2024-04-30T23:15:58.632 INFO:tasks.workunit.client.0.smithi100.stdout:1/512: dread - d3/d16/d20/d24/d69/f72 zero size 2024-04-30T23:15:58.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/656: dread d1/d12/f21 [0,4194304] 0 2024-04-30T23:15:58.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/660: symlink d5/lcc 0 2024-04-30T23:15:58.634 INFO:tasks.workunit.client.0.smithi100.stdout:0/662: creat d2/dba/fcd x:0 0 0 2024-04-30T23:15:58.635 INFO:tasks.workunit.client.0.smithi100.stdout:9/519: dwrite f3 [0,4194304] 0 2024-04-30T23:15:58.636 INFO:tasks.workunit.client.0.smithi100.stdout:4/640: link d19/f26 d19/d1a/d21/d4a/d53/fd2 0 2024-04-30T23:15:58.637 INFO:tasks.workunit.client.0.smithi100.stdout:1/513: mknod d3/d18/d60/d87/c92 0 2024-04-30T23:15:58.639 INFO:tasks.workunit.client.0.smithi100.stdout:2/661: mknod d5/d12/d70/ccd 0 2024-04-30T23:15:58.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/514: getdents d3/d16/d20/d24/d69/d5e 0 2024-04-30T23:15:58.640 INFO:tasks.workunit.client.0.smithi100.stdout:0/663: dread d2/f52 [0,4194304] 0 2024-04-30T23:15:58.640 INFO:tasks.workunit.client.0.smithi100.stdout:0/664: truncate d2/d50/d38/f7b 150083 0 2024-04-30T23:15:58.641 INFO:tasks.workunit.client.0.smithi100.stdout:2/662: creat d5/d47/d4c/fce x:0 0 0 2024-04-30T23:15:58.641 INFO:tasks.workunit.client.0.smithi100.stdout:3/560: sync 2024-04-30T23:15:58.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/665: mkdir d2/d50/d38/d5d/dc6/dce 0 2024-04-30T23:15:58.644 INFO:tasks.workunit.client.0.smithi100.stdout:3/561: rename d1/d14/d15/d2c/d68 to d1/d14/d15/d32/d6f/da2 0 2024-04-30T23:15:58.647 INFO:tasks.workunit.client.0.smithi100.stdout:9/520: write d4/d7/f38 [58029,14674] 0 2024-04-30T23:15:58.647 INFO:tasks.workunit.client.0.smithi100.stdout:9/521: chown d4/d9/d10/f4a 23213 1 2024-04-30T23:15:58.647 INFO:tasks.workunit.client.0.smithi100.stdout:0/666: symlink d2/d50/d38/d6c/lcf 0 2024-04-30T23:15:58.647 INFO:tasks.workunit.client.0.smithi100.stdout:9/522: fsync d4/d7/d5d/f64 0 2024-04-30T23:15:58.647 INFO:tasks.workunit.client.0.smithi100.stdout:9/523: write d4/d7/d8/d37/f59 [668637,106035] 0 2024-04-30T23:15:58.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/562: mknod d1/d14/d15/d32/d6f/ca3 0 2024-04-30T23:15:58.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/524: mkdir d4/d9/d51/d89/dbb 0 2024-04-30T23:15:58.650 INFO:tasks.workunit.client.0.smithi100.stdout:3/563: creat d1/d14/d15/d32/d92/fa4 x:0 0 0 2024-04-30T23:15:58.650 INFO:tasks.workunit.client.0.smithi100.stdout:3/564: chown d1/d14/f5f 1024962 1 2024-04-30T23:15:58.650 INFO:tasks.workunit.client.0.smithi100.stdout:3/565: write d1/d38/f78 [1022994,76155] 0 2024-04-30T23:15:58.651 INFO:tasks.workunit.client.0.smithi100.stdout:3/566: creat d1/d14/d15/d27/d5d/fa5 x:0 0 0 2024-04-30T23:15:58.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/657: write d1/d19/f46 [2285106,112932] 0 2024-04-30T23:15:58.652 INFO:tasks.workunit.client.0.smithi100.stdout:5/658: fdatasync d1/d19/d7f/f89 0 2024-04-30T23:15:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:5/659: rename d1/d12/d24/d34/l81 to d1/d12/d1a/d76/d77/d8c/ld8 0 2024-04-30T23:15:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/641: dwrite d19/d1a/d21/d4a/d53/d5d/f72 [4194304,4194304] 0 2024-04-30T23:15:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/642: chown d19/d33/d3f 3 1 2024-04-30T23:15:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/643: stat d19/d1a/d6d/d4e/la3 0 2024-04-30T23:15:58.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/660: mknod d1/d2c/d60/d66/d71/cd9 0 2024-04-30T23:15:58.663 INFO:tasks.workunit.client.0.smithi100.stdout:5/661: creat d1/d12/d27/fda x:0 0 0 2024-04-30T23:15:58.663 INFO:tasks.workunit.client.0.smithi100.stdout:5/662: dread - d1/d12/d1a/d76/d77/d8c/f9c zero size 2024-04-30T23:15:58.664 INFO:tasks.workunit.client.0.smithi100.stdout:5/663: creat d1/d37/fdb x:0 0 0 2024-04-30T23:15:58.666 INFO:tasks.workunit.client.0.smithi100.stdout:5/664: symlink d1/d2c/d60/d66/d75/ldc 0 2024-04-30T23:15:58.666 INFO:tasks.workunit.client.0.smithi100.stdout:5/665: chown d1/d19/c4b 0 1 2024-04-30T23:15:58.667 INFO:tasks.workunit.client.0.smithi100.stdout:5/666: creat d1/d3e/d9b/fdd x:0 0 0 2024-04-30T23:15:58.672 INFO:tasks.workunit.client.0.smithi100.stdout:2/663: dwrite d5/d2e/fc8 [4194304,4194304] 0 2024-04-30T23:15:58.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/567: dwrite d1/d14/d15/d27/f88 [0,4194304] 0 2024-04-30T23:15:58.682 INFO:tasks.workunit.client.0.smithi100.stdout:4/644: write f9 [1196185,1426] 0 2024-04-30T23:15:58.682 INFO:tasks.workunit.client.0.smithi100.stdout:4/645: stat d19/d1a/d21/d4a/f6a 0 2024-04-30T23:15:58.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/515: dwrite d3/d16/d20/d24/d69/d63/f91 [0,4194304] 0 2024-04-30T23:15:58.682 INFO:tasks.workunit.client.0.smithi100.stdout:4/646: write d19/d1a/d21/f83 [958061,28058] 0 2024-04-30T23:15:58.690 INFO:tasks.workunit.client.0.smithi100.stdout:0/667: dwrite d2/d4c/d68/f69 [0,4194304] 0 2024-04-30T23:15:58.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/525: dwrite d4/d9/d51/f84 [0,4194304] 0 2024-04-30T23:15:58.694 INFO:tasks.workunit.client.0.smithi100.stdout:1/516: read d3/f4 [5161187,50980] 0 2024-04-30T23:15:58.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/647: chown c0 540 1 2024-04-30T23:15:58.696 INFO:tasks.workunit.client.0.smithi100.stdout:2/664: dwrite d5/f6d [0,4194304] 0 2024-04-30T23:15:58.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/526: mknod d4/d7/dab/cbc 0 2024-04-30T23:15:58.706 INFO:tasks.workunit.client.0.smithi100.stdout:3/568: dwrite d1/d14/d15/d32/d6f/da2/d26/f9a [0,4194304] 0 2024-04-30T23:15:58.706 INFO:tasks.workunit.client.0.smithi100.stdout:3/569: write d1/d14/d15/d32/f63 [1046921,79788] 0 2024-04-30T23:15:58.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/570: write d1/d14/d15/d32/d6f/da2/d26/f98 [289821,77601] 0 2024-04-30T23:15:58.707 INFO:tasks.workunit.client.0.smithi100.stdout:1/517: creat d3/d18/d60/d87/f93 x:0 0 0 2024-04-30T23:15:58.709 INFO:tasks.workunit.client.0.smithi100.stdout:6/544: sync 2024-04-30T23:15:58.709 INFO:tasks.workunit.client.0.smithi100.stdout:6/545: fdatasync d7/d9/fac 0 2024-04-30T23:15:58.709 INFO:tasks.workunit.client.0.smithi100.stdout:4/648: dread d19/f2f [0,4194304] 0 2024-04-30T23:15:58.709 INFO:tasks.workunit.client.0.smithi100.stdout:4/649: fdatasync d19/d1a/d21/d4a/fa0 0 2024-04-30T23:15:58.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/665: truncate d5/d47/f8b 1739691 0 2024-04-30T23:15:58.710 INFO:tasks.workunit.client.0.smithi100.stdout:9/527: mkdir d4/d7/dab/db4/dbd 0 2024-04-30T23:15:58.712 INFO:tasks.workunit.client.0.smithi100.stdout:3/571: mknod d1/d14/ca6 0 2024-04-30T23:15:58.713 INFO:tasks.workunit.client.0.smithi100.stdout:1/518: creat d3/d18/d60/f94 x:0 0 0 2024-04-30T23:15:58.713 INFO:tasks.workunit.client.0.smithi100.stdout:1/519: chown d3/d16/d20/d24 10204471 1 2024-04-30T23:15:58.713 INFO:tasks.workunit.client.0.smithi100.stdout:0/668: dwrite d2/d50/d30/d32/f84 [0,4194304] 0 2024-04-30T23:15:58.714 INFO:tasks.workunit.client.0.smithi100.stdout:9/528: getdents d4/d7/d8/d37/d58/d8a 0 2024-04-30T23:15:58.714 INFO:tasks.workunit.client.0.smithi100.stdout:9/529: write d4/d7/d5d/f64 [79828,31519] 0 2024-04-30T23:15:58.715 INFO:tasks.workunit.client.0.smithi100.stdout:3/572: mknod d1/d14/d15/d27/d5d/ca7 0 2024-04-30T23:15:58.716 INFO:tasks.workunit.client.0.smithi100.stdout:8/577: sync 2024-04-30T23:15:58.716 INFO:tasks.workunit.client.0.smithi100.stdout:8/578: dread - d2/d29/d8b/d8e/f96 zero size 2024-04-30T23:15:58.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/520: creat d3/d18/f95 x:0 0 0 2024-04-30T23:15:58.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/521: getdents d3/d16/d20/d24/d69/d5e 0 2024-04-30T23:15:58.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/669: unlink d2/d50/d38/f7b 0 2024-04-30T23:15:58.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/670: chown d2/d14/l4a 4196087 1 2024-04-30T23:15:58.719 INFO:tasks.workunit.client.0.smithi100.stdout:7/709: sync 2024-04-30T23:15:58.719 INFO:tasks.workunit.client.0.smithi100.stdout:7/710: fdatasync d0/d1b/d2e/f63 0 2024-04-30T23:15:58.720 INFO:tasks.workunit.client.0.smithi100.stdout:9/530: symlink d4/d9/d10/db9/lbe 0 2024-04-30T23:15:58.721 INFO:tasks.workunit.client.0.smithi100.stdout:3/573: mkdir d1/d14/d15/d32/d6f/da2/d6d/da8 0 2024-04-30T23:15:58.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/574: readlink d1/d14/d15/d32/d6f/da2/d26/l24 0 2024-04-30T23:15:58.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/666: dread d5/d12/fc1 [0,4194304] 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/650: write d19/d1a/d6d/d4e/fc1 [3800375,14677] 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/579: mkdir d2/d89/d10/d52/d9a/db9 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/546: write f5 [3158611,74848] 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/651: write d19/f93 [1031282,44960] 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/580: truncate d2/d89/d10/d17/d8f/fb7 750043 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:1/522: link d3/d16/d20/d24/d69/d5e/c8a d3/d16/d20/d24/c96 0 2024-04-30T23:15:58.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/671: mkdir d2/d50/d38/d5d/dd0 0 2024-04-30T23:15:58.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/711: unlink d0/d1d/d5e/d6a/d4b/f9e 0 2024-04-30T23:15:58.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/531: creat d4/d9/d6f/fbf x:0 0 0 2024-04-30T23:15:58.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/575: mkdir d1/d14/d15/d32/d71/da9 0 2024-04-30T23:15:58.732 INFO:tasks.workunit.client.0.smithi100.stdout:6/547: mknod d7/db/cc8 0 2024-04-30T23:15:58.734 INFO:tasks.workunit.client.0.smithi100.stdout:8/581: link d2/d7/d18/d3a/da4/fb2 d2/d89/d10/d52/fba 0 2024-04-30T23:15:58.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/523: rename d3/d16/d20/l55 to d3/d16/d20/l97 0 2024-04-30T23:15:58.738 INFO:tasks.workunit.client.0.smithi100.stdout:0/672: mkdir d2/d4c/d68/dd1 0 2024-04-30T23:15:58.738 INFO:tasks.workunit.client.0.smithi100.stdout:0/673: stat d2/d14/d35/c8d 0 2024-04-30T23:15:58.739 INFO:tasks.workunit.client.0.smithi100.stdout:9/532: mknod d4/d7/d8d/cc0 0 2024-04-30T23:15:58.741 INFO:tasks.workunit.client.0.smithi100.stdout:3/576: symlink d1/d14/d15/d32/d71/da9/laa 0 2024-04-30T23:15:58.742 INFO:tasks.workunit.client.0.smithi100.stdout:6/548: symlink d7/d9/d86/d3e/d6b/d75/lc9 0 2024-04-30T23:15:58.744 INFO:tasks.workunit.client.0.smithi100.stdout:4/652: read d19/d1a/d21/f2d [1906683,112090] 0 2024-04-30T23:15:58.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/582: getdents d2/d89/d72/d93 0 2024-04-30T23:15:58.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/674: dread d2/d50/d38/d6c/d6e/f8a [0,4194304] 0 2024-04-30T23:15:58.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/675: write d2/d14/d35/f8e [1151801,9815] 0 2024-04-30T23:15:58.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/676: chown d2/l25 256926746 1 2024-04-30T23:15:58.748 INFO:tasks.workunit.client.0.smithi100.stdout:9/533: creat d4/d9/d51/d89/dbb/fc1 x:0 0 0 2024-04-30T23:15:58.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/667: dwrite d5/d47/d4c/dab/fb8 [0,4194304] 0 2024-04-30T23:15:58.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/668: write d5/d12/f3c [5157398,68544] 0 2024-04-30T23:15:58.749 INFO:tasks.workunit.client.0.smithi100.stdout:6/549: creat d7/df/d23/d24/d2e/d9f/fca x:0 0 0 2024-04-30T23:15:58.750 INFO:tasks.workunit.client.0.smithi100.stdout:4/653: truncate d19/d1a/d21/d4a/d53/d5e/fb4 373878 0 2024-04-30T23:15:58.751 INFO:tasks.workunit.client.0.smithi100.stdout:8/583: creat d2/d89/d10/d17/fbb x:0 0 0 2024-04-30T23:15:58.751 INFO:tasks.workunit.client.0.smithi100.stdout:8/584: truncate d2/d89/d10/d17/d8f/fac 543196 0 2024-04-30T23:15:58.752 INFO:tasks.workunit.client.0.smithi100.stdout:8/585: chown d2/d29/cb8 10 1 2024-04-30T23:15:58.752 INFO:tasks.workunit.client.0.smithi100.stdout:8/586: chown d2/d89/d10/d52 5108005 1 2024-04-30T23:15:58.753 INFO:tasks.workunit.client.0.smithi100.stdout:2/669: getdents d5/d12/d13 0 2024-04-30T23:15:58.759 INFO:tasks.workunit.client.0.smithi100.stdout:2/670: creat d5/d12/dc4/fcf x:0 0 0 2024-04-30T23:15:58.761 INFO:tasks.workunit.client.0.smithi100.stdout:2/671: link d5/d22/fc5 d5/d47/d4c/dab/fd0 0 2024-04-30T23:15:58.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/577: dread d1/d14/d15/d32/d6f/da2/f74 [0,4194304] 0 2024-04-30T23:15:58.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/672: link d5/d12/d8e/fac d5/d26/fd1 0 2024-04-30T23:15:58.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/673: readlink d5/d58/lb3 0 2024-04-30T23:15:58.765 INFO:tasks.workunit.client.0.smithi100.stdout:3/578: link d1/d14/d15/d27/d5d/c8f d1/d14/d15/d32/d6f/da2/d26/cab 0 2024-04-30T23:15:58.766 INFO:tasks.workunit.client.0.smithi100.stdout:2/674: symlink d5/d2e/ld2 0 2024-04-30T23:15:58.769 INFO:tasks.workunit.client.0.smithi100.stdout:9/534: read d4/f33 [541859,96111] 0 2024-04-30T23:15:58.769 INFO:tasks.workunit.client.0.smithi100.stdout:9/535: dread - d4/d9/d51/fba zero size 2024-04-30T23:15:58.769 INFO:tasks.workunit.client.0.smithi100.stdout:3/579: creat d1/d14/d15/d32/d6f/da2/d6d/fac x:0 0 0 2024-04-30T23:15:58.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/550: dwrite d7/d9/d86/f30 [4194304,4194304] 0 2024-04-30T23:15:58.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/551: chown d7/df/d23/d4f/l8f 1961 1 2024-04-30T23:15:58.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/552: write d7/df/d23/d24/d2e/f69 [813438,130372] 0 2024-04-30T23:15:58.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/553: write d7/df/d23/d4f/fbd [606509,129742] 0 2024-04-30T23:15:58.776 INFO:tasks.workunit.client.0.smithi100.stdout:9/536: dread d4/fb0 [0,4194304] 0 2024-04-30T23:15:58.776 INFO:tasks.workunit.client.0.smithi100.stdout:9/537: chown d4/d7/d60/d69 41419579 1 2024-04-30T23:15:58.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/538: creat d4/d7/d8/d37/fc2 x:0 0 0 2024-04-30T23:15:58.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/539: readlink d4/d7/d8/d37/d58/l71 0 2024-04-30T23:15:58.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/540: write d4/d9/d51/d89/fa9 [820056,31497] 0 2024-04-30T23:15:58.781 INFO:tasks.workunit.client.0.smithi100.stdout:9/541: mknod d4/d9/d6f/cc3 0 2024-04-30T23:15:58.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/675: dread d5/d26/f54 [0,4194304] 0 2024-04-30T23:15:58.782 INFO:tasks.workunit.client.0.smithi100.stdout:4/654: read d19/d1a/d21/d4a/d53/d5e/f6b [1914313,5781] 0 2024-04-30T23:15:58.782 INFO:tasks.workunit.client.0.smithi100.stdout:0/677: dwrite d2/d14/f24 [0,4194304] 0 2024-04-30T23:15:58.783 INFO:tasks.workunit.client.0.smithi100.stdout:9/542: mkdir d4/d9/d10/db9/dc4 0 2024-04-30T23:15:58.786 INFO:tasks.workunit.client.0.smithi100.stdout:2/676: rename d5/d47/d4c/fb9 to d5/d22/fd3 0 2024-04-30T23:15:58.786 INFO:tasks.workunit.client.0.smithi100.stdout:2/677: truncate d5/d47/fbe 61567 0 2024-04-30T23:15:58.788 INFO:tasks.workunit.client.0.smithi100.stdout:3/580: dread d1/d14/d21/f31 [4194304,4194304] 0 2024-04-30T23:15:58.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/543: creat d4/d9/d51/fc5 x:0 0 0 2024-04-30T23:15:58.790 INFO:tasks.workunit.client.0.smithi100.stdout:4/655: truncate d19/d1a/d6d/d4e/fc1 158265 0 2024-04-30T23:15:58.790 INFO:tasks.workunit.client.0.smithi100.stdout:4/656: dread - d19/d1a/d6d/d64/d78/d8c/fcf zero size 2024-04-30T23:15:58.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/581: link d1/d14/d15/d27/d34/l85 d1/d38/lad 0 2024-04-30T23:15:58.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/582: chown d1/d14/d15/d27/d5d/f6c 5861 1 2024-04-30T23:15:58.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/544: creat d4/d9/d93/fc6 x:0 0 0 2024-04-30T23:15:58.797 INFO:tasks.workunit.client.0.smithi100.stdout:2/678: symlink d5/d12/ld4 0 2024-04-30T23:15:58.797 INFO:tasks.workunit.client.0.smithi100.stdout:3/583: mkdir d1/d14/d15/d32/d6f/da2/d6d/d81/dae 0 2024-04-30T23:15:58.798 INFO:tasks.workunit.client.0.smithi100.stdout:6/554: dread d7/d9/f28 [0,4194304] 0 2024-04-30T23:15:58.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/679: write d5/d47/d66/f69 [1152627,122242] 0 2024-04-30T23:15:58.798 INFO:tasks.workunit.client.0.smithi100.stdout:9/545: dread d4/d7/d8/d37/d58/f77 [0,4194304] 0 2024-04-30T23:15:58.799 INFO:tasks.workunit.client.0.smithi100.stdout:6/555: creat d7/d9/d8e/fcb x:0 0 0 2024-04-30T23:15:58.799 INFO:tasks.workunit.client.0.smithi100.stdout:6/556: chown c4 0 1 2024-04-30T23:15:58.799 INFO:tasks.workunit.client.0.smithi100.stdout:6/557: stat d7/d9/d86/db0 0 2024-04-30T23:15:58.799 INFO:tasks.workunit.client.0.smithi100.stdout:6/558: readlink d7/df/d23/d24/l94 0 2024-04-30T23:15:58.800 INFO:tasks.workunit.client.0.smithi100.stdout:2/680: symlink d5/d58/ld5 0 2024-04-30T23:15:58.800 INFO:tasks.workunit.client.0.smithi100.stdout:2/681: write d5/d12/f9a [1027326,35711] 0 2024-04-30T23:15:58.801 INFO:tasks.workunit.client.0.smithi100.stdout:4/657: dread d19/d33/d3f/f41 [0,4194304] 0 2024-04-30T23:15:58.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/546: mknod d4/d7/d8d/cc7 0 2024-04-30T23:15:58.802 INFO:tasks.workunit.client.0.smithi100.stdout:6/559: symlink d7/d9/d86/d1b/d3f/lcc 0 2024-04-30T23:15:58.804 INFO:tasks.workunit.client.0.smithi100.stdout:2/682: creat d5/d26/fd6 x:0 0 0 2024-04-30T23:15:58.804 INFO:tasks.workunit.client.0.smithi100.stdout:2/683: read - d5/d26/d2f/f91 zero size 2024-04-30T23:15:58.811 INFO:tasks.workunit.client.0.smithi100.stdout:3/584: dread d1/d14/d15/d27/f33 [0,4194304] 0 2024-04-30T23:15:58.811 INFO:tasks.workunit.client.0.smithi100.stdout:3/585: fsync d1/d14/d15/d27/d34/f6e 0 2024-04-30T23:15:58.820 INFO:tasks.workunit.client.0.smithi100.stdout:4/658: write f12 [3804796,14074] 0 2024-04-30T23:15:58.820 INFO:tasks.workunit.client.0.smithi100.stdout:4/659: chown d19/d1a/d21/d4a/f6a 5 1 2024-04-30T23:15:58.823 INFO:tasks.workunit.client.0.smithi100.stdout:4/660: mkdir d19/d1a/d6d/d4e/d6e/dcb/dd3 0 2024-04-30T23:15:58.823 INFO:tasks.workunit.client.0.smithi100.stdout:4/661: stat d19/d1a/d29/c66 0 2024-04-30T23:15:58.823 INFO:tasks.workunit.client.0.smithi100.stdout:4/662: write d19/d1a/d21/d3c/fb9 [1181556,117792] 0 2024-04-30T23:15:58.824 INFO:tasks.workunit.client.0.smithi100.stdout:6/560: dread d7/d9/f28 [8388608,4194304] 0 2024-04-30T23:15:58.826 INFO:tasks.workunit.client.0.smithi100.stdout:6/561: rename d7/df/d23/d2b/d42/lab to d7/d9/d86/d1b/lcd 0 2024-04-30T23:15:58.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/684: dwrite d5/d12/d13/d4b/f99 [0,4194304] 0 2024-04-30T23:15:58.832 INFO:tasks.workunit.client.0.smithi100.stdout:9/547: dwrite d4/d9/d93/f9c [0,4194304] 0 2024-04-30T23:15:58.833 INFO:tasks.workunit.client.0.smithi100.stdout:4/663: dread d19/d1a/d21/d4a/d53/d5e/f6b [0,4194304] 0 2024-04-30T23:15:58.835 INFO:tasks.workunit.client.0.smithi100.stdout:9/548: creat d4/d9/d10/db9/dc4/fc8 x:0 0 0 2024-04-30T23:15:58.836 INFO:tasks.workunit.client.0.smithi100.stdout:4/664: mknod d19/d1a/d6d/d64/d78/d8c/cd4 0 2024-04-30T23:15:58.837 INFO:tasks.workunit.client.0.smithi100.stdout:9/549: link d4/d9/c2c d4/d7/dab/db4/dbd/cc9 0 2024-04-30T23:15:58.839 INFO:tasks.workunit.client.0.smithi100.stdout:9/550: creat d4/d7/fca x:0 0 0 2024-04-30T23:15:58.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/551: mkdir d4/d7/d8/d37/d58/dcb 0 2024-04-30T23:15:58.842 INFO:tasks.workunit.client.0.smithi100.stdout:3/586: dwrite d1/d14/d15/d32/d6f/da2/f39 [0,4194304] 0 2024-04-30T23:15:58.845 INFO:tasks.workunit.client.0.smithi100.stdout:3/587: mkdir d1/d14/d2b/d57/daf 0 2024-04-30T23:15:58.848 INFO:tasks.workunit.client.0.smithi100.stdout:3/588: creat d1/d14/d15/d32/d71/fb0 x:0 0 0 2024-04-30T23:15:58.848 INFO:tasks.workunit.client.0.smithi100.stdout:3/589: write d1/d14/d15/f7f [850818,39192] 0 2024-04-30T23:15:58.851 INFO:tasks.workunit.client.0.smithi100.stdout:6/562: dwrite d7/d9/f12 [0,4194304] 0 2024-04-30T23:15:58.851 INFO:tasks.workunit.client.0.smithi100.stdout:6/563: read - d7/d9/d86/f73 zero size 2024-04-30T23:15:58.851 INFO:tasks.workunit.client.0.smithi100.stdout:3/590: mkdir d1/d14/d15/d32/d6f/da2/d6d/d81/dae/db1 0 2024-04-30T23:15:58.853 INFO:tasks.workunit.client.0.smithi100.stdout:6/564: mknod d7/d9/d86/d3e/d6b/cce 0 2024-04-30T23:15:58.855 INFO:tasks.workunit.client.0.smithi100.stdout:4/665: read d19/d1a/d45/f92 [4175658,53183] 0 2024-04-30T23:15:58.859 INFO:tasks.workunit.client.0.smithi100.stdout:2/685: dwrite d5/d12/d13/d9e/fc9 [0,4194304] 0 2024-04-30T23:15:58.863 INFO:tasks.workunit.client.0.smithi100.stdout:2/686: symlink d5/d22/ld7 0 2024-04-30T23:15:58.863 INFO:tasks.workunit.client.0.smithi100.stdout:6/565: dread d7/d9/d86/d1b/f36 [4194304,4194304] 0 2024-04-30T23:15:58.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/687: creat d5/d12/d8e/dae/dbf/fd8 x:0 0 0 2024-04-30T23:15:58.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/688: read d5/d12/f6c [3224762,116085] 0 2024-04-30T23:15:58.873 INFO:tasks.workunit.client.0.smithi100.stdout:9/552: dwrite d4/d7/d60/fad [0,4194304] 0 2024-04-30T23:15:58.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/689: dread d5/d47/f8b [0,4194304] 0 2024-04-30T23:15:58.875 INFO:tasks.workunit.client.0.smithi100.stdout:3/591: write d1/d14/d15/d32/d6f/da2/f39 [1291042,79304] 0 2024-04-30T23:15:58.876 INFO:tasks.workunit.client.0.smithi100.stdout:9/553: rename d4/d7/d8d to d4/d9/d51/d89/dbb/dcc 0 2024-04-30T23:15:58.877 INFO:tasks.workunit.client.0.smithi100.stdout:2/690: creat d5/fd9 x:0 0 0 2024-04-30T23:15:58.879 INFO:tasks.workunit.client.0.smithi100.stdout:3/592: symlink d1/d14/d15/d32/d6f/da2/d6d/d7b/d90/lb2 0 2024-04-30T23:15:58.879 INFO:tasks.workunit.client.0.smithi100.stdout:4/666: dwrite d19/d1a/d21/f83 [0,4194304] 0 2024-04-30T23:15:58.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/554: mkdir d4/d9/d8e/dcd 0 2024-04-30T23:15:58.882 INFO:tasks.workunit.client.0.smithi100.stdout:2/691: creat d5/d12/d8e/dae/fda x:0 0 0 2024-04-30T23:15:58.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/667: getdents d19/d1a/d6d/d4e 0 2024-04-30T23:15:58.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/668: dread - d19/d1a/d21/d4a/d53/f8f zero size 2024-04-30T23:15:58.886 INFO:tasks.workunit.client.0.smithi100.stdout:6/566: dread d7/d9/d86/d62/fb5 [0,4194304] 0 2024-04-30T23:15:58.887 INFO:tasks.workunit.client.0.smithi100.stdout:9/555: link d4/d9/d6f/f90 d4/d9/d10/d7f/fce 0 2024-04-30T23:15:58.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/669: creat d19/d1a/d21/fd5 x:0 0 0 2024-04-30T23:15:58.893 INFO:tasks.workunit.client.0.smithi100.stdout:2/692: dread d5/d2e/fc8 [4194304,4194304] 0 2024-04-30T23:15:58.893 INFO:tasks.workunit.client.0.smithi100.stdout:2/693: chown d5/d47/d4c 1429 1 2024-04-30T23:15:58.893 INFO:tasks.workunit.client.0.smithi100.stdout:2/694: fsync d5/d47/d4c/fb5 0 2024-04-30T23:15:58.894 INFO:tasks.workunit.client.0.smithi100.stdout:3/593: write d1/d14/d2b/d57/f80 [3798241,42575] 0 2024-04-30T23:15:58.899 INFO:tasks.workunit.client.0.smithi100.stdout:6/567: mkdir d7/df/d23/d24/dbf/dcf 0 2024-04-30T23:15:58.900 INFO:tasks.workunit.client.0.smithi100.stdout:9/556: rmdir d4/d9/d8e/dcd 0 2024-04-30T23:15:58.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/695: link d5/d12/d13/c27 d5/cdb 0 2024-04-30T23:15:58.903 INFO:tasks.workunit.client.0.smithi100.stdout:6/568: unlink d7/d9/d86/d3e/f91 0 2024-04-30T23:15:58.903 INFO:tasks.workunit.client.0.smithi100.stdout:9/557: rmdir d4/d7/d8/d37/d58/d8a 39 2024-04-30T23:15:58.903 INFO:tasks.workunit.client.0.smithi100.stdout:9/558: fsync d4/d7/d8/d37/d3d/f40 0 2024-04-30T23:15:58.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/559: write d4/d7/d8/d37/f65 [807832,7680] 0 2024-04-30T23:15:58.913 INFO:tasks.workunit.client.0.smithi100.stdout:9/560: dread d4/d9/d51/d89/fa9 [0,4194304] 0 2024-04-30T23:15:58.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/670: dwrite d19/d1a/d21/d4a/d53/d5d/f96 [4194304,4194304] 0 2024-04-30T23:15:58.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/671: truncate d19/d33/d3f/f51 4500083 0 2024-04-30T23:15:58.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/569: write d7/df/f41 [3429193,24579] 0 2024-04-30T23:15:58.921 INFO:tasks.workunit.client.0.smithi100.stdout:3/594: dwrite d1/d14/f73 [4194304,4194304] 0 2024-04-30T23:15:58.927 INFO:tasks.workunit.client.0.smithi100.stdout:2/696: dwrite d5/d47/d4c/dab/fd0 [0,4194304] 0 2024-04-30T23:15:58.928 INFO:tasks.workunit.client.0.smithi100.stdout:2/697: readlink d5/d58/l7c 0 2024-04-30T23:15:58.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/561: dread f3 [4194304,4194304] 0 2024-04-30T23:15:58.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/562: chown d4/d7/d60/d69 519455 1 2024-04-30T23:15:58.932 INFO:tasks.workunit.client.0.smithi100.stdout:9/563: creat d4/d7/d60/d69/fcf x:0 0 0 2024-04-30T23:15:58.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/570: dread d7/df/d23/d24/d2e/d37/f68 [0,4194304] 0 2024-04-30T23:15:58.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/571: fdatasync d7/db/d3b/f6d 0 2024-04-30T23:15:58.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/572: dread - d7/db/d3b/f83 zero size 2024-04-30T23:15:58.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/573: fdatasync d7/df/d23/d24/d2e/d37/fb2 0 2024-04-30T23:15:58.939 INFO:tasks.workunit.client.0.smithi100.stdout:6/574: link d7/d9/d86/db0/f7b d7/db/fd0 0 2024-04-30T23:15:58.942 INFO:tasks.workunit.client.0.smithi100.stdout:6/575: mkdir d7/db/dd1 0 2024-04-30T23:15:58.944 INFO:tasks.workunit.client.0.smithi100.stdout:4/672: dwrite d19/d1a/d21/fd5 [0,4194304] 0 2024-04-30T23:15:58.944 INFO:tasks.workunit.client.0.smithi100.stdout:4/673: chown d19/d1a/d6d/d4e 260 1 2024-04-30T23:15:58.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/595: dwrite d1/d14/d15/d27/f33 [0,4194304] 0 2024-04-30T23:15:58.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/596: write d1/d14/f73 [2488448,32193] 0 2024-04-30T23:15:58.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/597: mknod d1/d14/d15/d27/cb3 0 2024-04-30T23:15:58.954 INFO:tasks.workunit.client.0.smithi100.stdout:2/698: dwrite d5/d22/f42 [0,4194304] 0 2024-04-30T23:15:58.954 INFO:tasks.workunit.client.0.smithi100.stdout:2/699: read d5/d26/d2f/d38/f75 [3876030,36753] 0 2024-04-30T23:15:58.961 INFO:tasks.workunit.client.0.smithi100.stdout:6/576: read d7/df/d23/d24/f5f [3594124,16228] 0 2024-04-30T23:15:58.961 INFO:tasks.workunit.client.0.smithi100.stdout:9/564: dwrite d4/d9/d51/f53 [4194304,4194304] 0 2024-04-30T23:15:58.961 INFO:tasks.workunit.client.0.smithi100.stdout:3/598: link d1/d14/d15/d32/d7d/c94 d1/d14/d15/d27/cb4 0 2024-04-30T23:15:58.961 INFO:tasks.workunit.client.0.smithi100.stdout:3/599: read d1/d14/d2b/d57/f80 [612748,12769] 0 2024-04-30T23:15:58.962 INFO:tasks.workunit.client.0.smithi100.stdout:3/600: read - d1/d14/d15/d32/d6f/da2/d26/f9e zero size 2024-04-30T23:15:58.965 INFO:tasks.workunit.client.0.smithi100.stdout:9/565: mkdir d4/d7/d8/d37/d58/dd0 0 2024-04-30T23:15:58.966 INFO:tasks.workunit.client.0.smithi100.stdout:3/601: mknod d1/d14/d15/d2c/cb5 0 2024-04-30T23:15:58.968 INFO:tasks.workunit.client.0.smithi100.stdout:4/674: dwrite d19/d1a/d29/f5f [0,4194304] 0 2024-04-30T23:15:58.972 INFO:tasks.workunit.client.0.smithi100.stdout:5/667: sync 2024-04-30T23:15:58.982 INFO:tasks.workunit.client.0.smithi100.stdout:2/700: dwrite d5/d2e/f35 [0,4194304] 0 2024-04-30T23:15:58.984 INFO:tasks.workunit.client.0.smithi100.stdout:3/602: dread d1/d14/d15/d32/d6f/da2/f39 [0,4194304] 0 2024-04-30T23:15:58.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/603: fdatasync d1/d14/d15/d32/d6f/da2/d26/f23 0 2024-04-30T23:15:58.985 INFO:tasks.workunit.client.0.smithi100.stdout:6/577: dread d7/db/f5c [0,4194304] 0 2024-04-30T23:15:58.991 INFO:tasks.workunit.client.0.smithi100.stdout:9/566: dread d4/d7/d8/d37/f6c [0,4194304] 0 2024-04-30T23:15:58.991 INFO:tasks.workunit.client.0.smithi100.stdout:3/604: mknod d1/d14/d2b/cb6 0 2024-04-30T23:15:58.991 INFO:tasks.workunit.client.0.smithi100.stdout:6/578: creat d7/d9/d86/d3e/d6b/fd2 x:0 0 0 2024-04-30T23:15:58.991 INFO:tasks.workunit.client.0.smithi100.stdout:6/579: fdatasync d7/d9/d86/d1b/d22/fbc 0 2024-04-30T23:15:58.991 INFO:tasks.workunit.client.0.smithi100.stdout:9/567: write d4/f1e [1075527,47249] 0 2024-04-30T23:15:58.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/675: dwrite d19/d1a/d21/d3c/fb9 [0,4194304] 0 2024-04-30T23:15:58.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/676: readlink d19/d1a/d29/d65/lc6 0 2024-04-30T23:15:59.002 INFO:tasks.workunit.client.0.smithi100.stdout:6/580: getdents d7/df/d23/d2b 0 2024-04-30T23:15:59.002 INFO:tasks.workunit.client.0.smithi100.stdout:6/581: write d7/d9/d86/d1b/d22/fbc [141045,75931] 0 2024-04-30T23:15:59.004 INFO:tasks.workunit.client.0.smithi100.stdout:6/582: mknod d7/d9/d86/dc7/cd3 0 2024-04-30T23:15:59.010 INFO:tasks.workunit.client.0.smithi100.stdout:2/701: dwrite d5/d12/d8e/fac [0,4194304] 0 2024-04-30T23:15:59.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/702: creat d5/d12/d13/d9e/fdc x:0 0 0 2024-04-30T23:15:59.012 INFO:tasks.workunit.client.0.smithi100.stdout:4/677: dread d19/f6f [0,4194304] 0 2024-04-30T23:15:59.012 INFO:tasks.workunit.client.0.smithi100.stdout:2/703: getdents d5/d12/d73 0 2024-04-30T23:15:59.013 INFO:tasks.workunit.client.0.smithi100.stdout:2/704: creat d5/d47/fdd x:0 0 0 2024-04-30T23:15:59.014 INFO:tasks.workunit.client.0.smithi100.stdout:2/705: unlink d5/d12/d13/d4b/l5d 0 2024-04-30T23:15:59.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/706: mknod d5/d12/d70/dc3/cde 0 2024-04-30T23:15:59.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/707: dread - d5/fd9 zero size 2024-04-30T23:15:59.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/708: chown d5/d12/c97 0 1 2024-04-30T23:15:59.020 INFO:tasks.workunit.client.0.smithi100.stdout:3/605: dwrite d1/d14/d2b/d57/f80 [4194304,4194304] 0 2024-04-30T23:15:59.020 INFO:tasks.workunit.client.0.smithi100.stdout:9/568: dwrite d4/fd [0,4194304] 0 2024-04-30T23:15:59.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/569: rename d4/d7/d8/d37/d58/l71 to d4/d7/d60/d69/ld1 0 2024-04-30T23:15:59.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/570: fsync d4/d9/d10/db9/dc4/fc8 0 2024-04-30T23:15:59.030 INFO:tasks.workunit.client.0.smithi100.stdout:7/712: sync 2024-04-30T23:15:59.030 INFO:tasks.workunit.client.0.smithi100.stdout:1/524: sync 2024-04-30T23:15:59.031 INFO:tasks.workunit.client.0.smithi100.stdout:1/525: dread - d3/d18/d60/f94 zero size 2024-04-30T23:15:59.031 INFO:tasks.workunit.client.0.smithi100.stdout:2/709: write d5/d12/d13/f59 [2587725,49905] 0 2024-04-30T23:15:59.033 INFO:tasks.workunit.client.0.smithi100.stdout:2/710: symlink d5/d47/d66/ldf 0 2024-04-30T23:15:59.034 INFO:tasks.workunit.client.0.smithi100.stdout:7/713: write d0/df/f14 [1445089,2193] 0 2024-04-30T23:15:59.034 INFO:tasks.workunit.client.0.smithi100.stdout:7/714: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 854514 0 2024-04-30T23:15:59.035 INFO:tasks.workunit.client.0.smithi100.stdout:2/711: symlink d5/d47/d4c/dab/le0 0 2024-04-30T23:15:59.035 INFO:tasks.workunit.client.0.smithi100.stdout:2/712: write d5/d26/d2f/f91 [70486,115845] 0 2024-04-30T23:15:59.035 INFO:tasks.workunit.client.0.smithi100.stdout:2/713: write d5/d12/d8e/dae/dbf/fd8 [1010877,120835] 0 2024-04-30T23:15:59.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/715: symlink d0/d1b/d2e/leb 0 2024-04-30T23:15:59.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/716: chown d0/d1d/d3f/c95 378536716 1 2024-04-30T23:15:59.038 INFO:tasks.workunit.client.0.smithi100.stdout:7/717: creat d0/d1b/d2e/fec x:0 0 0 2024-04-30T23:15:59.039 INFO:tasks.workunit.client.0.smithi100.stdout:7/718: mkdir d0/df/d4f/d93/db1/ded 0 2024-04-30T23:15:59.040 INFO:tasks.workunit.client.0.smithi100.stdout:7/719: chown d0/df/d4f/fbc 7425919 1 2024-04-30T23:15:59.043 INFO:tasks.workunit.client.0.smithi100.stdout:7/720: mknod d0/d1d/d5e/d6a/d4b/cee 0 2024-04-30T23:15:59.043 INFO:tasks.workunit.client.0.smithi100.stdout:7/721: write d0/d1d/d5e/d6a/d4b/d79/dd0/fd7 [576099,129518] 0 2024-04-30T23:15:59.044 INFO:tasks.workunit.client.0.smithi100.stdout:7/722: dread d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 [0,4194304] 0 2024-04-30T23:15:59.046 INFO:tasks.workunit.client.0.smithi100.stdout:1/526: dread d3/d16/f3c [0,4194304] 0 2024-04-30T23:15:59.046 INFO:tasks.workunit.client.0.smithi100.stdout:1/527: fdatasync d3/f4d 0 2024-04-30T23:15:59.046 INFO:tasks.workunit.client.0.smithi100.stdout:7/723: link d0/d1b/d1e/f40 d0/d1b/d2e/d97/fef 0 2024-04-30T23:15:59.047 INFO:tasks.workunit.client.0.smithi100.stdout:7/724: truncate d0/d1d/d5e/d6a/d4b/d79/dd0/fd7 1373633 0 2024-04-30T23:15:59.047 INFO:tasks.workunit.client.0.smithi100.stdout:3/606: dwrite d1/d38/f5c [0,4194304] 0 2024-04-30T23:15:59.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/678: dwrite d19/d33/f86 [0,4194304] 0 2024-04-30T23:15:59.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/679: chown d19/d1a/d6d/f3d 52 1 2024-04-30T23:15:59.049 INFO:tasks.workunit.client.0.smithi100.stdout:7/725: link d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 d0/d1b/d2e/dd8/ff0 0 2024-04-30T23:15:59.050 INFO:tasks.workunit.client.0.smithi100.stdout:7/726: write d0/df/d4f/d53/f59 [810341,55973] 0 2024-04-30T23:15:59.050 INFO:tasks.workunit.client.0.smithi100.stdout:2/714: dread d5/d22/fa8 [0,4194304] 0 2024-04-30T23:15:59.052 INFO:tasks.workunit.client.0.smithi100.stdout:9/571: dwrite d4/d9/d51/d89/dbb/fc1 [0,4194304] 0 2024-04-30T23:15:59.052 INFO:tasks.workunit.client.0.smithi100.stdout:3/607: rename d1/d14/d15/l42 to d1/d14/d2b/d57/lb7 0 2024-04-30T23:15:59.052 INFO:tasks.workunit.client.0.smithi100.stdout:3/608: write d1/f8d [1006613,62679] 0 2024-04-30T23:15:59.055 INFO:tasks.workunit.client.0.smithi100.stdout:4/680: mknod d19/cd6 0 2024-04-30T23:15:59.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/727: unlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fd6 0 2024-04-30T23:15:59.061 INFO:tasks.workunit.client.0.smithi100.stdout:9/572: rmdir d4/d7/d5d 39 2024-04-30T23:15:59.062 INFO:tasks.workunit.client.0.smithi100.stdout:1/528: write d3/d18/f53 [1307954,91783] 0 2024-04-30T23:15:59.063 INFO:tasks.workunit.client.0.smithi100.stdout:4/681: rename d19/d33/d3f/c8d to d19/d1a/d29/dae/cd7 0 2024-04-30T23:15:59.066 INFO:tasks.workunit.client.0.smithi100.stdout:1/529: unlink d3/d16/d20/f2a 0 2024-04-30T23:15:59.069 INFO:tasks.workunit.client.0.smithi100.stdout:4/682: rename d19/d33/fbd to d19/d1a/d6d/d4e/d6e/dcb/fd8 0 2024-04-30T23:15:59.071 INFO:tasks.workunit.client.0.smithi100.stdout:1/530: rename d3/d16/d20/c4a to d3/d16/d20/d24/d69/d5e/c98 0 2024-04-30T23:15:59.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/683: rmdir d19/d1a/d6d/d64 39 2024-04-30T23:15:59.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/684: fsync d19/d1a/d21/d4a/d53/f8f 0 2024-04-30T23:15:59.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/685: chown d19/d1a/d29/dae/fc9 14 1 2024-04-30T23:15:59.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/715: dwrite d5/d2e/fc8 [0,4194304] 0 2024-04-30T23:15:59.076 INFO:tasks.workunit.client.0.smithi100.stdout:3/609: dread d1/d14/d2b/f4c [0,4194304] 0 2024-04-30T23:15:59.076 INFO:tasks.workunit.client.0.smithi100.stdout:3/610: stat d1/d14/d15/d32/d71/l96 0 2024-04-30T23:15:59.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/716: write d5/d22/f40 [7318369,98370] 0 2024-04-30T23:15:59.076 INFO:tasks.workunit.client.0.smithi100.stdout:3/611: write d1/d14/d15/d27/f33 [4445823,85063] 0 2024-04-30T23:15:59.081 INFO:tasks.workunit.client.0.smithi100.stdout:3/612: creat d1/d14/d21/fb8 x:0 0 0 2024-04-30T23:15:59.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/717: dread d5/d47/d4c/fb5 [4194304,4194304] 0 2024-04-30T23:15:59.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/728: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/fc4 [0,4194304] 0 2024-04-30T23:15:59.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/729: chown d0/df 12592 1 2024-04-30T23:15:59.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/730: chown d0/d1b/d85 30 1 2024-04-30T23:15:59.096 INFO:tasks.workunit.client.0.smithi100.stdout:9/573: dread d4/d9/d10/d7f/f95 [0,4194304] 0 2024-04-30T23:15:59.097 INFO:tasks.workunit.client.0.smithi100.stdout:2/718: creat d5/d12/d8e/dae/fe1 x:0 0 0 2024-04-30T23:15:59.099 INFO:tasks.workunit.client.0.smithi100.stdout:3/613: dread d1/fa [0,4194304] 0 2024-04-30T23:15:59.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/731: mkdir d0/df/d4f/d53/da9/df1 0 2024-04-30T23:15:59.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/732: readlink d0/df/l13 0 2024-04-30T23:15:59.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/733: stat d0/d1d/d5e/d6a/d4b/d79/d2a/f52 0 2024-04-30T23:15:59.101 INFO:tasks.workunit.client.0.smithi100.stdout:2/719: mkdir d5/d47/d66/de2 0 2024-04-30T23:15:59.102 INFO:tasks.workunit.client.0.smithi100.stdout:3/614: getdents d1/d14/d15/d32/d6f/da2/d6d/d7b 0 2024-04-30T23:15:59.102 INFO:tasks.workunit.client.0.smithi100.stdout:3/615: truncate d1/d14/d15/d32/d92/fa4 662251 0 2024-04-30T23:15:59.103 INFO:tasks.workunit.client.0.smithi100.stdout:4/686: dwrite d19/d1a/d21/d3c/fb9 [4194304,4194304] 0 2024-04-30T23:15:59.105 INFO:tasks.workunit.client.0.smithi100.stdout:9/574: unlink d4/d7/d8/f66 0 2024-04-30T23:15:59.105 INFO:tasks.workunit.client.0.smithi100.stdout:7/734: dread d0/d1b/d60/d48/f8e [0,4194304] 0 2024-04-30T23:15:59.106 INFO:tasks.workunit.client.0.smithi100.stdout:2/720: unlink d5/d22/fd3 0 2024-04-30T23:15:59.108 INFO:tasks.workunit.client.0.smithi100.stdout:3/616: mknod d1/d14/d21/d67/cb9 0 2024-04-30T23:15:59.112 INFO:tasks.workunit.client.0.smithi100.stdout:9/575: getdents d4/d9/d6f 0 2024-04-30T23:15:59.114 INFO:tasks.workunit.client.0.smithi100.stdout:7/735: truncate d0/d1b/d60/d80/f90 146859 0 2024-04-30T23:15:59.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/736: readlink d0/d1d/d5e/d6a/d4b/d79/d2a/l73 0 2024-04-30T23:15:59.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/576: write d4/d9/d10/f7e [94432,55745] 0 2024-04-30T23:15:59.125 INFO:tasks.workunit.client.0.smithi100.stdout:3/617: getdents d1/d14/d15/d2c 0 2024-04-30T23:15:59.125 INFO:tasks.workunit.client.0.smithi100.stdout:4/687: dwrite f12 [0,4194304] 0 2024-04-30T23:15:59.126 INFO:tasks.workunit.client.0.smithi100.stdout:2/721: write d5/d2e/f35 [3254689,97258] 0 2024-04-30T23:15:59.128 INFO:tasks.workunit.client.0.smithi100.stdout:9/577: mknod d4/d7/cd2 0 2024-04-30T23:15:59.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/688: rename d19/d1a/d21/d4a/d53/d5e/lcc to d19/d1a/d6d/ld9 0 2024-04-30T23:15:59.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/722: mknod d5/d26/d2f/ce3 0 2024-04-30T23:15:59.134 INFO:tasks.workunit.client.0.smithi100.stdout:2/723: getdents d5/d12/dc4 0 2024-04-30T23:15:59.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/578: dread d4/d7/d8/d37/f6c [0,4194304] 0 2024-04-30T23:15:59.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/579: symlink d4/d9/d6f/ld3 0 2024-04-30T23:15:59.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/580: chown d4/d7/d5d/f75 856558 1 2024-04-30T23:15:59.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/581: fdatasync f3 0 2024-04-30T23:15:59.146 INFO:tasks.workunit.client.0.smithi100.stdout:9/582: creat d4/d9/d51/d89/dbb/fd4 x:0 0 0 2024-04-30T23:15:59.147 INFO:tasks.workunit.client.0.smithi100.stdout:7/737: dwrite d0/d1b/fcc [0,4194304] 0 2024-04-30T23:15:59.149 INFO:tasks.workunit.client.0.smithi100.stdout:4/689: write d19/d1a/d6d/d4e/d6e/f80 [3007907,64846] 0 2024-04-30T23:15:59.149 INFO:tasks.workunit.client.0.smithi100.stdout:4/690: fsync d19/d1a/d21/fc2 0 2024-04-30T23:15:59.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/724: read d5/d26/d9b/fba [459343,59636] 0 2024-04-30T23:15:59.152 INFO:tasks.workunit.client.0.smithi100.stdout:3/618: dwrite d1/d14/d15/d32/d6f/da2/d26/f23 [0,4194304] 0 2024-04-30T23:15:59.152 INFO:tasks.workunit.client.0.smithi100.stdout:3/619: fsync d1/d14/d15/f20 0 2024-04-30T23:15:59.155 INFO:tasks.workunit.client.0.smithi100.stdout:7/738: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dd4/ff2 x:0 0 0 2024-04-30T23:15:59.156 INFO:tasks.workunit.client.0.smithi100.stdout:2/725: truncate d5/d12/f3d 1857208 0 2024-04-30T23:15:59.157 INFO:tasks.workunit.client.0.smithi100.stdout:3/620: mknod d1/d14/d15/d32/d7d/cba 0 2024-04-30T23:15:59.159 INFO:tasks.workunit.client.0.smithi100.stdout:3/621: rename d1/d14/d15/d27/d5d/fa5 to d1/d14/d15/fbb 0 2024-04-30T23:15:59.173 INFO:tasks.workunit.client.0.smithi100.stdout:2/726: dread d5/d26/fd1 [0,4194304] 0 2024-04-30T23:15:59.177 INFO:tasks.workunit.client.0.smithi100.stdout:2/727: mknod d5/d12/ce4 0 2024-04-30T23:15:59.179 INFO:tasks.workunit.client.0.smithi100.stdout:2/728: link d5/d12/d70/dc3/cde d5/d47/d4c/dab/ce5 0 2024-04-30T23:15:59.179 INFO:tasks.workunit.client.0.smithi100.stdout:2/729: dread - d5/d2e/fbd zero size 2024-04-30T23:15:59.179 INFO:tasks.workunit.client.0.smithi100.stdout:2/730: dread - d5/fbb zero size 2024-04-30T23:15:59.180 INFO:tasks.workunit.client.0.smithi100.stdout:2/731: chown d5/d12/d70 121900 1 2024-04-30T23:15:59.181 INFO:tasks.workunit.client.0.smithi100.stdout:4/691: dwrite d19/d1a/d21/f2b [0,4194304] 0 2024-04-30T23:15:59.181 INFO:tasks.workunit.client.0.smithi100.stdout:9/583: dwrite d4/d9/d50/f5f [0,4194304] 0 2024-04-30T23:15:59.181 INFO:tasks.workunit.client.0.smithi100.stdout:9/584: write d4/d7/d60/d69/f97 [819642,70008] 0 2024-04-30T23:15:59.181 INFO:tasks.workunit.client.0.smithi100.stdout:9/585: truncate d4/d7/fca 1032499 0 2024-04-30T23:15:59.184 INFO:tasks.workunit.client.0.smithi100.stdout:4/692: link d19/d1a/d45/l94 d19/d1a/d21/d3c/lda 0 2024-04-30T23:15:59.184 INFO:tasks.workunit.client.0.smithi100.stdout:4/693: write d19/d1a/d21/d4a/d53/f70 [588915,28789] 0 2024-04-30T23:15:59.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/586: unlink d4/d7/d5d/f64 0 2024-04-30T23:15:59.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/587: dread - d4/d9/d6f/fbf zero size 2024-04-30T23:15:59.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/588: chown d4/c2b 12 1 2024-04-30T23:15:59.186 INFO:tasks.workunit.client.0.smithi100.stdout:2/732: dread d5/d12/f3d [0,4194304] 0 2024-04-30T23:15:59.186 INFO:tasks.workunit.client.0.smithi100.stdout:2/733: chown d5/d47/d66/ldf 13319234 1 2024-04-30T23:15:59.187 INFO:tasks.workunit.client.0.smithi100.stdout:4/694: creat d19/d1a/d6d/d4e/d6e/fdb x:0 0 0 2024-04-30T23:15:59.187 INFO:tasks.workunit.client.0.smithi100.stdout:7/739: dwrite d0/d1b/d60/d48/d4a/f4d [12582912,4194304] 0 2024-04-30T23:15:59.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/734: creat d5/d47/d66/fe6 x:0 0 0 2024-04-30T23:15:59.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/735: fsync d5/f16 0 2024-04-30T23:15:59.189 INFO:tasks.workunit.client.0.smithi100.stdout:4/695: symlink d19/d1a/d21/d4a/d53/d5e/d7e/ldc 0 2024-04-30T23:15:59.189 INFO:tasks.workunit.client.0.smithi100.stdout:4/696: write d19/f26 [1966767,128148] 0 2024-04-30T23:15:59.189 INFO:tasks.workunit.client.0.smithi100.stdout:3/622: read d1/f10 [7925774,32471] 0 2024-04-30T23:15:59.192 INFO:tasks.workunit.client.0.smithi100.stdout:7/740: mkdir d0/d1d/d3c/df3 0 2024-04-30T23:15:59.195 INFO:tasks.workunit.client.0.smithi100.stdout:3/623: link d1/d14/d15/d32/d6f/da2/d26/f98 d1/d14/d15/d32/d71/fbc 0 2024-04-30T23:15:59.197 INFO:tasks.workunit.client.0.smithi100.stdout:7/741: creat d0/d1b/d60/d48/d4a/d5b/ff4 x:0 0 0 2024-04-30T23:15:59.201 INFO:tasks.workunit.client.0.smithi100.stdout:8/587: sync 2024-04-30T23:15:59.201 INFO:tasks.workunit.client.0.smithi100.stdout:0/678: sync 2024-04-30T23:15:59.201 INFO:tasks.workunit.client.0.smithi100.stdout:8/588: chown d2/f76 243 1 2024-04-30T23:15:59.201 INFO:tasks.workunit.client.0.smithi100.stdout:0/679: chown d2/d50/d30/d32/f9d 5 1 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/589: stat d2/d89/d10/d17/f1a 0 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/590: rename d2/d29/d67 to d2/d29/d67/d73/dbc 22 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/591: truncate d2/d89/f4d 270944 0 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/592: dread - d2/d29/d71/f9c zero size 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/593: chown d2/d29/d67/d73/l90 21833 1 2024-04-30T23:15:59.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/594: chown d2/d7/d18 34358 1 2024-04-30T23:15:59.203 INFO:tasks.workunit.client.0.smithi100.stdout:0/680: mkdir d2/d50/d38/d5d/dc6/dd2 0 2024-04-30T23:15:59.204 INFO:tasks.workunit.client.0.smithi100.stdout:8/595: symlink d2/d7/d18/d3a/da4/lbd 0 2024-04-30T23:15:59.207 INFO:tasks.workunit.client.0.smithi100.stdout:0/681: getdents d2/d50/d38 0 2024-04-30T23:15:59.207 INFO:tasks.workunit.client.0.smithi100.stdout:8/596: mknod d2/cbe 0 2024-04-30T23:15:59.207 INFO:tasks.workunit.client.0.smithi100.stdout:8/597: fdatasync d2/f76 0 2024-04-30T23:15:59.208 INFO:tasks.workunit.client.0.smithi100.stdout:8/598: chown d2/d89/d7f/f3f 7275831 1 2024-04-30T23:15:59.208 INFO:tasks.workunit.client.0.smithi100.stdout:8/599: write d2/d89/d10/d17/d8f/fac [1113859,116177] 0 2024-04-30T23:15:59.209 INFO:tasks.workunit.client.0.smithi100.stdout:0/682: mknod d2/d50/d38/d6c/cd3 0 2024-04-30T23:15:59.209 INFO:tasks.workunit.client.0.smithi100.stdout:8/600: dread d2/f78 [0,4194304] 0 2024-04-30T23:15:59.210 INFO:tasks.workunit.client.0.smithi100.stdout:2/736: write d5/f62 [3919077,107866] 0 2024-04-30T23:15:59.214 INFO:tasks.workunit.client.0.smithi100.stdout:4/697: dwrite d19/d33/d3f/fc5 [0,4194304] 0 2024-04-30T23:15:59.214 INFO:tasks.workunit.client.0.smithi100.stdout:4/698: write d19/d1a/d21/f8b [5055652,10912] 0 2024-04-30T23:15:59.214 INFO:tasks.workunit.client.0.smithi100.stdout:4/699: fdatasync d19/d1a/d21/f2b 0 2024-04-30T23:15:59.216 INFO:tasks.workunit.client.0.smithi100.stdout:9/589: dwrite d4/d9/d51/f53 [4194304,4194304] 0 2024-04-30T23:15:59.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/590: creat d4/d7/fd5 x:0 0 0 2024-04-30T23:15:59.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/591: stat d4/d7/d60/d69/f97 0 2024-04-30T23:15:59.221 INFO:tasks.workunit.client.0.smithi100.stdout:2/737: dread d5/d26/f77 [0,4194304] 0 2024-04-30T23:15:59.221 INFO:tasks.workunit.client.0.smithi100.stdout:2/738: fdatasync d5/fbb 0 2024-04-30T23:15:59.221 INFO:tasks.workunit.client.0.smithi100.stdout:2/739: stat d5/d12/d13/d9e/fc9 0 2024-04-30T23:15:59.221 INFO:tasks.workunit.client.0.smithi100.stdout:2/740: fsync d5/d26/fd1 0 2024-04-30T23:15:59.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/741: symlink d5/d47/le7 0 2024-04-30T23:15:59.224 INFO:tasks.workunit.client.0.smithi100.stdout:7/742: dwrite d0/d1b/d2e/d3d/f9b [0,4194304] 0 2024-04-30T23:15:59.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/742: creat d5/d26/d2f/d38/fe8 x:0 0 0 2024-04-30T23:15:59.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/624: dwrite d1/d38/f5c [0,4194304] 0 2024-04-30T23:15:59.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/625: dread - d1/d14/d15/f62 zero size 2024-04-30T23:15:59.227 INFO:tasks.workunit.client.0.smithi100.stdout:2/743: link d5/d2e/c5f d5/d12/d70/dc3/ce9 0 2024-04-30T23:15:59.230 INFO:tasks.workunit.client.0.smithi100.stdout:2/744: link d5/d26/f54 d5/d58/fea 0 2024-04-30T23:15:59.230 INFO:tasks.workunit.client.0.smithi100.stdout:2/745: read - d5/d26/d2f/f63 zero size 2024-04-30T23:15:59.232 INFO:tasks.workunit.client.0.smithi100.stdout:8/601: dread d2/d89/d10/d17/f1b [0,4194304] 0 2024-04-30T23:15:59.233 INFO:tasks.workunit.client.0.smithi100.stdout:8/602: truncate d2/d89/f40 2015317 0 2024-04-30T23:15:59.244 INFO:tasks.workunit.client.0.smithi100.stdout:7/743: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/fc4 [1777266,26878] 0 2024-04-30T23:15:59.244 INFO:tasks.workunit.client.0.smithi100.stdout:7/744: readlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/l8b 0 2024-04-30T23:15:59.253 INFO:tasks.workunit.client.0.smithi100.stdout:7/745: read d0/df/d4f/d53/fc0 [1562802,35712] 0 2024-04-30T23:15:59.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/626: dwrite d1/d14/d15/d32/d6f/da2/f6b [0,4194304] 0 2024-04-30T23:15:59.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/746: mkdir d0/df/d4f/d53/dd2/df5 0 2024-04-30T23:15:59.255 INFO:tasks.workunit.client.0.smithi100.stdout:8/603: dwrite d2/d89/d10/d17/d8f/fb1 [0,4194304] 0 2024-04-30T23:15:59.255 INFO:tasks.workunit.client.0.smithi100.stdout:8/604: fsync d2/d89/d10/d17/d8f/fb1 0 2024-04-30T23:15:59.257 INFO:tasks.workunit.client.0.smithi100.stdout:2/746: dwrite d5/fb0 [0,4194304] 0 2024-04-30T23:15:59.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/627: unlink d1/d14/d15/f7f 0 2024-04-30T23:15:59.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/628: getdents d1/d38/d79 0 2024-04-30T23:15:59.258 INFO:tasks.workunit.client.0.smithi100.stdout:7/747: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/df6 0 2024-04-30T23:15:59.258 INFO:tasks.workunit.client.0.smithi100.stdout:7/748: write d0/d1d/d5e/d6a/f6d [5062860,117188] 0 2024-04-30T23:15:59.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/749: symlink d0/d1b/d60/lf7 0 2024-04-30T23:15:59.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/750: readlink d0/d1b/d2e/la0 0 2024-04-30T23:15:59.266 INFO:tasks.workunit.client.0.smithi100.stdout:7/751: rename d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/da3 to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/df8 0 2024-04-30T23:15:59.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/752: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/lf9 0 2024-04-30T23:15:59.269 INFO:tasks.workunit.client.0.smithi100.stdout:7/753: mkdir d0/d1b/d60/d80/dfa 0 2024-04-30T23:15:59.271 INFO:tasks.workunit.client.0.smithi100.stdout:7/754: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/ffb x:0 0 0 2024-04-30T23:15:59.271 INFO:tasks.workunit.client.0.smithi100.stdout:7/755: dread - d0/df/d4f/fbc zero size 2024-04-30T23:15:59.271 INFO:tasks.workunit.client.0.smithi100.stdout:7/756: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/fe2 [1770292,34042] 0 2024-04-30T23:15:59.272 INFO:tasks.workunit.client.0.smithi100.stdout:7/757: stat d0/f8 0 2024-04-30T23:15:59.272 INFO:tasks.workunit.client.0.smithi100.stdout:7/758: fsync d0/d1b/d2e/d3d/f9b 0 2024-04-30T23:15:59.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/759: link d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/df8/lc9 d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dc6/lfc 0 2024-04-30T23:15:59.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/760: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/df8/fcd [432134,111452] 0 2024-04-30T23:15:59.280 INFO:tasks.workunit.client.0.smithi100.stdout:3/629: write d1/d14/d15/d27/f88 [1979007,21268] 0 2024-04-30T23:15:59.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/605: dwrite d2/d29/f7e [0,4194304] 0 2024-04-30T23:15:59.281 INFO:tasks.workunit.client.0.smithi100.stdout:3/630: unlink d1/f9 0 2024-04-30T23:15:59.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/747: dwrite d5/d26/f54 [4194304,4194304] 0 2024-04-30T23:15:59.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/606: rmdir d2/d29/d71 39 2024-04-30T23:15:59.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/748: fdatasync d5/f6d 0 2024-04-30T23:15:59.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/749: write d5/d26/d9b/fba [3302326,92335] 0 2024-04-30T23:15:59.283 INFO:tasks.workunit.client.0.smithi100.stdout:8/607: creat d2/d29/d9e/daf/fbf x:0 0 0 2024-04-30T23:15:59.284 INFO:tasks.workunit.client.0.smithi100.stdout:2/750: symlink d5/d12/d8e/dae/leb 0 2024-04-30T23:15:59.284 INFO:tasks.workunit.client.0.smithi100.stdout:2/751: chown d5/d12/d70/dc3/ce9 687751 1 2024-04-30T23:15:59.286 INFO:tasks.workunit.client.0.smithi100.stdout:8/608: link d2/d89/f40 d2/d29/d9e/fc0 0 2024-04-30T23:15:59.286 INFO:tasks.workunit.client.0.smithi100.stdout:8/609: rename d2/d29/d8b/d8e to d2/d29/d8b/d8e/dc1 22 2024-04-30T23:15:59.287 INFO:tasks.workunit.client.0.smithi100.stdout:2/752: link d5/d12/f3c d5/d47/d66/fec 0 2024-04-30T23:15:59.288 INFO:tasks.workunit.client.0.smithi100.stdout:2/753: stat d5/d22/fc5 0 2024-04-30T23:15:59.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/610: mknod d2/d29/d71/cc2 0 2024-04-30T23:15:59.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/761: dread d0/d1b/d60/d48/d4a/f4c [4194304,4194304] 0 2024-04-30T23:15:59.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/762: stat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/fa4 0 2024-04-30T23:15:59.293 INFO:tasks.workunit.client.0.smithi100.stdout:8/611: link d2/cbe d2/d29/d67/cc3 0 2024-04-30T23:15:59.293 INFO:tasks.workunit.client.0.smithi100.stdout:8/612: chown d2/d89/d10/d17/f66 456866730 1 2024-04-30T23:15:59.295 INFO:tasks.workunit.client.0.smithi100.stdout:7/763: link d0/df/l13 d0/df/d4f/d53/da9/lfd 0 2024-04-30T23:15:59.296 INFO:tasks.workunit.client.0.smithi100.stdout:3/631: dread d1/d14/f73 [0,4194304] 0 2024-04-30T23:15:59.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/764: mknod d0/df/d4f/d53/cfe 0 2024-04-30T23:15:59.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/765: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/ffb zero size 2024-04-30T23:15:59.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/766: write d0/df/f14 [1002412,91616] 0 2024-04-30T23:15:59.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/767: dread - d0/d1b/d60/fb2 zero size 2024-04-30T23:15:59.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/632: symlink d1/d38/lbd 0 2024-04-30T23:15:59.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/768: symlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/lff 0 2024-04-30T23:15:59.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/633: truncate d1/d14/d21/f48 5194739 0 2024-04-30T23:15:59.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/769: fsync d0/d1d/d5e/d6a/d4b/f56 0 2024-04-30T23:15:59.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/754: dwrite d5/f25 [0,4194304] 0 2024-04-30T23:15:59.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:15:59 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:15:59.325 INFO:tasks.workunit.client.0.smithi100.stdout:3/634: dwrite d1/d14/d15/d32/d7d/f84 [0,4194304] 0 2024-04-30T23:15:59.326 INFO:tasks.workunit.client.0.smithi100.stdout:3/635: chown d1/d14/l1f 577274 1 2024-04-30T23:15:59.339 INFO:tasks.workunit.client.0.smithi100.stdout:7/770: write d0/d1b/d2e/f32 [15526944,66828] 0 2024-04-30T23:15:59.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/613: dwrite d2/d97/fa8 [0,4194304] 0 2024-04-30T23:15:59.344 INFO:tasks.workunit.client.0.smithi100.stdout:2/755: dwrite f1 [0,4194304] 0 2024-04-30T23:15:59.344 INFO:tasks.workunit.client.0.smithi100.stdout:2/756: readlink d5/d58/l64 0 2024-04-30T23:15:59.344 INFO:tasks.workunit.client.0.smithi100.stdout:2/757: chown d5/d22 30877 1 2024-04-30T23:15:59.344 INFO:tasks.workunit.client.0.smithi100.stdout:2/758: write d5/d12/dc4/fcf [601130,25457] 0 2024-04-30T23:15:59.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/668: sync 2024-04-30T23:15:59.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/669: dread - d1/d2c/d60/d66/d71/db6/dd4/fc1 zero size 2024-04-30T23:15:59.347 INFO:tasks.workunit.client.0.smithi100.stdout:2/759: unlink d5/d12/d8e/l90 0 2024-04-30T23:15:59.348 INFO:tasks.workunit.client.0.smithi100.stdout:5/670: unlink d1/d19/c4b 0 2024-04-30T23:15:59.350 INFO:tasks.workunit.client.0.smithi100.stdout:2/760: mknod d5/d12/d8e/dae/dbf/ced 0 2024-04-30T23:15:59.350 INFO:tasks.workunit.client.0.smithi100.stdout:2/761: write d5/d47/fdd [212998,44496] 0 2024-04-30T23:15:59.350 INFO:tasks.workunit.client.0.smithi100.stdout:5/671: creat d1/d2c/fde x:0 0 0 2024-04-30T23:15:59.351 INFO:tasks.workunit.client.0.smithi100.stdout:5/672: getdents d1/d2c/d60/d66/d75 0 2024-04-30T23:15:59.354 INFO:tasks.workunit.client.0.smithi100.stdout:3/636: dwrite d1/d14/d15/d32/d71/fb0 [0,4194304] 0 2024-04-30T23:15:59.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/614: dwrite d2/d7/f26 [0,4194304] 0 2024-04-30T23:15:59.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/615: chown d2/d29/d67/f99 3664 1 2024-04-30T23:15:59.362 INFO:tasks.workunit.client.0.smithi100.stdout:8/616: rename d2/d89/d10/f19 to d2/d97/fc4 0 2024-04-30T23:15:59.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/673: dread d1/d12/d24/d34/f9f [0,4194304] 0 2024-04-30T23:15:59.364 INFO:tasks.workunit.client.0.smithi100.stdout:8/617: symlink d2/d89/lc5 0 2024-04-30T23:15:59.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/674: chown d1/d12/d1a/d76/d77/d8c/ld6 12590 1 2024-04-30T23:15:59.365 INFO:tasks.workunit.client.0.smithi100.stdout:8/618: mknod d2/d7/d18/cc6 0 2024-04-30T23:15:59.367 INFO:tasks.workunit.client.0.smithi100.stdout:5/675: creat d1/d5f/fdf x:0 0 0 2024-04-30T23:15:59.367 INFO:tasks.workunit.client.0.smithi100.stdout:5/676: chown d1/d12/d1a/d5b/dc0 33587383 1 2024-04-30T23:15:59.367 INFO:tasks.workunit.client.0.smithi100.stdout:5/677: readlink d1/d12/d1a/l80 0 2024-04-30T23:15:59.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/619: mkdir d2/d29/d71/d86/dc7 0 2024-04-30T23:15:59.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/620: read d2/d7/d18/fa6 [146362,124402] 0 2024-04-30T23:15:59.369 INFO:tasks.workunit.client.0.smithi100.stdout:5/678: creat d1/d5f/fe0 x:0 0 0 2024-04-30T23:15:59.370 INFO:tasks.workunit.client.0.smithi100.stdout:5/679: mkdir d1/d12/de1 0 2024-04-30T23:15:59.371 INFO:tasks.workunit.client.0.smithi100.stdout:8/621: rename d2/f8 to d2/d7/d18/fc8 0 2024-04-30T23:15:59.371 INFO:tasks.workunit.client.0.smithi100.stdout:8/622: write d2/f3e [4906065,112618] 0 2024-04-30T23:15:59.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/680: getdents d1 0 2024-04-30T23:15:59.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/637: dwrite d1/d14/d15/d32/d6f/da2/d26/f9e [0,4194304] 0 2024-04-30T23:15:59.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/638: getdents d1/d14/d15/d32/d6f/da2/d6d/da8 0 2024-04-30T23:15:59.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/639: readlink d1/d14/d2b/l46 0 2024-04-30T23:15:59.375 INFO:tasks.workunit.client.0.smithi100.stdout:5/681: rename d1/d12/d24/d34/l8d to d1/d3e/d99/dbf/dd0/le2 0 2024-04-30T23:15:59.376 INFO:tasks.workunit.client.0.smithi100.stdout:5/682: fdatasync d1/d12/d24/f4e 0 2024-04-30T23:15:59.378 INFO:tasks.workunit.client.0.smithi100.stdout:5/683: mknod d1/d2c/d60/d66/d71/db6/ce3 0 2024-04-30T23:15:59.378 INFO:tasks.workunit.client.0.smithi100.stdout:5/684: truncate d1/d37/fdb 325022 0 2024-04-30T23:15:59.379 INFO:tasks.workunit.client.0.smithi100.stdout:5/685: link d1/d5f/fe0 d1/d3e/d9b/fe4 0 2024-04-30T23:15:59.380 INFO:tasks.workunit.client.0.smithi100.stdout:5/686: creat d1/d12/d74/fe5 x:0 0 0 2024-04-30T23:15:59.380 INFO:tasks.workunit.client.0.smithi100.stdout:5/687: readlink d1/l10 0 2024-04-30T23:15:59.382 INFO:tasks.workunit.client.0.smithi100.stdout:5/688: symlink d1/d2c/d60/d66/d71/db6/dd4/d85/le6 0 2024-04-30T23:15:59.394 INFO:tasks.workunit.client.0.smithi100.stdout:3/640: dwrite d1/d14/d15/d32/d6f/da2/f74 [0,4194304] 0 2024-04-30T23:15:59.394 INFO:tasks.workunit.client.0.smithi100.stdout:3/641: write d1/d14/d21/f2d [1203530,52807] 0 2024-04-30T23:15:59.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/642: rename d1/d14/d21/d67/l86 to d1/d14/d21/d67/lbe 0 2024-04-30T23:15:59.397 INFO:tasks.workunit.client.0.smithi100.stdout:3/643: rename d1/d14/d15/d27/d34/l3d to d1/d14/d21/d67/lbf 0 2024-04-30T23:15:59.402 INFO:tasks.workunit.client.0.smithi100.stdout:5/689: dwrite d1/d12/d1a/d76/fd2 [0,4194304] 0 2024-04-30T23:15:59.402 INFO:tasks.workunit.client.0.smithi100.stdout:5/690: stat d1/fa2 0 2024-04-30T23:15:59.404 INFO:tasks.workunit.client.0.smithi100.stdout:5/691: truncate d1/d19/f1e 7084346 0 2024-04-30T23:15:59.404 INFO:tasks.workunit.client.0.smithi100.stdout:5/692: truncate d1/d12/d24/f4e 639061 0 2024-04-30T23:15:59.404 INFO:tasks.workunit.client.0.smithi100.stdout:5/693: stat d1/d12/d27/f6b 0 2024-04-30T23:15:59.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/694: dread d1/f1b [0,4194304] 0 2024-04-30T23:15:59.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/695: stat d1/d12/d27/f29 0 2024-04-30T23:15:59.417 INFO:tasks.workunit.client.0.smithi100.stdout:5/696: mknod d1/d2c/d60/d66/d71/dcf/ce7 0 2024-04-30T23:15:59.417 INFO:tasks.workunit.client.0.smithi100.stdout:5/697: write d1/d12/f21 [768389,69923] 0 2024-04-30T23:15:59.417 INFO:tasks.workunit.client.0.smithi100.stdout:5/698: write d1/d3e/d9b/fe4 [1047874,19805] 0 2024-04-30T23:15:59.417 INFO:tasks.workunit.client.0.smithi100.stdout:5/699: dread - d1/d5f/f68 zero size 2024-04-30T23:15:59.417 INFO:tasks.workunit.client.0.smithi100.stdout:5/700: mkdir d1/d12/d24/de8 0 2024-04-30T23:15:59.419 INFO:tasks.workunit.client.0.smithi100.stdout:3/644: dwrite d1/d14/d15/d27/d5d/f6c [0,4194304] 0 2024-04-30T23:15:59.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/645: rename d1/ff to d1/d14/d15/d32/d6f/da2/d6d/d7b/d90/fc0 0 2024-04-30T23:15:59.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/646: readlink d1/d38/lbd 0 2024-04-30T23:15:59.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/647: dread - d1/d14/d15/d32/d92/f9d zero size 2024-04-30T23:15:59.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/648: write d1/d14/d15/d32/d6f/da2/f39 [3975212,63837] 0 2024-04-30T23:15:59.427 INFO:tasks.workunit.client.0.smithi100.stdout:3/649: creat d1/d38/fc1 x:0 0 0 2024-04-30T23:15:59.428 INFO:tasks.workunit.client.0.smithi100.stdout:3/650: read - d1/d14/d15/d32/d6f/da2/d6d/fac zero size 2024-04-30T23:15:59.428 INFO:tasks.workunit.client.0.smithi100.stdout:5/701: write d1/d12/f18 [5485412,56612] 0 2024-04-30T23:15:59.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/651: creat d1/d14/d15/d27/fc2 x:0 0 0 2024-04-30T23:15:59.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/652: stat d1/d14/d15/d32/d6f/da2/d26/l24 0 2024-04-30T23:15:59.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/653: readlink d1/d14/d15/d32/d6f/da2/l4f 0 2024-04-30T23:15:59.430 INFO:tasks.workunit.client.0.smithi100.stdout:3/654: creat d1/d14/d15/d32/d71/fc3 x:0 0 0 2024-04-30T23:15:59.433 INFO:tasks.workunit.client.0.smithi100.stdout:3/655: creat d1/d14/d21/fc4 x:0 0 0 2024-04-30T23:15:59.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/702: dread d1/d12/d24/d34/f9f [0,4194304] 0 2024-04-30T23:15:59.453 INFO:tasks.workunit.client.0.smithi100.stdout:5/703: dread d1/d19/d7f/f89 [0,4194304] 0 2024-04-30T23:15:59.454 INFO:tasks.workunit.client.0.smithi100.stdout:5/704: creat d1/d12/d74/fe9 x:0 0 0 2024-04-30T23:15:59.455 INFO:tasks.workunit.client.0.smithi100.stdout:5/705: mkdir d1/d12/de1/dea 0 2024-04-30T23:15:59.456 INFO:tasks.workunit.client.0.smithi100.stdout:3/656: dwrite d1/d14/d15/d27/fc2 [0,4194304] 0 2024-04-30T23:15:59.456 INFO:tasks.workunit.client.0.smithi100.stdout:3/657: write d1/d38/fc1 [299161,72712] 0 2024-04-30T23:15:59.460 INFO:tasks.workunit.client.0.smithi100.stdout:3/658: dread d1/d38/f78 [0,4194304] 0 2024-04-30T23:15:59.468 INFO:tasks.workunit.client.0.smithi100.stdout:5/706: dread d1/d19/f46 [0,4194304] 0 2024-04-30T23:15:59.469 INFO:tasks.workunit.client.0.smithi100.stdout:5/707: truncate d1/d37/fdb 970827 0 2024-04-30T23:15:59.476 INFO:tasks.workunit.client.0.smithi100.stdout:3/659: write d1/d14/d15/d27/d34/f54 [3685397,14902] 0 2024-04-30T23:15:59.476 INFO:tasks.workunit.client.0.smithi100.stdout:3/660: chown d1/d14/d15/d32/d6f/da2/f39 1028817 1 2024-04-30T23:15:59.484 INFO:tasks.workunit.client.0.smithi100.stdout:1/531: sync 2024-04-30T23:15:59.484 INFO:tasks.workunit.client.0.smithi100.stdout:6/583: sync 2024-04-30T23:15:59.484 INFO:tasks.workunit.client.0.smithi100.stdout:1/532: fsync d3/d16/d20/f81 0 2024-04-30T23:15:59.486 INFO:tasks.workunit.client.0.smithi100.stdout:6/584: link d7/d9/d86/d3e/d6b/fb9 d7/db/dd1/fd4 0 2024-04-30T23:15:59.486 INFO:tasks.workunit.client.0.smithi100.stdout:6/585: fdatasync d7/d9/d86/d1b/f6f 0 2024-04-30T23:15:59.492 INFO:tasks.workunit.client.0.smithi100.stdout:3/661: write d1/d14/d15/d32/f3e [1513579,107538] 0 2024-04-30T23:15:59.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/708: dwrite d1/fe [0,4194304] 0 2024-04-30T23:15:59.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/709: dread - d1/d12/d1a/d76/da9/fba zero size 2024-04-30T23:15:59.495 INFO:tasks.workunit.client.0.smithi100.stdout:5/710: rmdir d1/d12/d1a/d76/da9 39 2024-04-30T23:15:59.498 INFO:tasks.workunit.client.0.smithi100.stdout:5/711: write d1/d12/f23 [842036,60240] 0 2024-04-30T23:15:59.503 INFO:tasks.workunit.client.0.smithi100.stdout:6/586: write d7/d9/d86/d62/fb5 [1284425,20394] 0 2024-04-30T23:15:59.503 INFO:tasks.workunit.client.0.smithi100.stdout:6/587: stat d7/df/d23/d24/dbf/dcf 0 2024-04-30T23:15:59.505 INFO:tasks.workunit.client.0.smithi100.stdout:6/588: creat d7/d9/d86/dc7/fd5 x:0 0 0 2024-04-30T23:15:59.506 INFO:tasks.workunit.client.0.smithi100.stdout:6/589: mkdir d7/d9/d86/d3e/dd6 0 2024-04-30T23:15:59.510 INFO:tasks.workunit.client.0.smithi100.stdout:5/712: write d1/d12/f15 [34907,124292] 0 2024-04-30T23:15:59.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/662: dwrite d1/d14/d15/d2c/f95 [0,4194304] 0 2024-04-30T23:15:59.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/663: truncate d1/f8d 1261502 0 2024-04-30T23:15:59.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/664: chown d1/d14/d21 10 1 2024-04-30T23:15:59.523 INFO:tasks.workunit.client.0.smithi100.stdout:5/713: write d1/d19/f1e [1050078,95982] 0 2024-04-30T23:15:59.526 INFO:tasks.workunit.client.0.smithi100.stdout:5/714: write d1/f30 [519997,53237] 0 2024-04-30T23:15:59.527 INFO:tasks.workunit.client.0.smithi100.stdout:5/715: symlink d1/d2c/leb 0 2024-04-30T23:15:59.539 INFO:tasks.workunit.client.0.smithi100.stdout:3/665: dwrite d1/d14/f5f [4194304,4194304] 0 2024-04-30T23:15:59.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/666: rename d1/d38/l52 to d1/d14/d15/d32/d6f/da2/d6d/d81/dae/lc5 0 2024-04-30T23:15:59.542 INFO:tasks.workunit.client.0.smithi100.stdout:3/667: mkdir d1/dc6 0 2024-04-30T23:15:59.542 INFO:tasks.workunit.client.0.smithi100.stdout:3/668: read d1/d14/d15/d27/d34/f54 [2247137,41393] 0 2024-04-30T23:15:59.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:15:59 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:15:59.551 INFO:tasks.workunit.client.0.smithi100.stdout:5/716: dwrite d1/d3e/d99/fc2 [4194304,4194304] 0 2024-04-30T23:15:59.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:15:59 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:15:59.554 INFO:tasks.workunit.client.0.smithi100.stdout:3/669: dread d1/fa [0,4194304] 0 2024-04-30T23:15:59.554 INFO:tasks.workunit.client.0.smithi100.stdout:5/717: creat d1/d12/fec x:0 0 0 2024-04-30T23:15:59.555 INFO:tasks.workunit.client.0.smithi100.stdout:3/670: mknod d1/d14/d15/d32/d6f/da2/d6d/da8/cc7 0 2024-04-30T23:15:59.574 INFO:tasks.workunit.client.0.smithi100.stdout:5/718: dwrite d1/f30 [0,4194304] 0 2024-04-30T23:15:59.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/719: creat d1/d2c/d60/d66/fed x:0 0 0 2024-04-30T23:15:59.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/683: sync 2024-04-30T23:15:59.593 INFO:tasks.workunit.client.0.smithi100.stdout:5/720: dwrite d1/d2c/d60/f65 [0,4194304] 0 2024-04-30T23:15:59.609 INFO:tasks.workunit.client.0.smithi100.stdout:5/721: dwrite d1/d3e/d9b/fb5 [0,4194304] 0 2024-04-30T23:15:59.609 INFO:tasks.workunit.client.0.smithi100.stdout:5/722: chown d1/d12/d24/l38 1121 1 2024-04-30T23:15:59.611 INFO:tasks.workunit.client.0.smithi100.stdout:5/723: creat d1/d12/d24/fee x:0 0 0 2024-04-30T23:15:59.624 INFO:tasks.workunit.client.0.smithi100.stdout:5/724: dread d1/d12/d1a/f32 [0,4194304] 0 2024-04-30T23:15:59.624 INFO:tasks.workunit.client.0.smithi100.stdout:5/725: readlink d1/d12/d1a/d76/d77/d8c/ld8 0 2024-04-30T23:15:59.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/726: symlink d1/d3e/d99/lef 0 2024-04-30T23:15:59.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/727: truncate d1/d12/d1a/f32 4733854 0 2024-04-30T23:15:59.626 INFO:tasks.workunit.client.0.smithi100.stdout:5/728: creat d1/d12/ff0 x:0 0 0 2024-04-30T23:15:59.626 INFO:tasks.workunit.client.0.smithi100.stdout:5/729: dread - d1/d12/d24/d34/f69 zero size 2024-04-30T23:15:59.699 INFO:tasks.workunit.client.0.smithi100.stdout:9/592: sync 2024-04-30T23:15:59.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/700: sync 2024-04-30T23:15:59.700 INFO:tasks.workunit.client.0.smithi100.stdout:9/593: fdatasync d4/d9/d51/d89/fa9 0 2024-04-30T23:15:59.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/701: write d19/d1a/d21/d3c/f7f [5166891,67909] 0 2024-04-30T23:15:59.701 INFO:tasks.workunit.client.0.smithi100.stdout:9/594: creat d4/d9/d50/fd6 x:0 0 0 2024-04-30T23:15:59.701 INFO:tasks.workunit.client.0.smithi100.stdout:9/595: read d4/f5 [1137434,49667] 0 2024-04-30T23:15:59.701 INFO:tasks.workunit.client.0.smithi100.stdout:4/702: mknod d19/d1a/d45/cdd 0 2024-04-30T23:15:59.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/596: rename d4/d7/d8/d37/d58/dcb to d4/d9/d93/dd7 0 2024-04-30T23:15:59.710 INFO:tasks.workunit.client.0.smithi100.stdout:9/597: dread d4/d9/d10/d7f/f9a [0,4194304] 0 2024-04-30T23:15:59.710 INFO:tasks.workunit.client.0.smithi100.stdout:9/598: truncate d4/d7/fca 1990950 0 2024-04-30T23:15:59.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/599: mknod d4/d7/d8/cd8 0 2024-04-30T23:15:59.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/600: write d4/d9/d10/d7f/fce [336480,13906] 0 2024-04-30T23:15:59.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/703: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:59.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/704: write d19/d1a/d6d/d4e/d6e/f80 [60535,69405] 0 2024-04-30T23:15:59.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/705: chown d19/d33 1200122807 1 2024-04-30T23:15:59.722 INFO:tasks.workunit.client.0.smithi100.stdout:4/706: creat d19/d33/d3f/d40/fde x:0 0 0 2024-04-30T23:15:59.722 INFO:tasks.workunit.client.0.smithi100.stdout:4/707: write d19/d1a/d21/d4a/fa6 [155995,103153] 0 2024-04-30T23:15:59.722 INFO:tasks.workunit.client.0.smithi100.stdout:4/708: dread - d19/d1a/d29/dae/fbf zero size 2024-04-30T23:15:59.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/709: creat d19/d1a/d21/d4a/d53/fdf x:0 0 0 2024-04-30T23:15:59.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/710: unlink d19/d1a/d21/f2b 0 2024-04-30T23:15:59.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/711: chown d19/d1a/d45/lac 76 1 2024-04-30T23:15:59.727 INFO:tasks.workunit.client.0.smithi100.stdout:4/712: link d19/d33/d3f/f56 d19/d1a/d29/fe0 0 2024-04-30T23:15:59.729 INFO:tasks.workunit.client.0.smithi100.stdout:4/713: symlink d19/d1a/d95/le1 0 2024-04-30T23:15:59.736 INFO:tasks.workunit.client.0.smithi100.stdout:9/601: dwrite d4/d7/d60/d69/fa4 [0,4194304] 0 2024-04-30T23:15:59.736 INFO:tasks.workunit.client.0.smithi100.stdout:9/602: write d4/d7/fd5 [473244,61300] 0 2024-04-30T23:15:59.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/603: dread f2 [0,4194304] 0 2024-04-30T23:15:59.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/604: mkdir d4/d9/d93/dd7/dd9 0 2024-04-30T23:15:59.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/605: chown d4/d7/d5d/cac 3910 1 2024-04-30T23:15:59.744 INFO:tasks.workunit.client.0.smithi100.stdout:9/606: mkdir d4/d9/d10/db9/dc4/dda 0 2024-04-30T23:15:59.745 INFO:tasks.workunit.client.0.smithi100.stdout:9/607: mkdir d4/d9/d6f/ddb 0 2024-04-30T23:15:59.746 INFO:tasks.workunit.client.0.smithi100.stdout:9/608: truncate d4/d9/d10/f4a 9312460 0 2024-04-30T23:15:59.746 INFO:tasks.workunit.client.0.smithi100.stdout:9/609: truncate d4/d7/d60/d69/fcf 215783 0 2024-04-30T23:15:59.746 INFO:tasks.workunit.client.0.smithi100.stdout:9/610: fsync d4/d7/d8/f86 0 2024-04-30T23:15:59.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/714: write d19/d1a/d21/d4a/f6a [3054000,99022] 0 2024-04-30T23:15:59.750 INFO:tasks.workunit.client.0.smithi100.stdout:4/715: creat d19/d1a/d6d/fe2 x:0 0 0 2024-04-30T23:15:59.752 INFO:tasks.workunit.client.0.smithi100.stdout:4/716: creat d19/d33/d3f/d40/fe3 x:0 0 0 2024-04-30T23:15:59.752 INFO:tasks.workunit.client.0.smithi100.stdout:9/611: dread d4/d9/f7d [0,4194304] 0 2024-04-30T23:15:59.753 INFO:tasks.workunit.client.0.smithi100.stdout:6/590: sync 2024-04-30T23:15:59.753 INFO:tasks.workunit.client.0.smithi100.stdout:7/771: sync 2024-04-30T23:15:59.754 INFO:tasks.workunit.client.0.smithi100.stdout:9/612: rename d4/d9/d51/fba to d4/d7/d8/fdc 0 2024-04-30T23:15:59.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/591: mkdir d7/df/d23/d2b/d42/dd7 0 2024-04-30T23:15:59.756 INFO:tasks.workunit.client.0.smithi100.stdout:7/772: dread d0/d1b/d60/d80/f90 [0,4194304] 0 2024-04-30T23:15:59.757 INFO:tasks.workunit.client.0.smithi100.stdout:7/773: mknod d0/d1b/d60/d80/d91/c100 0 2024-04-30T23:15:59.758 INFO:tasks.workunit.client.0.smithi100.stdout:7/774: mknod d0/df/d4f/c101 0 2024-04-30T23:15:59.759 INFO:tasks.workunit.client.0.smithi100.stdout:7/775: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/f96 1217788 0 2024-04-30T23:15:59.768 INFO:tasks.workunit.client.0.smithi100.stdout:9/613: dread f0 [4194304,4194304] 0 2024-04-30T23:15:59.770 INFO:tasks.workunit.client.0.smithi100.stdout:9/614: rename d4/d7/d8/d19/f29 to d4/d9/d51/d89/dbb/dcc/fdd 0 2024-04-30T23:15:59.771 INFO:tasks.workunit.client.0.smithi100.stdout:4/717: dwrite d19/f2f [0,4194304] 0 2024-04-30T23:15:59.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/718: creat d19/d1a/d6d/d64/dc8/fe4 x:0 0 0 2024-04-30T23:15:59.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/719: chown d19/d33/d3f/d40/f97 781192 1 2024-04-30T23:15:59.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/720: stat d19/d1a/d6d/d4e/fc1 0 2024-04-30T23:15:59.777 INFO:tasks.workunit.client.0.smithi100.stdout:4/721: symlink d19/d1a/d6d/d4e/d6e/dcb/le5 0 2024-04-30T23:15:59.778 INFO:tasks.workunit.client.0.smithi100.stdout:4/722: write d19/d1a/d6d/d64/d78/d8c/fcf [826035,75667] 0 2024-04-30T23:15:59.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/615: dread d4/d9/d10/d7f/fce [0,4194304] 0 2024-04-30T23:15:59.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/616: dread - d4/fb3 zero size 2024-04-30T23:15:59.780 INFO:tasks.workunit.client.0.smithi100.stdout:4/723: creat d19/d1a/d6d/d4e/d6e/dcb/fe6 x:0 0 0 2024-04-30T23:15:59.780 INFO:tasks.workunit.client.0.smithi100.stdout:4/724: write d19/d1a/d21/d4a/d53/f76 [425693,30257] 0 2024-04-30T23:15:59.781 INFO:tasks.workunit.client.0.smithi100.stdout:9/617: rename f0 to d4/d9/d93/fde 0 2024-04-30T23:15:59.782 INFO:tasks.workunit.client.0.smithi100.stdout:9/618: dread - d4/d7/d8/d37/d58/f99 zero size 2024-04-30T23:15:59.782 INFO:tasks.workunit.client.0.smithi100.stdout:4/725: getdents d19/d1a/d21 0 2024-04-30T23:15:59.783 INFO:tasks.workunit.client.0.smithi100.stdout:4/726: fsync d19/d1a/d6d/f3d 0 2024-04-30T23:15:59.783 INFO:tasks.workunit.client.0.smithi100.stdout:4/727: getdents d19/d1a/d6d/d4e/d6e/dcb/dd3 0 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/728: creat d19/d1a/d21/d4a/d53/d5e/fe7 x:0 0 0 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/729: truncate d19/d1a/d6d/d4e/f9a 855686 0 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:8/623: sync 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:0/684: sync 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:2/762: sync 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/671: sync 2024-04-30T23:15:59.784 INFO:tasks.workunit.client.0.smithi100.stdout:7/776: write d0/df/d4f/d53/f5a [2202806,44124] 0 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/592: dwrite d7/f21 [0,4194304] 0 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:1/533: sync 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/593: chown d7/df/d23/d2b/d42/d84 4874759 1 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:5/730: sync 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:4/730: rename d19/d1a/d45/f92 to d19/d33/d7d/fe8 0 2024-04-30T23:15:59.785 INFO:tasks.workunit.client.0.smithi100.stdout:4/731: fsync d19/d1a/d21/f83 0 2024-04-30T23:15:59.787 INFO:tasks.workunit.client.0.smithi100.stdout:8/624: getdents d2/d89/d10/d17 0 2024-04-30T23:15:59.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/672: mkdir d1/d14/d2f/dc8 0 2024-04-30T23:15:59.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/777: mknod d0/df/d4f/d53/dd2/c102 0 2024-04-30T23:15:59.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/778: chown d0/df 2400988 1 2024-04-30T23:15:59.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/779: getdents d0/df/d4f/d93/db1/ded 0 2024-04-30T23:15:59.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/534: mkdir d3/d99 0 2024-04-30T23:15:59.792 INFO:tasks.workunit.client.0.smithi100.stdout:5/731: creat d1/d19/ff1 x:0 0 0 2024-04-30T23:15:59.793 INFO:tasks.workunit.client.0.smithi100.stdout:5/732: fsync d1/d12/d27/f4c 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/732: stat d19/d1a/d29/c63 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/733: write d19/d1a/d29/fe0 [2820453,936] 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/734: write d19/d1a/d21/d4a/d53/d5e/fb4 [1079672,23862] 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/735: write d19/d1a/d6d/d4e/d6e/f9f [5000127,106180] 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/736: readlink d19/d33/d3f/l7c 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/625: truncate d2/f3 1237367 0 2024-04-30T23:15:59.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/673: creat d1/d14/d15/d32/d7d/fc9 x:0 0 0 2024-04-30T23:15:59.798 INFO:tasks.workunit.client.0.smithi100.stdout:0/685: dread d2/d50/d30/d32/f9d [0,4194304] 0 2024-04-30T23:15:59.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/737: rename d19/d1a/d29/d65/lc6 to d19/d1a/d21/d4a/d53/d5e/le9 0 2024-04-30T23:15:59.800 INFO:tasks.workunit.client.0.smithi100.stdout:3/674: mknod d1/d38/cca 0 2024-04-30T23:15:59.800 INFO:tasks.workunit.client.0.smithi100.stdout:7/780: link d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dd4/ff2 d0/d1d/d5e/d6a/d4b/d79/d2a/f103 0 2024-04-30T23:15:59.801 INFO:tasks.workunit.client.0.smithi100.stdout:7/781: chown d0/d1b/d60/d48/d4a/f4d 60263 1 2024-04-30T23:15:59.801 INFO:tasks.workunit.client.0.smithi100.stdout:7/782: stat d0/df/d4f/d53/f59 0 2024-04-30T23:15:59.801 INFO:tasks.workunit.client.0.smithi100.stdout:4/738: mkdir d19/d1a/d6d/d64/d78/dea 0 2024-04-30T23:15:59.803 INFO:tasks.workunit.client.0.smithi100.stdout:3/675: mknod d1/d14/d15/d32/ccb 0 2024-04-30T23:15:59.804 INFO:tasks.workunit.client.0.smithi100.stdout:3/676: rmdir d1/d14/d15/d32/d7d 39 2024-04-30T23:15:59.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/619: dwrite d4/d7/d8/d37/f65 [0,4194304] 0 2024-04-30T23:15:59.819 INFO:tasks.workunit.client.0.smithi100.stdout:0/686: dread d2/d50/d38/d6c/fcb [0,4194304] 0 2024-04-30T23:15:59.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/739: dread d19/d1a/d6d/d4e/d6e/f9f [4194304,4194304] 0 2024-04-30T23:15:59.820 INFO:tasks.workunit.client.0.smithi100.stdout:4/740: readlink d19/d1a/d6d/d4e/d6e/dcb/le5 0 2024-04-30T23:15:59.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/687: chown d2/d50/d30/dc7/cb5 412802 1 2024-04-30T23:15:59.821 INFO:tasks.workunit.client.0.smithi100.stdout:0/688: mkdir d2/d50/d30/dd4 0 2024-04-30T23:15:59.822 INFO:tasks.workunit.client.0.smithi100.stdout:0/689: fdatasync d2/d14/d35/d57/f95 0 2024-04-30T23:15:59.822 INFO:tasks.workunit.client.0.smithi100.stdout:4/741: mkdir d19/d1a/d21/d4a/d53/deb 0 2024-04-30T23:15:59.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/742: mkdir d19/d1a/d6d/d64/d78/dec 0 2024-04-30T23:15:59.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/743: readlink d19/d33/d3f/l7c 0 2024-04-30T23:15:59.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/744: write f13 [3912981,36882] 0 2024-04-30T23:15:59.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/745: dread - d19/d1a/d95/fb5 zero size 2024-04-30T23:15:59.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/594: dwrite d7/db/d3b/f6d [0,4194304] 0 2024-04-30T23:15:59.831 INFO:tasks.workunit.client.0.smithi100.stdout:1/535: dwrite d3/d16/d20/f22 [0,4194304] 0 2024-04-30T23:15:59.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/595: mkdir d7/df/d23/d24/d2e/d37/d85/db4/dc6/dd8 0 2024-04-30T23:15:59.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/677: dwrite d1/d14/d15/d32/d7d/f84 [0,4194304] 0 2024-04-30T23:15:59.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/678: readlink d1/d38/lad 0 2024-04-30T23:15:59.835 INFO:tasks.workunit.client.0.smithi100.stdout:1/536: creat d3/d16/d20/f9a x:0 0 0 2024-04-30T23:15:59.835 INFO:tasks.workunit.client.0.smithi100.stdout:9/620: dread d4/d9/d10/d7f/f95 [0,4194304] 0 2024-04-30T23:15:59.836 INFO:tasks.workunit.client.0.smithi100.stdout:3/679: getdents d1/d14/d15/d32/d6f/da2/d6d/d81 0 2024-04-30T23:15:59.838 INFO:tasks.workunit.client.0.smithi100.stdout:0/690: write d2/d50/d38/d6c/fcb [6104314,85408] 0 2024-04-30T23:15:59.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/626: dwrite d2/d29/d9e/daf/fbf [0,4194304] 0 2024-04-30T23:15:59.841 INFO:tasks.workunit.client.0.smithi100.stdout:1/537: creat d3/d99/f9b x:0 0 0 2024-04-30T23:15:59.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/538: read d3/db/f3e [525828,126282] 0 2024-04-30T23:15:59.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/539: write d3/d16/d20/f45 [4561348,66880] 0 2024-04-30T23:15:59.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/540: fdatasync d3/d16/d20/d24/d69/d5e/f8b 0 2024-04-30T23:15:59.845 INFO:tasks.workunit.client.0.smithi100.stdout:1/541: symlink d3/d99/l9c 0 2024-04-30T23:15:59.847 INFO:tasks.workunit.client.0.smithi100.stdout:1/542: truncate d3/f6a 483958 0 2024-04-30T23:15:59.850 INFO:tasks.workunit.client.0.smithi100.stdout:4/746: dwrite d19/d33/d3f/fc5 [0,4194304] 0 2024-04-30T23:15:59.855 INFO:tasks.workunit.client.0.smithi100.stdout:4/747: rename d19/d1a/d21/d4a/d53/d5e/le9 to d19/d1a/led 0 2024-04-30T23:15:59.855 INFO:tasks.workunit.client.0.smithi100.stdout:4/748: chown d19/d1a/d21/d4a/d53/deb 410312 1 2024-04-30T23:15:59.856 INFO:tasks.workunit.client.0.smithi100.stdout:4/749: chown d19/d1a/d21/d3c/fb9 9320245 1 2024-04-30T23:15:59.857 INFO:tasks.workunit.client.0.smithi100.stdout:4/750: rmdir d19/d1a/d6d/d64 39 2024-04-30T23:15:59.857 INFO:tasks.workunit.client.0.smithi100.stdout:3/680: write d1/d14/d21/d67/f77 [3834485,115384] 0 2024-04-30T23:15:59.860 INFO:tasks.workunit.client.0.smithi100.stdout:3/681: creat d1/d14/d2b/d57/daf/fcc x:0 0 0 2024-04-30T23:15:59.861 INFO:tasks.workunit.client.0.smithi100.stdout:3/682: mknod d1/d14/d15/d27/d34/ccd 0 2024-04-30T23:15:59.865 INFO:tasks.workunit.client.0.smithi100.stdout:0/691: dwrite d2/d50/d30/d32/f84 [0,4194304] 0 2024-04-30T23:15:59.865 INFO:tasks.workunit.client.0.smithi100.stdout:0/692: fdatasync d2/d50/f4f 0 2024-04-30T23:15:59.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/693: unlink d2/d4c/d68/f69 0 2024-04-30T23:15:59.868 INFO:tasks.workunit.client.0.smithi100.stdout:8/627: write d2/d97/fa8 [1825755,8154] 0 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:6/596: dwrite d7/db/fa8 [0,4194304] 0 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/628: truncate d2/d89/d10/d17/d8f/fb7 1031469 0 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/629: fsync d2/d29/f47 0 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:6/597: write d7/d9/d86/db0/f7b [1016160,78827] 0 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:6/598: read - d7/db/d3b/f83 zero size 2024-04-30T23:15:59.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/694: rmdir d2/d50/d30/d32 39 2024-04-30T23:15:59.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/630: symlink d2/d89/d10/d52/d9a/db9/lc9 0 2024-04-30T23:15:59.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/621: dwrite d4/d9/d51/d89/dbb/fd4 [0,4194304] 0 2024-04-30T23:15:59.873 INFO:tasks.workunit.client.0.smithi100.stdout:6/599: rename d7/f27 to d7/df/d23/d24/d2e/d9f/fd9 0 2024-04-30T23:15:59.873 INFO:tasks.workunit.client.0.smithi100.stdout:6/600: chown d7/d9/f12 7 1 2024-04-30T23:15:59.877 INFO:tasks.workunit.client.0.smithi100.stdout:1/543: dread d3/d18/f43 [0,4194304] 0 2024-04-30T23:15:59.880 INFO:tasks.workunit.client.0.smithi100.stdout:9/622: creat d4/d9/d10/db9/dc4/fdf x:0 0 0 2024-04-30T23:15:59.882 INFO:tasks.workunit.client.0.smithi100.stdout:9/623: fdatasync d4/d7/d8/d37/f85 0 2024-04-30T23:15:59.885 INFO:tasks.workunit.client.0.smithi100.stdout:3/683: dread d1/d38/f5c [0,4194304] 0 2024-04-30T23:15:59.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/751: dwrite d19/d1a/d6d/fbe [0,4194304] 0 2024-04-30T23:15:59.889 INFO:tasks.workunit.client.0.smithi100.stdout:3/684: mknod d1/d14/d15/d32/d71/cce 0 2024-04-30T23:15:59.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/752: truncate d19/d1a/d21/d4a/d53/d5e/f6b 279176 0 2024-04-30T23:15:59.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/753: dread - d19/d1a/d6d/d4e/d6e/fa8 zero size 2024-04-30T23:15:59.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/754: readlink d19/d1a/d95/le1 0 2024-04-30T23:15:59.892 INFO:tasks.workunit.client.0.smithi100.stdout:4/755: dread d19/f6f [0,4194304] 0 2024-04-30T23:15:59.893 INFO:tasks.workunit.client.0.smithi100.stdout:4/756: chown d19/d1a/d6d/d64 26028537 1 2024-04-30T23:15:59.893 INFO:tasks.workunit.client.0.smithi100.stdout:3/685: unlink d1/d14/d15/d32/d6f/da2/d26/f9e 0 2024-04-30T23:15:59.895 INFO:tasks.workunit.client.0.smithi100.stdout:3/686: mknod d1/d14/d15/d27/d34/ccf 0 2024-04-30T23:15:59.896 INFO:tasks.workunit.client.0.smithi100.stdout:3/687: dread - d1/d14/d15/f62 zero size 2024-04-30T23:15:59.897 INFO:tasks.workunit.client.0.smithi100.stdout:3/688: symlink d1/d14/d2b/d57/ld0 0 2024-04-30T23:15:59.898 INFO:tasks.workunit.client.0.smithi100.stdout:3/689: mkdir d1/d14/d15/d27/d5d/dd1 0 2024-04-30T23:15:59.898 INFO:tasks.workunit.client.0.smithi100.stdout:3/690: fsync d1/d14/d21/fc4 0 2024-04-30T23:15:59.901 INFO:tasks.workunit.client.0.smithi100.stdout:8/631: read d2/d29/f2e [1413033,51401] 0 2024-04-30T23:15:59.901 INFO:tasks.workunit.client.0.smithi100.stdout:6/601: dwrite d7/d9/d86/d3e/d6b/fb8 [0,4194304] 0 2024-04-30T23:15:59.901 INFO:tasks.workunit.client.0.smithi100.stdout:0/695: dwrite d2/dba/fcd [0,4194304] 0 2024-04-30T23:15:59.901 INFO:tasks.workunit.client.0.smithi100.stdout:0/696: chown d2/d50/d30/dc7/cb5 1767 1 2024-04-30T23:15:59.903 INFO:tasks.workunit.client.0.smithi100.stdout:6/602: creat d7/d9/d86/d3e/dd6/fda x:0 0 0 2024-04-30T23:15:59.904 INFO:tasks.workunit.client.0.smithi100.stdout:8/632: symlink d2/d7/d18/d3a/lca 0 2024-04-30T23:15:59.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/697: mknod d2/d50/d30/d32/cd5 0 2024-04-30T23:15:59.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/698: stat d2/d4c/f89 0 2024-04-30T23:15:59.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/699: truncate d2/d50/d30/d32/f84 4450114 0 2024-04-30T23:15:59.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/603: link d7/d9/d86/d3e/d6b/d75/ca0 d7/df/d23/d4f/cdb 0 2024-04-30T23:15:59.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/604: chown d7/db/f44 0 1 2024-04-30T23:15:59.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/605: chown d7/df/d23/d2b/d42/dd7 56599 1 2024-04-30T23:15:59.916 INFO:tasks.workunit.client.0.smithi100.stdout:4/757: dwrite d19/d1a/d21/d4a/fa0 [0,4194304] 0 2024-04-30T23:15:59.917 INFO:tasks.workunit.client.0.smithi100.stdout:0/700: creat d2/d50/d38/d5d/dc6/dd2/fd6 x:0 0 0 2024-04-30T23:15:59.917 INFO:tasks.workunit.client.0.smithi100.stdout:6/606: getdents d7/d9/d86/d3e/d6b 0 2024-04-30T23:15:59.921 INFO:tasks.workunit.client.0.smithi100.stdout:0/701: mkdir d2/d50/d38/d5d/dc6/dd2/dd7 0 2024-04-30T23:15:59.923 INFO:tasks.workunit.client.0.smithi100.stdout:6/607: rename d7/df/d23/d24/d2e/d37/f68 to d7/df/d23/d24/d2e/d37/fdc 0 2024-04-30T23:15:59.926 INFO:tasks.workunit.client.0.smithi100.stdout:8/633: dwrite d2/d29/d9e/fc0 [0,4194304] 0 2024-04-30T23:15:59.928 INFO:tasks.workunit.client.0.smithi100.stdout:8/634: mknod d2/d89/d10/ccb 0 2024-04-30T23:15:59.938 INFO:tasks.workunit.client.0.smithi100.stdout:4/758: write d19/d1a/d21/d4a/d53/d5d/f72 [275890,90953] 0 2024-04-30T23:15:59.938 INFO:tasks.workunit.client.0.smithi100.stdout:3/691: dwrite d1/d14/d15/d27/fc2 [0,4194304] 0 2024-04-30T23:15:59.939 INFO:tasks.workunit.client.0.smithi100.stdout:4/759: fdatasync d19/d1a/d29/f5f 0 2024-04-30T23:15:59.939 INFO:tasks.workunit.client.0.smithi100.stdout:3/692: readlink d1/d14/d15/d2c/l9f 0 2024-04-30T23:15:59.940 INFO:tasks.workunit.client.0.smithi100.stdout:3/693: getdents d1/d14/d15/d32/d6f/da2/d6d 0 2024-04-30T23:15:59.941 INFO:tasks.workunit.client.0.smithi100.stdout:3/694: creat d1/d14/d15/d32/d71/da9/fd2 x:0 0 0 2024-04-30T23:15:59.948 INFO:tasks.workunit.client.0.smithi100.stdout:8/635: dwrite d2/f76 [0,4194304] 0 2024-04-30T23:15:59.950 INFO:tasks.workunit.client.0.smithi100.stdout:8/636: symlink d2/d29/d8b/d8e/lcc 0 2024-04-30T23:15:59.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/760: dread d19/d33/d3f/f56 [0,4194304] 0 2024-04-30T23:15:59.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/761: stat d19/d1a/d95/l98 0 2024-04-30T23:15:59.953 INFO:tasks.workunit.client.0.smithi100.stdout:4/762: unlink d19/d1a/fc3 0 2024-04-30T23:15:59.953 INFO:tasks.workunit.client.0.smithi100.stdout:4/763: chown d19/d1a/d95/fb5 6608 1 2024-04-30T23:15:59.955 INFO:tasks.workunit.client.0.smithi100.stdout:4/764: creat d19/d33/d3f/d40/fee x:0 0 0 2024-04-30T23:15:59.959 INFO:tasks.workunit.client.0.smithi100.stdout:3/695: read d1/d14/d15/f44 [2740553,18724] 0 2024-04-30T23:15:59.960 INFO:tasks.workunit.client.0.smithi100.stdout:4/765: creat d19/d1a/d6d/d64/d78/dec/fef x:0 0 0 2024-04-30T23:15:59.960 INFO:tasks.workunit.client.0.smithi100.stdout:4/766: write d19/d1a/d21/d4a/d53/f76 [1114788,81331] 0 2024-04-30T23:15:59.964 INFO:tasks.workunit.client.0.smithi100.stdout:8/637: write d2/d7/d18/f54 [2792954,51208] 0 2024-04-30T23:15:59.965 INFO:tasks.workunit.client.0.smithi100.stdout:8/638: creat d2/d89/d10/d6e/dad/fcd x:0 0 0 2024-04-30T23:15:59.966 INFO:tasks.workunit.client.0.smithi100.stdout:8/639: symlink d2/d89/d10/d6e/dad/lce 0 2024-04-30T23:15:59.966 INFO:tasks.workunit.client.0.smithi100.stdout:8/640: fdatasync d2/d29/f53 0 2024-04-30T23:15:59.966 INFO:tasks.workunit.client.0.smithi100.stdout:8/641: write d2/f76 [4284045,25983] 0 2024-04-30T23:15:59.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/642: getdents d2/d89/d10/d52 0 2024-04-30T23:15:59.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/643: truncate d2/d29/d9e/fc0 40019 0 2024-04-30T23:15:59.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/644: readlink d2/d7/d18/d3a/l59 0 2024-04-30T23:15:59.970 INFO:tasks.workunit.client.0.smithi100.stdout:8/645: creat d2/d29/d71/fcf x:0 0 0 2024-04-30T23:15:59.971 INFO:tasks.workunit.client.0.smithi100.stdout:4/767: rename d19/d1a/d6d/d64/d78/dec to d19/d1a/d6d/d64/d78/d8c/df0 0 2024-04-30T23:15:59.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/696: dwrite d1/d14/d21/fb8 [0,4194304] 0 2024-04-30T23:15:59.984 INFO:tasks.workunit.client.0.smithi100.stdout:8/646: dread d2/d89/d10/d17/f1b [0,4194304] 0 2024-04-30T23:15:59.986 INFO:tasks.workunit.client.0.smithi100.stdout:3/697: truncate d1/d14/d15/f44 2274913 0 2024-04-30T23:15:59.986 INFO:tasks.workunit.client.0.smithi100.stdout:8/647: getdents d2/d29/d71/d86 0 2024-04-30T23:15:59.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/698: symlink d1/d14/d15/d32/d6f/da2/d6d/da8/ld3 0 2024-04-30T23:15:59.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/699: readlink d1/d14/d21/l3c 0 2024-04-30T23:15:59.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/700: chown d1/d14/d21/d67/lbf 15408 1 2024-04-30T23:15:59.990 INFO:tasks.workunit.client.0.smithi100.stdout:3/701: rename d1/d14/d15/d27/d34/l59 to d1/d14/d15/d32/d6f/da2/d6d/da8/ld4 0 2024-04-30T23:15:59.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/768: dwrite d19/d1a/d6d/d64/d78/d8c/df0/fef [0,4194304] 0 2024-04-30T23:15:59.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/769: dread - d19/d1a/d21/d4a/d53/d5e/fe7 zero size 2024-04-30T23:15:59.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/770: readlink d19/d1a/d21/d4a/d53/d5e/d7e/ldc 0 2024-04-30T23:15:59.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/771: rmdir d19/d1a/d6d/d64/d78 39 2024-04-30T23:16:00.000 INFO:tasks.workunit.client.0.smithi100.stdout:4/772: write d19/d1a/d21/d4a/d53/f8f [80009,17951] 0 2024-04-30T23:16:00.000 INFO:tasks.workunit.client.0.smithi100.stdout:4/773: chown d19/d1a/d21/d4a/d53/d5d 35744044 1 2024-04-30T23:16:00.000 INFO:tasks.workunit.client.0.smithi100.stdout:8/648: dread d2/f3e [0,4194304] 0 2024-04-30T23:16:00.002 INFO:tasks.workunit.client.0.smithi100.stdout:8/649: mknod d2/d89/d10/d6e/cd0 0 2024-04-30T23:16:00.003 INFO:tasks.workunit.client.0.smithi100.stdout:3/702: dread d1/d14/d15/d27/f88 [0,4194304] 0 2024-04-30T23:16:00.004 INFO:tasks.workunit.client.0.smithi100.stdout:8/650: creat d2/d29/d9e/daf/fd1 x:0 0 0 2024-04-30T23:16:00.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/763: sync 2024-04-30T23:16:00.007 INFO:tasks.workunit.client.0.smithi100.stdout:8/651: link d2/d7/d18/f54 d2/d97/fd2 0 2024-04-30T23:16:00.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/764: rmdir d5/d47/d66/de2 0 2024-04-30T23:16:00.009 INFO:tasks.workunit.client.0.smithi100.stdout:8/652: creat d2/d29/d71/d86/dc7/fd3 x:0 0 0 2024-04-30T23:16:00.010 INFO:tasks.workunit.client.0.smithi100.stdout:2/765: mkdir d5/d12/d70/dee 0 2024-04-30T23:16:00.011 INFO:tasks.workunit.client.0.smithi100.stdout:8/653: creat d2/d29/d8b/fd4 x:0 0 0 2024-04-30T23:16:00.013 INFO:tasks.workunit.client.0.smithi100.stdout:2/766: creat d5/d12/d8e/dae/dbf/fef x:0 0 0 2024-04-30T23:16:00.013 INFO:tasks.workunit.client.0.smithi100.stdout:8/654: symlink d2/d89/d7f/ld5 0 2024-04-30T23:16:00.014 INFO:tasks.workunit.client.0.smithi100.stdout:8/655: write d2/f3e [5271696,98116] 0 2024-04-30T23:16:00.014 INFO:tasks.workunit.client.0.smithi100.stdout:2/767: link d5/d22/f40 d5/d47/d4c/ff0 0 2024-04-30T23:16:00.016 INFO:tasks.workunit.client.0.smithi100.stdout:8/656: creat d2/d89/d10/d6e/fd6 x:0 0 0 2024-04-30T23:16:00.017 INFO:tasks.workunit.client.0.smithi100.stdout:8/657: dread d2/d89/d10/d17/f4f [0,4194304] 0 2024-04-30T23:16:00.018 INFO:tasks.workunit.client.0.smithi100.stdout:3/703: dread d1/d14/d15/f1d [0,4194304] 0 2024-04-30T23:16:00.018 INFO:tasks.workunit.client.0.smithi100.stdout:2/768: mknod d5/d12/d13/cf1 0 2024-04-30T23:16:00.019 INFO:tasks.workunit.client.0.smithi100.stdout:8/658: link d2/d89/lc5 d2/d29/d67/d73/ld7 0 2024-04-30T23:16:00.019 INFO:tasks.workunit.client.0.smithi100.stdout:8/659: truncate d2/d7/f3c 1040501 0 2024-04-30T23:16:00.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/704: rename d1/d14/d15/d32/d7d to d1/d14/d2f/dd5 0 2024-04-30T23:16:00.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/705: write d1/d14/d15/d32/f3e [3791267,4043] 0 2024-04-30T23:16:00.022 INFO:tasks.workunit.client.0.smithi100.stdout:2/769: mknod d5/d12/d8e/cf2 0 2024-04-30T23:16:00.022 INFO:tasks.workunit.client.0.smithi100.stdout:2/770: fsync d5/f49 0 2024-04-30T23:16:00.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/706: mkdir d1/d14/d15/d32/d6f/da2/d6d/d81/dd6 0 2024-04-30T23:16:00.024 INFO:tasks.workunit.client.0.smithi100.stdout:2/771: mkdir d5/d12/d13/d9e/df3 0 2024-04-30T23:16:00.026 INFO:tasks.workunit.client.0.smithi100.stdout:3/707: symlink d1/d14/d15/d32/d6f/da2/d26/ld7 0 2024-04-30T23:16:00.028 INFO:tasks.workunit.client.0.smithi100.stdout:3/708: creat d1/d14/d15/fd8 x:0 0 0 2024-04-30T23:16:00.029 INFO:tasks.workunit.client.0.smithi100.stdout:8/660: dread d2/d89/d7f/f3f [0,4194304] 0 2024-04-30T23:16:00.030 INFO:tasks.workunit.client.0.smithi100.stdout:8/661: fsync d2/d29/d9e/daf/fbf 0 2024-04-30T23:16:00.030 INFO:tasks.workunit.client.0.smithi100.stdout:8/662: fsync d2/d89/d10/d17/f8c 0 2024-04-30T23:16:00.030 INFO:tasks.workunit.client.0.smithi100.stdout:8/663: readlink d2/d89/lb4 0 2024-04-30T23:16:00.030 INFO:tasks.workunit.client.0.smithi100.stdout:8/664: getdents d2/d29 0 2024-04-30T23:16:00.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/665: chown d2/d29/d8b/l8d 248853 1 2024-04-30T23:16:00.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/666: write d2/d89/d10/d17/fbb [78610,45956] 0 2024-04-30T23:16:00.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/667: creat d2/d89/d10/d52/d9a/fd8 x:0 0 0 2024-04-30T23:16:00.032 INFO:tasks.workunit.client.0.smithi100.stdout:8/668: symlink d2/d89/d10/d52/ld9 0 2024-04-30T23:16:00.047 INFO:tasks.workunit.client.0.smithi100.stdout:3/709: dread d1/d38/f60 [0,4194304] 0 2024-04-30T23:16:00.058 INFO:tasks.workunit.client.0.smithi100.stdout:8/669: dwrite d2/d89/d10/d17/d8f/fac [0,4194304] 0 2024-04-30T23:16:00.071 INFO:tasks.workunit.client.0.smithi100.stdout:3/710: dread d1/d14/d15/d2c/f7e [0,4194304] 0 2024-04-30T23:16:00.083 INFO:tasks.workunit.client.0.smithi100.stdout:8/670: dwrite d2/d7/f26 [0,4194304] 0 2024-04-30T23:16:00.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/733: sync 2024-04-30T23:16:00.084 INFO:tasks.workunit.client.0.smithi100.stdout:7/783: sync 2024-04-30T23:16:00.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/734: dread - d1/d12/d27/fda zero size 2024-04-30T23:16:00.085 INFO:tasks.workunit.client.0.smithi100.stdout:7/784: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/d104 0 2024-04-30T23:16:00.087 INFO:tasks.workunit.client.0.smithi100.stdout:7/785: unlink d0/d1b/d60/lda 0 2024-04-30T23:16:00.087 INFO:tasks.workunit.client.0.smithi100.stdout:7/786: truncate d0/d1b/d60/f54 792719 0 2024-04-30T23:16:00.088 INFO:tasks.workunit.client.0.smithi100.stdout:7/787: mknod d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/c105 0 2024-04-30T23:16:00.088 INFO:tasks.workunit.client.0.smithi100.stdout:3/711: dread d1/d14/d21/f2d [4194304,4194304] 0 2024-04-30T23:16:00.089 INFO:tasks.workunit.client.0.smithi100.stdout:5/735: write d1/d3e/d9b/fe4 [334489,73181] 0 2024-04-30T23:16:00.089 INFO:tasks.workunit.client.0.smithi100.stdout:5/736: write d1/fa2 [124737,94514] 0 2024-04-30T23:16:00.089 INFO:tasks.workunit.client.0.smithi100.stdout:5/737: fsync d1/d12/f16 0 2024-04-30T23:16:00.089 INFO:tasks.workunit.client.0.smithi100.stdout:7/788: mkdir d0/d1b/d60/dbe/d106 0 2024-04-30T23:16:00.090 INFO:tasks.workunit.client.0.smithi100.stdout:3/712: rename d1/le to d1/d14/d15/d32/d6f/da2/d6d/da8/ld9 0 2024-04-30T23:16:00.096 INFO:tasks.workunit.client.0.smithi100.stdout:8/671: dread d2/d7/d18/d3a/f3d [0,4194304] 0 2024-04-30T23:16:00.097 INFO:tasks.workunit.client.0.smithi100.stdout:5/738: mkdir d1/d12/d1a/df2 0 2024-04-30T23:16:00.097 INFO:tasks.workunit.client.0.smithi100.stdout:5/739: fdatasync d1/d12/ff0 0 2024-04-30T23:16:00.097 INFO:tasks.workunit.client.0.smithi100.stdout:5/740: write d1/d12/d74/fd1 [1826866,99751] 0 2024-04-30T23:16:00.098 INFO:tasks.workunit.client.0.smithi100.stdout:8/672: link d2/d89/lc5 d2/d29/d67/d73/lda 0 2024-04-30T23:16:00.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/741: truncate d1/d12/d27/f29 331234 0 2024-04-30T23:16:00.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/742: dread - d1/d2c/fca zero size 2024-04-30T23:16:00.099 INFO:tasks.workunit.client.0.smithi100.stdout:8/673: mkdir d2/d29/d71/ddb 0 2024-04-30T23:16:00.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/789: dread d0/d1b/d60/d48/f64 [0,4194304] 0 2024-04-30T23:16:00.100 INFO:tasks.workunit.client.0.smithi100.stdout:5/743: rename d1/d3e/d9b/fb5 to d1/d12/d74/ff3 0 2024-04-30T23:16:00.102 INFO:tasks.workunit.client.0.smithi100.stdout:8/674: mkdir d2/d89/d72/ddc 0 2024-04-30T23:16:00.103 INFO:tasks.workunit.client.0.smithi100.stdout:7/790: mknod d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/d104/c107 0 2024-04-30T23:16:00.105 INFO:tasks.workunit.client.0.smithi100.stdout:5/744: unlink d1/d12/f18 0 2024-04-30T23:16:00.106 INFO:tasks.workunit.client.0.smithi100.stdout:8/675: creat d2/d69/fdd x:0 0 0 2024-04-30T23:16:00.109 INFO:tasks.workunit.client.0.smithi100.stdout:7/791: symlink d0/d1b/d60/d80/dfa/l108 0 2024-04-30T23:16:00.111 INFO:tasks.workunit.client.0.smithi100.stdout:7/792: mknod d0/d1d/d5e/d6a/d4b/c109 0 2024-04-30T23:16:00.112 INFO:tasks.workunit.client.0.smithi100.stdout:7/793: creat d0/d1d/d5e/f10a x:0 0 0 2024-04-30T23:16:00.113 INFO:tasks.workunit.client.0.smithi100.stdout:7/794: creat d0/df/d4f/d93/db1/ded/f10b x:0 0 0 2024-04-30T23:16:00.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/795: creat d0/d1d/d5e/d6a/d4b/d79/dd0/f10c x:0 0 0 2024-04-30T23:16:00.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/796: read d0/d1b/d60/d48/f64 [992771,82263] 0 2024-04-30T23:16:00.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/713: dwrite d1/d14/d15/d32/d71/fb0 [0,4194304] 0 2024-04-30T23:16:00.118 INFO:tasks.workunit.client.0.smithi100.stdout:3/714: creat d1/d14/d2b/d57/fda x:0 0 0 2024-04-30T23:16:00.119 INFO:tasks.workunit.client.0.smithi100.stdout:3/715: creat d1/d14/d15/d2c/fdb x:0 0 0 2024-04-30T23:16:00.121 INFO:tasks.workunit.client.0.smithi100.stdout:3/716: symlink d1/d14/d15/d27/ldc 0 2024-04-30T23:16:00.124 INFO:tasks.workunit.client.0.smithi100.stdout:3/717: rename d1/d14/d2b/d57/fda to d1/fdd 0 2024-04-30T23:16:00.124 INFO:tasks.workunit.client.0.smithi100.stdout:7/797: dread d0/df/d4f/f7b [0,4194304] 0 2024-04-30T23:16:00.124 INFO:tasks.workunit.client.0.smithi100.stdout:7/798: write d0/d1b/d60/d48/d4a/f4d [8199364,125909] 0 2024-04-30T23:16:00.125 INFO:tasks.workunit.client.0.smithi100.stdout:7/799: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/f10d x:0 0 0 2024-04-30T23:16:00.126 INFO:tasks.workunit.client.0.smithi100.stdout:7/800: creat d0/d1b/d60/d80/d91/f10e x:0 0 0 2024-04-30T23:16:00.140 INFO:tasks.workunit.client.0.smithi100.stdout:5/745: dwrite d1/fa2 [0,4194304] 0 2024-04-30T23:16:00.140 INFO:tasks.workunit.client.0.smithi100.stdout:8/676: dwrite d2/d29/d9e/daf/fbf [0,4194304] 0 2024-04-30T23:16:00.143 INFO:tasks.workunit.client.0.smithi100.stdout:5/746: rename d1/f1b to d1/d12/d1a/d76/dd7/ff4 0 2024-04-30T23:16:00.144 INFO:tasks.workunit.client.0.smithi100.stdout:3/718: dwrite d1/d14/d15/d32/f63 [0,4194304] 0 2024-04-30T23:16:00.145 INFO:tasks.workunit.client.0.smithi100.stdout:5/747: rename d1/d12/d1a/d76/d77/ld3 to d1/d2c/d60/d66/d75/lf5 0 2024-04-30T23:16:00.150 INFO:tasks.workunit.client.0.smithi100.stdout:7/801: dwrite d0/d1b/d1e/f28 [0,4194304] 0 2024-04-30T23:16:00.159 INFO:tasks.workunit.client.0.smithi100.stdout:3/719: write d1/d14/d15/f16 [9123999,84270] 0 2024-04-30T23:16:00.160 INFO:tasks.workunit.client.0.smithi100.stdout:5/748: dread d1/d12/d1a/d76/fd2 [0,4194304] 0 2024-04-30T23:16:00.161 INFO:tasks.workunit.client.0.smithi100.stdout:5/749: rmdir d1/d19/d7f 39 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:7/802: dread d0/f16 [4194304,4194304] 0 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:8/677: dwrite d2/d29/d9e/daf/fd1 [0,4194304] 0 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/702: sync 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:1/544: sync 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:1/545: chown d3/f2f 15971 1 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/774: sync 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:6/608: sync 2024-04-30T23:16:00.162 INFO:tasks.workunit.client.0.smithi100.stdout:9/624: sync 2024-04-30T23:16:00.163 INFO:tasks.workunit.client.0.smithi100.stdout:5/750: link d1/d12/d24/f4e d1/d12/d1a/df2/ff6 0 2024-04-30T23:16:00.164 INFO:tasks.workunit.client.0.smithi100.stdout:7/803: mknod d0/d1d/d5e/d6a/c10f 0 2024-04-30T23:16:00.164 INFO:tasks.workunit.client.0.smithi100.stdout:7/804: fsync d0/df/f22 0 2024-04-30T23:16:00.164 INFO:tasks.workunit.client.0.smithi100.stdout:7/805: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/f10d [375046,86424] 0 2024-04-30T23:16:00.166 INFO:tasks.workunit.client.0.smithi100.stdout:8/678: mknod d2/d29/d71/d86/cde 0 2024-04-30T23:16:00.166 INFO:tasks.workunit.client.0.smithi100.stdout:6/609: dread d7/df/d23/d24/d2e/d37/fb2 [0,4194304] 0 2024-04-30T23:16:00.167 INFO:tasks.workunit.client.0.smithi100.stdout:6/610: chown d7/df/d23/d24/f90 451763 1 2024-04-30T23:16:00.167 INFO:tasks.workunit.client.0.smithi100.stdout:6/611: write d7/df/d23/d2b/d42/d84/f93 [830920,28333] 0 2024-04-30T23:16:00.167 INFO:tasks.workunit.client.0.smithi100.stdout:6/612: chown d7/d9/d86/dc7/fd5 30595 1 2024-04-30T23:16:00.167 INFO:tasks.workunit.client.0.smithi100.stdout:6/613: fsync d7/df/d23/d24/d2e/d37/d85/fb3 0 2024-04-30T23:16:00.167 INFO:tasks.workunit.client.0.smithi100.stdout:0/703: unlink d2/d50/f4f 0 2024-04-30T23:16:00.169 INFO:tasks.workunit.client.0.smithi100.stdout:1/546: link d3/f8 d3/d16/d20/d24/d69/f9d 0 2024-04-30T23:16:00.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/775: link d19/d1a/d6d/c3e d19/d1a/d6d/d64/dc8/cf1 0 2024-04-30T23:16:00.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/776: chown d19/d1a/d29/fe0 7743339 1 2024-04-30T23:16:00.174 INFO:tasks.workunit.client.0.smithi100.stdout:9/625: mknod d4/d9/d51/ce0 0 2024-04-30T23:16:00.175 INFO:tasks.workunit.client.0.smithi100.stdout:2/772: sync 2024-04-30T23:16:00.175 INFO:tasks.workunit.client.0.smithi100.stdout:2/773: chown d5/d22 35501732 1 2024-04-30T23:16:00.175 INFO:tasks.workunit.client.0.smithi100.stdout:7/806: chown d0/f1f 5568160 1 2024-04-30T23:16:00.177 INFO:tasks.workunit.client.0.smithi100.stdout:8/679: creat d2/d89/d10/d6e/dad/fdf x:0 0 0 2024-04-30T23:16:00.179 INFO:tasks.workunit.client.0.smithi100.stdout:6/614: mkdir d7/df/d23/d2b/d42/d84/ddd 0 2024-04-30T23:16:00.179 INFO:tasks.workunit.client.0.smithi100.stdout:6/615: chown d7/df/d23/l81 6 1 2024-04-30T23:16:00.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/547: creat d3/d18/f9e x:0 0 0 2024-04-30T23:16:00.181 INFO:tasks.workunit.client.0.smithi100.stdout:4/777: getdents d19/d1a 0 2024-04-30T23:16:00.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/626: creat d4/d7/d8/d37/d3d/fe1 x:0 0 0 2024-04-30T23:16:00.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/627: write d4/d7/d8/d37/d3d/fe1 [929086,12989] 0 2024-04-30T23:16:00.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/774: mknod d5/d12/d13/d9e/df3/cf4 0 2024-04-30T23:16:00.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/775: fdatasync d5/d12/d13/fa0 0 2024-04-30T23:16:00.184 INFO:tasks.workunit.client.0.smithi100.stdout:8/680: creat d2/d7/d18/d3a/fe0 x:0 0 0 2024-04-30T23:16:00.187 INFO:tasks.workunit.client.0.smithi100.stdout:6/616: unlink d7/df/d23/d4f/l8f 0 2024-04-30T23:16:00.188 INFO:tasks.workunit.client.0.smithi100.stdout:1/548: truncate d3/d18/f43 3227150 0 2024-04-30T23:16:00.189 INFO:tasks.workunit.client.0.smithi100.stdout:0/704: dread d2/d50/d30/dc7/f90 [4194304,4194304] 0 2024-04-30T23:16:00.189 INFO:tasks.workunit.client.0.smithi100.stdout:4/778: symlink d19/lf2 0 2024-04-30T23:16:00.189 INFO:tasks.workunit.client.0.smithi100.stdout:4/779: chown d19/d1a/d29/dae 252526 1 2024-04-30T23:16:00.189 INFO:tasks.workunit.client.0.smithi100.stdout:0/705: fdatasync d2/d14/d35/d57/f91 0 2024-04-30T23:16:00.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/751: dwrite d1/d12/d1a/d76/fd2 [4194304,4194304] 0 2024-04-30T23:16:00.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/617: rename d7/db/f44 to d7/d9/d86/fde 0 2024-04-30T23:16:00.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/618: write d7/df/d23/d24/d2e/d9f/fd9 [8922907,7621] 0 2024-04-30T23:16:00.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/619: dread - d7/d9/d86/d1b/d5a/f66 zero size 2024-04-30T23:16:00.193 INFO:tasks.workunit.client.0.smithi100.stdout:1/549: creat d3/d16/d20/d24/d69/f9f x:0 0 0 2024-04-30T23:16:00.195 INFO:tasks.workunit.client.0.smithi100.stdout:3/720: dwrite d1/d14/d15/d32/d6f/da2/f39 [0,4194304] 0 2024-04-30T23:16:00.196 INFO:tasks.workunit.client.0.smithi100.stdout:4/780: mknod d19/d1a/d6d/d4e/cf3 0 2024-04-30T23:16:00.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/721: write d1/d14/d15/f16 [1840685,104179] 0 2024-04-30T23:16:00.201 INFO:tasks.workunit.client.0.smithi100.stdout:5/752: rename d1/l10 to d1/d3e/lf7 0 2024-04-30T23:16:00.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/550: rmdir d3/d16/d20/d24/d51 39 2024-04-30T23:16:00.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/551: chown d3/d16/d20/d24/d69/f46 16313684 1 2024-04-30T23:16:00.207 INFO:tasks.workunit.client.0.smithi100.stdout:6/620: dread d7/db/f5c [0,4194304] 0 2024-04-30T23:16:00.207 INFO:tasks.workunit.client.0.smithi100.stdout:6/621: chown d7/df/d23/d24/d2e/d37/f9b 7074742 1 2024-04-30T23:16:00.213 INFO:tasks.workunit.client.0.smithi100.stdout:3/722: mkdir d1/d38/d79/dde 0 2024-04-30T23:16:00.213 INFO:tasks.workunit.client.0.smithi100.stdout:2/776: dwrite d5/d12/d8e/dae/fda [0,4194304] 0 2024-04-30T23:16:00.214 INFO:tasks.workunit.client.0.smithi100.stdout:5/753: mknod d1/d19/d7f/cf8 0 2024-04-30T23:16:00.214 INFO:tasks.workunit.client.0.smithi100.stdout:5/754: chown d1/d2c/d60/d66 530 1 2024-04-30T23:16:00.217 INFO:tasks.workunit.client.0.smithi100.stdout:6/622: creat d7/df/d23/d2b/d42/fdf x:0 0 0 2024-04-30T23:16:00.217 INFO:tasks.workunit.client.0.smithi100.stdout:4/781: dwrite d19/d1a/d21/d3c/f55 [0,4194304] 0 2024-04-30T23:16:00.218 INFO:tasks.workunit.client.0.smithi100.stdout:3/723: creat d1/d14/d15/d32/fdf x:0 0 0 2024-04-30T23:16:00.223 INFO:tasks.workunit.client.0.smithi100.stdout:6/623: creat d7/d9/d86/d1b/fe0 x:0 0 0 2024-04-30T23:16:00.223 INFO:tasks.workunit.client.0.smithi100.stdout:6/624: readlink d7/df/d23/d24/d2e/d37/l99 0 2024-04-30T23:16:00.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/782: truncate f9 6275883 0 2024-04-30T23:16:00.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/783: dread - d19/d1a/d6d/d4e/d6e/dcb/fd8 zero size 2024-04-30T23:16:00.228 INFO:tasks.workunit.client.0.smithi100.stdout:6/625: mknod d7/df/d23/d2b/ce1 0 2024-04-30T23:16:00.228 INFO:tasks.workunit.client.0.smithi100.stdout:5/755: dread d1/d19/f4a [0,4194304] 0 2024-04-30T23:16:00.228 INFO:tasks.workunit.client.0.smithi100.stdout:5/756: chown d1/d12/d24 605 1 2024-04-30T23:16:00.231 INFO:tasks.workunit.client.0.smithi100.stdout:6/626: rename d7/d9/d86/d1b/d59 to d7/d9/d86/d1b/d5a/de2 0 2024-04-30T23:16:00.231 INFO:tasks.workunit.client.0.smithi100.stdout:5/757: creat d1/d37/ff9 x:0 0 0 2024-04-30T23:16:00.233 INFO:tasks.workunit.client.0.smithi100.stdout:6/627: rename d7/df/d23/d2b/c64 to d7/df/d23/d2b/ce3 0 2024-04-30T23:16:00.233 INFO:tasks.workunit.client.0.smithi100.stdout:6/628: write d7/d9/d86/db0/f7b [1317469,104861] 0 2024-04-30T23:16:00.233 INFO:tasks.workunit.client.0.smithi100.stdout:6/629: fdatasync d7/df/d23/d24/d2e/f56 0 2024-04-30T23:16:00.235 INFO:tasks.workunit.client.0.smithi100.stdout:6/630: creat d7/df/d23/d24/dbf/fe4 x:0 0 0 2024-04-30T23:16:00.235 INFO:tasks.workunit.client.0.smithi100.stdout:6/631: write d7/f52 [1415275,106017] 0 2024-04-30T23:16:00.237 INFO:tasks.workunit.client.0.smithi100.stdout:6/632: mkdir d7/d9/d86/de5 0 2024-04-30T23:16:00.239 INFO:tasks.workunit.client.0.smithi100.stdout:6/633: rename d7/d9/d86/d1b/d5a/l9a to d7/df/d23/d2b/d42/d84/le6 0 2024-04-30T23:16:00.240 INFO:tasks.workunit.client.0.smithi100.stdout:6/634: mkdir d7/df/d23/d24/d2e/d37/d85/de7 0 2024-04-30T23:16:00.241 INFO:tasks.workunit.client.0.smithi100.stdout:8/681: dwrite d2/d7/d18/fc8 [4194304,4194304] 0 2024-04-30T23:16:00.242 INFO:tasks.workunit.client.0.smithi100.stdout:2/777: dread d5/d12/d8e/dae/fda [0,4194304] 0 2024-04-30T23:16:00.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/635: truncate d7/d9/d86/d3e/d6b/fb9 2671174 0 2024-04-30T23:16:00.243 INFO:tasks.workunit.client.0.smithi100.stdout:2/778: symlink d5/d12/d73/lf5 0 2024-04-30T23:16:00.243 INFO:tasks.workunit.client.0.smithi100.stdout:2/779: chown d5/d12/d13/f59 52 1 2024-04-30T23:16:00.243 INFO:tasks.workunit.client.0.smithi100.stdout:2/780: chown d5/d12/d8e/dae/dbf 120 1 2024-04-30T23:16:00.243 INFO:tasks.workunit.client.0.smithi100.stdout:2/781: truncate d5/d12/d13/d4b/f99 4621678 0 2024-04-30T23:16:00.244 INFO:tasks.workunit.client.0.smithi100.stdout:6/636: creat d7/d9/d86/de5/fe8 x:0 0 0 2024-04-30T23:16:00.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/782: symlink d5/d12/d13/d9e/df3/lf6 0 2024-04-30T23:16:00.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/783: chown d5/d12/d8e/dae/fda 84 1 2024-04-30T23:16:00.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/784: dread - d5/d12/d8e/dae/fe1 zero size 2024-04-30T23:16:00.245 INFO:tasks.workunit.client.0.smithi100.stdout:6/637: creat d7/df/d23/d2b/d42/d87/fe9 x:0 0 0 2024-04-30T23:16:00.245 INFO:tasks.workunit.client.0.smithi100.stdout:6/638: chown d7/df/d23/d2b/d42/d84/ddd 416 1 2024-04-30T23:16:00.245 INFO:tasks.workunit.client.0.smithi100.stdout:1/552: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:16:00.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/785: mkdir d5/df7 0 2024-04-30T23:16:00.246 INFO:tasks.workunit.client.0.smithi100.stdout:5/758: dread d1/d2c/d60/d66/d71/db6/dd4/f91 [0,4194304] 0 2024-04-30T23:16:00.246 INFO:tasks.workunit.client.0.smithi100.stdout:5/759: write d1/d37/fc6 [169336,1177] 0 2024-04-30T23:16:00.246 INFO:tasks.workunit.client.0.smithi100.stdout:5/760: read d1/d3e/f45 [1481907,59468] 0 2024-04-30T23:16:00.246 INFO:tasks.workunit.client.0.smithi100.stdout:5/761: stat d1/d12/d27/fda 0 2024-04-30T23:16:00.253 INFO:tasks.workunit.client.0.smithi100.stdout:2/786: creat d5/d12/d13/d4b/ff8 x:0 0 0 2024-04-30T23:16:00.253 INFO:tasks.workunit.client.0.smithi100.stdout:5/762: creat d1/d12/d1a/df2/ffa x:0 0 0 2024-04-30T23:16:00.253 INFO:tasks.workunit.client.0.smithi100.stdout:2/787: chown d5/d2e 3 1 2024-04-30T23:16:00.253 INFO:tasks.workunit.client.0.smithi100.stdout:2/788: chown d5/d12/f2b 1 1 2024-04-30T23:16:00.253 INFO:tasks.workunit.client.0.smithi100.stdout:2/789: chown d5/d26/f77 72778 1 2024-04-30T23:16:00.255 INFO:tasks.workunit.client.0.smithi100.stdout:5/763: unlink d1/d2c/d60/d66/d75/cbd 0 2024-04-30T23:16:00.256 INFO:tasks.workunit.client.0.smithi100.stdout:2/790: getdents d5/d12/d8e/dae 0 2024-04-30T23:16:00.257 INFO:tasks.workunit.client.0.smithi100.stdout:2/791: write d5/d26/fd1 [4971878,116831] 0 2024-04-30T23:16:00.266 INFO:tasks.workunit.client.0.smithi100.stdout:8/682: dwrite d2/d97/fd2 [0,4194304] 0 2024-04-30T23:16:00.273 INFO:tasks.workunit.client.0.smithi100.stdout:6/639: dwrite d7/df/d23/d24/dbf/fe4 [0,4194304] 0 2024-04-30T23:16:00.278 INFO:tasks.workunit.client.0.smithi100.stdout:7/807: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f103 [0,4194304] 0 2024-04-30T23:16:00.278 INFO:tasks.workunit.client.0.smithi100.stdout:7/808: chown d0/d1d/d5e/d6a/d4b/d79/dd0/f10c 2 1 2024-04-30T23:16:00.278 INFO:tasks.workunit.client.0.smithi100.stdout:7/809: read - d0/d1d/d5e/d6a/d4b/d79/dd0/f10c zero size 2024-04-30T23:16:00.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/810: getdents d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/d104 0 2024-04-30T23:16:00.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/683: read d2/d29/d71/d86/f98 [405911,47520] 0 2024-04-30T23:16:00.282 INFO:tasks.workunit.client.0.smithi100.stdout:4/784: dwrite d19/d1a/d21/d4a/d53/fd2 [0,4194304] 0 2024-04-30T23:16:00.283 INFO:tasks.workunit.client.0.smithi100.stdout:4/785: write d19/d1a/d29/fe0 [592419,113531] 0 2024-04-30T23:16:00.283 INFO:tasks.workunit.client.0.smithi100.stdout:5/764: dwrite d1/d12/d24/d34/f69 [0,4194304] 0 2024-04-30T23:16:00.284 INFO:tasks.workunit.client.0.smithi100.stdout:2/792: dwrite d5/d47/d66/fe6 [0,4194304] 0 2024-04-30T23:16:00.284 INFO:tasks.workunit.client.0.smithi100.stdout:2/793: fsync d5/f25 0 2024-04-30T23:16:00.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/640: read d7/d9/f12 [4075941,80450] 0 2024-04-30T23:16:00.293 INFO:tasks.workunit.client.0.smithi100.stdout:0/706: write d2/d50/d30/d32/f5b [1743288,49217] 0 2024-04-30T23:16:00.293 INFO:tasks.workunit.client.0.smithi100.stdout:8/684: mknod d2/d89/d10/d6e/da0/ce1 0 2024-04-30T23:16:00.293 INFO:tasks.workunit.client.0.smithi100.stdout:4/786: creat d19/d1a/d6d/d64/dc8/ff4 x:0 0 0 2024-04-30T23:16:00.300 INFO:tasks.workunit.client.0.smithi100.stdout:5/765: creat d1/d12/d1a/d76/ffb x:0 0 0 2024-04-30T23:16:00.304 INFO:tasks.workunit.client.0.smithi100.stdout:4/787: rmdir d19/d1a/d29/d65 39 2024-04-30T23:16:00.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/766: mknod d1/d12/d1a/d5b/cfc 0 2024-04-30T23:16:00.309 INFO:tasks.workunit.client.0.smithi100.stdout:0/707: dread d2/d14/d18/f33 [0,4194304] 0 2024-04-30T23:16:00.309 INFO:tasks.workunit.client.0.smithi100.stdout:4/788: mknod d19/d1a/d6d/d4e/d6e/dcb/cf5 0 2024-04-30T23:16:00.310 INFO:tasks.workunit.client.0.smithi100.stdout:4/789: dread - d19/d1a/d6d/d4e/d6e/dcb/fd8 zero size 2024-04-30T23:16:00.311 INFO:tasks.workunit.client.0.smithi100.stdout:5/767: truncate d1/d3e/d99/fc2 8150642 0 2024-04-30T23:16:00.312 INFO:tasks.workunit.client.0.smithi100.stdout:7/811: dwrite d0/d1d/fdc [4194304,4194304] 0 2024-04-30T23:16:00.312 INFO:tasks.workunit.client.0.smithi100.stdout:7/812: stat d0/d1b/d2e/fec 0 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/790: creat d19/d1a/d6d/d64/d78/dea/ff6 x:0 0 0 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/791: dread - d19/d1a/d6d/d4e/d6e/dcb/fd8 zero size 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/792: chown d19/d1a/l57 1015014 1 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/793: chown d19/d1a/d21/fc2 5187 1 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:2/794: dwrite d5/d26/d9b/fba [0,4194304] 0 2024-04-30T23:16:00.313 INFO:tasks.workunit.client.0.smithi100.stdout:2/795: chown d5/d22/f60 0 1 2024-04-30T23:16:00.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/641: dwrite d7/d9/d86/d3e/d6b/d75/f7c [0,4194304] 0 2024-04-30T23:16:00.321 INFO:tasks.workunit.client.0.smithi100.stdout:7/813: unlink d0/d1d/d5e/d6a/d4b/d79/c26 0 2024-04-30T23:16:00.322 INFO:tasks.workunit.client.0.smithi100.stdout:4/794: rename d19/d1a/c1d to d19/d1a/d21/cf7 0 2024-04-30T23:16:00.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:00 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:16:00.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:00 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:16:00.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:00 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:16:00.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:00 smithi100 ceph-mon[29745]: scrub summary: idle 2024-04-30T23:16:00.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:00 smithi100 ceph-mon[29745]: pgmap v445: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s rd, 175 MiB/s wr, 406 op/s 2024-04-30T23:16:00.324 INFO:tasks.workunit.client.0.smithi100.stdout:7/814: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4 39 2024-04-30T23:16:00.326 INFO:tasks.workunit.client.0.smithi100.stdout:4/795: mkdir d19/d1a/d21/df8 0 2024-04-30T23:16:00.326 INFO:tasks.workunit.client.0.smithi100.stdout:4/796: fsync d19/d1a/d21/d4a/d53/fd2 0 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/768: write d1/f7 [2833598,109529] 0 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/769: truncate d1/d12/d27/f6b 637260 0 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/770: chown d1/d12/d74/cc9 0 1 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/771: chown d1/d3e/d9b/fdd 79556268 1 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/772: chown d1/d12/d1a/df2/ffa 11938 1 2024-04-30T23:16:00.327 INFO:tasks.workunit.client.0.smithi100.stdout:8/685: dwrite d2/d7/f68 [0,4194304] 0 2024-04-30T23:16:00.328 INFO:tasks.workunit.client.0.smithi100.stdout:0/708: dread d2/f73 [0,4194304] 0 2024-04-30T23:16:00.328 INFO:tasks.workunit.client.0.smithi100.stdout:6/642: rename d7/d9/c82 to d7/d9/d86/db0/cea 0 2024-04-30T23:16:00.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/815: getdents d0/d1b 0 2024-04-30T23:16:00.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/816: write d0/d1b/f2b [2286939,82728] 0 2024-04-30T23:16:00.330 INFO:tasks.workunit.client.0.smithi100.stdout:8/686: write d2/d7/d18/d3a/f85 [151748,51865] 0 2024-04-30T23:16:00.330 INFO:tasks.workunit.client.0.smithi100.stdout:8/687: chown d2/d7/d18/ca2 1164 1 2024-04-30T23:16:00.336 INFO:tasks.workunit.client.0.smithi100.stdout:4/797: rmdir d19/d33/d3f/d40/da2 39 2024-04-30T23:16:00.336 INFO:tasks.workunit.client.0.smithi100.stdout:5/773: rmdir d1/d3e/d9b 39 2024-04-30T23:16:00.336 INFO:tasks.workunit.client.0.smithi100.stdout:5/774: write d1/d2c/d60/d66/d71/f94 [931007,36277] 0 2024-04-30T23:16:00.336 INFO:tasks.workunit.client.0.smithi100.stdout:5/775: dread - d1/d12/fec zero size 2024-04-30T23:16:00.336 INFO:tasks.workunit.client.0.smithi100.stdout:4/798: write d19/d33/d3f/d40/fee [925024,93873] 0 2024-04-30T23:16:00.337 INFO:tasks.workunit.client.0.smithi100.stdout:4/799: stat d19/d1a/d95/l98 0 2024-04-30T23:16:00.337 INFO:tasks.workunit.client.0.smithi100.stdout:6/643: mkdir d7/d9/deb 0 2024-04-30T23:16:00.337 INFO:tasks.workunit.client.0.smithi100.stdout:2/796: dwrite d5/d47/d4c/f4f [4194304,4194304] 0 2024-04-30T23:16:00.339 INFO:tasks.workunit.client.0.smithi100.stdout:8/688: mkdir d2/d29/d71/d86/de2 0 2024-04-30T23:16:00.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/800: rmdir d19/d1a/dcd 0 2024-04-30T23:16:00.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/801: write d19/d1a/d21/d4a/d53/d5d/f68 [266821,109721] 0 2024-04-30T23:16:00.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/802: read - d19/d1a/d6d/fe2 zero size 2024-04-30T23:16:00.347 INFO:tasks.workunit.client.0.smithi100.stdout:6/644: creat d7/fec x:0 0 0 2024-04-30T23:16:00.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/776: dread d1/d12/d74/ff3 [0,4194304] 0 2024-04-30T23:16:00.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/777: dread - d1/d12/ff0 zero size 2024-04-30T23:16:00.353 INFO:tasks.workunit.client.0.smithi100.stdout:8/689: dread d2/d89/d7f/f3f [0,4194304] 0 2024-04-30T23:16:00.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/797: truncate d5/d22/f40 3092764 0 2024-04-30T23:16:00.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/798: chown f1 4692983 1 2024-04-30T23:16:00.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/803: symlink d19/d1a/d95/lf9 0 2024-04-30T23:16:00.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/804: chown d19/d1a/d21/d4a/f6a 60 1 2024-04-30T23:16:00.354 INFO:tasks.workunit.client.0.smithi100.stdout:7/817: dwrite d0/d1d/d5e/d6a/f2d [0,4194304] 0 2024-04-30T23:16:00.356 INFO:tasks.workunit.client.0.smithi100.stdout:8/690: creat d2/d89/d7f/fe3 x:0 0 0 2024-04-30T23:16:00.357 INFO:tasks.workunit.client.0.smithi100.stdout:2/799: creat d5/d12/d70/dee/ff9 x:0 0 0 2024-04-30T23:16:00.366 INFO:tasks.workunit.client.0.smithi100.stdout:8/691: mknod d2/d89/d10/d6e/ce4 0 2024-04-30T23:16:00.366 INFO:tasks.workunit.client.0.smithi100.stdout:4/805: truncate d19/d33/d7d/fe8 842091 0 2024-04-30T23:16:00.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/692: creat d2/d89/d10/d52/fe5 x:0 0 0 2024-04-30T23:16:00.373 INFO:tasks.workunit.client.0.smithi100.stdout:7/818: creat d0/d1b/d60/d48/d4a/d5b/f110 x:0 0 0 2024-04-30T23:16:00.375 INFO:tasks.workunit.client.0.smithi100.stdout:5/778: dwrite d1/d12/d1a/d76/ffb [0,4194304] 0 2024-04-30T23:16:00.376 INFO:tasks.workunit.client.0.smithi100.stdout:5/779: stat d1/d19/d7f 0 2024-04-30T23:16:00.379 INFO:tasks.workunit.client.0.smithi100.stdout:5/780: creat d1/d2c/d60/d66/d71/dcf/ffd x:0 0 0 2024-04-30T23:16:00.380 INFO:tasks.workunit.client.0.smithi100.stdout:2/800: dwrite d5/d2e/f50 [0,4194304] 0 2024-04-30T23:16:00.382 INFO:tasks.workunit.client.0.smithi100.stdout:4/806: dread d19/f26 [0,4194304] 0 2024-04-30T23:16:00.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/801: symlink d5/d47/d4c/dab/lfa 0 2024-04-30T23:16:00.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/802: fsync d5/d26/d2f/f63 0 2024-04-30T23:16:00.384 INFO:tasks.workunit.client.0.smithi100.stdout:4/807: mknod d19/d1a/cfa 0 2024-04-30T23:16:00.384 INFO:tasks.workunit.client.0.smithi100.stdout:4/808: write d19/d33/d3f/f56 [3348750,14297] 0 2024-04-30T23:16:00.386 INFO:tasks.workunit.client.0.smithi100.stdout:2/803: mkdir d5/d22/da6/dfb 0 2024-04-30T23:16:00.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/819: dread d0/f8 [0,4194304] 0 2024-04-30T23:16:00.386 INFO:tasks.workunit.client.0.smithi100.stdout:2/804: chown d5/d47/le7 0 1 2024-04-30T23:16:00.388 INFO:tasks.workunit.client.0.smithi100.stdout:2/805: rename d5/d26/d2f/d38/c57 to d5/d47/d4c/dab/cfc 0 2024-04-30T23:16:00.389 INFO:tasks.workunit.client.0.smithi100.stdout:7/820: link d0/d1d/d5e/d6a/d4b/d79/d2a/c6b d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dc6/c111 0 2024-04-30T23:16:00.390 INFO:tasks.workunit.client.0.smithi100.stdout:7/821: rename d0/d1b/d60/d48/d4a/d5b/l66 to d0/d1b/d60/d80/dfa/l112 0 2024-04-30T23:16:00.396 INFO:tasks.workunit.client.0.smithi100.stdout:4/809: dread d19/d1a/d6d/d64/f8a [0,4194304] 0 2024-04-30T23:16:00.408 INFO:tasks.workunit.client.0.smithi100.stdout:2/806: dwrite d5/d12/d8e/dae/dbf/fef [0,4194304] 0 2024-04-30T23:16:00.419 INFO:tasks.workunit.client.0.smithi100.stdout:4/810: mkdir d19/d1a/d21/d4a/d53/deb/dfb 0 2024-04-30T23:16:00.428 INFO:tasks.workunit.client.0.smithi100.stdout:2/807: creat d5/d12/d8e/dae/ffd x:0 0 0 2024-04-30T23:16:00.430 INFO:tasks.workunit.client.0.smithi100.stdout:4/811: symlink d19/d1a/lfc 0 2024-04-30T23:16:00.434 INFO:tasks.workunit.client.0.smithi100.stdout:4/812: link f12 d19/d1a/d21/d4a/d53/d5d/ffd 0 2024-04-30T23:16:00.438 INFO:tasks.workunit.client.0.smithi100.stdout:2/808: dread d5/d47/d4c/dab/fd0 [0,4194304] 0 2024-04-30T23:16:00.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/822: creat d0/d1b/d2e/f113 x:0 0 0 2024-04-30T23:16:00.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/809: rename d5/d22/l23 to d5/lfe 0 2024-04-30T23:16:00.456 INFO:tasks.workunit.client.0.smithi100.stdout:4/813: creat d19/d1a/d6d/d4e/ffe x:0 0 0 2024-04-30T23:16:00.461 INFO:tasks.workunit.client.0.smithi100.stdout:4/814: creat d19/d33/d3f/fff x:0 0 0 2024-04-30T23:16:00.461 INFO:tasks.workunit.client.0.smithi100.stdout:2/810: dwrite d5/d12/dc4/fcf [0,4194304] 0 2024-04-30T23:16:00.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/815: symlink d19/l100 0 2024-04-30T23:16:00.487 INFO:tasks.workunit.client.0.smithi100.stdout:4/816: dwrite d19/d33/f5a [0,4194304] 0 2024-04-30T23:16:00.488 INFO:tasks.workunit.client.0.smithi100.stdout:2/811: dwrite d5/d12/d70/dee/ff9 [0,4194304] 0 2024-04-30T23:16:00.488 INFO:tasks.workunit.client.0.smithi100.stdout:2/812: fsync d5/f2d 0 2024-04-30T23:16:00.488 INFO:tasks.workunit.client.0.smithi100.stdout:2/813: chown d5/d26/fd1 9037224 1 2024-04-30T23:16:00.493 INFO:tasks.workunit.client.0.smithi100.stdout:7/823: unlink d0/d1d/d5e/d6a/d4b/d79/d2a/f103 0 2024-04-30T23:16:00.493 INFO:tasks.workunit.client.0.smithi100.stdout:7/824: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/ffb zero size 2024-04-30T23:16:00.493 INFO:tasks.workunit.client.0.smithi100.stdout:7/825: readlink d0/df/l78 0 2024-04-30T23:16:00.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/814: creat d5/d12/d13/fff x:0 0 0 2024-04-30T23:16:00.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/815: write d5/d47/fdd [540793,57203] 0 2024-04-30T23:16:00.495 INFO:tasks.workunit.client.0.smithi100.stdout:7/826: symlink d0/d1d/d3f/l114 0 2024-04-30T23:16:00.495 INFO:tasks.workunit.client.0.smithi100.stdout:7/827: chown d0/df/d4f/fbc 330149377 1 2024-04-30T23:16:00.497 INFO:tasks.workunit.client.0.smithi100.stdout:2/816: creat d5/d2e/f100 x:0 0 0 2024-04-30T23:16:00.497 INFO:tasks.workunit.client.0.smithi100.stdout:2/817: write d5/d12/d13/d4b/ff8 [903457,98532] 0 2024-04-30T23:16:00.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/828: creat d0/df/d4f/d53/dd2/df5/f115 x:0 0 0 2024-04-30T23:16:00.503 INFO:tasks.workunit.client.0.smithi100.stdout:7/829: rename d0/d1b/d60/d80 to d0/d1b/d60/d48/d116 0 2024-04-30T23:16:00.503 INFO:tasks.workunit.client.0.smithi100.stdout:7/830: read d0/d1b/d2e/dd8/ff0 [454392,107333] 0 2024-04-30T23:16:00.505 INFO:tasks.workunit.client.0.smithi100.stdout:7/831: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/db8/f117 x:0 0 0 2024-04-30T23:16:00.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/818: dread d5/d47/d66/fec [0,4194304] 0 2024-04-30T23:16:00.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/819: mkdir d5/d12/d73/d101 0 2024-04-30T23:16:00.513 INFO:tasks.workunit.client.0.smithi100.stdout:4/817: dwrite d19/d1a/d21/d4a/d53/d5d/f96 [4194304,4194304] 0 2024-04-30T23:16:00.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/832: dread d0/d1d/d5e/d6a/d4b/dcb/fe8 [0,4194304] 0 2024-04-30T23:16:00.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/818: mkdir d19/d33/d3f/d101 0 2024-04-30T23:16:00.515 INFO:tasks.workunit.client.0.smithi100.stdout:2/820: dread d5/d12/d13/d4b/f52 [0,4194304] 0 2024-04-30T23:16:00.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/819: stat d19/d1a/c1f 0 2024-04-30T23:16:00.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/820: write d19/d1a/d21/f83 [4231209,34209] 0 2024-04-30T23:16:00.516 INFO:tasks.workunit.client.0.smithi100.stdout:2/821: unlink d5/d12/d13/c89 0 2024-04-30T23:16:00.517 INFO:tasks.workunit.client.0.smithi100.stdout:4/821: unlink d19/d33/d3f/l60 0 2024-04-30T23:16:00.518 INFO:tasks.workunit.client.0.smithi100.stdout:4/822: creat d19/f102 x:0 0 0 2024-04-30T23:16:00.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/823: dread d19/d33/d7d/fe8 [0,4194304] 0 2024-04-30T23:16:00.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/824: dread - d19/d33/d3f/fff zero size 2024-04-30T23:16:00.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/825: readlink d19/d1a/d6d/d4e/d6e/dcb/le5 0 2024-04-30T23:16:00.526 INFO:tasks.workunit.client.0.smithi100.stdout:2/822: dread d5/d47/d4c/dab/fd0 [0,4194304] 0 2024-04-30T23:16:00.528 INFO:tasks.workunit.client.0.smithi100.stdout:2/823: truncate d5/d26/f77 211061 0 2024-04-30T23:16:00.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/826: rename d19/d33/d3f to d19/d1a/d29/d103 0 2024-04-30T23:16:00.536 INFO:tasks.workunit.client.0.smithi100.stdout:4/827: mkdir d19/d1a/d6d/d4e/d6e/dcb/d104 0 2024-04-30T23:16:00.537 INFO:tasks.workunit.client.0.smithi100.stdout:7/833: dwrite d0/d1d/fdc [4194304,4194304] 0 2024-04-30T23:16:00.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/828: creat d19/d1a/d6d/d4e/f105 x:0 0 0 2024-04-30T23:16:00.539 INFO:tasks.workunit.client.0.smithi100.stdout:4/829: creat d19/d1a/d6d/d4e/f106 x:0 0 0 2024-04-30T23:16:00.541 INFO:tasks.workunit.client.0.smithi100.stdout:4/830: link d19/d1a/d29/dae/fb0 d19/d33/f107 0 2024-04-30T23:16:00.543 INFO:tasks.workunit.client.0.smithi100.stdout:7/834: rename d0/d1b/d60/l61 to d0/l118 0 2024-04-30T23:16:00.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/831: mknod d19/d1a/d21/c108 0 2024-04-30T23:16:00.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:00 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:16:00.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:00 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:16:00.546 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:00 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:16:00.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:00 smithi104 ceph-mon[32987]: scrub summary: idle 2024-04-30T23:16:00.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:00 smithi104 ceph-mon[32987]: pgmap v445: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s rd, 175 MiB/s wr, 406 op/s 2024-04-30T23:16:00.550 INFO:tasks.workunit.client.0.smithi100.stdout:4/832: dread d19/d1a/d21/d4a/d53/f8f [0,4194304] 0 2024-04-30T23:16:00.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:00 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:16:00.551 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:00 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:16:00.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:00 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:16:00.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:00 smithi183 ceph-mon[33560]: scrub summary: idle 2024-04-30T23:16:00.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:00 smithi183 ceph-mon[33560]: pgmap v445: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s rd, 175 MiB/s wr, 406 op/s 2024-04-30T23:16:00.552 INFO:tasks.workunit.client.0.smithi100.stdout:4/833: unlink d19/d1a/d95/fb5 0 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:1/553: sync 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/628: sync 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:3/724: sync 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:3/725: chown d1/d14/d2b/d57/fa1 11658 1 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/629: fdatasync d4/d9/d51/d89/dbb/dcc/fdd 0 2024-04-30T23:16:00.553 INFO:tasks.workunit.client.0.smithi100.stdout:1/554: write d3/d16/d20/d24/d51/d59/d5f/f8f [618587,75201] 0 2024-04-30T23:16:00.556 INFO:tasks.workunit.client.0.smithi100.stdout:7/835: dread d0/d1b/d2e/d3d/f9b [0,4194304] 0 2024-04-30T23:16:00.557 INFO:tasks.workunit.client.0.smithi100.stdout:2/824: dwrite d5/d22/f60 [0,4194304] 0 2024-04-30T23:16:00.557 INFO:tasks.workunit.client.0.smithi100.stdout:2/825: write d5/d47/f8b [2182619,82092] 0 2024-04-30T23:16:00.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/834: creat d19/d1a/d6d/d64/d78/dea/f109 x:0 0 0 2024-04-30T23:16:00.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/726: creat d1/d14/d15/d2c/fe0 x:0 0 0 2024-04-30T23:16:00.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/727: chown d1/d14/d2f/dd5/cba 5644 1 2024-04-30T23:16:00.564 INFO:tasks.workunit.client.0.smithi100.stdout:7/836: creat d0/d1b/d60/d48/d116/f119 x:0 0 0 2024-04-30T23:16:00.564 INFO:tasks.workunit.client.0.smithi100.stdout:7/837: truncate d0/d1d/d5e/d6a/d4b/dcb/fe8 1610108 0 2024-04-30T23:16:00.564 INFO:tasks.workunit.client.0.smithi100.stdout:7/838: chown d0/d1b/d60/d48/d4a/l9f 3402 1 2024-04-30T23:16:00.565 INFO:tasks.workunit.client.0.smithi100.stdout:7/839: dread - d0/d1b/d60/f9a zero size 2024-04-30T23:16:00.565 INFO:tasks.workunit.client.0.smithi100.stdout:7/840: chown d0/d1b/d60/d48/d116/d91/ca5 13583 1 2024-04-30T23:16:00.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/835: creat d19/d1a/d29/dae/f10a x:0 0 0 2024-04-30T23:16:00.570 INFO:tasks.workunit.client.0.smithi100.stdout:3/728: symlink d1/d14/d15/d27/d34/le1 0 2024-04-30T23:16:00.571 INFO:tasks.workunit.client.0.smithi100.stdout:7/841: mknod d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/df6/c11a 0 2024-04-30T23:16:00.573 INFO:tasks.workunit.client.0.smithi100.stdout:4/836: mknod d19/d1a/d6d/d4e/d6e/c10b 0 2024-04-30T23:16:00.574 INFO:tasks.workunit.client.0.smithi100.stdout:3/729: mknod d1/d14/d15/d27/d34/ce2 0 2024-04-30T23:16:00.578 INFO:tasks.workunit.client.0.smithi100.stdout:7/842: link d0/df/d4f/d93/db1/ded/f10b d0/d1b/d60/d48/d116/f11b 0 2024-04-30T23:16:00.578 INFO:tasks.workunit.client.0.smithi100.stdout:3/730: symlink d1/d14/d15/d27/d5d/le3 0 2024-04-30T23:16:00.578 INFO:tasks.workunit.client.0.smithi100.stdout:7/843: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72 39 2024-04-30T23:16:00.579 INFO:tasks.workunit.client.0.smithi100.stdout:3/731: getdents d1/d14/d2b 0 2024-04-30T23:16:00.579 INFO:tasks.workunit.client.0.smithi100.stdout:3/732: write d1/d14/d2f/dd5/fc9 [365279,49222] 0 2024-04-30T23:16:00.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/844: fdatasync d0/d1b/d60/d48/f8e 0 2024-04-30T23:16:00.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/845: chown d0/d1b/d85/lac 32642 1 2024-04-30T23:16:00.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/846: chown d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/fa7 51905996 1 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/847: fsync d0/df/d4f/d53/f5a 0 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/848: fsync d0/d1b/d1e/f40 0 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/849: chown d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/lf9 3 1 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:3/733: symlink d1/d14/d15/d32/d6f/da2/d6d/d81/le4 0 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:9/630: dwrite d4/d9/d51/d89/dbb/dcc/fdd [4194304,4194304] 0 2024-04-30T23:16:00.580 INFO:tasks.workunit.client.0.smithi100.stdout:9/631: dread - d4/fb3 zero size 2024-04-30T23:16:00.581 INFO:tasks.workunit.client.0.smithi100.stdout:9/632: stat d4/d7/d8/d37/f6c 0 2024-04-30T23:16:00.581 INFO:tasks.workunit.client.0.smithi100.stdout:2/826: dwrite d5/d12/d13/f59 [4194304,4194304] 0 2024-04-30T23:16:00.581 INFO:tasks.workunit.client.0.smithi100.stdout:7/850: getdents d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb 0 2024-04-30T23:16:00.583 INFO:tasks.workunit.client.0.smithi100.stdout:3/734: creat d1/d14/d15/d32/d6f/fe5 x:0 0 0 2024-04-30T23:16:00.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/735: write d1/d14/d15/fd8 [698040,67152] 0 2024-04-30T23:16:00.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/736: stat d1/d14/d21/f48 0 2024-04-30T23:16:00.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/737: readlink d1/d14/d15/d32/d6f/da2/d26/l3f 0 2024-04-30T23:16:00.584 INFO:tasks.workunit.client.0.smithi100.stdout:9/633: mkdir d4/d7/d8/d19/de2 0 2024-04-30T23:16:00.585 INFO:tasks.workunit.client.0.smithi100.stdout:9/634: stat d4/d9/d51/d89/fa9 0 2024-04-30T23:16:00.593 INFO:tasks.workunit.client.0.smithi100.stdout:7/851: creat d0/d1b/d60/d48/d116/f11c x:0 0 0 2024-04-30T23:16:00.595 INFO:tasks.workunit.client.0.smithi100.stdout:3/738: truncate d1/f10 1012776 0 2024-04-30T23:16:00.596 INFO:tasks.workunit.client.0.smithi100.stdout:3/739: chown d1/d14/d2b/d57/l93 39832884 1 2024-04-30T23:16:00.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/635: unlink d4/d9/d8e/l9f 0 2024-04-30T23:16:00.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/636: truncate d4/d7/fd5 1107077 0 2024-04-30T23:16:00.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/852: chown d0/cb 218187545 1 2024-04-30T23:16:00.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/853: stat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/fc4 0 2024-04-30T23:16:00.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/637: rmdir d4/d7/d60/d69 39 2024-04-30T23:16:00.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/638: write d4/d7/fca [2401561,82993] 0 2024-04-30T23:16:00.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/639: stat d4/d7/dab/db4 0 2024-04-30T23:16:00.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/854: getdents d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad 0 2024-04-30T23:16:00.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/855: fdatasync d0/d1d/d5e/d6a/d4b/d79/f3b 0 2024-04-30T23:16:00.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/856: write d0/df/f22 [2347682,111310] 0 2024-04-30T23:16:00.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/857: readlink d0/df/l13 0 2024-04-30T23:16:00.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/858: dread d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 [0,4194304] 0 2024-04-30T23:16:00.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/640: symlink d4/d9/d51/d89/le3 0 2024-04-30T23:16:00.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/641: truncate d4/d7/d8/f4d 1624754 0 2024-04-30T23:16:00.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/827: dwrite d5/d2e/fcb [0,4194304] 0 2024-04-30T23:16:00.604 INFO:tasks.workunit.client.0.smithi100.stdout:9/642: creat d4/d7/d8/d19/de2/fe4 x:0 0 0 2024-04-30T23:16:00.604 INFO:tasks.workunit.client.0.smithi100.stdout:9/643: write d4/d7/d60/d69/fcf [808799,91265] 0 2024-04-30T23:16:00.604 INFO:tasks.workunit.client.0.smithi100.stdout:2/828: read d5/f49 [420393,125118] 0 2024-04-30T23:16:00.606 INFO:tasks.workunit.client.0.smithi100.stdout:2/829: creat d5/d8f/f102 x:0 0 0 2024-04-30T23:16:00.623 INFO:tasks.workunit.client.0.smithi100.stdout:3/740: dwrite d1/d14/d21/d67/f77 [0,4194304] 0 2024-04-30T23:16:00.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/741: fdatasync d1/d14/d15/d32/d92/f9d 0 2024-04-30T23:16:00.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/644: write d4/d9/d10/d7f/fa6 [81917,88711] 0 2024-04-30T23:16:00.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/645: dread - d4/d7/f62 zero size 2024-04-30T23:16:00.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/742: symlink d1/d14/d15/d32/d6f/da2/d6d/d81/dae/le6 0 2024-04-30T23:16:00.625 INFO:tasks.workunit.client.0.smithi100.stdout:0/709: sync 2024-04-30T23:16:00.626 INFO:tasks.workunit.client.0.smithi100.stdout:3/743: creat d1/d14/d2f/dc8/fe7 x:0 0 0 2024-04-30T23:16:00.631 INFO:tasks.workunit.client.0.smithi100.stdout:2/830: dread d5/d12/d13/d4b/f99 [0,4194304] 0 2024-04-30T23:16:00.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/859: dwrite d0/d1b/d60/d48/f50 [0,4194304] 0 2024-04-30T23:16:00.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/860: write d0/d1d/fc7 [925901,58789] 0 2024-04-30T23:16:00.644 INFO:tasks.workunit.client.0.smithi100.stdout:7/861: rename d0/c69 to d0/d1d/d3c/df3/c11d 0 2024-04-30T23:16:00.646 INFO:tasks.workunit.client.0.smithi100.stdout:0/710: read d2/d14/d35/d40/f9b [1183680,27932] 0 2024-04-30T23:16:00.646 INFO:tasks.workunit.client.0.smithi100.stdout:0/711: getdents d2/d4c/d68/dd1 0 2024-04-30T23:16:00.649 INFO:tasks.workunit.client.0.smithi100.stdout:9/646: dread d4/d7/d8/d37/d3d/f41 [0,4194304] 0 2024-04-30T23:16:00.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/831: dread d5/f25 [4194304,4194304] 0 2024-04-30T23:16:00.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/832: write d5/d2e/f100 [40519,22253] 0 2024-04-30T23:16:00.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/647: getdents d4/d9/d6f 0 2024-04-30T23:16:00.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/648: dread - d4/d7/fb6 zero size 2024-04-30T23:16:00.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/649: write d4/d7/d8/d37/d58/f77 [984357,65707] 0 2024-04-30T23:16:00.655 INFO:tasks.workunit.client.0.smithi100.stdout:9/650: creat d4/d7/dab/fe5 x:0 0 0 2024-04-30T23:16:00.664 INFO:tasks.workunit.client.0.smithi100.stdout:2/833: dread d5/d22/f2c [0,4194304] 0 2024-04-30T23:16:00.664 INFO:tasks.workunit.client.0.smithi100.stdout:2/834: fdatasync d5/d12/d8e/f98 0 2024-04-30T23:16:00.665 INFO:tasks.workunit.client.0.smithi100.stdout:2/835: getdents d5/d22/da6 0 2024-04-30T23:16:00.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/836: mknod d5/d12/d70/c103 0 2024-04-30T23:16:00.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/862: dwrite d0/d1d/d5e/d6a/f35 [4194304,4194304] 0 2024-04-30T23:16:00.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/712: dwrite d2/d14/d35/d57/f60 [4194304,4194304] 0 2024-04-30T23:16:00.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/713: fsync d2/d50/d30/d32/f3b 0 2024-04-30T23:16:00.676 INFO:tasks.workunit.client.0.smithi100.stdout:2/837: dread d5/d22/f4e [4194304,4194304] 0 2024-04-30T23:16:00.678 INFO:tasks.workunit.client.0.smithi100.stdout:2/838: write d5/f28 [375215,100860] 0 2024-04-30T23:16:00.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/651: dwrite d4/d9/d10/f4a [0,4194304] 0 2024-04-30T23:16:00.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/652: read - d4/d9/d50/fd6 zero size 2024-04-30T23:16:00.684 INFO:tasks.workunit.client.0.smithi100.stdout:9/653: truncate d4/d9/d10/f28 597602 0 2024-04-30T23:16:00.684 INFO:tasks.workunit.client.0.smithi100.stdout:9/654: truncate d4/d9/d10/d7f/f9a 1147004 0 2024-04-30T23:16:00.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/655: dread d4/d7/fd5 [0,4194304] 0 2024-04-30T23:16:00.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/656: write d4/d9/d6f/fbf [816957,3676] 0 2024-04-30T23:16:00.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/657: unlink d4/d7/d8/d37/d58/f99 0 2024-04-30T23:16:00.697 INFO:tasks.workunit.client.0.smithi100.stdout:9/658: chown d4/d7/d8/c47 123700 1 2024-04-30T23:16:00.697 INFO:tasks.workunit.client.0.smithi100.stdout:2/839: write d5/d47/fdd [485278,130574] 0 2024-04-30T23:16:00.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/840: symlink d5/d22/da6/l104 0 2024-04-30T23:16:00.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/841: chown d5/d12/d13/d9e/fdc 1 1 2024-04-30T23:16:00.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/842: write d5/d47/d4c/f92 [1232300,32833] 0 2024-04-30T23:16:00.699 INFO:tasks.workunit.client.0.smithi100.stdout:7/863: dwrite d0/d1b/d60/d48/f50 [4194304,4194304] 0 2024-04-30T23:16:00.700 INFO:tasks.workunit.client.0.smithi100.stdout:2/843: mknod d5/d47/d66/c105 0 2024-04-30T23:16:00.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/864: symlink d0/df/d4f/d53/dd2/l11e 0 2024-04-30T23:16:00.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/865: chown d0/d1d/d5e/d6a/d4b/c109 1051025 1 2024-04-30T23:16:00.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/844: creat d5/d12/d70/dc3/f106 x:0 0 0 2024-04-30T23:16:00.709 INFO:tasks.workunit.client.0.smithi100.stdout:0/714: dwrite d2/d14/d35/d57/f6b [4194304,4194304] 0 2024-04-30T23:16:00.723 INFO:tasks.workunit.client.0.smithi100.stdout:9/659: dread d4/d7/d60/d69/fa4 [0,4194304] 0 2024-04-30T23:16:00.725 INFO:tasks.workunit.client.0.smithi100.stdout:9/660: creat d4/d7/d8/d37/d58/fe6 x:0 0 0 2024-04-30T23:16:00.729 INFO:tasks.workunit.client.0.smithi100.stdout:2/845: dwrite d5/d47/d4c/fb5 [0,4194304] 0 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:9/661: read d4/d7/d8/d37/d58/f77 [50472,32994] 0 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/866: dwrite d0/d1d/d5e/d6a/d4b/d79/f3b [0,4194304] 0 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/867: fsync d0/d1b/d60/d48/d116/f11b 0 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:8/693: sync 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:5/781: sync 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:6/645: sync 2024-04-30T23:16:00.731 INFO:tasks.workunit.client.0.smithi100.stdout:8/694: chown d2/d89/d72/f9b 1037598890 1 2024-04-30T23:16:00.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/782: read - d1/d2c/d60/d66/fed zero size 2024-04-30T23:16:00.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/868: symlink d0/d1b/d60/dbe/d106/l11f 0 2024-04-30T23:16:00.732 INFO:tasks.workunit.client.0.smithi100.stdout:0/715: dwrite d2/d14/d18/f33 [0,4194304] 0 2024-04-30T23:16:00.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/695: creat d2/d7/fe6 x:0 0 0 2024-04-30T23:16:00.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/696: dread - d2/d29/f61 zero size 2024-04-30T23:16:00.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/662: dread d4/d9/d6f/f90 [0,4194304] 0 2024-04-30T23:16:00.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/846: write d5/d47/d4c/f51 [73716,49498] 0 2024-04-30T23:16:00.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/847: write d5/d47/d4c/ff0 [3218236,124892] 0 2024-04-30T23:16:00.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/848: chown d5/d47/d4c/fce 117 1 2024-04-30T23:16:00.735 INFO:tasks.workunit.client.0.smithi100.stdout:7/869: rename d0/d1d/d5e/d6a/d4b/d79/d2a/f96 to d0/d1b/d60/f120 0 2024-04-30T23:16:00.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/870: dread d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 [0,4194304] 0 2024-04-30T23:16:00.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/871: dread - d0/d1d/d5e/f10a zero size 2024-04-30T23:16:00.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/872: dread - d0/df/d4f/fbc zero size 2024-04-30T23:16:00.737 INFO:tasks.workunit.client.0.smithi100.stdout:0/716: mkdir d2/d50/d30/dd8 0 2024-04-30T23:16:00.737 INFO:tasks.workunit.client.0.smithi100.stdout:8/697: stat d2/d7/d18/c32 0 2024-04-30T23:16:00.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/873: dread d0/d1d/d5e/d6a/d4b/d79/d2a/f52 [0,4194304] 0 2024-04-30T23:16:00.737 INFO:tasks.workunit.client.0.smithi100.stdout:9/663: creat d4/d9/fe7 x:0 0 0 2024-04-30T23:16:00.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/849: symlink d5/d12/d8e/dae/l107 0 2024-04-30T23:16:00.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/850: fsync d5/d26/d2f/d38/faf 0 2024-04-30T23:16:00.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/851: write d5/f80 [9242663,64399] 0 2024-04-30T23:16:00.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/852: readlink d5/d12/ld4 0 2024-04-30T23:16:00.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/698: creat d2/d89/d10/d52/d9a/db9/fe7 x:0 0 0 2024-04-30T23:16:00.740 INFO:tasks.workunit.client.0.smithi100.stdout:7/874: stat d0/d1d/d3f/lde 0 2024-04-30T23:16:00.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/664: symlink d4/d9/d10/db9/dc4/le8 0 2024-04-30T23:16:00.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/665: write d4/fb3 [553934,16050] 0 2024-04-30T23:16:00.742 INFO:tasks.workunit.client.0.smithi100.stdout:2/853: rename d5/d12/d70/ccd to d5/d12/dc4/c108 0 2024-04-30T23:16:00.742 INFO:tasks.workunit.client.0.smithi100.stdout:2/854: chown d5/d12/d13/d9e/fdc 23246127 1 2024-04-30T23:16:00.743 INFO:tasks.workunit.client.0.smithi100.stdout:8/699: creat d2/d29/d9e/daf/fe8 x:0 0 0 2024-04-30T23:16:00.743 INFO:tasks.workunit.client.0.smithi100.stdout:8/700: chown d2/d29/d71/d86/cde 1635 1 2024-04-30T23:16:00.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/701: symlink d2/d29/d8b/d8e/le9 0 2024-04-30T23:16:00.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/702: rmdir d2/d7/d18/d3a 39 2024-04-30T23:16:00.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/703: truncate d2/d7/f45 2307445 0 2024-04-30T23:16:00.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/704: mkdir d2/d29/d67/dea 0 2024-04-30T23:16:00.748 INFO:tasks.workunit.client.0.smithi100.stdout:8/705: symlink d2/d29/d71/ddb/leb 0 2024-04-30T23:16:00.750 INFO:tasks.workunit.client.0.smithi100.stdout:5/783: dread d1/d37/f6d [0,4194304] 0 2024-04-30T23:16:00.751 INFO:tasks.workunit.client.0.smithi100.stdout:5/784: chown d1/d2c/d60/d66/d71/db6/dd4 6687 1 2024-04-30T23:16:00.751 INFO:tasks.workunit.client.0.smithi100.stdout:5/785: chown d1/d2c/d60/d66/d75 53654 1 2024-04-30T23:16:00.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/646: dwrite d7/d9/d86/d62/faa [0,4194304] 0 2024-04-30T23:16:00.764 INFO:tasks.workunit.client.0.smithi100.stdout:2/855: truncate d5/d12/d13/f59 9235764 0 2024-04-30T23:16:00.767 INFO:tasks.workunit.client.0.smithi100.stdout:6/647: creat d7/df/d23/d2b/d42/fed x:0 0 0 2024-04-30T23:16:00.769 INFO:tasks.workunit.client.0.smithi100.stdout:2/856: link d5/f14 d5/d12/d8e/dae/dbf/f109 0 2024-04-30T23:16:00.771 INFO:tasks.workunit.client.0.smithi100.stdout:6/648: mknod d7/d9/d86/d3e/d6b/d75/cee 0 2024-04-30T23:16:00.772 INFO:tasks.workunit.client.0.smithi100.stdout:2/857: mknod d5/c10a 0 2024-04-30T23:16:00.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/717: dwrite d2/f3a [0,4194304] 0 2024-04-30T23:16:00.773 INFO:tasks.workunit.client.0.smithi100.stdout:7/875: dwrite d0/d1b/d60/d48/d4a/d87/f8c [0,4194304] 0 2024-04-30T23:16:00.773 INFO:tasks.workunit.client.0.smithi100.stdout:7/876: chown d0/d1b/d60/d48/d116/d91/ca5 958 1 2024-04-30T23:16:00.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/649: getdents d7/df/d23/d24/d2e/d37/d85/db4 0 2024-04-30T23:16:00.774 INFO:tasks.workunit.client.0.smithi100.stdout:2/858: dread d5/d26/f77 [0,4194304] 0 2024-04-30T23:16:00.775 INFO:tasks.workunit.client.0.smithi100.stdout:9/666: dwrite d4/d9/d10/d7f/f95 [0,4194304] 0 2024-04-30T23:16:00.777 INFO:tasks.workunit.client.0.smithi100.stdout:5/786: dread d1/d2c/d60/f65 [0,4194304] 0 2024-04-30T23:16:00.777 INFO:tasks.workunit.client.0.smithi100.stdout:5/787: chown d1/d12/d1a/d76/d77/d8c/f9c 12349 1 2024-04-30T23:16:00.778 INFO:tasks.workunit.client.0.smithi100.stdout:7/877: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/f121 x:0 0 0 2024-04-30T23:16:00.778 INFO:tasks.workunit.client.0.smithi100.stdout:7/878: write d0/df/d4f/d53/dd2/df5/f115 [622360,107084] 0 2024-04-30T23:16:00.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/650: creat d7/d9/deb/fef x:0 0 0 2024-04-30T23:16:00.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/651: stat d7/df/d23/d2b/d42/d84/f93 0 2024-04-30T23:16:00.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/859: symlink d5/d2e/l10b 0 2024-04-30T23:16:00.782 INFO:tasks.workunit.client.0.smithi100.stdout:2/860: stat d5/d47/d66 0 2024-04-30T23:16:00.784 INFO:tasks.workunit.client.0.smithi100.stdout:9/667: creat d4/d7/d60/d69/fe9 x:0 0 0 2024-04-30T23:16:00.785 INFO:tasks.workunit.client.0.smithi100.stdout:2/861: rmdir d5/d47/d66 39 2024-04-30T23:16:00.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/652: dread d7/df/d23/d24/d2e/d37/d85/fb3 [0,4194304] 0 2024-04-30T23:16:00.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/653: chown d7/df/d23/d24/d2e/d37/d85/db4/lc3 14031 1 2024-04-30T23:16:00.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/654: fsync d7/db/fa8 0 2024-04-30T23:16:00.790 INFO:tasks.workunit.client.0.smithi100.stdout:6/655: symlink d7/d9/d86/d1b/d22/d38/lf0 0 2024-04-30T23:16:00.802 INFO:tasks.workunit.client.0.smithi100.stdout:2/862: dread d5/d26/d2f/d38/f75 [0,4194304] 0 2024-04-30T23:16:00.803 INFO:tasks.workunit.client.0.smithi100.stdout:6/656: dread d7/d9/f31 [0,4194304] 0 2024-04-30T23:16:00.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/657: rmdir d7/d9/d86/d3e 39 2024-04-30T23:16:00.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/658: truncate d7/db/d3b/fa1 783008 0 2024-04-30T23:16:00.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/659: chown d7/d9/d86/d1b/ca6 64006025 1 2024-04-30T23:16:00.805 INFO:tasks.workunit.client.0.smithi100.stdout:6/660: creat d7/df/d23/d4f/ff1 x:0 0 0 2024-04-30T23:16:00.806 INFO:tasks.workunit.client.0.smithi100.stdout:5/788: dwrite d1/d19/f46 [4194304,4194304] 0 2024-04-30T23:16:00.806 INFO:tasks.workunit.client.0.smithi100.stdout:7/879: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/f52 [0,4194304] 0 2024-04-30T23:16:00.806 INFO:tasks.workunit.client.0.smithi100.stdout:0/718: dwrite d2/d14/d18/f2d [0,4194304] 0 2024-04-30T23:16:00.806 INFO:tasks.workunit.client.0.smithi100.stdout:6/661: symlink d7/d9/d86/db0/lf2 0 2024-04-30T23:16:00.808 INFO:tasks.workunit.client.0.smithi100.stdout:5/789: symlink d1/d12/d24/d34/lfe 0 2024-04-30T23:16:00.812 INFO:tasks.workunit.client.0.smithi100.stdout:7/880: mkdir d0/d1b/d60/dbe/d122 0 2024-04-30T23:16:00.812 INFO:tasks.workunit.client.0.smithi100.stdout:7/881: chown d0/d1b/d2e/la0 1 1 2024-04-30T23:16:00.813 INFO:tasks.workunit.client.0.smithi100.stdout:6/662: symlink d7/lf3 0 2024-04-30T23:16:00.814 INFO:tasks.workunit.client.0.smithi100.stdout:6/663: mkdir d7/df/d23/d4f/df4 0 2024-04-30T23:16:00.815 INFO:tasks.workunit.client.0.smithi100.stdout:6/664: creat d7/d9/ff5 x:0 0 0 2024-04-30T23:16:00.825 INFO:tasks.workunit.client.0.smithi100.stdout:0/719: dread d2/d14/d35/fa7 [0,4194304] 0 2024-04-30T23:16:00.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/665: dread d7/db/d3b/f58 [0,4194304] 0 2024-04-30T23:16:00.830 INFO:tasks.workunit.client.0.smithi100.stdout:2/863: dwrite d5/d47/d4c/fce [0,4194304] 0 2024-04-30T23:16:00.830 INFO:tasks.workunit.client.0.smithi100.stdout:2/864: write d5/fa4 [362351,11767] 0 2024-04-30T23:16:00.833 INFO:tasks.workunit.client.0.smithi100.stdout:5/790: dwrite d1/d3e/f45 [0,4194304] 0 2024-04-30T23:16:00.839 INFO:tasks.workunit.client.0.smithi100.stdout:7/882: dwrite d0/d1b/d60/d48/d4a/d5b/ff4 [0,4194304] 0 2024-04-30T23:16:00.841 INFO:tasks.workunit.client.0.smithi100.stdout:7/883: truncate d0/d1b/d60/d48/f64 3637929 0 2024-04-30T23:16:00.843 INFO:tasks.workunit.client.0.smithi100.stdout:7/884: rename d0/d1d/d5e/d6a/d4b/d79/l86 to d0/d1d/d3f/l123 0 2024-04-30T23:16:00.843 INFO:tasks.workunit.client.0.smithi100.stdout:7/885: chown d0/d1b/d60/dbe/d106/l11f 406 1 2024-04-30T23:16:00.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/886: link d0/cc d0/d1b/d60/d48/d4a/d5b/c124 0 2024-04-30T23:16:00.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/887: write d0/df/d4f/d53/f59 [1773031,5068] 0 2024-04-30T23:16:00.846 INFO:tasks.workunit.client.0.smithi100.stdout:6/666: dread d7/d9/f31 [0,4194304] 0 2024-04-30T23:16:00.848 INFO:tasks.workunit.client.0.smithi100.stdout:5/791: dread d1/d12/d24/d34/f69 [0,4194304] 0 2024-04-30T23:16:00.848 INFO:tasks.workunit.client.0.smithi100.stdout:5/792: write d1/d2c/d5d/f72 [629062,17504] 0 2024-04-30T23:16:00.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/793: creat d1/d3e/d99/dbf/dd0/fff x:0 0 0 2024-04-30T23:16:00.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/794: dread - d1/d12/d74/fe5 zero size 2024-04-30T23:16:00.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/865: dread d5/d47/d4c/fb5 [0,4194304] 0 2024-04-30T23:16:00.851 INFO:tasks.workunit.client.0.smithi100.stdout:5/795: creat d1/d12/de1/dea/f100 x:0 0 0 2024-04-30T23:16:00.852 INFO:tasks.workunit.client.0.smithi100.stdout:5/796: creat d1/d2c/d60/d66/d71/f101 x:0 0 0 2024-04-30T23:16:00.853 INFO:tasks.workunit.client.0.smithi100.stdout:6/667: write d7/d9/d86/d3e/d6b/fb9 [3068352,63567] 0 2024-04-30T23:16:00.853 INFO:tasks.workunit.client.0.smithi100.stdout:6/668: dread - d7/df/d23/d2b/d42/fdf zero size 2024-04-30T23:16:00.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/797: rename d1/d2c/d5d/fa0 to d1/d2c/d60/d66/d71/db6/dd4/f102 0 2024-04-30T23:16:00.856 INFO:tasks.workunit.client.0.smithi100.stdout:5/798: truncate d1/d19/f1e 2612982 0 2024-04-30T23:16:00.860 INFO:tasks.workunit.client.0.smithi100.stdout:7/888: write d0/d1b/d60/d48/f50 [3001211,65849] 0 2024-04-30T23:16:00.862 INFO:tasks.workunit.client.0.smithi100.stdout:7/889: creat d0/d1d/d5e/d6a/d4b/d79/dd0/f125 x:0 0 0 2024-04-30T23:16:00.867 INFO:tasks.workunit.client.0.smithi100.stdout:2/866: dread d5/d47/d4c/fce [0,4194304] 0 2024-04-30T23:16:00.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/867: mkdir d5/d22/da6/d10c 0 2024-04-30T23:16:00.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/868: read d5/f49 [213661,14205] 0 2024-04-30T23:16:00.876 INFO:tasks.workunit.client.0.smithi100.stdout:6/669: dwrite d7/df/f3c [0,4194304] 0 2024-04-30T23:16:00.876 INFO:tasks.workunit.client.0.smithi100.stdout:6/670: fdatasync d7/d9/d86/db0/f7b 0 2024-04-30T23:16:00.878 INFO:tasks.workunit.client.0.smithi100.stdout:5/799: write d1/d2c/d60/d66/d71/db6/dd4/f102 [2267134,18483] 0 2024-04-30T23:16:00.880 INFO:tasks.workunit.client.0.smithi100.stdout:2/869: mknod d5/d12/d70/dc3/c10d 0 2024-04-30T23:16:00.882 INFO:tasks.workunit.client.0.smithi100.stdout:5/800: truncate d1/d3e/f45 332235 0 2024-04-30T23:16:00.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/870: truncate d5/f62 4189397 0 2024-04-30T23:16:00.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/890: dwrite d0/f16 [0,4194304] 0 2024-04-30T23:16:00.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/891: chown d0/d1b/d60/dbe/dd5 419 1 2024-04-30T23:16:00.892 INFO:tasks.workunit.client.0.smithi100.stdout:7/892: symlink d0/d1d/d5e/l126 0 2024-04-30T23:16:00.892 INFO:tasks.workunit.client.0.smithi100.stdout:6/671: write d7/d9/d86/d1b/d5a/fb1 [551915,88976] 0 2024-04-30T23:16:00.893 INFO:tasks.workunit.client.0.smithi100.stdout:7/893: symlink d0/d1b/d60/dbe/dd5/l127 0 2024-04-30T23:16:00.895 INFO:tasks.workunit.client.0.smithi100.stdout:7/894: rmdir d0/d1d/d3f 39 2024-04-30T23:16:00.898 INFO:tasks.workunit.client.0.smithi100.stdout:7/895: creat d0/d1d/d5e/d6a/d4b/dcb/f128 x:0 0 0 2024-04-30T23:16:00.898 INFO:tasks.workunit.client.0.smithi100.stdout:7/896: truncate d0/d1b/d60/d48/d116/f90 1115314 0 2024-04-30T23:16:00.898 INFO:tasks.workunit.client.0.smithi100.stdout:7/897: write d0/d1b/d1e/f40 [1533896,12810] 0 2024-04-30T23:16:00.898 INFO:tasks.workunit.client.0.smithi100.stdout:7/898: readlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/l8b 0 2024-04-30T23:16:00.900 INFO:tasks.workunit.client.0.smithi100.stdout:2/871: write d5/d47/d4c/f4f [3837201,5119] 0 2024-04-30T23:16:00.900 INFO:tasks.workunit.client.0.smithi100.stdout:7/899: dread d0/d1b/d60/f54 [0,4194304] 0 2024-04-30T23:16:00.900 INFO:tasks.workunit.client.0.smithi100.stdout:7/900: read d0/d1d/d5e/d6a/d4b/d79/d2a/fbf [1090465,121515] 0 2024-04-30T23:16:00.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/872: link d5/d26/d2f/d38/f61 d5/d12/d8e/dae/f10e 0 2024-04-30T23:16:00.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/873: stat d5/d12/f1e 0 2024-04-30T23:16:00.902 INFO:tasks.workunit.client.0.smithi100.stdout:7/901: mkdir d0/d1b/d2e/d3d/d129 0 2024-04-30T23:16:00.908 INFO:tasks.workunit.client.0.smithi100.stdout:2/874: dread d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:16:00.909 INFO:tasks.workunit.client.0.smithi100.stdout:6/672: dread d7/df/d23/d24/d2e/d37/fdc [0,4194304] 0 2024-04-30T23:16:00.909 INFO:tasks.workunit.client.0.smithi100.stdout:6/673: readlink d7/df/d23/d24/d2e/l45 0 2024-04-30T23:16:00.910 INFO:tasks.workunit.client.0.smithi100.stdout:5/801: dwrite d1/d12/f21 [0,4194304] 0 2024-04-30T23:16:00.912 INFO:tasks.workunit.client.0.smithi100.stdout:6/674: getdents d7/d11/d34 0 2024-04-30T23:16:00.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/675: write d7/db/dd1/fd4 [2301409,70462] 0 2024-04-30T23:16:00.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/676: stat d7/df/d23/d2b/c35 0 2024-04-30T23:16:00.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/555: sync 2024-04-30T23:16:00.921 INFO:tasks.workunit.client.0.smithi100.stdout:3/744: sync 2024-04-30T23:16:00.921 INFO:tasks.workunit.client.0.smithi100.stdout:4/837: sync 2024-04-30T23:16:00.921 INFO:tasks.workunit.client.0.smithi100.stdout:4/838: fsync d19/d1a/d21/d4a/d53/d5e/fb4 0 2024-04-30T23:16:00.922 INFO:tasks.workunit.client.0.smithi100.stdout:4/839: readlink d19/d1a/d6d/d64/l88 0 2024-04-30T23:16:00.922 INFO:tasks.workunit.client.0.smithi100.stdout:3/745: write d1/f8d [1580884,41334] 0 2024-04-30T23:16:00.922 INFO:tasks.workunit.client.0.smithi100.stdout:3/746: chown d1/d38/d79 58 1 2024-04-30T23:16:00.922 INFO:tasks.workunit.client.0.smithi100.stdout:6/677: rename d7/d9/d86/d62/l6c to d7/d9/d86/d3e/dd6/lf6 0 2024-04-30T23:16:00.922 INFO:tasks.workunit.client.0.smithi100.stdout:6/678: chown d7/df/f3c 13798 1 2024-04-30T23:16:00.923 INFO:tasks.workunit.client.0.smithi100.stdout:1/556: creat d3/fa0 x:0 0 0 2024-04-30T23:16:00.924 INFO:tasks.workunit.client.0.smithi100.stdout:4/840: mkdir d19/d1a/d6d/d64/d78/d10c 0 2024-04-30T23:16:00.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/802: write d1/d3e/d99/fc2 [1539973,76104] 0 2024-04-30T23:16:00.930 INFO:tasks.workunit.client.0.smithi100.stdout:2/875: dwrite d5/d47/d66/f69 [0,4194304] 0 2024-04-30T23:16:00.930 INFO:tasks.workunit.client.0.smithi100.stdout:2/876: fsync d5/d12/d8e/dae/fe1 0 2024-04-30T23:16:00.934 INFO:tasks.workunit.client.0.smithi100.stdout:3/747: rename d1/d14/d2f/dd5 to d1/d14/d15/d32/de8 0 2024-04-30T23:16:00.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/841: mkdir d19/d1a/d29/d103/d40/da2/d10d 0 2024-04-30T23:16:00.935 INFO:tasks.workunit.client.0.smithi100.stdout:3/748: chown d1/d14/c2e 12 1 2024-04-30T23:16:00.935 INFO:tasks.workunit.client.0.smithi100.stdout:3/749: chown d1/d14/d15/d32/d6f/da2/f39 637732 1 2024-04-30T23:16:00.935 INFO:tasks.workunit.client.0.smithi100.stdout:3/750: truncate d1/d14/d15/d32/d6f/fe5 213660 0 2024-04-30T23:16:00.935 INFO:tasks.workunit.client.0.smithi100.stdout:3/751: chown d1/d14/d15/d32/d6f/da2/d26/c8b 742594 1 2024-04-30T23:16:00.941 INFO:tasks.workunit.client.0.smithi100.stdout:2/877: mkdir d5/df7/d10f 0 2024-04-30T23:16:00.953 INFO:tasks.workunit.client.0.smithi100.stdout:2/878: dread d5/d22/fc5 [0,4194304] 0 2024-04-30T23:16:00.954 INFO:tasks.workunit.client.0.smithi100.stdout:2/879: creat d5/d8f/f110 x:0 0 0 2024-04-30T23:16:00.957 INFO:tasks.workunit.client.0.smithi100.stdout:5/803: dread d1/d12/f15 [0,4194304] 0 2024-04-30T23:16:00.957 INFO:tasks.workunit.client.0.smithi100.stdout:6/679: dwrite d7/df/d23/d24/d2e/d9f/fd9 [0,4194304] 0 2024-04-30T23:16:00.957 INFO:tasks.workunit.client.0.smithi100.stdout:1/557: dwrite d3/f5 [0,4194304] 0 2024-04-30T23:16:00.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/804: getdents d1/d12/d24/de8 0 2024-04-30T23:16:00.958 INFO:tasks.workunit.client.0.smithi100.stdout:1/558: write d3/d99/f9b [69425,59591] 0 2024-04-30T23:16:00.959 INFO:tasks.workunit.client.0.smithi100.stdout:6/680: symlink d7/d9/d86/d1b/d5a/de2/d98/lf7 0 2024-04-30T23:16:00.959 INFO:tasks.workunit.client.0.smithi100.stdout:6/681: write d7/d9/fac [197901,98002] 0 2024-04-30T23:16:00.959 INFO:tasks.workunit.client.0.smithi100.stdout:6/682: truncate d7/db/f5c 4548886 0 2024-04-30T23:16:00.960 INFO:tasks.workunit.client.0.smithi100.stdout:5/805: creat d1/d2c/d5d/f103 x:0 0 0 2024-04-30T23:16:00.962 INFO:tasks.workunit.client.0.smithi100.stdout:1/559: mknod d3/d16/d20/ca1 0 2024-04-30T23:16:00.962 INFO:tasks.workunit.client.0.smithi100.stdout:1/560: fsync d3/d16/d20/d24/d51/d59/d5f/f7d 0 2024-04-30T23:16:00.962 INFO:tasks.workunit.client.0.smithi100.stdout:6/683: truncate d7/d9/f12 1083161 0 2024-04-30T23:16:00.963 INFO:tasks.workunit.client.0.smithi100.stdout:3/752: dwrite d1/d14/d21/f2d [4194304,4194304] 0 2024-04-30T23:16:00.963 INFO:tasks.workunit.client.0.smithi100.stdout:3/753: write d1/f10 [1430014,101245] 0 2024-04-30T23:16:00.963 INFO:tasks.workunit.client.0.smithi100.stdout:6/684: rmdir d7/df/d23/d24/d2e/d9f 39 2024-04-30T23:16:00.967 INFO:tasks.workunit.client.0.smithi100.stdout:3/754: creat d1/d14/d15/d32/d6f/da2/d6d/d7b/fe9 x:0 0 0 2024-04-30T23:16:00.969 INFO:tasks.workunit.client.0.smithi100.stdout:6/685: rename d7/df/d23/d2b/d42/d84/ddd to d7/db/dd1/df8 0 2024-04-30T23:16:00.969 INFO:tasks.workunit.client.0.smithi100.stdout:6/686: write d7/df/d23/d24/fc4 [70090,6399] 0 2024-04-30T23:16:00.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/880: write d5/d12/d8e/dae/dbf/fef [3102182,110451] 0 2024-04-30T23:16:00.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/755: rename d1/ca0 to d1/d14/d2b/cea 0 2024-04-30T23:16:00.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/756: stat d1/d14/d21/f8e 0 2024-04-30T23:16:00.975 INFO:tasks.workunit.client.0.smithi100.stdout:6/687: rename d7/db/dd1/fd4 to d7/db/dd1/ff9 0 2024-04-30T23:16:00.975 INFO:tasks.workunit.client.0.smithi100.stdout:5/806: dread d1/fe [0,4194304] 0 2024-04-30T23:16:00.976 INFO:tasks.workunit.client.0.smithi100.stdout:2/881: mkdir d5/d26/d2f/d38/d111 0 2024-04-30T23:16:00.976 INFO:tasks.workunit.client.0.smithi100.stdout:1/561: write d3/d16/d20/d24/d69/f71 [1936258,52311] 0 2024-04-30T23:16:00.979 INFO:tasks.workunit.client.0.smithi100.stdout:3/757: rename d1/d14/d15/d27/d5d/ca7 to d1/d14/d15/d32/d6f/da2/d6d/d81/dae/ceb 0 2024-04-30T23:16:00.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/562: mknod d3/d16/d20/d24/d51/d80/ca2 0 2024-04-30T23:16:00.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/563: dread - d3/d16/d20/d24/d51/d59/d5f/f7d zero size 2024-04-30T23:16:00.993 INFO:tasks.workunit.client.0.smithi100.stdout:6/688: write d7/d9/f28 [4638101,49161] 0 2024-04-30T23:16:00.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/689: rename d7/d9/fac to d7/d9/d86/ffa 0 2024-04-30T23:16:01.000 INFO:tasks.workunit.client.0.smithi100.stdout:6/690: creat d7/ffb x:0 0 0 2024-04-30T23:16:01.005 INFO:tasks.workunit.client.0.smithi100.stdout:5/807: dwrite d1/d12/f15 [0,4194304] 0 2024-04-30T23:16:01.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/882: dwrite d5/d2e/f35 [0,4194304] 0 2024-04-30T23:16:01.008 INFO:tasks.workunit.client.0.smithi100.stdout:2/883: truncate d5/d22/f40 4326667 0 2024-04-30T23:16:01.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/884: truncate d5/d12/f3c 2480092 0 2024-04-30T23:16:01.013 INFO:tasks.workunit.client.0.smithi100.stdout:5/808: dread d1/d3e/d9b/fe4 [0,4194304] 0 2024-04-30T23:16:01.014 INFO:tasks.workunit.client.0.smithi100.stdout:5/809: chown d1/d3e/d9b/fe4 1873 1 2024-04-30T23:16:01.014 INFO:tasks.workunit.client.0.smithi100.stdout:3/758: dwrite d1/d14/d2b/d57/fa1 [0,4194304] 0 2024-04-30T23:16:01.017 INFO:tasks.workunit.client.0.smithi100.stdout:2/885: creat d5/d2e/f112 x:0 0 0 2024-04-30T23:16:01.018 INFO:tasks.workunit.client.0.smithi100.stdout:1/564: dwrite d3/d18/f53 [0,4194304] 0 2024-04-30T23:16:01.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/759: symlink d1/d14/d15/d27/d34/lec 0 2024-04-30T23:16:01.029 INFO:tasks.workunit.client.0.smithi100.stdout:3/760: creat d1/d14/d15/d32/d6f/da2/d6d/d81/fed x:0 0 0 2024-04-30T23:16:01.031 INFO:tasks.workunit.client.0.smithi100.stdout:2/886: read d5/d12/d8e/fac [951125,60727] 0 2024-04-30T23:16:01.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/706: sync 2024-04-30T23:16:01.032 INFO:tasks.workunit.client.0.smithi100.stdout:8/707: fsync d2/d29/f58 0 2024-04-30T23:16:01.032 INFO:tasks.workunit.client.0.smithi100.stdout:1/565: dread d3/d16/f3c [0,4194304] 0 2024-04-30T23:16:01.033 INFO:tasks.workunit.client.0.smithi100.stdout:1/566: read d3/d18/f6d [244484,56792] 0 2024-04-30T23:16:01.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/708: mkdir d2/d29/d71/ddb/dec 0 2024-04-30T23:16:01.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/709: mknod d2/d29/d71/d86/ced 0 2024-04-30T23:16:01.036 INFO:tasks.workunit.client.0.smithi100.stdout:1/567: rename d3/d18/l1a to d3/d16/d20/d24/d69/d63/la3 0 2024-04-30T23:16:01.036 INFO:tasks.workunit.client.0.smithi100.stdout:1/568: dread - d3/d16/d20/d24/d69/f72 zero size 2024-04-30T23:16:01.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/569: mknod d3/d16/d20/d24/d69/d5e/ca4 0 2024-04-30T23:16:01.045 INFO:tasks.workunit.client.0.smithi100.stdout:2/887: dread d5/d26/d2f/d38/f61 [0,4194304] 0 2024-04-30T23:16:01.046 INFO:tasks.workunit.client.0.smithi100.stdout:2/888: creat d5/d26/d2f/d38/d111/f113 x:0 0 0 2024-04-30T23:16:01.053 INFO:tasks.workunit.client.0.smithi100.stdout:3/761: dwrite d1/d14/d15/d32/d6f/da2/d26/f28 [0,4194304] 0 2024-04-30T23:16:01.059 INFO:tasks.workunit.client.0.smithi100.stdout:1/570: read d3/db/f3d [1748018,92633] 0 2024-04-30T23:16:01.060 INFO:tasks.workunit.client.0.smithi100.stdout:1/571: chown d3/d16/l66 672 1 2024-04-30T23:16:01.060 INFO:tasks.workunit.client.0.smithi100.stdout:1/572: read - d3/d16/d20/f9a zero size 2024-04-30T23:16:01.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/710: dwrite d2/d89/d10/d6e/fd6 [0,4194304] 0 2024-04-30T23:16:01.061 INFO:tasks.workunit.client.0.smithi100.stdout:2/889: dread d5/d47/d4c/dab/fd0 [0,4194304] 0 2024-04-30T23:16:01.061 INFO:tasks.workunit.client.0.smithi100.stdout:3/762: dread d1/d14/d15/d32/d71/fbc [0,4194304] 0 2024-04-30T23:16:01.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/573: unlink d3/d18/c28 0 2024-04-30T23:16:01.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/890: symlink d5/d12/d13/l114 0 2024-04-30T23:16:01.065 INFO:tasks.workunit.client.0.smithi100.stdout:2/891: write d5/d12/f6c [973188,96330] 0 2024-04-30T23:16:01.065 INFO:tasks.workunit.client.0.smithi100.stdout:1/574: rmdir d3/d18 39 2024-04-30T23:16:01.067 INFO:tasks.workunit.client.0.smithi100.stdout:2/892: rename d5/d12/d70/dc3 to d5/d22/da6/d115 0 2024-04-30T23:16:01.068 INFO:tasks.workunit.client.0.smithi100.stdout:1/575: getdents d3/db/d4b 0 2024-04-30T23:16:01.069 INFO:tasks.workunit.client.0.smithi100.stdout:2/893: symlink d5/d26/d2f/l116 0 2024-04-30T23:16:01.070 INFO:tasks.workunit.client.0.smithi100.stdout:1/576: creat d3/d16/d20/d24/d51/d59/d5f/fa5 x:0 0 0 2024-04-30T23:16:01.071 INFO:tasks.workunit.client.0.smithi100.stdout:2/894: creat d5/d12/d13/d9e/f117 x:0 0 0 2024-04-30T23:16:01.071 INFO:tasks.workunit.client.0.smithi100.stdout:2/895: fsync d5/d47/d4c/dab/fc0 0 2024-04-30T23:16:01.082 INFO:tasks.workunit.client.0.smithi100.stdout:8/711: dwrite d2/d29/d8b/fd4 [0,4194304] 0 2024-04-30T23:16:01.084 INFO:tasks.workunit.client.0.smithi100.stdout:8/712: truncate d2/d7/f26 2434025 0 2024-04-30T23:16:01.087 INFO:tasks.workunit.client.0.smithi100.stdout:3/763: dwrite d1/d14/d15/f16 [8388608,4194304] 0 2024-04-30T23:16:01.087 INFO:tasks.workunit.client.0.smithi100.stdout:8/713: dread d2/d29/d9e/fc0 [0,4194304] 0 2024-04-30T23:16:01.089 INFO:tasks.workunit.client.0.smithi100.stdout:3/764: creat d1/d14/d15/d32/d6f/da2/fee x:0 0 0 2024-04-30T23:16:01.090 INFO:tasks.workunit.client.0.smithi100.stdout:8/714: mknod d2/d29/d67/d73/cee 0 2024-04-30T23:16:01.091 INFO:tasks.workunit.client.0.smithi100.stdout:1/577: dwrite d3/d18/f68 [0,4194304] 0 2024-04-30T23:16:01.093 INFO:tasks.workunit.client.0.smithi100.stdout:2/896: dwrite d5/d12/f3d [0,4194304] 0 2024-04-30T23:16:01.093 INFO:tasks.workunit.client.0.smithi100.stdout:3/765: unlink d1/d14/d21/fc4 0 2024-04-30T23:16:01.093 INFO:tasks.workunit.client.0.smithi100.stdout:3/766: chown d1/d14/d15/d32/d6f/da2/d6d/da8/ld3 4123956 1 2024-04-30T23:16:01.093 INFO:tasks.workunit.client.0.smithi100.stdout:8/715: rmdir d2/d29/d71/ddb 39 2024-04-30T23:16:01.098 INFO:tasks.workunit.client.0.smithi100.stdout:1/578: rename d3/d16/d20/f81 to d3/d16/d20/d24/d69/d5e/d7a/fa6 0 2024-04-30T23:16:01.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/897: rmdir d5/d12/d13 39 2024-04-30T23:16:01.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/898: write d5/d22/f2c [8897393,94664] 0 2024-04-30T23:16:01.101 INFO:tasks.workunit.client.0.smithi100.stdout:3/767: mkdir d1/d38/def 0 2024-04-30T23:16:01.102 INFO:tasks.workunit.client.0.smithi100.stdout:8/716: symlink d2/d29/d71/d86/de2/lef 0 2024-04-30T23:16:01.103 INFO:tasks.workunit.client.0.smithi100.stdout:2/899: dread d5/f49 [0,4194304] 0 2024-04-30T23:16:01.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/579: rename d3/d16/c1b to d3/db/d4b/ca7 0 2024-04-30T23:16:01.105 INFO:tasks.workunit.client.0.smithi100.stdout:3/768: mkdir d1/d14/d15/d32/d71/df0 0 2024-04-30T23:16:01.106 INFO:tasks.workunit.client.0.smithi100.stdout:1/580: mknod d3/d16/d20/d24/d51/d59/d5f/ca8 0 2024-04-30T23:16:01.107 INFO:tasks.workunit.client.0.smithi100.stdout:1/581: write d3/f58 [4374350,14089] 0 2024-04-30T23:16:01.107 INFO:tasks.workunit.client.0.smithi100.stdout:1/582: chown d3/d16/d20/d24/d69/d63/l79 404 1 2024-04-30T23:16:01.111 INFO:tasks.workunit.client.0.smithi100.stdout:1/583: getdents d3/d16/d20 0 2024-04-30T23:16:01.119 INFO:tasks.workunit.client.0.smithi100.stdout:1/584: write d3/f6a [712389,61120] 0 2024-04-30T23:16:01.119 INFO:tasks.workunit.client.0.smithi100.stdout:1/585: chown d3/d16/d20 178234536 1 2024-04-30T23:16:01.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/769: dread d1/d14/d21/f2d [4194304,4194304] 0 2024-04-30T23:16:01.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/900: read d5/d22/fc5 [3845797,117649] 0 2024-04-30T23:16:01.124 INFO:tasks.workunit.client.0.smithi100.stdout:2/901: mkdir d5/d12/d13/d9e/d118 0 2024-04-30T23:16:01.125 INFO:tasks.workunit.client.0.smithi100.stdout:8/717: dwrite d2/f1d [0,4194304] 0 2024-04-30T23:16:01.126 INFO:tasks.workunit.client.0.smithi100.stdout:2/902: rename d5/d12/d8e/dae/fe1 to d5/d12/d13/d4b/f119 0 2024-04-30T23:16:01.128 INFO:tasks.workunit.client.0.smithi100.stdout:2/903: mkdir d5/d22/d11a 0 2024-04-30T23:16:01.129 INFO:tasks.workunit.client.0.smithi100.stdout:2/904: truncate d5/d12/d13/d4b/f99 3833327 0 2024-04-30T23:16:01.130 INFO:tasks.workunit.client.0.smithi100.stdout:2/905: creat d5/d12/d13/d9e/d118/f11b x:0 0 0 2024-04-30T23:16:01.130 INFO:tasks.workunit.client.0.smithi100.stdout:2/906: truncate d5/d22/fc6 951556 0 2024-04-30T23:16:01.130 INFO:tasks.workunit.client.0.smithi100.stdout:2/907: fdatasync d5/d2e/fc8 0 2024-04-30T23:16:01.130 INFO:tasks.workunit.client.0.smithi100.stdout:2/908: write d5/d12/d8e/f98 [42037,25184] 0 2024-04-30T23:16:01.135 INFO:tasks.workunit.client.0.smithi100.stdout:1/586: write d3/d16/d20/f22 [2910128,40607] 0 2024-04-30T23:16:01.137 INFO:tasks.workunit.client.0.smithi100.stdout:1/587: unlink d3/d18/f43 0 2024-04-30T23:16:01.137 INFO:tasks.workunit.client.0.smithi100.stdout:1/588: truncate d3/d18/f95 700769 0 2024-04-30T23:16:01.138 INFO:tasks.workunit.client.0.smithi100.stdout:1/589: mkdir d3/d16/d20/d24/d69/d63/da9 0 2024-04-30T23:16:01.139 INFO:tasks.workunit.client.0.smithi100.stdout:1/590: symlink d3/d16/d20/d24/d51/d80/laa 0 2024-04-30T23:16:01.140 INFO:tasks.workunit.client.0.smithi100.stdout:3/770: dread d1/d14/d15/f20 [0,4194304] 0 2024-04-30T23:16:01.141 INFO:tasks.workunit.client.0.smithi100.stdout:1/591: symlink d3/d16/d20/d24/d69/d5e/d7a/lab 0 2024-04-30T23:16:01.142 INFO:tasks.workunit.client.0.smithi100.stdout:1/592: creat d3/d16/d20/d24/d51/d59/d5f/fac x:0 0 0 2024-04-30T23:16:01.144 INFO:tasks.workunit.client.0.smithi100.stdout:1/593: rename d3/d16/d20/d24/d51/l62 to d3/d16/d20/d24/d69/d5e/lad 0 2024-04-30T23:16:01.145 INFO:tasks.workunit.client.0.smithi100.stdout:1/594: mkdir d3/d16/d20/d24/d51/d80/dae 0 2024-04-30T23:16:01.149 INFO:tasks.workunit.client.0.smithi100.stdout:1/595: fdatasync d3/f4d 0 2024-04-30T23:16:01.150 INFO:tasks.workunit.client.0.smithi100.stdout:8/718: dwrite d2/d97/fd2 [0,4194304] 0 2024-04-30T23:16:01.155 INFO:tasks.workunit.client.0.smithi100.stdout:8/719: write d2/d7/d18/d3a/f85 [690149,81433] 0 2024-04-30T23:16:01.160 INFO:tasks.workunit.client.0.smithi100.stdout:2/909: dwrite d5/d12/f2b [0,4194304] 0 2024-04-30T23:16:01.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/910: getdents d5/d26/d2f 0 2024-04-30T23:16:01.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/911: readlink d5/d12/d13/l114 0 2024-04-30T23:16:01.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/912: fsync d5/d12/d13/d9e/fdc 0 2024-04-30T23:16:01.162 INFO:tasks.workunit.client.0.smithi100.stdout:2/913: creat d5/d12/d70/dee/f11c x:0 0 0 2024-04-30T23:16:01.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/914: fsync d5/d26/d2f/f68 0 2024-04-30T23:16:01.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/915: chown d5/d12/d13/l34 58 1 2024-04-30T23:16:01.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/916: fdatasync d5/d47/f8b 0 2024-04-30T23:16:01.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/917: mknod d5/d47/d4c/c11d 0 2024-04-30T23:16:01.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/771: dwrite d1/d14/d15/d32/fdf [0,4194304] 0 2024-04-30T23:16:01.164 INFO:tasks.workunit.client.0.smithi100.stdout:2/918: unlink d5/d26/d9b/fba 0 2024-04-30T23:16:01.166 INFO:tasks.workunit.client.0.smithi100.stdout:3/772: truncate d1/d14/d2b/f4c 714463 0 2024-04-30T23:16:01.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/773: mknod d1/d14/d2b/d57/daf/cf1 0 2024-04-30T23:16:01.170 INFO:tasks.workunit.client.0.smithi100.stdout:3/774: mknod d1/d14/d15/d27/d34/cf2 0 2024-04-30T23:16:01.172 INFO:tasks.workunit.client.0.smithi100.stdout:3/775: creat d1/d14/d15/d27/d5d/dd1/ff3 x:0 0 0 2024-04-30T23:16:01.172 INFO:tasks.workunit.client.0.smithi100.stdout:3/776: chown d1/d14/d21/fb8 2187 1 2024-04-30T23:16:01.174 INFO:tasks.workunit.client.0.smithi100.stdout:3/777: creat d1/d14/ff4 x:0 0 0 2024-04-30T23:16:01.181 INFO:tasks.workunit.client.0.smithi100.stdout:8/720: dwrite d2/d7/f6a [0,4194304] 0 2024-04-30T23:16:01.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/919: write d5/fb0 [260178,124921] 0 2024-04-30T23:16:01.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/920: readlink d5/d12/d13/l20 0 2024-04-30T23:16:01.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/921: write d5/f49 [1248177,30657] 0 2024-04-30T23:16:01.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/922: chown d5/d58/ld5 17597370 1 2024-04-30T23:16:01.186 INFO:tasks.workunit.client.0.smithi100.stdout:3/778: rename d1/d14 to d1/d38/df5 0 2024-04-30T23:16:01.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/923: link d5/d47/d66/fe6 d5/d12/d13/d9e/f11e 0 2024-04-30T23:16:01.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/924: write d5/d2e/f112 [382316,65877] 0 2024-04-30T23:16:01.196 INFO:tasks.workunit.client.0.smithi100.stdout:8/721: dread d2/d97/fd2 [0,4194304] 0 2024-04-30T23:16:01.200 INFO:tasks.workunit.client.0.smithi100.stdout:8/722: symlink d2/d29/d8b/lf0 0 2024-04-30T23:16:01.206 INFO:tasks.workunit.client.0.smithi100.stdout:3/779: dwrite d1/f4a [0,4194304] 0 2024-04-30T23:16:01.217 INFO:tasks.workunit.client.0.smithi100.stdout:8/723: dread d2/d89/d7f/f39 [0,4194304] 0 2024-04-30T23:16:01.218 INFO:tasks.workunit.client.0.smithi100.stdout:2/925: dwrite d5/d12/d13/d4b/ff8 [0,4194304] 0 2024-04-30T23:16:01.218 INFO:tasks.workunit.client.0.smithi100.stdout:2/926: fsync d5/d22/fc6 0 2024-04-30T23:16:01.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/724: creat d2/d29/d71/d86/ff1 x:0 0 0 2024-04-30T23:16:01.221 INFO:tasks.workunit.client.0.smithi100.stdout:8/725: creat d2/d29/d8b/d8e/ff2 x:0 0 0 2024-04-30T23:16:01.221 INFO:tasks.workunit.client.0.smithi100.stdout:8/726: readlink d2/d29/d67/d73/lda 0 2024-04-30T23:16:01.222 INFO:tasks.workunit.client.0.smithi100.stdout:8/727: readlink d2/d7/d18/l5e 0 2024-04-30T23:16:01.224 INFO:tasks.workunit.client.0.smithi100.stdout:2/927: dread d5/d26/d2f/d38/f43 [0,4194304] 0 2024-04-30T23:16:01.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/780: dwrite d1/d38/df5/d2f/f7c [0,4194304] 0 2024-04-30T23:16:01.235 INFO:tasks.workunit.client.0.smithi100.stdout:8/728: read d2/f1d [331141,36181] 0 2024-04-30T23:16:01.235 INFO:tasks.workunit.client.0.smithi100.stdout:8/729: readlink d2/d7/l6d 0 2024-04-30T23:16:01.235 INFO:tasks.workunit.client.0.smithi100.stdout:3/781: link d1/d38/df5/d15/d32/d6f/da2/d6d/l83 d1/d38/df5/d2f/lf6 0 2024-04-30T23:16:01.235 INFO:tasks.workunit.client.0.smithi100.stdout:3/782: write d1/d38/df5/d15/d32/d6f/da2/d6d/d81/fed [399899,2499] 0 2024-04-30T23:16:01.236 INFO:tasks.workunit.client.0.smithi100.stdout:3/783: fdatasync d1/d38/df5/d2b/f53 0 2024-04-30T23:16:01.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/928: dwrite d5/d12/d70/dee/ff9 [0,4194304] 0 2024-04-30T23:16:01.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/929: chown d5/d12/d13/d9e 1382655 1 2024-04-30T23:16:01.251 INFO:tasks.workunit.client.0.smithi100.stdout:8/730: read d2/d29/f2b [1712844,50557] 0 2024-04-30T23:16:01.257 INFO:tasks.workunit.client.0.smithi100.stdout:3/784: dwrite d1/d38/df5/d15/d2c/f95 [0,4194304] 0 2024-04-30T23:16:01.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/785: write d1/d38/df5/d21/f48 [1574492,101065] 0 2024-04-30T23:16:01.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/786: stat d1/d38/df5/d15/d2c/fdb 0 2024-04-30T23:16:01.261 INFO:tasks.workunit.client.0.smithi100.stdout:8/731: dread d2/f1d [0,4194304] 0 2024-04-30T23:16:01.264 INFO:tasks.workunit.client.0.smithi100.stdout:8/732: mknod d2/d89/d72/ddc/cf3 0 2024-04-30T23:16:01.264 INFO:tasks.workunit.client.0.smithi100.stdout:8/733: fdatasync d2/d7/f3c 0 2024-04-30T23:16:01.264 INFO:tasks.workunit.client.0.smithi100.stdout:9/668: sync 2024-04-30T23:16:01.265 INFO:tasks.workunit.client.0.smithi100.stdout:0/720: sync 2024-04-30T23:16:01.267 INFO:tasks.workunit.client.0.smithi100.stdout:2/930: dwrite d5/d12/d8e/f93 [0,4194304] 0 2024-04-30T23:16:01.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/931: creat d5/d12/d73/f11f x:0 0 0 2024-04-30T23:16:01.290 INFO:tasks.workunit.client.0.smithi100.stdout:0/721: dwrite d2/d4c/f89 [0,4194304] 0 2024-04-30T23:16:01.290 INFO:tasks.workunit.client.0.smithi100.stdout:8/734: dwrite d2/d7/d18/d3a/da4/fb2 [0,4194304] 0 2024-04-30T23:16:01.292 INFO:tasks.workunit.client.0.smithi100.stdout:0/722: mknod d2/d50/d30/dd8/cd9 0 2024-04-30T23:16:01.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/735: creat d2/d7/ff4 x:0 0 0 2024-04-30T23:16:01.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/932: dwrite d5/d22/fa8 [0,4194304] 0 2024-04-30T23:16:01.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/933: write d5/d26/fd1 [3045134,19431] 0 2024-04-30T23:16:01.302 INFO:tasks.workunit.client.0.smithi100.stdout:2/934: write d5/d22/fc6 [988877,96012] 0 2024-04-30T23:16:01.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/723: dwrite d2/d50/d38/f7a [0,4194304] 0 2024-04-30T23:16:01.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/736: dwrite d2/d29/d9e/daf/fd1 [0,4194304] 0 2024-04-30T23:16:01.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/737: dread - d2/d29/d67/d73/f7b zero size 2024-04-30T23:16:01.327 INFO:tasks.workunit.client.0.smithi100.stdout:2/935: dwrite d5/d12/d8e/dae/f10e [0,4194304] 0 2024-04-30T23:16:01.329 INFO:tasks.workunit.client.0.smithi100.stdout:8/738: rename d2/d7/fe6 to d2/d29/d71/d86/ff5 0 2024-04-30T23:16:01.329 INFO:tasks.workunit.client.0.smithi100.stdout:8/739: chown d2/d89/d10/d17/f1b 224454290 1 2024-04-30T23:16:01.333 INFO:tasks.workunit.client.0.smithi100.stdout:0/724: write d2/d14/d35/d57/f60 [8358139,88535] 0 2024-04-30T23:16:01.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/740: mknod d2/d7/d18/cf6 0 2024-04-30T23:16:01.334 INFO:tasks.workunit.client.0.smithi100.stdout:0/725: mkdir d2/d14/d35/d57/d62/dda 0 2024-04-30T23:16:01.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/936: dwrite d5/d12/f1e [0,4194304] 0 2024-04-30T23:16:01.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/937: dread d5/d47/d66/f69 [0,4194304] 0 2024-04-30T23:16:01.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/938: getdents d5/d12/dc4 0 2024-04-30T23:16:01.364 INFO:tasks.workunit.client.0.smithi100.stdout:8/741: dwrite d2/d29/f2b [0,4194304] 0 2024-04-30T23:16:01.365 INFO:tasks.workunit.client.0.smithi100.stdout:2/939: rename d5/d8f/f110 to d5/d12/d13/d9e/d118/f120 0 2024-04-30T23:16:01.365 INFO:tasks.workunit.client.0.smithi100.stdout:2/940: chown d5/f2d 2365251 1 2024-04-30T23:16:01.366 INFO:tasks.workunit.client.0.smithi100.stdout:8/742: mknod d2/d7/d18/d3a/cf7 0 2024-04-30T23:16:01.367 INFO:tasks.workunit.client.0.smithi100.stdout:0/726: dwrite d2/d5a/f66 [4194304,4194304] 0 2024-04-30T23:16:01.367 INFO:tasks.workunit.client.0.smithi100.stdout:8/743: mkdir d2/d89/d10/d17/d8f/df8 0 2024-04-30T23:16:01.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/744: write d2/d89/d10/d17/d8f/fb7 [885996,79563] 0 2024-04-30T23:16:01.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/745: write d2/d97/fa8 [2387833,95730] 0 2024-04-30T23:16:01.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/746: dread - d2/f50 zero size 2024-04-30T23:16:01.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/747: mknod d2/d89/d10/d17/d8f/df8/cf9 0 2024-04-30T23:16:01.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/727: read d2/d14/d35/f8e [485761,63097] 0 2024-04-30T23:16:01.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/728: readlink d2/d50/d30/l47 0 2024-04-30T23:16:01.373 INFO:tasks.workunit.client.0.smithi100.stdout:2/941: dread d5/d12/fc1 [0,4194304] 0 2024-04-30T23:16:01.374 INFO:tasks.workunit.client.0.smithi100.stdout:2/942: mkdir d5/d26/d2f/d121 0 2024-04-30T23:16:01.386 INFO:tasks.workunit.client.0.smithi100.stdout:4/842: sync 2024-04-30T23:16:01.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/902: sync 2024-04-30T23:16:01.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/903: chown d0/d1d/fb3 30087 1 2024-04-30T23:16:01.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/904: truncate d0/d1b/d60/fdd 1416032 0 2024-04-30T23:16:01.388 INFO:tasks.workunit.client.0.smithi100.stdout:4/843: rename d19/d1a/d21/d4a/d53/d5d/f96 to d19/d1a/d6d/d64/d78/d10c/f10e 0 2024-04-30T23:16:01.388 INFO:tasks.workunit.client.0.smithi100.stdout:4/844: chown d19/d1a/d21/d4a/d53/fdf 127313 1 2024-04-30T23:16:01.389 INFO:tasks.workunit.client.0.smithi100.stdout:4/845: mkdir d19/d1a/d21/d4a/d10f 0 2024-04-30T23:16:01.390 INFO:tasks.workunit.client.0.smithi100.stdout:4/846: creat d19/d1a/d95/f110 x:0 0 0 2024-04-30T23:16:01.393 INFO:tasks.workunit.client.0.smithi100.stdout:8/748: dwrite d2/d29/d67/f99 [0,4194304] 0 2024-04-30T23:16:01.398 INFO:tasks.workunit.client.0.smithi100.stdout:2/943: dwrite d5/d26/d2f/d38/f75 [4194304,4194304] 0 2024-04-30T23:16:01.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/944: unlink d5/d26/f54 0 2024-04-30T23:16:01.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/945: readlink d5/d22/l7a 0 2024-04-30T23:16:01.401 INFO:tasks.workunit.client.0.smithi100.stdout:2/946: symlink d5/d26/d2f/l122 0 2024-04-30T23:16:01.403 INFO:tasks.workunit.client.0.smithi100.stdout:8/749: dread d2/d7/d18/d3a/f3d [0,4194304] 0 2024-04-30T23:16:01.403 INFO:tasks.workunit.client.0.smithi100.stdout:8/750: write d2/f78 [583603,45015] 0 2024-04-30T23:16:01.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/751: creat d2/d7/ffa x:0 0 0 2024-04-30T23:16:01.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/752: write d2/d29/d8b/d8e/f96 [672915,90891] 0 2024-04-30T23:16:01.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/753: dread - d2/d89/d10/d6e/dad/fdf zero size 2024-04-30T23:16:01.407 INFO:tasks.workunit.client.0.smithi100.stdout:7/905: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dd4/ff2 [3658676,88106] 0 2024-04-30T23:16:01.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/947: dread d5/d47/d66/fe6 [0,4194304] 0 2024-04-30T23:16:01.414 INFO:tasks.workunit.client.0.smithi100.stdout:4/847: dwrite d19/d1a/d21/d4a/d53/d5e/d7e/fa7 [0,4194304] 0 2024-04-30T23:16:01.414 INFO:tasks.workunit.client.0.smithi100.stdout:4/848: stat d19/d1a/f48 0 2024-04-30T23:16:01.416 INFO:tasks.workunit.client.0.smithi100.stdout:4/849: truncate d19/d33/f5a 259046 0 2024-04-30T23:16:01.416 INFO:tasks.workunit.client.0.smithi100.stdout:4/850: chown d19/d33/d7d/faf 0 1 2024-04-30T23:16:01.419 INFO:tasks.workunit.client.0.smithi100.stdout:4/851: creat d19/d1a/d21/d4a/d53/d5e/f111 x:0 0 0 2024-04-30T23:16:01.419 INFO:tasks.workunit.client.0.smithi100.stdout:4/852: write d19/d1a/d21/d4a/fa6 [587655,49134] 0 2024-04-30T23:16:01.419 INFO:tasks.workunit.client.0.smithi100.stdout:4/853: chown d19/d1a/d21/d3c 4788151 1 2024-04-30T23:16:01.421 INFO:tasks.workunit.client.0.smithi100.stdout:7/906: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/fc1 [1298598,95111] 0 2024-04-30T23:16:01.421 INFO:tasks.workunit.client.0.smithi100.stdout:7/907: stat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/d104/c107 0 2024-04-30T23:16:01.422 INFO:tasks.workunit.client.0.smithi100.stdout:7/908: fdatasync d0/d1d/d5e/d6a/f2d 0 2024-04-30T23:16:01.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/909: creat d0/d1d/d3c/f12a x:0 0 0 2024-04-30T23:16:01.427 INFO:tasks.workunit.client.0.smithi100.stdout:2/948: write d5/d47/d4c/fce [2594897,33036] 0 2024-04-30T23:16:01.428 INFO:tasks.workunit.client.0.smithi100.stdout:7/910: mknod d0/d1b/d2e/d97/c12b 0 2024-04-30T23:16:01.431 INFO:tasks.workunit.client.0.smithi100.stdout:7/911: mkdir d0/df/d4f/d53/dd2/d12c 0 2024-04-30T23:16:01.432 INFO:tasks.workunit.client.0.smithi100.stdout:8/754: dwrite d2/d7/f12 [0,4194304] 0 2024-04-30T23:16:01.432 INFO:tasks.workunit.client.0.smithi100.stdout:8/755: chown d2/d89/d10/d17/f4f 1905598 1 2024-04-30T23:16:01.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/949: dread d5/d26/d2f/d38/f75 [4194304,4194304] 0 2024-04-30T23:16:01.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/950: read - d5/d26/d2f/d38/faf zero size 2024-04-30T23:16:01.447 INFO:tasks.workunit.client.0.smithi100.stdout:4/854: dwrite d19/d1a/d6d/d64/d78/f82 [0,4194304] 0 2024-04-30T23:16:01.448 INFO:tasks.workunit.client.0.smithi100.stdout:4/855: mknod d19/d1a/d29/d65/c112 0 2024-04-30T23:16:01.450 INFO:tasks.workunit.client.0.smithi100.stdout:7/912: write d0/d1b/d60/d48/d4a/d5b/ff4 [3322720,102481] 0 2024-04-30T23:16:01.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/856: mknod d19/d1a/d29/c113 0 2024-04-30T23:16:01.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/857: write d19/d1a/d6d/d4e/f105 [571887,77464] 0 2024-04-30T23:16:01.452 INFO:tasks.workunit.client.0.smithi100.stdout:7/913: creat d0/df/d4f/d53/dd2/f12d x:0 0 0 2024-04-30T23:16:01.452 INFO:tasks.workunit.client.0.smithi100.stdout:7/914: dread - d0/d1b/d60/f9a zero size 2024-04-30T23:16:01.453 INFO:tasks.workunit.client.0.smithi100.stdout:4/858: creat d19/d1a/d6d/d64/d78/d10c/f114 x:0 0 0 2024-04-30T23:16:01.462 INFO:tasks.workunit.client.0.smithi100.stdout:2/951: dread d5/d12/d13/d4b/ff8 [0,4194304] 0 2024-04-30T23:16:01.462 INFO:tasks.workunit.client.0.smithi100.stdout:2/952: truncate d5/d22/f2c 3632395 0 2024-04-30T23:16:01.463 INFO:tasks.workunit.client.0.smithi100.stdout:8/756: dwrite d2/d29/d8b/fd4 [0,4194304] 0 2024-04-30T23:16:01.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/757: mknod d2/d89/d72/ddc/cfb 0 2024-04-30T23:16:01.466 INFO:tasks.workunit.client.0.smithi100.stdout:2/953: rename d5/d2e/l10b to d5/d47/d4c/l123 0 2024-04-30T23:16:01.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/758: rmdir d2/d29/d71/ddb 39 2024-04-30T23:16:01.468 INFO:tasks.workunit.client.0.smithi100.stdout:8/759: rmdir d2/d29/d67 39 2024-04-30T23:16:01.469 INFO:tasks.workunit.client.0.smithi100.stdout:4/859: dread d19/d1a/d6d/fbe [0,4194304] 0 2024-04-30T23:16:01.470 INFO:tasks.workunit.client.0.smithi100.stdout:4/860: dread - d19/d33/fab zero size 2024-04-30T23:16:01.470 INFO:tasks.workunit.client.0.smithi100.stdout:4/861: readlink d19/d1a/d6d/d4e/d6e/dcb/le5 0 2024-04-30T23:16:01.471 INFO:tasks.workunit.client.0.smithi100.stdout:4/862: mkdir d19/d1a/d6d/d64/d78/d8c/d115 0 2024-04-30T23:16:01.474 INFO:tasks.workunit.client.0.smithi100.stdout:4/863: symlink d19/d1a/d95/l116 0 2024-04-30T23:16:01.481 INFO:tasks.workunit.client.0.smithi100.stdout:2/954: dread d5/d12/d13/d4b/ff8 [0,4194304] 0 2024-04-30T23:16:01.482 INFO:tasks.workunit.client.0.smithi100.stdout:2/955: creat d5/d12/d13/d9e/df3/f124 x:0 0 0 2024-04-30T23:16:01.482 INFO:tasks.workunit.client.0.smithi100.stdout:2/956: dread - d5/d12/d13/fff zero size 2024-04-30T23:16:01.483 INFO:tasks.workunit.client.0.smithi100.stdout:2/957: symlink d5/d12/d13/d4b/l125 0 2024-04-30T23:16:01.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/915: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/fe6 [0,4194304] 0 2024-04-30T23:16:01.489 INFO:tasks.workunit.client.0.smithi100.stdout:2/958: symlink d5/d47/d4c/l126 0 2024-04-30T23:16:01.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/864: dread d19/d1a/f37 [0,4194304] 0 2024-04-30T23:16:01.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/865: fdatasync d19/d1a/d21/d4a/d53/fdf 0 2024-04-30T23:16:01.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/866: readlink d19/l100 0 2024-04-30T23:16:01.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/867: write d19/d1a/d21/d4a/d53/d5e/fb4 [1150827,78008] 0 2024-04-30T23:16:01.492 INFO:tasks.workunit.client.0.smithi100.stdout:2/959: creat d5/d26/d2f/d38/d111/f127 x:0 0 0 2024-04-30T23:16:01.492 INFO:tasks.workunit.client.0.smithi100.stdout:2/960: fdatasync d5/d12/d73/f11f 0 2024-04-30T23:16:01.494 INFO:tasks.workunit.client.0.smithi100.stdout:4/868: creat d19/d1a/d95/f117 x:0 0 0 2024-04-30T23:16:01.494 INFO:tasks.workunit.client.0.smithi100.stdout:4/869: write d19/d1a/d6d/d4e/d6e/f80 [2710351,65507] 0 2024-04-30T23:16:01.494 INFO:tasks.workunit.client.0.smithi100.stdout:4/870: fdatasync d19/d1a/d21/d4a/fa4 0 2024-04-30T23:16:01.495 INFO:tasks.workunit.client.0.smithi100.stdout:8/760: dwrite d2/d29/d71/d86/ff5 [0,4194304] 0 2024-04-30T23:16:01.495 INFO:tasks.workunit.client.0.smithi100.stdout:2/961: creat d5/d58/f128 x:0 0 0 2024-04-30T23:16:01.495 INFO:tasks.workunit.client.0.smithi100.stdout:2/962: fdatasync d5/d12/d13/d4b/ff8 0 2024-04-30T23:16:01.495 INFO:tasks.workunit.client.0.smithi100.stdout:2/963: fdatasync d5/d12/d13/d4b/f119 0 2024-04-30T23:16:01.495 INFO:tasks.workunit.client.0.smithi100.stdout:2/964: chown d5/d12/d8e/la5 58 1 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/916: dwrite d0/d1d/d5e/f10a [0,4194304] 0 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/917: dread - d0/d1b/d60/d48/d4a/f94 zero size 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/918: chown d0/d1b/d2e/dd8 30 1 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/919: fsync d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/f10d 0 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/920: fdatasync d0/d1b/d60/fdd 0 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:8/761: getdents d2/d89/d10/d52/d9a 0 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:8/762: write d2/d89/d10/d17/f1b [4251269,7383] 0 2024-04-30T23:16:01.504 INFO:tasks.workunit.client.0.smithi100.stdout:8/763: chown d2/d89/d10/d52/f65 443945 1 2024-04-30T23:16:01.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/921: mknod d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/c12e 0 2024-04-30T23:16:01.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/871: truncate d19/d1a/d6d/d4e/d6e/f80 2550960 0 2024-04-30T23:16:01.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/872: fsync d19/d1a/f37 0 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/691: sync 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/692: chown d7/d9/d86/d1b/fe0 582476 1 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/693: chown d7/df/d23/d24/d2e 115 1 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/694: stat d7/df/d23/d2b/d42 0 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/695: read - d7/df/d23/d2b/d42/fdf zero size 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/965: dwrite d5/d12/d13/fa0 [0,4194304] 0 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/966: stat d5/d12/d73 0 2024-04-30T23:16:01.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/967: chown d5/lcc 246937 1 2024-04-30T23:16:01.520 INFO:tasks.workunit.client.0.smithi100.stdout:2/968: stat d5/d47/d4c/dab/le0 0 2024-04-30T23:16:01.520 INFO:tasks.workunit.client.0.smithi100.stdout:2/969: truncate d5/d26/d2f/d38/d111/f127 218495 0 2024-04-30T23:16:01.520 INFO:tasks.workunit.client.0.smithi100.stdout:6/696: mknod d7/d9/d86/d1b/d22/d38/cfc 0 2024-04-30T23:16:01.523 INFO:tasks.workunit.client.0.smithi100.stdout:6/697: rename d7/d11/d34/l14 to d7/df/d23/d24/d2e/lfd 0 2024-04-30T23:16:01.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/698: mkdir d7/d9/d86/d62/dfe 0 2024-04-30T23:16:01.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/699: chown d7/ffb 12881296 1 2024-04-30T23:16:01.527 INFO:tasks.workunit.client.0.smithi100.stdout:6/700: mknod d7/df/d23/d24/d2e/d37/cff 0 2024-04-30T23:16:01.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/873: dwrite d19/d1a/d29/d103/d40/da2/fad [0,4194304] 0 2024-04-30T23:16:01.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/874: chown d19/d1a/d6d/d64/d78/d8c/fce 916220 1 2024-04-30T23:16:01.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/875: chown d19/d33/d7d/faf 172073270 1 2024-04-30T23:16:01.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/970: dwrite d5/d12/f3d [0,4194304] 0 2024-04-30T23:16:01.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/971: stat d5/d22/c3a 0 2024-04-30T23:16:01.546 INFO:tasks.workunit.client.0.smithi100.stdout:6/701: dwrite d7/d11/d34/f26 [0,4194304] 0 2024-04-30T23:16:01.549 INFO:tasks.workunit.client.0.smithi100.stdout:6/702: mknod d7/d9/d86/dc7/c100 0 2024-04-30T23:16:01.551 INFO:tasks.workunit.client.0.smithi100.stdout:6/703: unlink d7/d9/d86/d1b/d22/f70 0 2024-04-30T23:16:01.554 INFO:tasks.workunit.client.0.smithi100.stdout:4/876: write d19/f27 [1172006,107704] 0 2024-04-30T23:16:01.554 INFO:tasks.workunit.client.0.smithi100.stdout:4/877: chown d19/d33/d7d 490700 1 2024-04-30T23:16:01.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/878: creat d19/d1a/d6d/d64/dc8/f118 x:0 0 0 2024-04-30T23:16:01.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/879: chown d19/d1a/d29/dae 1 1 2024-04-30T23:16:01.556 INFO:tasks.workunit.client.0.smithi100.stdout:4/880: mkdir d19/d1a/d21/d4a/d53/deb/d119 0 2024-04-30T23:16:01.558 INFO:tasks.workunit.client.0.smithi100.stdout:2/972: dread d5/d12/d73/f8d [0,4194304] 0 2024-04-30T23:16:01.559 INFO:tasks.workunit.client.0.smithi100.stdout:2/973: symlink d5/d22/da6/dfb/l129 0 2024-04-30T23:16:01.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/881: write d19/d1a/d21/d3c/fbb [673950,80249] 0 2024-04-30T23:16:01.565 INFO:tasks.workunit.client.0.smithi100.stdout:4/882: symlink d19/d1a/d29/d103/d40/da2/l11a 0 2024-04-30T23:16:01.565 INFO:tasks.workunit.client.0.smithi100.stdout:2/974: write d5/d26/f4a [958538,4650] 0 2024-04-30T23:16:01.566 INFO:tasks.workunit.client.0.smithi100.stdout:2/975: fsync d5/d26/d2f/d38/f75 0 2024-04-30T23:16:01.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/883: creat d19/d1a/d6d/d64/d78/d10c/f11b x:0 0 0 2024-04-30T23:16:01.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/884: chown d19/d1a/d29/d103/f51 2233 1 2024-04-30T23:16:01.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/885: write d19/d33/d7d/faf [266052,92312] 0 2024-04-30T23:16:01.568 INFO:tasks.workunit.client.0.smithi100.stdout:2/976: write d5/fa4 [112522,119277] 0 2024-04-30T23:16:01.568 INFO:tasks.workunit.client.0.smithi100.stdout:2/977: fdatasync d5/d22/f4e 0 2024-04-30T23:16:01.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/886: dread d19/d1a/d21/d4a/fa6 [0,4194304] 0 2024-04-30T23:16:01.570 INFO:tasks.workunit.client.0.smithi100.stdout:4/887: readlink d19/lf2 0 2024-04-30T23:16:01.571 INFO:tasks.workunit.client.0.smithi100.stdout:4/888: link d19/d1a/d29/dae/fc9 d19/d1a/d29/dae/f11c 0 2024-04-30T23:16:01.572 INFO:tasks.workunit.client.0.smithi100.stdout:6/704: dwrite d7/d11/d34/f26 [0,4194304] 0 2024-04-30T23:16:01.572 INFO:tasks.workunit.client.0.smithi100.stdout:6/705: fdatasync d7/db/d3b/fa1 0 2024-04-30T23:16:01.572 INFO:tasks.workunit.client.0.smithi100.stdout:6/706: dread - d7/df/d23/d2b/d42/fdf zero size 2024-04-30T23:16:01.573 INFO:tasks.workunit.client.0.smithi100.stdout:6/707: getdents d7/d11/d34 0 2024-04-30T23:16:01.574 INFO:tasks.workunit.client.0.smithi100.stdout:6/708: symlink d7/d9/d86/db0/l101 0 2024-04-30T23:16:01.574 INFO:tasks.workunit.client.0.smithi100.stdout:6/709: write d7/db/d3b/f58 [5024343,52200] 0 2024-04-30T23:16:01.575 INFO:tasks.workunit.client.0.smithi100.stdout:6/710: creat d7/d9/d86/d3e/d6b/dc2/f102 x:0 0 0 2024-04-30T23:16:01.575 INFO:tasks.workunit.client.0.smithi100.stdout:6/711: getdents d7/df/d23/d24/d2e/d37/d85/de7 0 2024-04-30T23:16:01.590 INFO:tasks.workunit.client.0.smithi100.stdout:4/889: write d19/d1a/d29/dae/fb0 [4046924,120473] 0 2024-04-30T23:16:01.594 INFO:tasks.workunit.client.0.smithi100.stdout:2/978: dwrite d5/d12/d13/d9e/fc9 [0,4194304] 0 2024-04-30T23:16:01.601 INFO:tasks.workunit.client.0.smithi100.stdout:2/979: getdents d5/d22/da6/dfb 0 2024-04-30T23:16:01.601 INFO:tasks.workunit.client.0.smithi100.stdout:2/980: readlink d5/d12/l5e 0 2024-04-30T23:16:01.602 INFO:tasks.workunit.client.0.smithi100.stdout:2/981: creat d5/d47/d66/f12a x:0 0 0 2024-04-30T23:16:01.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/982: dread d5/d58/f65 [0,4194304] 0 2024-04-30T23:16:01.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/983: dwrite d5/d26/d2f/d38/f61 [0,4194304] 0 2024-04-30T23:16:01.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/984: chown d5/d12/c97 1797946 1 2024-04-30T23:16:01.623 INFO:tasks.workunit.client.0.smithi100.stdout:2/985: dread d5/d12/d8e/f98 [0,4194304] 0 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/596: sync 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/810: sync 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/787: sync 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/597: chown d3/d16/l49 507 1 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:3/788: write d1/d38/df5/d15/f1d [9291028,5747] 0 2024-04-30T23:16:01.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/811: write d1/d2c/d5d/f103 [347592,61082] 0 2024-04-30T23:16:01.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/598: creat d3/d16/d20/d24/faf x:0 0 0 2024-04-30T23:16:01.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/599: truncate d3/d18/f95 898031 0 2024-04-30T23:16:01.627 INFO:tasks.workunit.client.0.smithi100.stdout:5/812: truncate d1/d12/f31 4342836 0 2024-04-30T23:16:01.631 INFO:tasks.workunit.client.0.smithi100.stdout:5/813: mknod d1/d12/d1a/d76/da9/c104 0 2024-04-30T23:16:01.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/814: link d1/d12/d74/fe9 d1/d12/d24/f105 0 2024-04-30T23:16:01.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/815: dread - d1/d19/ff1 zero size 2024-04-30T23:16:01.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/816: stat d1/d3e/d99/dbf/dd0 0 2024-04-30T23:16:01.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/817: dread - d1/d12/d24/f105 zero size 2024-04-30T23:16:01.633 INFO:tasks.workunit.client.0.smithi100.stdout:5/818: creat d1/d19/d7f/f106 x:0 0 0 2024-04-30T23:16:01.634 INFO:tasks.workunit.client.0.smithi100.stdout:5/819: truncate d1/d2c/d60/d66/d71/db6/dd4/f91 4521695 0 2024-04-30T23:16:01.635 INFO:tasks.workunit.client.0.smithi100.stdout:2/986: write d5/d12/d13/d4b/f99 [1365329,56969] 0 2024-04-30T23:16:01.635 INFO:tasks.workunit.client.0.smithi100.stdout:2/987: write d5/fd9 [924150,84891] 0 2024-04-30T23:16:01.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/789: dwrite d1/d38/df5/d15/d2c/f7e [0,4194304] 0 2024-04-30T23:16:01.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/790: truncate d1/d38/df5/d15/f6a 700891 0 2024-04-30T23:16:01.649 INFO:tasks.workunit.client.0.smithi100.stdout:3/791: mknod d1/d38/df5/cf7 0 2024-04-30T23:16:01.651 INFO:tasks.workunit.client.0.smithi100.stdout:3/792: mkdir d1/d38/def/df8 0 2024-04-30T23:16:01.652 INFO:tasks.workunit.client.0.smithi100.stdout:3/793: dread d1/d38/df5/d15/d32/d6f/fe5 [0,4194304] 0 2024-04-30T23:16:01.652 INFO:tasks.workunit.client.0.smithi100.stdout:3/794: getdents d1/d38/df5/d15/d27/d5d 0 2024-04-30T23:16:01.654 INFO:tasks.workunit.client.0.smithi100.stdout:3/795: symlink d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dd6/lf9 0 2024-04-30T23:16:01.656 INFO:tasks.workunit.client.0.smithi100.stdout:3/796: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/ffa x:0 0 0 2024-04-30T23:16:01.658 INFO:tasks.workunit.client.0.smithi100.stdout:3/797: symlink d1/d38/def/df8/lfb 0 2024-04-30T23:16:01.658 INFO:tasks.workunit.client.0.smithi100.stdout:3/798: dread - d1/d38/df5/d15/d32/d6f/da2/d6d/fac zero size 2024-04-30T23:16:01.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/600: dwrite d3/d18/d60/d87/f8d [0,4194304] 0 2024-04-30T23:16:01.660 INFO:tasks.workunit.client.0.smithi100.stdout:1/601: mkdir d3/d16/d20/d24/db0 0 2024-04-30T23:16:01.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/820: dwrite d1/d12/de1/dea/f100 [0,4194304] 0 2024-04-30T23:16:01.662 INFO:tasks.workunit.client.0.smithi100.stdout:1/602: getdents d3 0 2024-04-30T23:16:01.666 INFO:tasks.workunit.client.0.smithi100.stdout:1/603: rename d3/d16/d20/f33 to d3/d18/fb1 0 2024-04-30T23:16:01.674 INFO:tasks.workunit.client.0.smithi100.stdout:5/821: dread d1/d12/d27/f42 [0,4194304] 0 2024-04-30T23:16:01.675 INFO:tasks.workunit.client.0.smithi100.stdout:5/822: creat d1/d12/d1a/d5b/f107 x:0 0 0 2024-04-30T23:16:01.676 INFO:tasks.workunit.client.0.smithi100.stdout:3/799: dwrite d1/d38/df5/d15/d32/de8/fc9 [0,4194304] 0 2024-04-30T23:16:01.677 INFO:tasks.workunit.client.0.smithi100.stdout:5/823: rename d1/d12/d27/f29 to d1/d12/d1a/df2/f108 0 2024-04-30T23:16:01.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/800: link d1/d38/df5/d21/f55 d1/d38/df5/d2b/d57/daf/ffc 0 2024-04-30T23:16:01.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/801: truncate d1/f10 1777425 0 2024-04-30T23:16:01.681 INFO:tasks.workunit.client.0.smithi100.stdout:5/824: symlink d1/d12/d1a/df2/l109 0 2024-04-30T23:16:01.685 INFO:tasks.workunit.client.0.smithi100.stdout:3/802: rename d1/d38/df5/d15/d27/l29 to d1/d38/df5/d2f/dc8/lfd 0 2024-04-30T23:16:01.685 INFO:tasks.workunit.client.0.smithi100.stdout:3/803: fsync d1/d38/df5/d21/d67/f77 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/825: mknod d1/d2c/d60/c10a 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/826: fdatasync d1/d3e/d99/fc2 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/827: write d1/d2c/d60/d66/d71/db6/dd4/f102 [3876578,39491] 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/828: write d1/d12/d24/d34/f69 [4197678,17372] 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/829: fsync d1/d12/f16 0 2024-04-30T23:16:01.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/830: chown d1/d12/d1a/d5b/f107 1061938519 1 2024-04-30T23:16:01.687 INFO:tasks.workunit.client.0.smithi100.stdout:3/804: mknod d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/d90/cfe 0 2024-04-30T23:16:01.687 INFO:tasks.workunit.client.0.smithi100.stdout:5/831: creat d1/d12/d1a/d5b/f10b x:0 0 0 2024-04-30T23:16:01.687 INFO:tasks.workunit.client.0.smithi100.stdout:5/832: fsync d1/d3e/d9b/fdd 0 2024-04-30T23:16:01.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/833: creat d1/d12/d74/f10c x:0 0 0 2024-04-30T23:16:01.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/834: readlink d1/d12/d27/l54 0 2024-04-30T23:16:01.689 INFO:tasks.workunit.client.0.smithi100.stdout:5/835: mknod d1/d12/d1a/d76/da9/c10d 0 2024-04-30T23:16:01.690 INFO:tasks.workunit.client.0.smithi100.stdout:5/836: rename d1/d12/d1a/d76/dd7/ff4 to d1/f10e 0 2024-04-30T23:16:01.698 INFO:tasks.workunit.client.0.smithi100.stdout:1/604: dwrite d3/f2f [0,4194304] 0 2024-04-30T23:16:01.708 INFO:tasks.workunit.client.0.smithi100.stdout:3/805: dread d1/d38/df5/d15/f16 [4194304,4194304] 0 2024-04-30T23:16:01.709 INFO:tasks.workunit.client.0.smithi100.stdout:3/806: rmdir d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae 39 2024-04-30T23:16:01.709 INFO:tasks.workunit.client.0.smithi100.stdout:3/807: write d1/d38/df5/d15/d32/f3e [2156357,38197] 0 2024-04-30T23:16:01.709 INFO:tasks.workunit.client.0.smithi100.stdout:3/808: truncate d1/d38/df5/d15/d32/d6f/da2/fee 957405 0 2024-04-30T23:16:01.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/809: write d1/d38/df5/d15/d32/d6f/da2/f74 [2263924,101064] 0 2024-04-30T23:16:01.722 INFO:tasks.workunit.client.0.smithi100.stdout:1/605: dwrite d3/d16/d20/d24/f7c [0,4194304] 0 2024-04-30T23:16:01.724 INFO:tasks.workunit.client.0.smithi100.stdout:3/810: creat d1/d38/df5/d15/d32/fff x:0 0 0 2024-04-30T23:16:01.726 INFO:tasks.workunit.client.0.smithi100.stdout:1/606: link d3/c15 d3/d16/d20/d24/d69/d5e/d7a/cb2 0 2024-04-30T23:16:01.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/811: symlink d1/d38/df5/d15/d27/d5d/dd1/l100 0 2024-04-30T23:16:01.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/607: mknod d3/d16/d20/d24/d51/d80/dae/cb3 0 2024-04-30T23:16:01.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/812: symlink d1/d38/d79/dde/l101 0 2024-04-30T23:16:01.749 INFO:tasks.workunit.client.0.smithi100.stdout:1/608: dwrite d3/f2f [0,4194304] 0 2024-04-30T23:16:01.749 INFO:tasks.workunit.client.0.smithi100.stdout:1/609: readlink d3/d16/d20/d24/d69/d63/l88 0 2024-04-30T23:16:01.755 INFO:tasks.workunit.client.0.smithi100.stdout:3/813: dwrite d1/d38/df5/d2b/f4c [0,4194304] 0 2024-04-30T23:16:01.755 INFO:tasks.workunit.client.0.smithi100.stdout:3/814: write d1/d38/df5/d15/f62 [260732,47950] 0 2024-04-30T23:16:01.757 INFO:tasks.workunit.client.0.smithi100.stdout:3/815: mkdir d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/d102 0 2024-04-30T23:16:01.758 INFO:tasks.workunit.client.0.smithi100.stdout:3/816: creat d1/d38/df5/d15/d32/d71/df0/f103 x:0 0 0 2024-04-30T23:16:01.758 INFO:tasks.workunit.client.0.smithi100.stdout:3/817: fdatasync d1/d38/df5/d15/d32/d71/fc3 0 2024-04-30T23:16:01.759 INFO:tasks.workunit.client.0.smithi100.stdout:3/818: symlink d1/d38/d79/l104 0 2024-04-30T23:16:01.759 INFO:tasks.workunit.client.0.smithi100.stdout:9/669: sync 2024-04-30T23:16:01.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/729: sync 2024-04-30T23:16:01.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/730: write d2/d14/d18/f45 [3514562,96824] 0 2024-04-30T23:16:01.760 INFO:tasks.workunit.client.0.smithi100.stdout:3/819: rmdir d1/d38/df5/d15/d32/d6f/da2/d6d 39 2024-04-30T23:16:01.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/670: symlink d4/d7/d8/d37/d58/lea 0 2024-04-30T23:16:01.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/671: stat d4/l56 0 2024-04-30T23:16:01.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/672: chown d4/d7/fd5 844196 1 2024-04-30T23:16:01.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/610: dread d3/d16/d20/d24/d69/d63/f6c [0,4194304] 0 2024-04-30T23:16:01.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/611: read - d3/d16/d20/d24/faf zero size 2024-04-30T23:16:01.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/612: write d3/d18/fb1 [1343652,79891] 0 2024-04-30T23:16:01.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/731: unlink d2/f23 0 2024-04-30T23:16:01.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/820: truncate d1/d38/df5/d15/f44 730849 0 2024-04-30T23:16:01.763 INFO:tasks.workunit.client.0.smithi100.stdout:9/673: mkdir d4/d7/d8/d37/d58/dd0/deb 0 2024-04-30T23:16:01.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/613: mkdir d3/d16/d20/d24/d69/d63/da9/db4 0 2024-04-30T23:16:01.766 INFO:tasks.workunit.client.0.smithi100.stdout:1/614: mknod d3/d16/d20/d24/d51/d80/dae/cb5 0 2024-04-30T23:16:01.786 INFO:tasks.workunit.client.0.smithi100.stdout:1/615: dwrite d3/d16/d20/d24/d69/f46 [4194304,4194304] 0 2024-04-30T23:16:01.786 INFO:tasks.workunit.client.0.smithi100.stdout:3/821: dread d1/d38/df5/d15/d32/fdf [0,4194304] 0 2024-04-30T23:16:01.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/674: write d4/d9/d93/fde [3397602,108877] 0 2024-04-30T23:16:01.788 INFO:tasks.workunit.client.0.smithi100.stdout:1/616: mkdir d3/d16/d20/d24/d51/d59/d5f/db6 0 2024-04-30T23:16:01.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/822: creat d1/d38/df5/d15/f105 x:0 0 0 2024-04-30T23:16:01.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/732: dwrite d2/d14/d35/d57/f95 [0,4194304] 0 2024-04-30T23:16:01.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/733: fsync d2/d50/d38/d6c/f74 0 2024-04-30T23:16:01.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/734: chown d2/d14/d35/f8e 2885413 1 2024-04-30T23:16:01.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/675: link d4/d9/d10/db9/lbe d4/d7/d8/d19/de2/lec 0 2024-04-30T23:16:01.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/617: mkdir d3/d16/d20/d24/db7 0 2024-04-30T23:16:01.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/618: fdatasync d3/f58 0 2024-04-30T23:16:01.792 INFO:tasks.workunit.client.0.smithi100.stdout:3/823: truncate d1/d38/df5/d15/d32/de8/f84 2462642 0 2024-04-30T23:16:01.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/824: truncate d1/d38/df5/d15/f1b 4649203 0 2024-04-30T23:16:01.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/825: readlink d1/d38/df5/d15/d32/d6f/da2/d26/l3f 0 2024-04-30T23:16:01.795 INFO:tasks.workunit.client.0.smithi100.stdout:3/826: truncate d1/d38/df5/d2b/d57/daf/fcc 301958 0 2024-04-30T23:16:01.800 INFO:tasks.workunit.client.0.smithi100.stdout:9/676: write d4/d7/fca [1060205,122167] 0 2024-04-30T23:16:01.800 INFO:tasks.workunit.client.0.smithi100.stdout:9/677: write f2 [676276,43865] 0 2024-04-30T23:16:01.803 INFO:tasks.workunit.client.0.smithi100.stdout:9/678: creat d4/d9/d93/dd7/fed x:0 0 0 2024-04-30T23:16:01.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/679: getdents d4/d7/d8/d37/d58/dd0 0 2024-04-30T23:16:01.806 INFO:tasks.workunit.client.0.smithi100.stdout:9/680: mknod d4/d9/d10/db9/cee 0 2024-04-30T23:16:01.806 INFO:tasks.workunit.client.0.smithi100.stdout:9/681: chown d4/d7/f38 1896 1 2024-04-30T23:16:01.808 INFO:tasks.workunit.client.0.smithi100.stdout:9/682: mknod d4/d7/d8/d37/d58/dd0/cef 0 2024-04-30T23:16:01.808 INFO:tasks.workunit.client.0.smithi100.stdout:9/683: write d4/d9/d51/f53 [2488133,83609] 0 2024-04-30T23:16:01.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/827: dread d1/d38/df5/d15/d27/f88 [0,4194304] 0 2024-04-30T23:16:01.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/828: write d1/d38/df5/d15/d32/d6f/da2/d26/f98 [1063082,7044] 0 2024-04-30T23:16:01.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/829: stat d1/d38/df5/ff4 0 2024-04-30T23:16:01.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/830: write d1/d38/fc1 [526108,100651] 0 2024-04-30T23:16:01.811 INFO:tasks.workunit.client.0.smithi100.stdout:3/831: link d1/d38/df5/d15/d27/d34/le1 d1/d38/d79/l106 0 2024-04-30T23:16:01.811 INFO:tasks.workunit.client.0.smithi100.stdout:3/832: readlink d1/d38/df5/d15/d32/d6f/da2/d6d/l83 0 2024-04-30T23:16:01.811 INFO:tasks.workunit.client.0.smithi100.stdout:3/833: write d1/d38/df5/d15/d32/d71/da9/fd2 [753071,120717] 0 2024-04-30T23:16:01.812 INFO:tasks.workunit.client.0.smithi100.stdout:0/735: dwrite d2/d50/d38/f3f [4194304,4194304] 0 2024-04-30T23:16:01.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/736: readlink d2/d14/d35/d57/lb9 0 2024-04-30T23:16:01.814 INFO:tasks.workunit.client.0.smithi100.stdout:3/834: creat d1/d38/df5/d2f/dc8/f107 x:0 0 0 2024-04-30T23:16:01.815 INFO:tasks.workunit.client.0.smithi100.stdout:0/737: truncate d2/f59 3956866 0 2024-04-30T23:16:01.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/619: dwrite d3/d16/d20/f27 [0,4194304] 0 2024-04-30T23:16:01.822 INFO:tasks.workunit.client.0.smithi100.stdout:0/738: dread d2/fa1 [0,4194304] 0 2024-04-30T23:16:01.823 INFO:tasks.workunit.client.0.smithi100.stdout:3/835: creat d1/d38/df5/d15/d32/d92/f108 x:0 0 0 2024-04-30T23:16:01.824 INFO:tasks.workunit.client.0.smithi100.stdout:1/620: mknod d3/d16/d20/d24/d69/d63/da9/db4/cb8 0 2024-04-30T23:16:01.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/684: read d4/d9/d10/f27 [5784494,39744] 0 2024-04-30T23:16:01.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/685: chown d4/d9/d6f/fbf 77434 1 2024-04-30T23:16:01.827 INFO:tasks.workunit.client.0.smithi100.stdout:0/739: mknod d2/d50/d30/cdb 0 2024-04-30T23:16:01.828 INFO:tasks.workunit.client.0.smithi100.stdout:3/836: symlink d1/d38/df5/d15/d27/d5d/l109 0 2024-04-30T23:16:01.830 INFO:tasks.workunit.client.0.smithi100.stdout:1/621: creat d3/d18/d60/d87/fb9 x:0 0 0 2024-04-30T23:16:01.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/686: rename d4/d7/d8/d19/l9e to d4/d9/d6f/ddb/lf0 0 2024-04-30T23:16:01.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/740: truncate d2/d14/f19 2521811 0 2024-04-30T23:16:01.833 INFO:tasks.workunit.client.0.smithi100.stdout:3/837: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/f10a x:0 0 0 2024-04-30T23:16:01.834 INFO:tasks.workunit.client.0.smithi100.stdout:1/622: rmdir d3/d18/d60 39 2024-04-30T23:16:01.834 INFO:tasks.workunit.client.0.smithi100.stdout:1/623: write d3/d16/d20/d24/faf [784755,50869] 0 2024-04-30T23:16:01.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/687: creat d4/d9/d51/d89/ff1 x:0 0 0 2024-04-30T23:16:01.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/838: mkdir d1/d38/df5/d21/d67/d10b 0 2024-04-30T23:16:01.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/839: write d1/d38/df5/d15/d32/d6f/da2/d6d/d81/fed [552771,49738] 0 2024-04-30T23:16:01.839 INFO:tasks.workunit.client.0.smithi100.stdout:1/624: creat d3/d16/d20/d24/d51/d80/fba x:0 0 0 2024-04-30T23:16:01.840 INFO:tasks.workunit.client.0.smithi100.stdout:1/625: chown d3/d16/d20/d24/d51/c85 334704 1 2024-04-30T23:16:01.840 INFO:tasks.workunit.client.0.smithi100.stdout:9/688: readlink d4/d7/d8/d37/l43 0 2024-04-30T23:16:01.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/689: dread - d4/d9/d10/fa2 zero size 2024-04-30T23:16:01.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/690: readlink d4/d7/d8/d37/laf 0 2024-04-30T23:16:01.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/691: fdatasync d4/d7/d60/d69/fe9 0 2024-04-30T23:16:01.843 INFO:tasks.workunit.client.0.smithi100.stdout:3/840: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/d90/f10c x:0 0 0 2024-04-30T23:16:01.843 INFO:tasks.workunit.client.0.smithi100.stdout:3/841: chown d1/d38/c82 938 1 2024-04-30T23:16:01.846 INFO:tasks.workunit.client.0.smithi100.stdout:1/626: unlink d3/d18/fb1 0 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/842: rename d1/d38/df5/d15/d32/de8/fc9 to d1/d38/df5/d15/d32/d6f/da2/d6d/d81/f10d 0 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/843: write d1/d38/df5/d15/d2c/f7e [4348264,76681] 0 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/844: chown d1/d38/df5/d15/d32/de8/c94 51 1 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/845: read - d1/d38/df5/d15/d2c/fe0 zero size 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/764: sync 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:7/922: sync 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/765: chown d2/d29/d67/f99 48709807 1 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/766: stat d2/d7/d18/fa6 0 2024-04-30T23:16:01.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/767: chown d2/d29/f2e 45 1 2024-04-30T23:16:01.850 INFO:tasks.workunit.client.0.smithi100.stdout:1/627: mkdir d3/dbb 0 2024-04-30T23:16:01.851 INFO:tasks.workunit.client.0.smithi100.stdout:3/846: mkdir d1/d38/def/d10e 0 2024-04-30T23:16:01.852 INFO:tasks.workunit.client.0.smithi100.stdout:8/768: getdents d2/d89/d10/d52/d9a/db9 0 2024-04-30T23:16:01.853 INFO:tasks.workunit.client.0.smithi100.stdout:8/769: getdents d2/d7/d18/d3a/da4 0 2024-04-30T23:16:01.861 INFO:tasks.workunit.client.0.smithi100.stdout:0/741: dwrite d2/d5a/f92 [0,4194304] 0 2024-04-30T23:16:01.861 INFO:tasks.workunit.client.0.smithi100.stdout:9/692: dwrite d4/f9d [0,4194304] 0 2024-04-30T23:16:01.861 INFO:tasks.workunit.client.0.smithi100.stdout:0/742: chown d2/d50/f71 127560708 1 2024-04-30T23:16:01.861 INFO:tasks.workunit.client.0.smithi100.stdout:0/743: fsync d2/d50/d30/d32/f5b 0 2024-04-30T23:16:01.866 INFO:tasks.workunit.client.0.smithi100.stdout:7/923: write d0/d1d/d5e/d6a/f6d [961157,43382] 0 2024-04-30T23:16:01.866 INFO:tasks.workunit.client.0.smithi100.stdout:9/693: link d4/d7/d8/d37/l43 d4/d7/d8/d37/d58/dd0/lf2 0 2024-04-30T23:16:01.867 INFO:tasks.workunit.client.0.smithi100.stdout:0/744: truncate d2/d14/d35/d57/f78 825247 0 2024-04-30T23:16:01.869 INFO:tasks.workunit.client.0.smithi100.stdout:7/924: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/f12f x:0 0 0 2024-04-30T23:16:01.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/694: symlink d4/d9/d10/db9/dc4/dda/lf3 0 2024-04-30T23:16:01.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/695: stat d4/d9/d93/dd7/dd9 0 2024-04-30T23:16:01.872 INFO:tasks.workunit.client.0.smithi100.stdout:0/745: getdents d2/d4c/d68 0 2024-04-30T23:16:01.874 INFO:tasks.workunit.client.0.smithi100.stdout:6/712: sync 2024-04-30T23:16:01.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/988: sync 2024-04-30T23:16:01.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/989: read d5/d26/f4a [937808,10814] 0 2024-04-30T23:16:01.874 INFO:tasks.workunit.client.0.smithi100.stdout:4/890: sync 2024-04-30T23:16:01.875 INFO:tasks.workunit.client.0.smithi100.stdout:0/746: unlink d2/d4c/d68/c7f 0 2024-04-30T23:16:01.875 INFO:tasks.workunit.client.0.smithi100.stdout:0/747: fsync d2/d14/d18/f45 0 2024-04-30T23:16:01.877 INFO:tasks.workunit.client.0.smithi100.stdout:7/925: rename d0/ld to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dc6/l130 0 2024-04-30T23:16:01.878 INFO:tasks.workunit.client.0.smithi100.stdout:4/891: symlink d19/l11d 0 2024-04-30T23:16:01.878 INFO:tasks.workunit.client.0.smithi100.stdout:4/892: readlink d19/d1a/d29/d103/l7c 0 2024-04-30T23:16:01.879 INFO:tasks.workunit.client.0.smithi100.stdout:7/926: truncate d0/d1b/d60/fdd 1011608 0 2024-04-30T23:16:01.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/770: dwrite d2/d29/f61 [0,4194304] 0 2024-04-30T23:16:01.882 INFO:tasks.workunit.client.0.smithi100.stdout:8/771: chown d2/d89/f49 3447 1 2024-04-30T23:16:01.884 INFO:tasks.workunit.client.0.smithi100.stdout:7/927: link d0/d1b/d60/d48/d4a/f92 d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/f131 0 2024-04-30T23:16:01.885 INFO:tasks.workunit.client.0.smithi100.stdout:5/837: sync 2024-04-30T23:16:01.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/928: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/df6 39 2024-04-30T23:16:01.894 INFO:tasks.workunit.client.0.smithi100.stdout:5/838: mknod d1/d12/d1a/df2/c10f 0 2024-04-30T23:16:01.894 INFO:tasks.workunit.client.0.smithi100.stdout:5/839: write d1/d3e/d99/dbf/dd0/fff [665133,19084] 0 2024-04-30T23:16:01.895 INFO:tasks.workunit.client.0.smithi100.stdout:7/929: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/db8/f132 x:0 0 0 2024-04-30T23:16:01.895 INFO:tasks.workunit.client.0.smithi100.stdout:7/930: fdatasync d0/d1b/d1e/f40 0 2024-04-30T23:16:01.903 INFO:tasks.workunit.client.0.smithi100.stdout:4/893: dread d19/d1a/d21/d3c/f7f [0,4194304] 0 2024-04-30T23:16:01.903 INFO:tasks.workunit.client.0.smithi100.stdout:2/990: read d5/d12/d8e/dae/fda [2681884,15757] 0 2024-04-30T23:16:01.903 INFO:tasks.workunit.client.0.smithi100.stdout:2/991: stat d5/d12/f3c 0 2024-04-30T23:16:01.904 INFO:tasks.workunit.client.0.smithi100.stdout:5/840: dread d1/d19/f1e [0,4194304] 0 2024-04-30T23:16:01.904 INFO:tasks.workunit.client.0.smithi100.stdout:2/992: rename d5/d58/f65 to d5/d12/d13/d9e/f12b 0 2024-04-30T23:16:01.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/841: mkdir d1/d2c/d60/d66/d71/db6/dd4/d85/d110 0 2024-04-30T23:16:01.907 INFO:tasks.workunit.client.0.smithi100.stdout:2/993: unlink d5/d22/da6/d115/f106 0 2024-04-30T23:16:01.907 INFO:tasks.workunit.client.0.smithi100.stdout:2/994: fdatasync d5/f6d 0 2024-04-30T23:16:01.908 INFO:tasks.workunit.client.0.smithi100.stdout:2/995: symlink d5/d58/l12c 0 2024-04-30T23:16:01.917 INFO:tasks.workunit.client.0.smithi100.stdout:3/847: write d1/d38/df5/d2b/d57/f80 [7243060,79094] 0 2024-04-30T23:16:01.917 INFO:tasks.workunit.client.0.smithi100.stdout:6/713: dwrite d7/d9/d86/d62/faa [4194304,4194304] 0 2024-04-30T23:16:01.917 INFO:tasks.workunit.client.0.smithi100.stdout:1/628: dwrite d3/d16/d20/d24/f5c [4194304,4194304] 0 2024-04-30T23:16:01.917 INFO:tasks.workunit.client.0.smithi100.stdout:3/848: stat d1/d38/df5/d15/d32/d92/f9d 0 2024-04-30T23:16:01.917 INFO:tasks.workunit.client.0.smithi100.stdout:1/629: chown d3/d16/d20/d24/d51/d59/l78 48215566 1 2024-04-30T23:16:01.919 INFO:tasks.workunit.client.0.smithi100.stdout:6/714: creat d7/d9/d86/de5/f103 x:0 0 0 2024-04-30T23:16:01.919 INFO:tasks.workunit.client.0.smithi100.stdout:8/772: read d2/d7/f6a [2813411,106615] 0 2024-04-30T23:16:01.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/715: getdents d7/df/d23/d24/d2e/d37/d85 0 2024-04-30T23:16:01.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/716: fdatasync d7/d9/d86/d62/fb5 0 2024-04-30T23:16:01.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/773: creat d2/d29/d71/d86/de2/ffc x:0 0 0 2024-04-30T23:16:01.925 INFO:tasks.workunit.client.0.smithi100.stdout:6/717: mkdir d7/d9/d86/d3e/d104 0 2024-04-30T23:16:01.926 INFO:tasks.workunit.client.0.smithi100.stdout:9/696: dwrite d4/d9/d10/f3a [4194304,4194304] 0 2024-04-30T23:16:01.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/697: rmdir d4/d7/d8/d37 39 2024-04-30T23:16:01.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/698: chown d4/f33 3674 1 2024-04-30T23:16:01.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/699: truncate d4/d7/d60/d69/fe9 615902 0 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/842: dread d1/d12/d74/ff3 [0,4194304] 0 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/843: chown d1/d12/d1a/c53 351108766 1 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/844: readlink d1/d12/d24/l9e 0 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/845: chown d1/d2c/d60/d66/d71/db6/cb9 87631 1 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:7/931: dwrite d0/d1d/d3c/f47 [0,4194304] 0 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:7/932: dread - d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/ffb zero size 2024-04-30T23:16:01.935 INFO:tasks.workunit.client.0.smithi100.stdout:7/933: write d0/d1d/d5e/d6a/d4b/d79/d2a/f88 [373524,84930] 0 2024-04-30T23:16:01.936 INFO:tasks.workunit.client.0.smithi100.stdout:5/846: truncate d1/d12/de1/dea/f100 3891938 0 2024-04-30T23:16:01.937 INFO:tasks.workunit.client.0.smithi100.stdout:3/849: dread d1/d38/df5/d2f/f7c [0,4194304] 0 2024-04-30T23:16:01.937 INFO:tasks.workunit.client.0.smithi100.stdout:3/850: truncate d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/f10a 301923 0 2024-04-30T23:16:01.938 INFO:tasks.workunit.client.0.smithi100.stdout:5/847: link d1/d2c/d60/d66/fed d1/d3e/d99/f111 0 2024-04-30T23:16:01.940 INFO:tasks.workunit.client.0.smithi100.stdout:3/851: mknod d1/d38/df5/d15/d32/d6f/c10f 0 2024-04-30T23:16:01.941 INFO:tasks.workunit.client.0.smithi100.stdout:5/848: symlink d1/d2c/d60/d66/d75/l112 0 2024-04-30T23:16:01.941 INFO:tasks.workunit.client.0.smithi100.stdout:5/849: readlink d1/d2c/l3f 0 2024-04-30T23:16:01.941 INFO:tasks.workunit.client.0.smithi100.stdout:4/894: dwrite d19/d1a/d29/d103/d40/fee [0,4194304] 0 2024-04-30T23:16:01.943 INFO:tasks.workunit.client.0.smithi100.stdout:5/850: rename d1/d3e/d9b/fdd to d1/d12/d1a/d76/d77/d8c/f113 0 2024-04-30T23:16:01.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/851: mknod d1/d12/c114 0 2024-04-30T23:16:01.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/852: chown d1/d12/d27/fc8 16226 1 2024-04-30T23:16:01.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/996: dwrite d5/f6d [0,4194304] 0 2024-04-30T23:16:01.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/997: write d5/d12/f9a [1288908,107787] 0 2024-04-30T23:16:01.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/998: fdatasync d5/fbb 0 2024-04-30T23:16:01.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/999: fsync d5/d12/d13/d4b/f52 0 2024-04-30T23:16:01.951 INFO:tasks.workunit.client.0.smithi100.stdout:6/718: dwrite d7/df/d23/d24/d2e/d37/fb2 [0,4194304] 0 2024-04-30T23:16:01.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/852: dread d1/d38/df5/d15/d27/f88 [0,4194304] 0 2024-04-30T23:16:01.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/853: chown d1/d38/df5/d15/d32/d6f/da2/d6d/d81/fed 0 1 2024-04-30T23:16:01.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/719: creat d7/d9/d86/d3e/d104/f105 x:0 0 0 2024-04-30T23:16:01.956 INFO:tasks.workunit.client.0.smithi100.stdout:3/854: stat d1/d38/df5/d21/d67/lbf 0 2024-04-30T23:16:01.956 INFO:tasks.workunit.client.0.smithi100.stdout:3/855: fdatasync d1/d38/df5/d2f/dc8/f107 0 2024-04-30T23:16:01.957 INFO:tasks.workunit.client.0.smithi100.stdout:3/856: dread - d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/ffa zero size 2024-04-30T23:16:01.957 INFO:tasks.workunit.client.0.smithi100.stdout:3/857: chown d1/d38/df5/d15/d2c/cb5 859400162 1 2024-04-30T23:16:01.957 INFO:tasks.workunit.client.0.smithi100.stdout:7/934: read d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/fe2 [1381667,74441] 0 2024-04-30T23:16:01.957 INFO:tasks.workunit.client.0.smithi100.stdout:8/774: dwrite d2/d29/f7e [0,4194304] 0 2024-04-30T23:16:01.959 INFO:tasks.workunit.client.0.smithi100.stdout:6/720: symlink d7/df/d23/d2b/d42/dd7/l106 0 2024-04-30T23:16:01.961 INFO:tasks.workunit.client.0.smithi100.stdout:3/858: creat d1/d38/df5/d15/d32/d6f/da2/f110 x:0 0 0 2024-04-30T23:16:01.963 INFO:tasks.workunit.client.0.smithi100.stdout:8/775: mknod d2/d89/d10/d6e/cfd 0 2024-04-30T23:16:01.964 INFO:tasks.workunit.client.0.smithi100.stdout:7/935: write d0/d1d/d5e/d6a/f6d [4348307,10659] 0 2024-04-30T23:16:01.964 INFO:tasks.workunit.client.0.smithi100.stdout:7/936: dread - d0/d1d/d5e/d6a/d4b/d79/dd0/f10c zero size 2024-04-30T23:16:01.966 INFO:tasks.workunit.client.0.smithi100.stdout:3/859: rename d1/d38/df5/d2b/d57/daf/ffc to d1/d38/df5/d15/d32/d6f/da2/d6d/f111 0 2024-04-30T23:16:01.966 INFO:tasks.workunit.client.0.smithi100.stdout:3/860: chown d1/d38/f78 775 1 2024-04-30T23:16:01.966 INFO:tasks.workunit.client.0.smithi100.stdout:3/861: chown d1/d38/lbd 52046 1 2024-04-30T23:16:01.968 INFO:tasks.workunit.client.0.smithi100.stdout:8/776: mkdir d2/d7/dfe 0 2024-04-30T23:16:01.971 INFO:tasks.workunit.client.0.smithi100.stdout:8/777: dread d2/d89/d10/d17/f4c [0,4194304] 0 2024-04-30T23:16:01.976 INFO:tasks.workunit.client.0.smithi100.stdout:8/778: dread d2/d29/d8b/d8e/f96 [0,4194304] 0 2024-04-30T23:16:01.977 INFO:tasks.workunit.client.0.smithi100.stdout:8/779: symlink d2/d89/d72/d93/lff 0 2024-04-30T23:16:01.980 INFO:tasks.workunit.client.0.smithi100.stdout:3/862: write d1/d38/f5c [3380276,31618] 0 2024-04-30T23:16:01.981 INFO:tasks.workunit.client.0.smithi100.stdout:3/863: chown d1/d38/df5/d15/d2c 1 1 2024-04-30T23:16:01.981 INFO:tasks.workunit.client.0.smithi100.stdout:3/864: truncate d1/d38/df5/d15/f105 99683 0 2024-04-30T23:16:01.981 INFO:tasks.workunit.client.0.smithi100.stdout:5/853: dwrite d1/d2c/d60/f65 [0,4194304] 0 2024-04-30T23:16:01.982 INFO:tasks.workunit.client.0.smithi100.stdout:5/854: rmdir d1/d2c/d60 39 2024-04-30T23:16:01.984 INFO:tasks.workunit.client.0.smithi100.stdout:5/855: symlink d1/d2c/d60/d66/d71/db6/dd4/l115 0 2024-04-30T23:16:01.985 INFO:tasks.workunit.client.0.smithi100.stdout:4/895: dwrite f8 [0,4194304] 0 2024-04-30T23:16:01.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/896: creat d19/d1a/d21/d4a/d53/deb/d119/f11e x:0 0 0 2024-04-30T23:16:01.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/897: truncate d19/d1a/d6d/d4e/d6e/fa8 98319 0 2024-04-30T23:16:01.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/898: readlink l15 0 2024-04-30T23:16:01.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/899: chown d19/d1a/d6d/d4e/fc1 0 1 2024-04-30T23:16:01.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/900: creat d19/d1a/d21/d4a/d53/f11f x:0 0 0 2024-04-30T23:16:01.988 INFO:tasks.workunit.client.0.smithi100.stdout:7/937: dwrite d0/d1b/d2e/f113 [0,4194304] 0 2024-04-30T23:16:01.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/901: creat d19/d1a/d21/d4a/d53/d5d/f120 x:0 0 0 2024-04-30T23:16:01.990 INFO:tasks.workunit.client.0.smithi100.stdout:4/902: write d19/d1a/d21/d4a/d53/d5e/f111 [806209,97043] 0 2024-04-30T23:16:01.992 INFO:tasks.workunit.client.0.smithi100.stdout:8/780: write d2/d89/d10/d17/d8f/fb1 [2324375,18535] 0 2024-04-30T23:16:01.996 INFO:tasks.workunit.client.0.smithi100.stdout:4/903: truncate d19/d1a/d6d/d64/d78/f82 3802454 0 2024-04-30T23:16:01.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/904: rename d19/d1a/d45/lac to d19/d1a/d29/dae/l121 0 2024-04-30T23:16:01.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/905: stat d19/d1a/d6d/d64/d78 0 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/906: write d19/d33/d7d/fe8 [823479,11089] 0 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/907: read - d19/d1a/d21/fc2 zero size 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/865: write d1/d38/df5/f5f [1827694,116477] 0 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/908: fsync d19/d1a/d29/d103/fc5 0 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/909: dread - d19/f102 zero size 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/866: readlink d1/d38/df5/d21/d67/lbe 0 2024-04-30T23:16:01.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/867: chown d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/lc5 46 1 2024-04-30T23:16:02.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/910: creat d19/d1a/d21/d4a/d53/f122 x:0 0 0 2024-04-30T23:16:02.007 INFO:tasks.workunit.client.0.smithi100.stdout:4/911: rename d19/d1a/d29/dae/fca to d19/d1a/d21/d3c/f123 0 2024-04-30T23:16:02.008 INFO:tasks.workunit.client.0.smithi100.stdout:3/868: dread d1/d38/df5/d15/f6a [0,4194304] 0 2024-04-30T23:16:02.009 INFO:tasks.workunit.client.0.smithi100.stdout:5/856: dwrite d1/d12/d27/f4c [0,4194304] 0 2024-04-30T23:16:02.012 INFO:tasks.workunit.client.0.smithi100.stdout:5/857: mkdir d1/d12/d1a/d76/da9/d116 0 2024-04-30T23:16:02.013 INFO:tasks.workunit.client.0.smithi100.stdout:7/938: dwrite d0/d1b/d60/d48/d116/f119 [0,4194304] 0 2024-04-30T23:16:02.014 INFO:tasks.workunit.client.0.smithi100.stdout:5/858: rmdir d1/d3e/d99/dbf 39 2024-04-30T23:16:02.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/939: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/f133 x:0 0 0 2024-04-30T23:16:02.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/940: write d0/d1b/d2e/d3d/f57 [555134,16635] 0 2024-04-30T23:16:02.023 INFO:tasks.workunit.client.0.smithi100.stdout:7/941: creat d0/d1b/d2e/d97/f134 x:0 0 0 2024-04-30T23:16:02.025 INFO:tasks.workunit.client.0.smithi100.stdout:7/942: unlink d0/df/d4f/d53/fc0 0 2024-04-30T23:16:02.032 INFO:tasks.workunit.client.0.smithi100.stdout:4/912: dwrite d19/d1a/d21/d4a/d53/f122 [0,4194304] 0 2024-04-30T23:16:02.038 INFO:tasks.workunit.client.0.smithi100.stdout:5/859: dwrite d1/f10e [0,4194304] 0 2024-04-30T23:16:02.039 INFO:tasks.workunit.client.0.smithi100.stdout:5/860: chown d1/d12/d24/de8 0 1 2024-04-30T23:16:02.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/913: dread d19/d1a/d21/d3c/f55 [0,4194304] 0 2024-04-30T23:16:02.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/914: stat d19/lf2 0 2024-04-30T23:16:02.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/915: mknod d19/d33/c124 0 2024-04-30T23:16:02.050 INFO:tasks.workunit.client.0.smithi100.stdout:5/861: dread d1/d19/f1e [0,4194304] 0 2024-04-30T23:16:02.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/943: dwrite d0/df/f14 [0,4194304] 0 2024-04-30T23:16:02.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/944: stat d0/d1b/d60/d48/d4a/d5b/f6c 0 2024-04-30T23:16:02.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/916: rename d19/d1a/d29/d103/la9 to d19/d1a/d45/l125 0 2024-04-30T23:16:02.052 INFO:tasks.workunit.client.0.smithi100.stdout:7/945: mknod d0/df/d4f/d53/dd2/df5/c135 0 2024-04-30T23:16:02.054 INFO:tasks.workunit.client.0.smithi100.stdout:7/946: read d0/d1b/d60/d48/d116/f90 [681699,30502] 0 2024-04-30T23:16:02.061 INFO:tasks.workunit.client.0.smithi100.stdout:4/917: rmdir d19/d1a/d6d/d64/d78/dea 39 2024-04-30T23:16:02.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/947: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/d7d/f136 x:0 0 0 2024-04-30T23:16:02.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/948: fsync d0/d1d/fc7 0 2024-04-30T23:16:02.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/949: creat d0/d1d/d5e/d6a/d4b/d79/dd0/f137 x:0 0 0 2024-04-30T23:16:02.067 INFO:tasks.workunit.client.0.smithi100.stdout:7/950: truncate d0/d1d/d5e/d6a/f2d 798426 0 2024-04-30T23:16:02.070 INFO:tasks.workunit.client.0.smithi100.stdout:7/951: rename d0/d1b/d60/f54 to d0/d1b/d60/dbe/d122/f138 0 2024-04-30T23:16:02.072 INFO:tasks.workunit.client.0.smithi100.stdout:7/952: mkdir d0/df/d4f/d53/d139 0 2024-04-30T23:16:02.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/953: mkdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/d13a 0 2024-04-30T23:16:02.083 INFO:tasks.workunit.client.0.smithi100.stdout:7/954: dread d0/d1b/d2e/d3d/f9b [0,4194304] 0 2024-04-30T23:16:02.110 INFO:tasks.workunit.client.0.smithi100.stdout:0/748: sync 2024-04-30T23:16:02.110 INFO:tasks.workunit.client.0.smithi100.stdout:0/749: getdents d2/d14/d35/d40/dbe 0 2024-04-30T23:16:02.121 INFO:tasks.workunit.client.0.smithi100.stdout:0/750: dread d2/d14/d35/fa7 [0,4194304] 0 2024-04-30T23:16:02.133 INFO:tasks.workunit.client.0.smithi100.stdout:0/751: dread d2/fc [0,4194304] 0 2024-04-30T23:16:02.135 INFO:tasks.workunit.client.0.smithi100.stdout:0/752: symlink d2/d50/d38/d6c/ldc 0 2024-04-30T23:16:02.151 INFO:tasks.workunit.client.0.smithi100.stdout:0/753: dwrite d2/d5a/f6a [0,4194304] 0 2024-04-30T23:16:02.154 INFO:tasks.workunit.client.0.smithi100.stdout:0/754: creat d2/d14/d35/d57/d62/dda/fdd x:0 0 0 2024-04-30T23:16:02.154 INFO:tasks.workunit.client.0.smithi100.stdout:0/755: chown d2/d14 3499 1 2024-04-30T23:16:02.155 INFO:tasks.workunit.client.0.smithi100.stdout:0/756: rmdir d2/d50/d38/d6c 39 2024-04-30T23:16:02.155 INFO:tasks.workunit.client.0.smithi100.stdout:0/757: fsync d2/d14/d35/d57/f60 0 2024-04-30T23:16:02.156 INFO:tasks.workunit.client.0.smithi100.stdout:0/758: mkdir d2/d50/d38/d6c/d6e/dad/dde 0 2024-04-30T23:16:02.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/759: rename d2/d50/d30/c58 to d2/d14/d35/d40/d83/cdf 0 2024-04-30T23:16:02.171 INFO:tasks.workunit.client.0.smithi100.stdout:0/760: dread d2/f8 [0,4194304] 0 2024-04-30T23:16:02.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/761: dwrite d2/d14/d18/f93 [0,4194304] 0 2024-04-30T23:16:02.193 INFO:tasks.workunit.client.0.smithi100.stdout:0/762: dread d2/d50/d38/d6c/d6e/f8a [0,4194304] 0 2024-04-30T23:16:02.195 INFO:tasks.workunit.client.0.smithi100.stdout:0/763: symlink d2/d50/d38/d5d/dc6/le0 0 2024-04-30T23:16:02.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/764: mkdir d2/d50/d30/dd4/de1 0 2024-04-30T23:16:02.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/765: fsync d2/d50/d38/fb2 0 2024-04-30T23:16:02.198 INFO:tasks.workunit.client.0.smithi100.stdout:0/766: creat d2/d5a/fe2 x:0 0 0 2024-04-30T23:16:02.208 INFO:tasks.workunit.client.0.smithi100.stdout:0/767: dread d2/d50/d30/d32/f84 [0,4194304] 0 2024-04-30T23:16:02.210 INFO:tasks.workunit.client.0.smithi100.stdout:0/768: truncate d2/d14/d35/d40/f56 448811 0 2024-04-30T23:16:02.220 INFO:tasks.workunit.client.0.smithi100.stdout:0/769: truncate d2/d14/d35/d40/f56 50133 0 2024-04-30T23:16:02.222 INFO:tasks.workunit.client.0.smithi100.stdout:0/770: write d2/d14/d18/f45 [4288320,9160] 0 2024-04-30T23:16:02.223 INFO:tasks.workunit.client.0.smithi100.stdout:0/771: write d2/d5a/f77 [4295394,42273] 0 2024-04-30T23:16:02.223 INFO:tasks.workunit.client.0.smithi100.stdout:0/772: creat d2/d5a/fe3 x:0 0 0 2024-04-30T23:16:02.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/773: rmdir d2/d50 39 2024-04-30T23:16:02.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/774: rmdir d2/d14/d35/d57/d62/dda 39 2024-04-30T23:16:02.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/775: chown d2/d14/d35/d40/dbe 14328916 1 2024-04-30T23:16:02.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/776: chown d2/l46 220 1 2024-04-30T23:16:02.237 INFO:tasks.workunit.client.0.smithi100.stdout:0/777: dread d2/d50/d30/d32/f5b [0,4194304] 0 2024-04-30T23:16:02.245 INFO:tasks.workunit.client.0.smithi100.stdout:1/630: sync 2024-04-30T23:16:02.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/631: unlink d3/db/d4b/c57 0 2024-04-30T23:16:02.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/632: unlink d3/d16/d20/d24/d69/f72 0 2024-04-30T23:16:02.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/778: dwrite d2/dba/fcd [0,4194304] 0 2024-04-30T23:16:02.260 INFO:tasks.workunit.client.0.smithi100.stdout:0/779: unlink d2/d50/d38/f7a 0 2024-04-30T23:16:02.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/633: dwrite d3/db/f39 [0,4194304] 0 2024-04-30T23:16:02.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/634: stat d3/d16/d20/d24/d69/d63/da9/db4 0 2024-04-30T23:16:02.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/635: dread d3/d16/d20/d24/d51/d59/f73 [0,4194304] 0 2024-04-30T23:16:02.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/636: readlink d3/d16/l4e 0 2024-04-30T23:16:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:1/637: symlink d3/d16/lbc 0 2024-04-30T23:16:02.276 INFO:tasks.workunit.client.0.smithi100.stdout:1/638: mkdir d3/d16/d20/d24/db7/dbd 0 2024-04-30T23:16:02.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/639: mkdir d3/d16/d20/d24/db7/dbe 0 2024-04-30T23:16:02.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/640: fsync d3/d18/d60/f8c 0 2024-04-30T23:16:02.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/641: write d3/d16/d20/d24/d51/d59/f73 [1502250,56622] 0 2024-04-30T23:16:02.278 INFO:tasks.workunit.client.0.smithi100.stdout:1/642: symlink d3/d16/d20/d24/d69/d63/da9/db4/lbf 0 2024-04-30T23:16:02.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/643: creat d3/d16/d20/d24/d69/d63/da9/fc0 x:0 0 0 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/644: chown d3/d16/d20/d24/db7/dbe 15499 1 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/645: chown d3/d16/d20/d24/d69/d63/f91 86268154 1 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/646: stat d3/d18/d60/l83 0 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/647: truncate d3/f9 586174 0 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/648: readlink d3/d16/d20/d24/d51/d80/laa 0 2024-04-30T23:16:02.280 INFO:tasks.workunit.client.0.smithi100.stdout:1/649: stat d3/d99/f9b 0 2024-04-30T23:16:02.281 INFO:tasks.workunit.client.0.smithi100.stdout:1/650: symlink d3/d99/lc1 0 2024-04-30T23:16:02.281 INFO:tasks.workunit.client.0.smithi100.stdout:1/651: symlink d3/d16/d20/lc2 0 2024-04-30T23:16:02.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/780: dwrite d2/d14/d35/fb4 [0,4194304] 0 2024-04-30T23:16:02.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/781: dread - d2/d14/d35/d57/d62/fc2 zero size 2024-04-30T23:16:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:5/862: sync 2024-04-30T23:16:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:4/918: sync 2024-04-30T23:16:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/955: sync 2024-04-30T23:16:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:5/863: fsync d1/d12/d27/f58 0 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:5/864: dread - d1/d12/d27/fc8 zero size 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:6/721: sync 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/919: write d19/d1a/d29/d103/d40/fde [35497,106508] 0 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/920: truncate d19/d1a/d6d/d4e/d6e/fdb 852055 0 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/921: chown d19/d1a/d29/dae/fc9 29230264 1 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:8/781: sync 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/922: chown d19/d1a/d45/l94 832214601 1 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/923: dread - d19/d1a/d6d/d4e/d6e/dcb/fe6 zero size 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/700: sync 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/701: truncate d4/d7/d8/d37/d58/fe6 871386 0 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/702: write d4/fb3 [1090018,46205] 0 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:3/869: sync 2024-04-30T23:16:02.298 INFO:tasks.workunit.client.0.smithi100.stdout:3/870: write d1/d38/df5/f73 [3743045,57996] 0 2024-04-30T23:16:02.299 INFO:tasks.workunit.client.0.smithi100.stdout:7/956: mknod d0/d1d/d5e/d6a/d4b/d79/d2a/c13b 0 2024-04-30T23:16:02.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/865: rename d1/d37/fc6 to d1/d12/d24/d34/f117 0 2024-04-30T23:16:02.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/722: link d7/df/d23/d24/d2e/d37/f74 d7/d9/d86/f107 0 2024-04-30T23:16:02.304 INFO:tasks.workunit.client.0.smithi100.stdout:8/782: mknod d2/d29/d71/ddb/c100 0 2024-04-30T23:16:02.305 INFO:tasks.workunit.client.0.smithi100.stdout:4/924: getdents d19/d1a/d21/d4a 0 2024-04-30T23:16:02.306 INFO:tasks.workunit.client.0.smithi100.stdout:5/866: creat d1/d19/d7f/f118 x:0 0 0 2024-04-30T23:16:02.309 INFO:tasks.workunit.client.0.smithi100.stdout:6/723: rename d7/d9/d86/d1b/d22/d38/cfc to d7/df/d23/d2b/d42/dd7/c108 0 2024-04-30T23:16:02.310 INFO:tasks.workunit.client.0.smithi100.stdout:1/652: dwrite d3/d16/f84 [0,4194304] 0 2024-04-30T23:16:02.311 INFO:tasks.workunit.client.0.smithi100.stdout:8/783: rmdir d2/d29/d71/ddb/dec 0 2024-04-30T23:16:02.312 INFO:tasks.workunit.client.0.smithi100.stdout:5/867: truncate d1/d12/de1/dea/f100 1135604 0 2024-04-30T23:16:02.317 INFO:tasks.workunit.client.0.smithi100.stdout:6/724: rename d7/df/f53 to d7/d9/d86/d1b/d5a/de2/d98/f109 0 2024-04-30T23:16:02.317 INFO:tasks.workunit.client.0.smithi100.stdout:1/653: write d3/db/f3d [3475033,53378] 0 2024-04-30T23:16:02.319 INFO:tasks.workunit.client.0.smithi100.stdout:5/868: mkdir d1/d12/d1a/d5b/d119 0 2024-04-30T23:16:02.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/869: write d1/d12/d1a/d76/d77/d8c/f9c [26182,76296] 0 2024-04-30T23:16:02.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/870: fdatasync d1/d12/d27/fc8 0 2024-04-30T23:16:02.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/871: fdatasync d1/d12/d1a/d5b/fbc 0 2024-04-30T23:16:02.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/782: write d2/d4c/f89 [2702103,42069] 0 2024-04-30T23:16:02.329 INFO:tasks.workunit.client.0.smithi100.stdout:5/872: mknod d1/d2c/d60/c11a 0 2024-04-30T23:16:02.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/783: creat d2/d50/d38/d6c/fe4 x:0 0 0 2024-04-30T23:16:02.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/784: write d2/d50/d30/d32/f5b [3390632,56530] 0 2024-04-30T23:16:02.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/785: chown d2/d14/d35 32046514 1 2024-04-30T23:16:02.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/786: write d2/d14/d35/d57/d62/dda/fdd [244937,101880] 0 2024-04-30T23:16:02.334 INFO:tasks.workunit.client.0.smithi100.stdout:0/787: truncate d2/d14/d35/d40/f49 2162340 0 2024-04-30T23:16:02.338 INFO:tasks.workunit.client.0.smithi100.stdout:8/784: dread d2/f3 [0,4194304] 0 2024-04-30T23:16:02.338 INFO:tasks.workunit.client.0.smithi100.stdout:4/925: dwrite d19/d33/f5a [0,4194304] 0 2024-04-30T23:16:02.338 INFO:tasks.workunit.client.0.smithi100.stdout:3/871: dwrite d1/d38/df5/d15/d32/d6f/da2/f39 [0,4194304] 0 2024-04-30T23:16:02.340 INFO:tasks.workunit.client.0.smithi100.stdout:8/785: creat d2/d97/f101 x:0 0 0 2024-04-30T23:16:02.342 INFO:tasks.workunit.client.0.smithi100.stdout:9/703: dwrite d4/d7/d8/f86 [0,4194304] 0 2024-04-30T23:16:02.343 INFO:tasks.workunit.client.0.smithi100.stdout:1/654: dread d3/d16/f3c [0,4194304] 0 2024-04-30T23:16:02.343 INFO:tasks.workunit.client.0.smithi100.stdout:1/655: chown d3/d16/d20/d24/d51/d59/d5f/l7e 109 1 2024-04-30T23:16:02.343 INFO:tasks.workunit.client.0.smithi100.stdout:3/872: symlink d1/d38/def/df8/l112 0 2024-04-30T23:16:02.346 INFO:tasks.workunit.client.0.smithi100.stdout:9/704: truncate d4/d9/f16 1167206 0 2024-04-30T23:16:02.348 INFO:tasks.workunit.client.0.smithi100.stdout:3/873: rename d1/d38/df5/d2f/c35 to d1/d38/df5/d15/d32/d6f/da2/d6d/d81/c113 0 2024-04-30T23:16:02.348 INFO:tasks.workunit.client.0.smithi100.stdout:3/874: write d1/d38/df5/d15/d27/d34/f6e [524328,30948] 0 2024-04-30T23:16:02.348 INFO:tasks.workunit.client.0.smithi100.stdout:1/656: read d3/d16/d20/d24/d51/d59/f73 [973735,29239] 0 2024-04-30T23:16:02.348 INFO:tasks.workunit.client.0.smithi100.stdout:1/657: chown d3/d16/d20/ca1 14778560 1 2024-04-30T23:16:02.349 INFO:tasks.workunit.client.0.smithi100.stdout:1/658: chown d3/d16/d20/d24/d69 1 1 2024-04-30T23:16:02.349 INFO:tasks.workunit.client.0.smithi100.stdout:1/659: truncate d3/d16/d20/d24/d69/f9f 1039363 0 2024-04-30T23:16:02.349 INFO:tasks.workunit.client.0.smithi100.stdout:6/725: dwrite d7/d9/deb/fef [0,4194304] 0 2024-04-30T23:16:02.351 INFO:tasks.workunit.client.0.smithi100.stdout:3/875: mknod d1/d38/df5/d15/d32/d71/df0/c114 0 2024-04-30T23:16:02.351 INFO:tasks.workunit.client.0.smithi100.stdout:3/876: chown d1/d38/df5/d2b/d57/fa1 0 1 2024-04-30T23:16:02.351 INFO:tasks.workunit.client.0.smithi100.stdout:5/873: dwrite d1/d2c/d60/d66/d71/db6/dd4/f91 [4194304,4194304] 0 2024-04-30T23:16:02.354 INFO:tasks.workunit.client.0.smithi100.stdout:1/660: unlink d3/d16/d20/ca1 0 2024-04-30T23:16:02.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/786: write d2/d7/d18/d3a/f85 [1007070,1660] 0 2024-04-30T23:16:02.356 INFO:tasks.workunit.client.0.smithi100.stdout:9/705: rename d4/d9/d10/c34 to d4/d7/d8/d19/de2/cf4 0 2024-04-30T23:16:02.356 INFO:tasks.workunit.client.0.smithi100.stdout:9/706: fsync d4/d9/d10/db9/dc4/fc8 0 2024-04-30T23:16:02.359 INFO:tasks.workunit.client.0.smithi100.stdout:6/726: symlink d7/df/l10a 0 2024-04-30T23:16:02.359 INFO:tasks.workunit.client.0.smithi100.stdout:6/727: write d7/df/d23/d4f/fbd [837578,130453] 0 2024-04-30T23:16:02.362 INFO:tasks.workunit.client.0.smithi100.stdout:0/788: dwrite d2/d50/f3c [0,4194304] 0 2024-04-30T23:16:02.366 INFO:tasks.workunit.client.0.smithi100.stdout:3/877: mknod d1/d38/df5/d15/d32/d6f/da2/d6d/c115 0 2024-04-30T23:16:02.366 INFO:tasks.workunit.client.0.smithi100.stdout:5/874: creat d1/d12/d1a/d76/d8e/f11b x:0 0 0 2024-04-30T23:16:02.366 INFO:tasks.workunit.client.0.smithi100.stdout:5/875: fdatasync d1/d12/d24/fee 0 2024-04-30T23:16:02.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/787: symlink d2/d89/d7f/l102 0 2024-04-30T23:16:02.370 INFO:tasks.workunit.client.0.smithi100.stdout:9/707: creat d4/d9/d8e/ff5 x:0 0 0 2024-04-30T23:16:02.375 INFO:tasks.workunit.client.0.smithi100.stdout:0/789: unlink d2/d14/d35/d57/d62/dda/fdd 0 2024-04-30T23:16:02.376 INFO:tasks.workunit.client.0.smithi100.stdout:9/708: dread d4/d7/d8/d37/d58/f77 [0,4194304] 0 2024-04-30T23:16:02.376 INFO:tasks.workunit.client.0.smithi100.stdout:3/878: link d1/d38/df5/c3a d1/dc6/c116 0 2024-04-30T23:16:02.378 INFO:tasks.workunit.client.0.smithi100.stdout:5/876: rmdir d1/d2c/d60/d66 39 2024-04-30T23:16:02.379 INFO:tasks.workunit.client.0.smithi100.stdout:8/788: stat d2/d89/lc5 0 2024-04-30T23:16:02.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/728: dwrite d7/db/f5c [4194304,4194304] 0 2024-04-30T23:16:02.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/729: dread - d7/d9/d86/d3e/d6b/fd2 zero size 2024-04-30T23:16:02.381 INFO:tasks.workunit.client.0.smithi100.stdout:0/790: creat d2/d50/d38/d5d/dc4/fe5 x:0 0 0 2024-04-30T23:16:02.381 INFO:tasks.workunit.client.0.smithi100.stdout:5/877: dread d1/d12/d1a/d76/d77/d8c/f9c [0,4194304] 0 2024-04-30T23:16:02.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/709: creat d4/d7/d60/ff6 x:0 0 0 2024-04-30T23:16:02.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/710: fsync d4/d7/d8/d37/d3d/fe1 0 2024-04-30T23:16:02.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/711: fdatasync d4/d9/d51/d89/dbb/fc1 0 2024-04-30T23:16:02.384 INFO:tasks.workunit.client.0.smithi100.stdout:3/879: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/d90/f117 x:0 0 0 2024-04-30T23:16:02.386 INFO:tasks.workunit.client.0.smithi100.stdout:8/789: creat d2/d7/d18/d3a/da4/f103 x:0 0 0 2024-04-30T23:16:02.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/730: mknod d7/df/d23/d2b/d42/d87/c10b 0 2024-04-30T23:16:02.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/731: dread - d7/d9/d86/dc7/fd5 zero size 2024-04-30T23:16:02.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/732: chown d7/df/d23/d4f/c72 1015 1 2024-04-30T23:16:02.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/791: rmdir d2/d14/d35/d40 39 2024-04-30T23:16:02.390 INFO:tasks.workunit.client.0.smithi100.stdout:5/878: mkdir d1/d12/d1a/df2/d11c 0 2024-04-30T23:16:02.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/712: symlink d4/d9/d93/lf7 0 2024-04-30T23:16:02.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/790: creat d2/d7/d18/f104 x:0 0 0 2024-04-30T23:16:02.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/791: fsync d2/d29/d9e/daf/fe8 0 2024-04-30T23:16:02.394 INFO:tasks.workunit.client.0.smithi100.stdout:6/733: link d7/df/f41 d7/d9/d8e/f10c 0 2024-04-30T23:16:02.395 INFO:tasks.workunit.client.0.smithi100.stdout:5/879: creat d1/d3e/d99/f11d x:0 0 0 2024-04-30T23:16:02.397 INFO:tasks.workunit.client.0.smithi100.stdout:8/792: creat d2/d29/d67/f105 x:0 0 0 2024-04-30T23:16:02.397 INFO:tasks.workunit.client.0.smithi100.stdout:8/793: readlink d2/d7/d18/d3a/da4/lbd 0 2024-04-30T23:16:02.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/734: symlink d7/df/d23/l10d 0 2024-04-30T23:16:02.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/794: creat d2/d69/f106 x:0 0 0 2024-04-30T23:16:02.406 INFO:tasks.workunit.client.0.smithi100.stdout:6/735: symlink d7/df/d23/d2b/l10e 0 2024-04-30T23:16:02.414 INFO:tasks.workunit.client.0.smithi100.stdout:8/795: unlink d2/d29/d71/d86/de2/ffc 0 2024-04-30T23:16:02.414 INFO:tasks.workunit.client.0.smithi100.stdout:6/736: creat d7/d9/d86/d1b/d3f/f10f x:0 0 0 2024-04-30T23:16:02.416 INFO:tasks.workunit.client.0.smithi100.stdout:8/796: rmdir d2/d89/d10/d17 39 2024-04-30T23:16:02.416 INFO:tasks.workunit.client.0.smithi100.stdout:8/797: write d2/d29/d9e/fc0 [692007,30290] 0 2024-04-30T23:16:02.419 INFO:tasks.workunit.client.0.smithi100.stdout:8/798: creat d2/d29/d8b/f107 x:0 0 0 2024-04-30T23:16:02.419 INFO:tasks.workunit.client.0.smithi100.stdout:8/799: truncate d2/d97/f9d 224903 0 2024-04-30T23:16:02.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/737: read d7/db/fd0 [20998,76167] 0 2024-04-30T23:16:02.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/800: symlink d2/d29/d71/l108 0 2024-04-30T23:16:02.421 INFO:tasks.workunit.client.0.smithi100.stdout:6/738: write d7/f89 [241684,44725] 0 2024-04-30T23:16:02.421 INFO:tasks.workunit.client.0.smithi100.stdout:1/661: dwrite d3/f9 [0,4194304] 0 2024-04-30T23:16:02.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/801: rmdir d2/d89/d10/d52 39 2024-04-30T23:16:02.423 INFO:tasks.workunit.client.0.smithi100.stdout:6/739: mknod d7/df/d23/d24/d2e/c110 0 2024-04-30T23:16:02.428 INFO:tasks.workunit.client.0.smithi100.stdout:6/740: link d7/db/d3b/l60 d7/d9/d86/dc7/l111 0 2024-04-30T23:16:02.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/802: mkdir d2/d7/d109 0 2024-04-30T23:16:02.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/803: write d2/d89/d10/d52/d9a/db9/fe7 [861227,71631] 0 2024-04-30T23:16:02.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/804: readlink d2/d89/d10/d17/l5f 0 2024-04-30T23:16:02.435 INFO:tasks.workunit.client.0.smithi100.stdout:3/880: dwrite d1/d38/df5/d15/d32/d6f/da2/f74 [4194304,4194304] 0 2024-04-30T23:16:02.435 INFO:tasks.workunit.client.0.smithi100.stdout:9/713: dwrite d4/d9/d10/db9/dc4/fc8 [0,4194304] 0 2024-04-30T23:16:02.436 INFO:tasks.workunit.client.0.smithi100.stdout:6/741: truncate d7/df/d23/d24/f5f 359549 0 2024-04-30T23:16:02.437 INFO:tasks.workunit.client.0.smithi100.stdout:0/792: dwrite d2/d50/f3c [4194304,4194304] 0 2024-04-30T23:16:02.438 INFO:tasks.workunit.client.0.smithi100.stdout:5/880: dwrite d1/d12/d27/fa8 [0,4194304] 0 2024-04-30T23:16:02.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/662: dwrite d3/d18/f90 [0,4194304] 0 2024-04-30T23:16:02.445 INFO:tasks.workunit.client.0.smithi100.stdout:0/793: mkdir d2/d50/d38/de6 0 2024-04-30T23:16:02.453 INFO:tasks.workunit.client.0.smithi100.stdout:5/881: truncate d1/d5f/f83 2572888 0 2024-04-30T23:16:02.453 INFO:tasks.workunit.client.0.smithi100.stdout:8/805: dwrite d2/d7/ff4 [0,4194304] 0 2024-04-30T23:16:02.457 INFO:tasks.workunit.client.0.smithi100.stdout:1/663: creat d3/fc3 x:0 0 0 2024-04-30T23:16:02.457 INFO:tasks.workunit.client.0.smithi100.stdout:7/957: sync 2024-04-30T23:16:02.457 INFO:tasks.workunit.client.0.smithi100.stdout:6/742: dwrite d7/df/d23/d24/d2e/d37/d85/fb3 [0,4194304] 0 2024-04-30T23:16:02.457 INFO:tasks.workunit.client.0.smithi100.stdout:6/743: fdatasync d7/df/f41 0 2024-04-30T23:16:02.458 INFO:tasks.workunit.client.0.smithi100.stdout:0/794: mkdir d2/d50/d38/d5d/de7 0 2024-04-30T23:16:02.460 INFO:tasks.workunit.client.0.smithi100.stdout:5/882: link d1/d37/ff9 d1/d12/d24/d34/f11e 0 2024-04-30T23:16:02.460 INFO:tasks.workunit.client.0.smithi100.stdout:5/883: readlink d1/l9 0 2024-04-30T23:16:02.463 INFO:tasks.workunit.client.0.smithi100.stdout:8/806: creat d2/d7/d109/f10a x:0 0 0 2024-04-30T23:16:02.463 INFO:tasks.workunit.client.0.smithi100.stdout:8/807: chown d2/d89/d10/d6e/fd6 5249748 1 2024-04-30T23:16:02.464 INFO:tasks.workunit.client.0.smithi100.stdout:1/664: mkdir d3/d16/d20/d24/d51/d80/dae/dc4 0 2024-04-30T23:16:02.465 INFO:tasks.workunit.client.0.smithi100.stdout:7/958: symlink d0/df/d4f/d93/db1/ded/l13c 0 2024-04-30T23:16:02.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/959: write d0/df/d4f/d53/da9/faa [900511,94685] 0 2024-04-30T23:16:02.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/960: write d0/df/d4f/d53/f5a [1037072,5706] 0 2024-04-30T23:16:02.468 INFO:tasks.workunit.client.0.smithi100.stdout:6/744: truncate d7/d9/f12 32125 0 2024-04-30T23:16:02.468 INFO:tasks.workunit.client.0.smithi100.stdout:6/745: readlink d7/df/d23/d2b/d42/d84/le6 0 2024-04-30T23:16:02.468 INFO:tasks.workunit.client.0.smithi100.stdout:4/926: sync 2024-04-30T23:16:02.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/795: mkdir d2/d50/d38/d5d/de8 0 2024-04-30T23:16:02.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/796: readlink d2/d14/d35/d57/lb9 0 2024-04-30T23:16:02.471 INFO:tasks.workunit.client.0.smithi100.stdout:5/884: link d1/d12/d1a/d76/d77/d8c/f9c d1/d19/f11f 0 2024-04-30T23:16:02.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/665: mknod d3/d18/d60/d87/cc5 0 2024-04-30T23:16:02.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/666: chown d3/f4 396098 1 2024-04-30T23:16:02.475 INFO:tasks.workunit.client.0.smithi100.stdout:6/746: creat d7/df/d23/d24/d2e/d37/d85/db4/dc6/f112 x:0 0 0 2024-04-30T23:16:02.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/747: readlink d7/d9/d86/d1b/l7e 0 2024-04-30T23:16:02.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/748: write d7/d9/d86/d1b/d5a/fb1 [3087749,127067] 0 2024-04-30T23:16:02.477 INFO:tasks.workunit.client.0.smithi100.stdout:4/927: rmdir d19/d1a/d6d/d4e/d6e/dcb/d104 0 2024-04-30T23:16:02.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/885: mkdir d1/d12/d27/d120 0 2024-04-30T23:16:02.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/886: stat d1/d2c/d60/d66/d71/db6 0 2024-04-30T23:16:02.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/808: mknod d2/d7/c10b 0 2024-04-30T23:16:02.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/809: write d2/d7/d18/d3a/da4/f103 [639111,22239] 0 2024-04-30T23:16:02.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/667: symlink d3/d16/d20/d24/d51/d80/lc6 0 2024-04-30T23:16:02.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/668: truncate d3/d16/d20/d24/d69/d63/da9/fc0 90654 0 2024-04-30T23:16:02.483 INFO:tasks.workunit.client.0.smithi100.stdout:4/928: link d19/d1a/d21/d4a/d53/d5e/fe7 d19/d1a/d6d/d64/d78/d8c/f126 0 2024-04-30T23:16:02.484 INFO:tasks.workunit.client.0.smithi100.stdout:7/961: dwrite d0/d1b/d2e/f63 [0,4194304] 0 2024-04-30T23:16:02.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/810: dread d2/d89/d10/d17/d8f/fb7 [0,4194304] 0 2024-04-30T23:16:02.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/797: creat d2/d4c/d68/dd1/fe9 x:0 0 0 2024-04-30T23:16:02.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/798: readlink d2/d14/d35/d57/d62/d75/l7d 0 2024-04-30T23:16:02.487 INFO:tasks.workunit.client.0.smithi100.stdout:5/887: symlink d1/d2c/d60/d66/d71/db6/dd4/d85/d110/l121 0 2024-04-30T23:16:02.491 INFO:tasks.workunit.client.0.smithi100.stdout:7/962: mkdir d0/d1b/d60/dbe/d106/d13d 0 2024-04-30T23:16:02.492 INFO:tasks.workunit.client.0.smithi100.stdout:7/963: truncate d0/d1d/d5e/d6a/d4b/d79/dd0/f137 72930 0 2024-04-30T23:16:02.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/929: dread f12 [4194304,4194304] 0 2024-04-30T23:16:02.493 INFO:tasks.workunit.client.0.smithi100.stdout:8/811: mknod d2/d29/d71/d86/c10c 0 2024-04-30T23:16:02.494 INFO:tasks.workunit.client.0.smithi100.stdout:0/799: rmdir d2/d50/d30/dd4 39 2024-04-30T23:16:02.498 INFO:tasks.workunit.client.0.smithi100.stdout:5/888: creat d1/d12/d24/de8/f122 x:0 0 0 2024-04-30T23:16:02.500 INFO:tasks.workunit.client.0.smithi100.stdout:7/964: mknod d0/df/d4f/d53/d139/c13e 0 2024-04-30T23:16:02.501 INFO:tasks.workunit.client.0.smithi100.stdout:8/812: creat d2/d89/d10/d52/d9a/f10d x:0 0 0 2024-04-30T23:16:02.502 INFO:tasks.workunit.client.0.smithi100.stdout:8/813: fdatasync d2/d89/d10/d17/d8f/fac 0 2024-04-30T23:16:02.502 INFO:tasks.workunit.client.0.smithi100.stdout:8/814: dread - d2/d89/d10/d52/fe5 zero size 2024-04-30T23:16:02.502 INFO:tasks.workunit.client.0.smithi100.stdout:6/749: dwrite d7/df/f3c [0,4194304] 0 2024-04-30T23:16:02.502 INFO:tasks.workunit.client.0.smithi100.stdout:6/750: truncate d7/d9/d8e/fcb 352795 0 2024-04-30T23:16:02.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/800: mknod d2/d50/d38/d5d/de8/cea 0 2024-04-30T23:16:02.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/889: creat d1/d12/d1a/d76/d77/f123 x:0 0 0 2024-04-30T23:16:02.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/669: dwrite d3/d16/d20/d24/faf [0,4194304] 0 2024-04-30T23:16:02.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/670: chown d3/d16/d20/d24/d51 4871777 1 2024-04-30T23:16:02.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/965: rmdir d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/df8 39 2024-04-30T23:16:02.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/966: chown d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db5/ffb 551 1 2024-04-30T23:16:02.514 INFO:tasks.workunit.client.0.smithi100.stdout:8/815: getdents d2/d89/d10 0 2024-04-30T23:16:02.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/751: truncate d7/d9/d86/d62/fb5 3359064 0 2024-04-30T23:16:02.514 INFO:tasks.workunit.client.0.smithi100.stdout:8/816: write d2/d89/d10/d17/d8f/fb1 [2658914,47509] 0 2024-04-30T23:16:02.514 INFO:tasks.workunit.client.0.smithi100.stdout:5/890: symlink d1/d2c/d60/d66/d75/l124 0 2024-04-30T23:16:02.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/752: dread - d7/d9/d86/d1b/d5a/de2/d98/fa2 zero size 2024-04-30T23:16:02.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/930: dread d19/d1a/d29/d103/f56 [0,4194304] 0 2024-04-30T23:16:02.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/931: chown d19/d1a/d21/d4a/d53/f70 6235 1 2024-04-30T23:16:02.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/932: write d19/d1a/d6d/d4e/d6e/f80 [530393,54426] 0 2024-04-30T23:16:02.517 INFO:tasks.workunit.client.0.smithi100.stdout:8/817: creat d2/d7/dfe/f10e x:0 0 0 2024-04-30T23:16:02.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/891: symlink d1/d12/d74/l125 0 2024-04-30T23:16:02.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/892: fsync d1/d12/ff0 0 2024-04-30T23:16:02.520 INFO:tasks.workunit.client.0.smithi100.stdout:6/753: link d7/df/d23/d24/d2e/d37/fdc d7/d9/d86/d3e/d6b/d75/f113 0 2024-04-30T23:16:02.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/933: unlink d19/d1a/d21/d3c/lda 0 2024-04-30T23:16:02.525 INFO:tasks.workunit.client.0.smithi100.stdout:1/671: dwrite d3/d16/d20/d24/d51/d80/fba [0,4194304] 0 2024-04-30T23:16:02.525 INFO:tasks.workunit.client.0.smithi100.stdout:8/818: mkdir d2/d29/d9e/d10f 0 2024-04-30T23:16:02.526 INFO:tasks.workunit.client.0.smithi100.stdout:5/893: mkdir d1/d5f/d126 0 2024-04-30T23:16:02.527 INFO:tasks.workunit.client.0.smithi100.stdout:6/754: link d7/df/d23/d2b/d42/d84/le6 d7/df/d23/d4f/df4/l114 0 2024-04-30T23:16:02.529 INFO:tasks.workunit.client.0.smithi100.stdout:4/934: unlink d19/d1a/d6d/c89 0 2024-04-30T23:16:02.529 INFO:tasks.workunit.client.0.smithi100.stdout:4/935: chown d19/d1a/d6d/d4e/ffe 0 1 2024-04-30T23:16:02.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/672: mknod d3/d16/d20/d24/cc7 0 2024-04-30T23:16:02.531 INFO:tasks.workunit.client.0.smithi100.stdout:7/967: dwrite d0/d1d/f6e [0,4194304] 0 2024-04-30T23:16:02.531 INFO:tasks.workunit.client.0.smithi100.stdout:8/819: rmdir d2/d29/d67/d73 39 2024-04-30T23:16:02.533 INFO:tasks.workunit.client.0.smithi100.stdout:5/894: creat d1/d12/d1a/d76/d8e/f127 x:0 0 0 2024-04-30T23:16:02.533 INFO:tasks.workunit.client.0.smithi100.stdout:5/895: truncate d1/d12/d1a/d76/d77/f123 860678 0 2024-04-30T23:16:02.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/755: symlink d7/df/d23/d24/d2e/d37/l115 0 2024-04-30T23:16:02.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/936: rmdir d19/d1a/d6d/d64/d78/d8c 39 2024-04-30T23:16:02.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/673: mkdir d3/db/d4b/dc8 0 2024-04-30T23:16:02.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/968: truncate d0/df/f22 2113434 0 2024-04-30T23:16:02.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/969: readlink d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/lb7 0 2024-04-30T23:16:02.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/820: mknod d2/d89/c110 0 2024-04-30T23:16:02.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/821: truncate d2/d89/f49 809154 0 2024-04-30T23:16:02.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/822: read - d2/d89/d10/d52/d9a/fd8 zero size 2024-04-30T23:16:02.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/823: fsync d2/d29/f30 0 2024-04-30T23:16:02.543 INFO:tasks.workunit.client.0.smithi100.stdout:5/896: mknod d1/d3e/daa/c128 0 2024-04-30T23:16:02.545 INFO:tasks.workunit.client.0.smithi100.stdout:6/756: creat d7/d11/f116 x:0 0 0 2024-04-30T23:16:02.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/937: creat d19/d1a/d21/d4a/f127 x:0 0 0 2024-04-30T23:16:02.548 INFO:tasks.workunit.client.0.smithi100.stdout:8/824: rmdir d2/d29/d71/d86/de2 39 2024-04-30T23:16:02.548 INFO:tasks.workunit.client.0.smithi100.stdout:8/825: chown d2/d89/d10/d17/f4f 1531646575 1 2024-04-30T23:16:02.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/897: rmdir d1/d19/d78 39 2024-04-30T23:16:02.551 INFO:tasks.workunit.client.0.smithi100.stdout:1/674: write d3/d16/d20/d24/d69/d63/f6c [3039197,60117] 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/898: dread d1/d12/d27/f42 [0,4194304] 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:4/938: symlink d19/d1a/d6d/d64/d78/d8c/df0/l128 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/757: creat d7/d9/d86/d3e/d6b/dc2/f117 x:0 0 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/970: mkdir d0/d1b/d60/d48/d13f 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/899: readlink d1/d2c/d60/d66/d75/l124 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/900: stat d1 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/901: fsync d1/d37/ff9 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/758: truncate d7/df/d23/d2b/d42/fed 930136 0 2024-04-30T23:16:02.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/759: chown d7/df/l10a 2491248 1 2024-04-30T23:16:02.562 INFO:tasks.workunit.client.0.smithi100.stdout:8/826: mkdir d2/d69/d111 0 2024-04-30T23:16:02.562 INFO:tasks.workunit.client.0.smithi100.stdout:4/939: link d19/d1a/d95/l98 d19/d1a/d29/d103/d40/da2/d10d/l129 0 2024-04-30T23:16:02.563 INFO:tasks.workunit.client.0.smithi100.stdout:7/971: symlink d0/df/d4f/d93/db1/ded/l140 0 2024-04-30T23:16:02.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/902: mkdir d1/d12/d1a/d76/d77/d8c/d129 0 2024-04-30T23:16:02.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/903: readlink d1/d12/d1a/d76/d77/d8c/ld6 0 2024-04-30T23:16:02.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/940: creat d19/d1a/d45/f12a x:0 0 0 2024-04-30T23:16:02.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/941: creat d19/d1a/d6d/d64/d78/f12b x:0 0 0 2024-04-30T23:16:02.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/675: dwrite d3/d18/d60/d87/f93 [0,4194304] 0 2024-04-30T23:16:02.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/676: dread - d3/fa0 zero size 2024-04-30T23:16:02.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/677: chown d3/db/f39 542 1 2024-04-30T23:16:02.573 INFO:tasks.workunit.client.0.smithi100.stdout:8/827: dread d2/d7/d18/f54 [0,4194304] 0 2024-04-30T23:16:02.576 INFO:tasks.workunit.client.0.smithi100.stdout:1/678: mkdir d3/d16/d20/d24/dc9 0 2024-04-30T23:16:02.577 INFO:tasks.workunit.client.0.smithi100.stdout:8/828: creat d2/d29/d67/dea/f112 x:0 0 0 2024-04-30T23:16:02.577 INFO:tasks.workunit.client.0.smithi100.stdout:1/679: mkdir d3/d16/d20/d24/dca 0 2024-04-30T23:16:02.578 INFO:tasks.workunit.client.0.smithi100.stdout:1/680: chown d3/c7 137900126 1 2024-04-30T23:16:02.579 INFO:tasks.workunit.client.0.smithi100.stdout:6/760: write d7/df/f3c [3976434,124498] 0 2024-04-30T23:16:02.582 INFO:tasks.workunit.client.0.smithi100.stdout:3/881: sync 2024-04-30T23:16:02.582 INFO:tasks.workunit.client.0.smithi100.stdout:8/829: link d2/d29/d71/d86/lb3 d2/d89/d72/l113 0 2024-04-30T23:16:02.582 INFO:tasks.workunit.client.0.smithi100.stdout:8/830: fdatasync d2/d89/d10/d52/f65 0 2024-04-30T23:16:02.582 INFO:tasks.workunit.client.0.smithi100.stdout:1/681: chown d3/db/f40 205 1 2024-04-30T23:16:02.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/831: fdatasync d2/d89/d10/d17/f4c 0 2024-04-30T23:16:02.583 INFO:tasks.workunit.client.0.smithi100.stdout:6/761: link d7/d9/d86/db0/l101 d7/df/d23/d4f/df4/l118 0 2024-04-30T23:16:02.585 INFO:tasks.workunit.client.0.smithi100.stdout:8/832: rename d2/d69/fdd to d2/d29/d8b/d8e/f114 0 2024-04-30T23:16:02.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/762: getdents d7/d9/d86/d1b 0 2024-04-30T23:16:02.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/763: write d7/df/d23/d2b/d42/d87/f8b [622634,76465] 0 2024-04-30T23:16:02.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/764: dread - d7/d9/ff5 zero size 2024-04-30T23:16:02.589 INFO:tasks.workunit.client.0.smithi100.stdout:8/833: rename d2/d7/f6a to d2/d29/d71/ddb/f115 0 2024-04-30T23:16:02.589 INFO:tasks.workunit.client.0.smithi100.stdout:7/972: dwrite d0/d1b/d60/d48/d116/d91/f10e [0,4194304] 0 2024-04-30T23:16:02.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/904: dwrite d1/d12/d24/d34/f11e [0,4194304] 0 2024-04-30T23:16:02.598 INFO:tasks.workunit.client.0.smithi100.stdout:1/682: dread d3/d16/d20/f45 [0,4194304] 0 2024-04-30T23:16:02.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/905: link d1/d2c/d60/d66/d71/db6/dd4/d85/le6 d1/d12/d1a/d76/da9/l12a 0 2024-04-30T23:16:02.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/906: chown d1/d12/f31 0 1 2024-04-30T23:16:02.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/907: chown d1/d5f 924915 1 2024-04-30T23:16:02.604 INFO:tasks.workunit.client.0.smithi100.stdout:8/834: symlink d2/d7/d18/l116 0 2024-04-30T23:16:02.613 INFO:tasks.workunit.client.0.smithi100.stdout:3/882: dwrite d1/d38/df5/d15/d2c/fdb [0,4194304] 0 2024-04-30T23:16:02.613 INFO:tasks.workunit.client.0.smithi100.stdout:3/883: readlink d1/d38/df5/d2b/l46 0 2024-04-30T23:16:02.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/942: dwrite d19/d1a/d6d/d4e/d6e/f80 [0,4194304] 0 2024-04-30T23:16:02.618 INFO:tasks.workunit.client.0.smithi100.stdout:6/765: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:16:02.619 INFO:tasks.workunit.client.0.smithi100.stdout:3/884: mkdir d1/d38/df5/d15/d32/d71/df0/d118 0 2024-04-30T23:16:02.622 INFO:tasks.workunit.client.0.smithi100.stdout:6/766: symlink d7/df/d23/d2b/d42/d84/l119 0 2024-04-30T23:16:02.622 INFO:tasks.workunit.client.0.smithi100.stdout:6/767: write d7/df/d23/d24/d2e/d37/f9b [677543,95503] 0 2024-04-30T23:16:02.624 INFO:tasks.workunit.client.0.smithi100.stdout:6/768: creat d7/d9/d86/d3e/d6b/d75/f11a x:0 0 0 2024-04-30T23:16:02.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/769: mknod d7/df/d23/d24/d2e/d37/d85/c11b 0 2024-04-30T23:16:02.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/770: symlink d7/db/dd1/df8/l11c 0 2024-04-30T23:16:02.630 INFO:tasks.workunit.client.0.smithi100.stdout:6/771: mknod d7/d9/d86/d3e/d6b/c11d 0 2024-04-30T23:16:02.631 INFO:tasks.workunit.client.0.smithi100.stdout:6/772: mknod d7/df/d23/d24/d2e/d37/d85/db4/dc6/dd8/c11e 0 2024-04-30T23:16:02.633 INFO:tasks.workunit.client.0.smithi100.stdout:8/835: dread d2/d29/f2b [0,4194304] 0 2024-04-30T23:16:02.633 INFO:tasks.workunit.client.0.smithi100.stdout:8/836: fsync d2/d89/d7f/fe3 0 2024-04-30T23:16:02.633 INFO:tasks.workunit.client.0.smithi100.stdout:8/837: truncate d2/d29/d71/fcf 702660 0 2024-04-30T23:16:02.634 INFO:tasks.workunit.client.0.smithi100.stdout:1/683: dwrite d3/f9 [0,4194304] 0 2024-04-30T23:16:02.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/973: dwrite d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dad/db4/f133 [0,4194304] 0 2024-04-30T23:16:02.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/974: chown d0/d1b/d60/fdd 120 1 2024-04-30T23:16:02.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/684: mkdir d3/dbb/dcb 0 2024-04-30T23:16:02.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/943: dread d19/d1a/d21/f83 [0,4194304] 0 2024-04-30T23:16:02.645 INFO:tasks.workunit.client.0.smithi100.stdout:1/685: rename d3/d18/f90 to d3/d16/d20/d24/d51/d59/fcc 0 2024-04-30T23:16:02.645 INFO:tasks.workunit.client.0.smithi100.stdout:7/975: dread d0/d1d/d5e/d6a/d4b/dcb/fe8 [0,4194304] 0 2024-04-30T23:16:02.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/944: creat d19/d1a/d29/d103/f12c x:0 0 0 2024-04-30T23:16:02.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/945: stat d19/d33/d7d/fb3 0 2024-04-30T23:16:02.647 INFO:tasks.workunit.client.0.smithi100.stdout:4/946: write d19/d1a/d29/fe0 [1669697,15207] 0 2024-04-30T23:16:02.647 INFO:tasks.workunit.client.0.smithi100.stdout:8/838: write d2/d29/f7e [2015995,7766] 0 2024-04-30T23:16:02.647 INFO:tasks.workunit.client.0.smithi100.stdout:8/839: truncate d2/d89/f40 1059188 0 2024-04-30T23:16:02.648 INFO:tasks.workunit.client.0.smithi100.stdout:1/686: link d3/d16/d20/f45 d3/d16/d20/d24/d51/fcd 0 2024-04-30T23:16:02.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/885: dwrite d1/d38/df5/d15/d32/d71/da9/fd2 [0,4194304] 0 2024-04-30T23:16:02.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/947: getdents d19/d1a/d29/dae 0 2024-04-30T23:16:02.657 INFO:tasks.workunit.client.0.smithi100.stdout:1/687: unlink d3/d16/d20/c5a 0 2024-04-30T23:16:02.657 INFO:tasks.workunit.client.0.smithi100.stdout:4/948: mkdir d19/d1a/d21/d4a/d12d 0 2024-04-30T23:16:02.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/714: sync 2024-04-30T23:16:02.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/715: fdatasync d4/f9d 0 2024-04-30T23:16:02.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/688: mknod d3/dbb/dcb/cce 0 2024-04-30T23:16:02.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/716: mknod d4/d9/d6f/ddb/cf8 0 2024-04-30T23:16:02.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/717: readlink d4/d7/d8/d19/l5a 0 2024-04-30T23:16:02.668 INFO:tasks.workunit.client.0.smithi100.stdout:9/718: write d4/d7/d8/f4d [1491876,101458] 0 2024-04-30T23:16:02.671 INFO:tasks.workunit.client.0.smithi100.stdout:9/719: truncate d4/fd 1942571 0 2024-04-30T23:16:02.672 INFO:tasks.workunit.client.0.smithi100.stdout:9/720: readlink d4/d7/d8/d37/d58/lea 0 2024-04-30T23:16:02.674 INFO:tasks.workunit.client.0.smithi100.stdout:1/689: write d3/d16/d20/d24/f5c [2343396,69795] 0 2024-04-30T23:16:02.676 INFO:tasks.workunit.client.0.smithi100.stdout:1/690: rmdir d3 39 2024-04-30T23:16:02.685 INFO:tasks.workunit.client.0.smithi100.stdout:8/840: dwrite d2/d7/d18/d3a/f84 [0,4194304] 0 2024-04-30T23:16:02.688 INFO:tasks.workunit.client.0.smithi100.stdout:3/886: dwrite d1/d38/df5/d2b/d57/daf/fcc [0,4194304] 0 2024-04-30T23:16:02.689 INFO:tasks.workunit.client.0.smithi100.stdout:4/949: dwrite d19/d33/d7d/fb3 [4194304,4194304] 0 2024-04-30T23:16:02.689 INFO:tasks.workunit.client.0.smithi100.stdout:8/841: unlink d2/d29/d67/c7a 0 2024-04-30T23:16:02.690 INFO:tasks.workunit.client.0.smithi100.stdout:8/842: chown d2/d89/d10/d52/f65 106931 1 2024-04-30T23:16:02.693 INFO:tasks.workunit.client.0.smithi100.stdout:3/887: symlink d1/d38/df5/l119 0 2024-04-30T23:16:02.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/721: dread d4/d9/d51/d89/dbb/fd4 [0,4194304] 0 2024-04-30T23:16:02.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/722: dread - d4/d7/dab/fe5 zero size 2024-04-30T23:16:02.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/723: readlink d4/d9/d6f/l83 0 2024-04-30T23:16:02.696 INFO:tasks.workunit.client.0.smithi100.stdout:4/950: rename d19/f6f to d19/d1a/d21/d4a/d53/deb/f12e 0 2024-04-30T23:16:02.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/843: mknod d2/d89/d10/d17/c117 0 2024-04-30T23:16:02.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/844: chown d2/d89/d10/d52/lb6 176571794 1 2024-04-30T23:16:02.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/951: rename d19/d33/f86 to d19/d1a/d29/dae/f12f 0 2024-04-30T23:16:02.701 INFO:tasks.workunit.client.0.smithi100.stdout:8/845: link d2/d7/c8a d2/d97/c118 0 2024-04-30T23:16:02.702 INFO:tasks.workunit.client.0.smithi100.stdout:9/724: mkdir d4/d7/d8/d37/df9 0 2024-04-30T23:16:02.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/725: creat d4/d9/d51/ffa x:0 0 0 2024-04-30T23:16:02.705 INFO:tasks.workunit.client.0.smithi100.stdout:8/846: fdatasync d2/f1d 0 2024-04-30T23:16:02.705 INFO:tasks.workunit.client.0.smithi100.stdout:1/691: dwrite d3/d16/f36 [4194304,4194304] 0 2024-04-30T23:16:02.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/726: creat d4/d7/d60/d69/ffb x:0 0 0 2024-04-30T23:16:02.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/727: chown d4/d7/d8/d37/f6c 24766 1 2024-04-30T23:16:02.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/888: write d1/d38/df5/d21/f48 [2188015,23146] 0 2024-04-30T23:16:02.713 INFO:tasks.workunit.client.0.smithi100.stdout:8/847: mkdir d2/d89/d10/d6e/dad/d119 0 2024-04-30T23:16:02.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/692: rename d3/d16/d20/d24/dc9 to d3/d16/d20/d24/d69/d63/dcf 0 2024-04-30T23:16:02.720 INFO:tasks.workunit.client.0.smithi100.stdout:8/848: mknod d2/d69/c11a 0 2024-04-30T23:16:02.720 INFO:tasks.workunit.client.0.smithi100.stdout:8/849: stat d2/d89/d10/d17/d8f/df8 0 2024-04-30T23:16:02.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/693: symlink d3/d16/d20/d24/d69/d5e/d7a/ld0 0 2024-04-30T23:16:02.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/694: read d3/d16/d20/d24/d69/d63/da9/fc0 [71087,48165] 0 2024-04-30T23:16:02.730 INFO:tasks.workunit.client.0.smithi100.stdout:0/801: sync 2024-04-30T23:16:02.731 INFO:tasks.workunit.client.0.smithi100.stdout:3/889: dwrite d1/d38/df5/d15/fbb [0,4194304] 0 2024-04-30T23:16:02.732 INFO:tasks.workunit.client.0.smithi100.stdout:3/890: fsync d1/d38/df5/d15/d27/fc2 0 2024-04-30T23:16:02.732 INFO:tasks.workunit.client.0.smithi100.stdout:4/952: dwrite d19/d1a/d29/fe0 [0,4194304] 0 2024-04-30T23:16:02.733 INFO:tasks.workunit.client.0.smithi100.stdout:0/802: mkdir d2/d4c/deb 0 2024-04-30T23:16:02.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/850: dread d2/d7/d18/d3a/da4/f103 [0,4194304] 0 2024-04-30T23:16:02.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/851: write d2/d7/d18/f104 [355007,31225] 0 2024-04-30T23:16:02.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/852: fsync d2/d29/f30 0 2024-04-30T23:16:02.736 INFO:tasks.workunit.client.0.smithi100.stdout:4/953: unlink d19/d1a/l6c 0 2024-04-30T23:16:02.737 INFO:tasks.workunit.client.0.smithi100.stdout:0/803: unlink d2/f5 0 2024-04-30T23:16:02.737 INFO:tasks.workunit.client.0.smithi100.stdout:0/804: write d2/d5a/fe3 [1189,36961] 0 2024-04-30T23:16:02.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/853: creat d2/d89/d10/d17/d8f/df8/f11b x:0 0 0 2024-04-30T23:16:02.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/854: dread - d2/d29/d8b/d8e/ff2 zero size 2024-04-30T23:16:02.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/728: dwrite d4/d9/d10/db9/dc4/fdf [0,4194304] 0 2024-04-30T23:16:02.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/729: read d4/fb0 [431702,7402] 0 2024-04-30T23:16:02.742 INFO:tasks.workunit.client.0.smithi100.stdout:4/954: rename d19/d1a/d6d/d4e/d6e/dcb/le5 to d19/l130 0 2024-04-30T23:16:02.744 INFO:tasks.workunit.client.0.smithi100.stdout:0/805: truncate d2/f1e 1703637 0 2024-04-30T23:16:02.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/855: mknod d2/d29/d71/c11c 0 2024-04-30T23:16:02.749 INFO:tasks.workunit.client.0.smithi100.stdout:4/955: mkdir d19/d1a/d6d/d64/d78/d10c/d131 0 2024-04-30T23:16:02.750 INFO:tasks.workunit.client.0.smithi100.stdout:0/806: mkdir d2/d50/d30/d32/dec 0 2024-04-30T23:16:02.751 INFO:tasks.workunit.client.0.smithi100.stdout:8/856: getdents d2/d29/d8b 0 2024-04-30T23:16:02.752 INFO:tasks.workunit.client.0.smithi100.stdout:1/695: dwrite d3/d18/f68 [0,4194304] 0 2024-04-30T23:16:02.756 INFO:tasks.workunit.client.0.smithi100.stdout:3/891: dwrite d1/d38/df5/d2f/dc8/fe7 [0,4194304] 0 2024-04-30T23:16:02.760 INFO:tasks.workunit.client.0.smithi100.stdout:8/857: creat d2/d89/d10/d6e/da0/f11d x:0 0 0 2024-04-30T23:16:02.764 INFO:tasks.workunit.client.0.smithi100.stdout:8/858: dread d2/d29/f58 [0,4194304] 0 2024-04-30T23:16:02.766 INFO:tasks.workunit.client.0.smithi100.stdout:9/730: dwrite d4/d9/d10/f7e [0,4194304] 0 2024-04-30T23:16:02.768 INFO:tasks.workunit.client.0.smithi100.stdout:8/859: symlink d2/d7/l11e 0 2024-04-30T23:16:02.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/807: dread d2/f65 [0,4194304] 0 2024-04-30T23:16:02.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/808: chown d2/f2e 2694 1 2024-04-30T23:16:02.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/809: chown d2/d50/d38/d5d/dae 1 1 2024-04-30T23:16:02.769 INFO:tasks.workunit.client.0.smithi100.stdout:9/731: creat d4/d7/d60/d69/ffc x:0 0 0 2024-04-30T23:16:02.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/860: creat d2/d29/d67/f11f x:0 0 0 2024-04-30T23:16:02.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/810: rename d2/d14/d35/l48 to d2/d14/d35/d57/led 0 2024-04-30T23:16:02.774 INFO:tasks.workunit.client.0.smithi100.stdout:4/956: dwrite d19/d1a/d6d/d64/d78/d10c/f114 [0,4194304] 0 2024-04-30T23:16:02.774 INFO:tasks.workunit.client.0.smithi100.stdout:4/957: fdatasync d19/d1a/d21/fc2 0 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/811: creat d2/d50/d38/d5d/dc6/dd2/fee x:0 0 0 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/812: getdents d2/d14/d35/d40/dbe 0 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/813: fsync d2/d14/d35/d57/d62/fc2 0 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/814: chown d2/d50/d38/d6c/fcb 528737 1 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/815: chown d2/d14/d35/d57/d62/d75/fc8 10428852 1 2024-04-30T23:16:02.776 INFO:tasks.workunit.client.0.smithi100.stdout:8/861: dread d2/d89/d10/d17/f8c [0,4194304] 0 2024-04-30T23:16:02.781 INFO:tasks.workunit.client.0.smithi100.stdout:4/958: mkdir d19/d1a/d6d/d64/dc8/d132 0 2024-04-30T23:16:02.781 INFO:tasks.workunit.client.0.smithi100.stdout:4/959: readlink d19/d1a/d29/dae/l121 0 2024-04-30T23:16:02.781 INFO:tasks.workunit.client.0.smithi100.stdout:0/816: getdents d2/d14/d18 0 2024-04-30T23:16:02.785 INFO:tasks.workunit.client.0.smithi100.stdout:9/732: dread d4/d9/d10/f7e [0,4194304] 0 2024-04-30T23:16:02.787 INFO:tasks.workunit.client.0.smithi100.stdout:0/817: dread d2/f1e [0,4194304] 0 2024-04-30T23:16:02.792 INFO:tasks.workunit.client.0.smithi100.stdout:0/818: creat d2/d5a/fef x:0 0 0 2024-04-30T23:16:02.793 INFO:tasks.workunit.client.0.smithi100.stdout:0/819: truncate d2/d14/d35/d40/f9b 985252 0 2024-04-30T23:16:02.796 INFO:tasks.workunit.client.0.smithi100.stdout:0/820: link d2/d14/l15 d2/d14/d35/d57/d62/lf0 0 2024-04-30T23:16:02.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/821: symlink d2/lf1 0 2024-04-30T23:16:02.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/862: dwrite d2/d29/d67/d73/f7b [0,4194304] 0 2024-04-30T23:16:02.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/863: truncate d2/d89/d72/f9b 4617924 0 2024-04-30T23:16:02.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/864: fsync d2/d69/f106 0 2024-04-30T23:16:02.800 INFO:tasks.workunit.client.0.smithi100.stdout:8/865: write d2/d89/d10/d17/f4c [85671,50474] 0 2024-04-30T23:16:02.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/866: creat d2/d89/d7f/f120 x:0 0 0 2024-04-30T23:16:02.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/867: unlink d2/d29/d71/cc2 0 2024-04-30T23:16:02.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/868: write d2/d29/f58 [687336,113427] 0 2024-04-30T23:16:02.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/869: stat d2/d89/d72/ddc/cf3 0 2024-04-30T23:16:02.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/870: chown d2/d29/d71/d86/de2/lef 923102822 1 2024-04-30T23:16:02.805 INFO:tasks.workunit.client.0.smithi100.stdout:8/871: creat d2/d89/d10/d52/f121 x:0 0 0 2024-04-30T23:16:02.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/872: rename d2/d7/l6d to d2/d69/l122 0 2024-04-30T23:16:02.808 INFO:tasks.workunit.client.0.smithi100.stdout:8/873: mkdir d2/d89/d10/d17/d8f/df8/d123 0 2024-04-30T23:16:02.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/822: dread d2/d50/f71 [0,4194304] 0 2024-04-30T23:16:02.810 INFO:tasks.workunit.client.0.smithi100.stdout:9/733: dwrite d4/d7/d8/d37/d58/fe6 [0,4194304] 0 2024-04-30T23:16:02.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/823: truncate d2/d14/d18/f29 1790881 0 2024-04-30T23:16:02.812 INFO:tasks.workunit.client.0.smithi100.stdout:9/734: mkdir d4/d7/d8/d37/d58/dd0/dfd 0 2024-04-30T23:16:02.812 INFO:tasks.workunit.client.0.smithi100.stdout:9/735: chown d4/d9/d10/db9/dc4 35167337 1 2024-04-30T23:16:02.812 INFO:tasks.workunit.client.0.smithi100.stdout:9/736: write d4/d9/d51/d89/dbb/fc1 [5071414,5170] 0 2024-04-30T23:16:02.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/824: creat d2/d50/d38/d5d/dc6/ff2 x:0 0 0 2024-04-30T23:16:02.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/825: write d2/d50/d30/f6f [1706456,56602] 0 2024-04-30T23:16:02.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/826: fsync d2/d14/d35/d40/f9b 0 2024-04-30T23:16:02.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/737: rename d4/d7/d8/d37/d58/d8a to d4/d9/d51/dfe 0 2024-04-30T23:16:02.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/738: stat d4/d9/d10/d7f/f95 0 2024-04-30T23:16:02.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/739: truncate d4/d7/d8/d37/f85 110547 0 2024-04-30T23:16:02.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/827: mknod d2/d14/d35/cf3 0 2024-04-30T23:16:02.827 INFO:tasks.workunit.client.0.smithi100.stdout:9/740: dread d4/d7/d8/d37/d3d/f40 [4194304,4194304] 0 2024-04-30T23:16:02.828 INFO:tasks.workunit.client.0.smithi100.stdout:0/828: dread d2/d14/d35/f39 [4194304,4194304] 0 2024-04-30T23:16:02.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/874: dwrite d2/d7/ffa [0,4194304] 0 2024-04-30T23:16:02.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/829: rename d2/d50/d38/d6c/fcb to d2/d4c/deb/ff4 0 2024-04-30T23:16:02.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/830: fsync d2/fc 0 2024-04-30T23:16:02.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/831: dread - d2/d50/d38/d5d/dc4/fe5 zero size 2024-04-30T23:16:02.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/832: symlink d2/d50/d38/d5d/lf5 0 2024-04-30T23:16:02.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/833: write d2/dba/fcd [4792648,68526] 0 2024-04-30T23:16:02.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/834: write d2/d50/d38/d5d/dc4/fe5 [109343,4262] 0 2024-04-30T23:16:02.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/835: mkdir d2/d50/d30/dc7/df6 0 2024-04-30T23:16:02.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/836: dread - d2/d50/d38/d6c/fb6 zero size 2024-04-30T23:16:02.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/837: readlink d2/d14/d35/d57/d62/laa 0 2024-04-30T23:16:02.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/838: chown d2/d50/d38/d5d/lf5 2 1 2024-04-30T23:16:02.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/839: truncate d2/d14/d35/d57/f60 2274277 0 2024-04-30T23:16:02.841 INFO:tasks.workunit.client.0.smithi100.stdout:5/908: sync 2024-04-30T23:16:02.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/875: dread d2/d29/d67/d73/f7b [0,4194304] 0 2024-04-30T23:16:02.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/876: chown d2/d89/d10/ccb 191410 1 2024-04-30T23:16:02.848 INFO:tasks.workunit.client.0.smithi100.stdout:8/877: mkdir d2/d29/d67/d73/d124 0 2024-04-30T23:16:02.856 INFO:tasks.workunit.client.0.smithi100.stdout:9/741: dwrite f2 [0,4194304] 0 2024-04-30T23:16:02.866 INFO:tasks.workunit.client.0.smithi100.stdout:5/909: dwrite d1/d12/d1a/d76/d8e/f127 [0,4194304] 0 2024-04-30T23:16:02.866 INFO:tasks.workunit.client.0.smithi100.stdout:5/910: write d1/f30 [5064782,487] 0 2024-04-30T23:16:02.869 INFO:tasks.workunit.client.0.smithi100.stdout:5/911: symlink d1/d3e/d9b/l12b 0 2024-04-30T23:16:02.870 INFO:tasks.workunit.client.0.smithi100.stdout:9/742: write d4/d7/d8/d37/d3d/f40 [3859655,21250] 0 2024-04-30T23:16:02.871 INFO:tasks.workunit.client.0.smithi100.stdout:5/912: creat d1/d12/d1a/d76/da9/f12c x:0 0 0 2024-04-30T23:16:02.871 INFO:tasks.workunit.client.0.smithi100.stdout:5/913: stat d1/d19/c51 0 2024-04-30T23:16:02.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/878: dwrite d2/d7/ffa [0,4194304] 0 2024-04-30T23:16:02.872 INFO:tasks.workunit.client.0.smithi100.stdout:9/743: creat d4/d9/d51/d89/dbb/dcc/fff x:0 0 0 2024-04-30T23:16:02.872 INFO:tasks.workunit.client.0.smithi100.stdout:9/744: read d4/d7/f38 [2165838,19379] 0 2024-04-30T23:16:02.872 INFO:tasks.workunit.client.0.smithi100.stdout:9/745: fsync d4/d7/fd5 0 2024-04-30T23:16:02.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/914: mknod d1/d12/d1a/d76/d77/d8c/d129/c12d 0 2024-04-30T23:16:02.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/915: chown d1/d19/c51 1 1 2024-04-30T23:16:02.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/916: stat d1/d12/d1a/d76/da9/fba 0 2024-04-30T23:16:02.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/746: creat d4/d9/d51/f100 x:0 0 0 2024-04-30T23:16:02.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/747: read - d4/d9/d51/d89/dbb/dcc/fff zero size 2024-04-30T23:16:02.884 INFO:tasks.workunit.client.0.smithi100.stdout:8/879: dread d2/d7/ffa [0,4194304] 0 2024-04-30T23:16:02.885 INFO:tasks.workunit.client.0.smithi100.stdout:8/880: mknod d2/d29/d9e/daf/c125 0 2024-04-30T23:16:02.885 INFO:tasks.workunit.client.0.smithi100.stdout:8/881: write d2/d89/d10/d17/f4f [2479827,90655] 0 2024-04-30T23:16:02.894 INFO:tasks.workunit.client.0.smithi100.stdout:5/917: dwrite d1/d19/f11f [0,4194304] 0 2024-04-30T23:16:02.896 INFO:tasks.workunit.client.0.smithi100.stdout:5/918: unlink d1/d12/d24/d34/f11e 0 2024-04-30T23:16:02.896 INFO:tasks.workunit.client.0.smithi100.stdout:5/919: stat d1/d12/d1a/d76/d77/d8c/d129/c12d 0 2024-04-30T23:16:02.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/920: read d1/d12/d27/f82 [4867011,112057] 0 2024-04-30T23:16:02.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/921: write d1/d12/d1a/d76/d77/f97 [1137728,45354] 0 2024-04-30T23:16:02.901 INFO:tasks.workunit.client.0.smithi100.stdout:8/882: dread d2/d29/f61 [0,4194304] 0 2024-04-30T23:16:02.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/922: link d1/d12/d1a/df2/f108 d1/d12/d1a/d76/dd7/f12e 0 2024-04-30T23:16:02.903 INFO:tasks.workunit.client.0.smithi100.stdout:8/883: truncate d2/d7/d18/f104 175574 0 2024-04-30T23:16:02.904 INFO:tasks.workunit.client.0.smithi100.stdout:8/884: truncate d2/d89/d10/d17/f4c 1229225 0 2024-04-30T23:16:02.904 INFO:tasks.workunit.client.0.smithi100.stdout:8/885: readlink d2/d7/d18/la5 0 2024-04-30T23:16:02.904 INFO:tasks.workunit.client.0.smithi100.stdout:8/886: getdents d2/d29/d8b 0 2024-04-30T23:16:02.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/976: sync 2024-04-30T23:16:02.909 INFO:tasks.workunit.client.0.smithi100.stdout:6/773: sync 2024-04-30T23:16:02.910 INFO:tasks.workunit.client.0.smithi100.stdout:6/774: write d7/d9/d86/f73 [954187,62306] 0 2024-04-30T23:16:02.910 INFO:tasks.workunit.client.0.smithi100.stdout:6/775: readlink d7/df/d23/d2b/d42/d84/le6 0 2024-04-30T23:16:02.912 INFO:tasks.workunit.client.0.smithi100.stdout:7/977: rename d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d72/fc4 to d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/f141 0 2024-04-30T23:16:02.912 INFO:tasks.workunit.client.0.smithi100.stdout:7/978: chown d0/d1b/d60/d48/d4a/d87 0 1 2024-04-30T23:16:02.913 INFO:tasks.workunit.client.0.smithi100.stdout:7/979: chown d0/d1b/d60/d48/c99 181046620 1 2024-04-30T23:16:02.913 INFO:tasks.workunit.client.0.smithi100.stdout:7/980: write d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/f141 [2974393,29661] 0 2024-04-30T23:16:02.918 INFO:tasks.workunit.client.0.smithi100.stdout:5/923: write d1/d12/d27/f82 [1496949,16730] 0 2024-04-30T23:16:02.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/924: stat d1/d37/f6d 0 2024-04-30T23:16:02.920 INFO:tasks.workunit.client.0.smithi100.stdout:5/925: creat d1/d3e/d99/f12f x:0 0 0 2024-04-30T23:16:02.928 INFO:tasks.workunit.client.0.smithi100.stdout:8/887: dwrite d2/d7/d18/fa6 [0,4194304] 0 2024-04-30T23:16:02.928 INFO:tasks.workunit.client.0.smithi100.stdout:8/888: chown d2/d7/dfe/f10e 0 1 2024-04-30T23:16:02.930 INFO:tasks.workunit.client.0.smithi100.stdout:8/889: rename d2/d89/d10 to d2/d29/d71/d86/dc7/d126 0 2024-04-30T23:16:02.931 INFO:tasks.workunit.client.0.smithi100.stdout:8/890: read d2/f6 [870593,120326] 0 2024-04-30T23:16:02.931 INFO:tasks.workunit.client.0.smithi100.stdout:8/891: read d2/d7/d18/d3a/f85 [538720,4502] 0 2024-04-30T23:16:02.931 INFO:tasks.workunit.client.0.smithi100.stdout:8/892: write d2/f3 [4529789,67524] 0 2024-04-30T23:16:02.931 INFO:tasks.workunit.client.0.smithi100.stdout:8/893: rename d2/d7 to d2/d7/d127 22 2024-04-30T23:16:02.933 INFO:tasks.workunit.client.0.smithi100.stdout:8/894: getdents d2/d29/d71/d86/dc7/d126/d6e/dad 0 2024-04-30T23:16:02.933 INFO:tasks.workunit.client.0.smithi100.stdout:8/895: write d2/d29/d71/d86/dc7/d126/d17/fbb [781200,72572] 0 2024-04-30T23:16:02.934 INFO:tasks.workunit.client.0.smithi100.stdout:8/896: creat d2/d29/d9e/d10f/f128 x:0 0 0 2024-04-30T23:16:02.935 INFO:tasks.workunit.client.0.smithi100.stdout:8/897: symlink d2/l129 0 2024-04-30T23:16:02.936 INFO:tasks.workunit.client.0.smithi100.stdout:8/898: rmdir d2/d29/d71/ddb 39 2024-04-30T23:16:02.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/899: rmdir d2/d29/d71/d86/de2 39 2024-04-30T23:16:02.937 INFO:tasks.workunit.client.0.smithi100.stdout:6/776: write d7/df/d23/d24/dbf/fe4 [3913264,11348] 0 2024-04-30T23:16:02.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/900: creat d2/d89/d72/ddc/f12a x:0 0 0 2024-04-30T23:16:02.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/901: getdents d2/d29/d71/d86/dc7/d126/d6e/dad 0 2024-04-30T23:16:02.939 INFO:tasks.workunit.client.0.smithi100.stdout:6/777: mkdir d7/df/d23/d24/dbf/d11f 0 2024-04-30T23:16:02.944 INFO:tasks.workunit.client.0.smithi100.stdout:5/926: dwrite d1/d12/d24/fee [0,4194304] 0 2024-04-30T23:16:02.944 INFO:tasks.workunit.client.0.smithi100.stdout:5/927: chown d1/d5f/d126 122 1 2024-04-30T23:16:02.944 INFO:tasks.workunit.client.0.smithi100.stdout:5/928: write d1/d12/d1a/d5b/f107 [984064,114002] 0 2024-04-30T23:16:02.944 INFO:tasks.workunit.client.0.smithi100.stdout:7/981: dwrite d0/d1b/d60/d48/d116/f11c [0,4194304] 0 2024-04-30T23:16:02.944 INFO:tasks.workunit.client.0.smithi100.stdout:7/982: write d0/f1f [14290663,117776] 0 2024-04-30T23:16:02.951 INFO:tasks.workunit.client.0.smithi100.stdout:6/778: write d7/d9/f31 [3538805,16850] 0 2024-04-30T23:16:02.953 INFO:tasks.workunit.client.0.smithi100.stdout:6/779: mknod d7/df/d23/d2b/c120 0 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/780: getdents d7/d9/d86/d62 0 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/781: read d7/d9/f51 [499478,104288] 0 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/782: chown d7/d9/d86/d1b/d3f 234978 1 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/783: readlink d7/d9/d86/d1b/d22/d38/lf0 0 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/784: truncate d7/df/d23/d24/d2e/fba 360511 0 2024-04-30T23:16:02.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/785: truncate d7/df/d23/d24/d2e/d37/f74 4791651 0 2024-04-30T23:16:02.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/902: dread d2/d89/d7f/f3f [0,4194304] 0 2024-04-30T23:16:02.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/903: fsync d2/d97/fd2 0 2024-04-30T23:16:02.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/904: read - d2/d29/d67/f11f zero size 2024-04-30T23:16:02.960 INFO:tasks.workunit.client.0.smithi100.stdout:6/786: creat d7/d9/d86/d3e/dd6/f121 x:0 0 0 2024-04-30T23:16:02.960 INFO:tasks.workunit.client.0.smithi100.stdout:6/787: read d7/f52 [49991,130793] 0 2024-04-30T23:16:02.961 INFO:tasks.workunit.client.0.smithi100.stdout:8/905: rmdir d2/d29 39 2024-04-30T23:16:02.964 INFO:tasks.workunit.client.0.smithi100.stdout:8/906: mknod d2/d69/d111/c12b 0 2024-04-30T23:16:02.965 INFO:tasks.workunit.client.0.smithi100.stdout:8/907: mknod d2/d29/d71/d86/dc7/d126/d52/c12c 0 2024-04-30T23:16:02.975 INFO:tasks.workunit.client.0.smithi100.stdout:8/908: dread d2/d89/d7f/f3f [0,4194304] 0 2024-04-30T23:16:02.975 INFO:tasks.workunit.client.0.smithi100.stdout:8/909: fdatasync d2/f76 0 2024-04-30T23:16:02.976 INFO:tasks.workunit.client.0.smithi100.stdout:5/929: dwrite d1/d12/d24/fee [0,4194304] 0 2024-04-30T23:16:02.976 INFO:tasks.workunit.client.0.smithi100.stdout:7/983: dread d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/dbb/fe2 [0,4194304] 0 2024-04-30T23:16:02.977 INFO:tasks.workunit.client.0.smithi100.stdout:5/930: chown d1/d2c/d60/d66/d75/l124 12 1 2024-04-30T23:16:02.977 INFO:tasks.workunit.client.0.smithi100.stdout:7/984: fsync d0/df/d4f/d53/da9/fba 0 2024-04-30T23:16:02.977 INFO:tasks.workunit.client.0.smithi100.stdout:8/910: mknod d2/d7/c12d 0 2024-04-30T23:16:02.979 INFO:tasks.workunit.client.0.smithi100.stdout:5/931: mkdir d1/d2c/dac/d130 0 2024-04-30T23:16:02.980 INFO:tasks.workunit.client.0.smithi100.stdout:7/985: rename d0/d1d/d5e/d6a/d4b/d79/dd0/f137 to d0/d1b/d60/f142 0 2024-04-30T23:16:02.982 INFO:tasks.workunit.client.0.smithi100.stdout:8/911: mkdir d2/d69/d111/d12e 0 2024-04-30T23:16:02.982 INFO:tasks.workunit.client.0.smithi100.stdout:8/912: write d2/d29/d9e/d10f/f128 [464531,31268] 0 2024-04-30T23:16:02.982 INFO:tasks.workunit.client.0.smithi100.stdout:5/932: creat d1/d12/d1a/df2/d11c/f131 x:0 0 0 2024-04-30T23:16:02.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/933: write d1/d37/fdb [599403,43687] 0 2024-04-30T23:16:02.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/934: write d1/d12/d1a/d76/d77/d8c/f113 [671029,73438] 0 2024-04-30T23:16:02.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/935: fdatasync d1/d37/f9d 0 2024-04-30T23:16:02.984 INFO:tasks.workunit.client.0.smithi100.stdout:6/788: dwrite d7/f52 [0,4194304] 0 2024-04-30T23:16:02.984 INFO:tasks.workunit.client.0.smithi100.stdout:6/789: write d7/d9/d86/d3e/d6b/fd2 [606745,39435] 0 2024-04-30T23:16:02.984 INFO:tasks.workunit.client.0.smithi100.stdout:7/986: mkdir d0/d1b/d2e/d97/d143 0 2024-04-30T23:16:02.985 INFO:tasks.workunit.client.0.smithi100.stdout:8/913: getdents d2/d89/d72 0 2024-04-30T23:16:02.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/936: rmdir d1/d3e/d99/dbf/dd0 39 2024-04-30T23:16:02.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/937: creat d1/d2c/dac/d130/f132 x:0 0 0 2024-04-30T23:16:02.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/938: write d1/d2c/fde [444769,9287] 0 2024-04-30T23:16:02.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/939: creat d1/d12/d1a/df2/d11c/f133 x:0 0 0 2024-04-30T23:16:02.993 INFO:tasks.workunit.client.0.smithi100.stdout:8/914: write d2/d89/d7f/f3f [3350207,72543] 0 2024-04-30T23:16:02.994 INFO:tasks.workunit.client.0.smithi100.stdout:8/915: creat d2/f12f x:0 0 0 2024-04-30T23:16:02.995 INFO:tasks.workunit.client.0.smithi100.stdout:8/916: getdents d2/d29/d71/d86/dc7 0 2024-04-30T23:16:02.995 INFO:tasks.workunit.client.0.smithi100.stdout:8/917: stat d2/d29/d8b/d8e 0 2024-04-30T23:16:02.995 INFO:tasks.workunit.client.0.smithi100.stdout:8/918: chown d2/d89/d72/ddc 678871 1 2024-04-30T23:16:02.995 INFO:tasks.workunit.client.0.smithi100.stdout:8/919: chown d2/d89/d7f/cb5 32674 1 2024-04-30T23:16:02.998 INFO:tasks.workunit.client.0.smithi100.stdout:1/696: sync 2024-04-30T23:16:03.002 INFO:tasks.workunit.client.0.smithi100.stdout:6/790: dread d7/df/d23/d24/d2e/d37/d85/fb3 [0,4194304] 0 2024-04-30T23:16:03.005 INFO:tasks.workunit.client.0.smithi100.stdout:7/987: dread d0/d1d/d5e/d6a/d4b/d79/f75 [0,4194304] 0 2024-04-30T23:16:03.006 INFO:tasks.workunit.client.0.smithi100.stdout:1/697: getdents d3/d16/d20/d24/d69/d5e 0 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:6/791: write d7/df/d23/d24/d2e/f69 [616187,120969] 0 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:5/940: dread d1/d12/d27/f58 [0,4194304] 0 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:6/792: truncate d7/d9/d86/d1b/f88 181977 0 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:5/941: write d1/d12/d1a/df2/ffa [51711,83251] 0 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:5/942: chown d1/d19/f11f 1774448600 1 2024-04-30T23:16:03.010 INFO:tasks.workunit.client.0.smithi100.stdout:7/988: link d0/d1d/d5e/l126 d0/df/d4f/d53/da9/df1/l144 0 2024-04-30T23:16:03.012 INFO:tasks.workunit.client.0.smithi100.stdout:6/793: symlink d7/df/d23/d24/d2e/d37/l122 0 2024-04-30T23:16:03.013 INFO:tasks.workunit.client.0.smithi100.stdout:7/989: truncate d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/f141 556296 0 2024-04-30T23:16:03.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/794: mknod d7/df/d23/d4f/c123 0 2024-04-30T23:16:03.016 INFO:tasks.workunit.client.0.smithi100.stdout:7/990: creat d0/df/d4f/d53/da9/f145 x:0 0 0 2024-04-30T23:16:03.016 INFO:tasks.workunit.client.0.smithi100.stdout:7/991: chown d0/d1b/d60/d48/d4a/d5b/fca 10194 1 2024-04-30T23:16:03.017 INFO:tasks.workunit.client.0.smithi100.stdout:6/795: truncate d7/db/fd0 999175 0 2024-04-30T23:16:03.019 INFO:tasks.workunit.client.0.smithi100.stdout:1/698: dread d3/d16/d20/d24/d69/f46 [4194304,4194304] 0 2024-04-30T23:16:03.019 INFO:tasks.workunit.client.0.smithi100.stdout:7/992: rename d0/df/d4f/d93 to d0/d1b/d60/d48/d4a/d87/d146 0 2024-04-30T23:16:03.019 INFO:tasks.workunit.client.0.smithi100.stdout:7/993: fsync d0/d1b/fcc 0 2024-04-30T23:16:03.021 INFO:tasks.workunit.client.0.smithi100.stdout:1/699: rmdir d3/d18/d60 39 2024-04-30T23:16:03.021 INFO:tasks.workunit.client.0.smithi100.stdout:1/700: write d3/db/f3d [3854397,85082] 0 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:7/994: mknod d0/df/d4f/d53/da9/df1/c147 0 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:7/995: write d0/d1b/d60/d48/d4a/d5b/f110 [1036194,97044] 0 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:9/748: sync 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/892: sync 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:4/960: sync 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:0/840: sync 2024-04-30T23:16:03.024 INFO:tasks.workunit.client.0.smithi100.stdout:4/961: chown d19/d1a/d6d/d64/d78/d8c/df0/l128 295482 1 2024-04-30T23:16:03.025 INFO:tasks.workunit.client.0.smithi100.stdout:1/701: rename d3/d16/d20/d24/d69/l6f to d3/d16/d20/d24/d69/d5e/d7a/ld1 0 2024-04-30T23:16:03.025 INFO:tasks.workunit.client.0.smithi100.stdout:1/702: readlink d3/d16/d20/d24/d51/d59/d5f/l50 0 2024-04-30T23:16:03.026 INFO:tasks.workunit.client.0.smithi100.stdout:7/996: creat d0/d1d/d5e/d6a/d4b/d79/d2a/d7c/d7f/da6/f148 x:0 0 0 2024-04-30T23:16:03.027 INFO:tasks.workunit.client.0.smithi100.stdout:7/997: chown d0/d1b/d60/d48/d4a/d5b/fca 7349 1 2024-04-30T23:16:03.029 INFO:tasks.workunit.client.0.smithi100.stdout:3/893: creat d1/d38/df5/f11a x:0 0 0 2024-04-30T23:16:03.031 INFO:tasks.workunit.client.0.smithi100.stdout:5/943: dwrite d1/d12/d74/fe9 [0,4194304] 0 2024-04-30T23:16:03.031 INFO:tasks.workunit.client.0.smithi100.stdout:5/944: readlink d1/d12/l57 0 2024-04-30T23:16:03.033 INFO:tasks.workunit.client.0.smithi100.stdout:0/841: creat d2/d50/d38/d5d/dc6/dd2/dd7/ff7 x:0 0 0 2024-04-30T23:16:03.033 INFO:tasks.workunit.client.0.smithi100.stdout:4/962: mknod d19/d1a/d6d/d64/c133 0 2024-04-30T23:16:03.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/998: creat d0/d1b/d60/dbe/f149 x:0 0 0 2024-04-30T23:16:03.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/894: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/f11b x:0 0 0 2024-04-30T23:16:03.039 INFO:tasks.workunit.client.0.smithi100.stdout:9/749: write d4/d7/d8/d37/f65 [1186478,83082] 0 2024-04-30T23:16:03.041 INFO:tasks.workunit.client.0.smithi100.stdout:3/895: write d1/d38/df5/d15/f105 [91170,49092] 0 2024-04-30T23:16:03.041 INFO:tasks.workunit.client.0.smithi100.stdout:3/896: chown d1 12 1 2024-04-30T23:16:03.042 INFO:tasks.workunit.client.0.smithi100.stdout:4/963: symlink d19/d1a/d21/d4a/d53/l134 0 2024-04-30T23:16:03.042 INFO:tasks.workunit.client.0.smithi100.stdout:4/964: chown d19/d1a/d29/d103/f12c 1151774000 1 2024-04-30T23:16:03.045 INFO:tasks.workunit.client.0.smithi100.stdout:9/750: rename d4/d7/d60/f67 to d4/d9/d8e/f101 0 2024-04-30T23:16:03.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:02 smithi104 ceph-mon[32987]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 205 MiB/s wr, 394 op/s 2024-04-30T23:16:03.047 INFO:tasks.workunit.client.0.smithi100.stdout:6/796: dwrite d7/d9/d86/d1b/d22/fbc [0,4194304] 0 2024-04-30T23:16:03.047 INFO:tasks.workunit.client.0.smithi100.stdout:5/945: write d1/d12/d24/d34/f9f [2660416,48967] 0 2024-04-30T23:16:03.048 INFO:tasks.workunit.client.0.smithi100.stdout:4/965: creat d19/d1a/d6d/d4e/d6e/dcb/dd3/f135 x:0 0 0 2024-04-30T23:16:03.048 INFO:tasks.workunit.client.0.smithi100.stdout:4/966: write d19/d1a/d21/fc2 [480340,83356] 0 2024-04-30T23:16:03.049 INFO:tasks.workunit.client.0.smithi100.stdout:9/751: mkdir d4/d7/d60/d69/d102 0 2024-04-30T23:16:03.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:02 smithi183 ceph-mon[33560]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 205 MiB/s wr, 394 op/s 2024-04-30T23:16:03.055 INFO:tasks.workunit.client.0.smithi100.stdout:5/946: rename d1/d12/d27/f58 to d1/d12/d24/d34/f134 0 2024-04-30T23:16:03.056 INFO:tasks.workunit.client.0.smithi100.stdout:6/797: dread d7/db/fd0 [0,4194304] 0 2024-04-30T23:16:03.061 INFO:tasks.workunit.client.0.smithi100.stdout:0/842: dwrite d2/d14/d35/d57/d62/d75/fc8 [0,4194304] 0 2024-04-30T23:16:03.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/752: dread d4/d9/d10/f4a [0,4194304] 0 2024-04-30T23:16:03.067 INFO:tasks.workunit.client.0.smithi100.stdout:1/703: dwrite d3/d16/d20/d24/d51/d59/d5f/fac [0,4194304] 0 2024-04-30T23:16:03.068 INFO:tasks.workunit.client.0.smithi100.stdout:0/843: unlink d2/d50/d38/d6c/fb6 0 2024-04-30T23:16:03.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:02 smithi100 ceph-mon[29745]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 205 MiB/s wr, 394 op/s 2024-04-30T23:16:03.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/967: dwrite d19/d1a/d21/d4a/d53/d5d/f72 [4194304,4194304] 0 2024-04-30T23:16:03.074 INFO:tasks.workunit.client.0.smithi100.stdout:4/968: read - d19/d1a/d6d/d64/dc8/ff4 zero size 2024-04-30T23:16:03.076 INFO:tasks.workunit.client.0.smithi100.stdout:7/999: dwrite d0/d1b/d60/d48/d4a/f4c [8388608,4194304] 0 2024-04-30T23:16:03.076 INFO:tasks.workunit.client.0.smithi100.stdout:9/753: mkdir d4/d9/d103 0 2024-04-30T23:16:03.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/897: dread d1/d38/df5/d15/fd8 [0,4194304] 0 2024-04-30T23:16:03.077 INFO:tasks.workunit.client.0.smithi100.stdout:0/844: creat d2/d4c/ff8 x:0 0 0 2024-04-30T23:16:03.077 INFO:tasks.workunit.client.0.smithi100.stdout:0/845: read d2/d50/d30/f3d [1325925,87887] 0 2024-04-30T23:16:03.079 INFO:tasks.workunit.client.0.smithi100.stdout:4/969: mkdir d19/d1a/d6d/d4e/d6e/dcb/dd3/d136 0 2024-04-30T23:16:03.080 INFO:tasks.workunit.client.0.smithi100.stdout:9/754: creat d4/d9/d8e/f104 x:0 0 0 2024-04-30T23:16:03.081 INFO:tasks.workunit.client.0.smithi100.stdout:3/898: mkdir d1/d38/df5/d15/d27/d5d/d11c 0 2024-04-30T23:16:03.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/970: rename d19/d1a/f9d to d19/d1a/d21/df8/f137 0 2024-04-30T23:16:03.084 INFO:tasks.workunit.client.0.smithi100.stdout:4/971: truncate d19/d1a/d6d/d64/d78/dea/f109 261392 0 2024-04-30T23:16:03.084 INFO:tasks.workunit.client.0.smithi100.stdout:4/972: write d19/d1a/d29/d65/fb1 [710250,118516] 0 2024-04-30T23:16:03.084 INFO:tasks.workunit.client.0.smithi100.stdout:9/755: mknod d4/d7/d60/d69/d102/c105 0 2024-04-30T23:16:03.086 INFO:tasks.workunit.client.0.smithi100.stdout:4/973: symlink d19/d1a/d29/dae/l138 0 2024-04-30T23:16:03.087 INFO:tasks.workunit.client.0.smithi100.stdout:9/756: rmdir d4/db7 0 2024-04-30T23:16:03.088 INFO:tasks.workunit.client.0.smithi100.stdout:4/974: unlink d19/d1a/l59 0 2024-04-30T23:16:03.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/704: dwrite d3/d16/d20/d24/d69/d5e/f8b [0,4194304] 0 2024-04-30T23:16:03.092 INFO:tasks.workunit.client.0.smithi100.stdout:0/846: write d2/d14/d35/fb4 [895825,26586] 0 2024-04-30T23:16:03.105 INFO:tasks.workunit.client.0.smithi100.stdout:4/975: write d19/d1a/d21/f25 [2464633,43913] 0 2024-04-30T23:16:03.107 INFO:tasks.workunit.client.0.smithi100.stdout:4/976: symlink d19/d1a/d6d/d64/d78/d8c/d115/l139 0 2024-04-30T23:16:03.108 INFO:tasks.workunit.client.0.smithi100.stdout:3/899: dwrite d1/d38/df5/d15/d27/d34/f97 [0,4194304] 0 2024-04-30T23:16:03.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/977: creat d19/d1a/d21/d3c/f13a x:0 0 0 2024-04-30T23:16:03.113 INFO:tasks.workunit.client.0.smithi100.stdout:4/978: creat d19/d1a/d6d/d64/dc8/f13b x:0 0 0 2024-04-30T23:16:03.114 INFO:tasks.workunit.client.0.smithi100.stdout:4/979: mknod d19/d1a/d29/dae/c13c 0 2024-04-30T23:16:03.114 INFO:tasks.workunit.client.0.smithi100.stdout:4/980: stat d19/d1a/d6d/d64/d78/lb8 0 2024-04-30T23:16:03.115 INFO:tasks.workunit.client.0.smithi100.stdout:4/981: symlink d19/d1a/d29/d65/l13d 0 2024-04-30T23:16:03.117 INFO:tasks.workunit.client.0.smithi100.stdout:4/982: truncate d19/d1a/d29/dae/fb0 3166190 0 2024-04-30T23:16:03.117 INFO:tasks.workunit.client.0.smithi100.stdout:4/983: stat c5 0 2024-04-30T23:16:03.120 INFO:tasks.workunit.client.0.smithi100.stdout:9/757: dwrite d4/d7/d60/d69/fe9 [0,4194304] 0 2024-04-30T23:16:03.120 INFO:tasks.workunit.client.0.smithi100.stdout:0/847: dwrite d2/d50/d30/f6f [0,4194304] 0 2024-04-30T23:16:03.120 INFO:tasks.workunit.client.0.smithi100.stdout:1/705: dwrite d3/d16/d20/d24/d51/d59/d5f/f8f [0,4194304] 0 2024-04-30T23:16:03.124 INFO:tasks.workunit.client.0.smithi100.stdout:9/758: mkdir d4/d9/d51/d89/dbb/d106 0 2024-04-30T23:16:03.129 INFO:tasks.workunit.client.0.smithi100.stdout:1/706: chown d3/db/c37 118822070 1 2024-04-30T23:16:03.129 INFO:tasks.workunit.client.0.smithi100.stdout:1/707: write d3/f8 [3532867,116151] 0 2024-04-30T23:16:03.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/708: mkdir d3/dbb/dcb/dd2 0 2024-04-30T23:16:03.141 INFO:tasks.workunit.client.0.smithi100.stdout:3/900: dwrite d1/d38/df5/f11a [0,4194304] 0 2024-04-30T23:16:03.143 INFO:tasks.workunit.client.0.smithi100.stdout:4/984: dwrite d19/d1a/d21/d4a/d53/fd2 [0,4194304] 0 2024-04-30T23:16:03.144 INFO:tasks.workunit.client.0.smithi100.stdout:3/901: symlink d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/d102/l11d 0 2024-04-30T23:16:03.144 INFO:tasks.workunit.client.0.smithi100.stdout:3/902: readlink d1/d38/def/df8/lfb 0 2024-04-30T23:16:03.147 INFO:tasks.workunit.client.0.smithi100.stdout:4/985: creat d19/d1a/d21/d4a/d53/deb/d119/f13e x:0 0 0 2024-04-30T23:16:03.147 INFO:tasks.workunit.client.0.smithi100.stdout:4/986: chown d19/d1a/d21/d4a/d53/deb/d119 71 1 2024-04-30T23:16:03.149 INFO:tasks.workunit.client.0.smithi100.stdout:0/848: dwrite d2/d50/d38/fb2 [0,4194304] 0 2024-04-30T23:16:03.149 INFO:tasks.workunit.client.0.smithi100.stdout:9/759: dread d4/d9/d51/f84 [0,4194304] 0 2024-04-30T23:16:03.149 INFO:tasks.workunit.client.0.smithi100.stdout:0/849: truncate d2/f52 870038 0 2024-04-30T23:16:03.149 INFO:tasks.workunit.client.0.smithi100.stdout:3/903: rename d1/d38/df5/d21/d67/c9c to d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dd6/c11e 0 2024-04-30T23:16:03.151 INFO:tasks.workunit.client.0.smithi100.stdout:1/709: read d3/db/f39 [3117388,41440] 0 2024-04-30T23:16:03.153 INFO:tasks.workunit.client.0.smithi100.stdout:9/760: rename d4/d7/d8/d19/de2/fe4 to d4/d7/d8/d37/df9/f107 0 2024-04-30T23:16:03.154 INFO:tasks.workunit.client.0.smithi100.stdout:1/710: creat d3/dbb/dcb/dd2/fd3 x:0 0 0 2024-04-30T23:16:03.155 INFO:tasks.workunit.client.0.smithi100.stdout:0/850: symlink d2/d50/d30/d32/lf9 0 2024-04-30T23:16:03.156 INFO:tasks.workunit.client.0.smithi100.stdout:3/904: dread d1/d38/df5/d15/d32/d6f/da2/d26/f98 [0,4194304] 0 2024-04-30T23:16:03.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/851: rename d2/fa1 to d2/d50/d38/d5d/dae/ffa 0 2024-04-30T23:16:03.160 INFO:tasks.workunit.client.0.smithi100.stdout:0/852: creat d2/d50/d30/d32/dec/ffb x:0 0 0 2024-04-30T23:16:03.161 INFO:tasks.workunit.client.0.smithi100.stdout:0/853: getdents d2/d50/d38/d6c 0 2024-04-30T23:16:03.161 INFO:tasks.workunit.client.0.smithi100.stdout:0/854: chown d2/d4c/deb/ff4 321 1 2024-04-30T23:16:03.161 INFO:tasks.workunit.client.0.smithi100.stdout:0/855: chown d2/d4c/ff8 2 1 2024-04-30T23:16:03.162 INFO:tasks.workunit.client.0.smithi100.stdout:0/856: symlink d2/d50/d38/d5d/de7/lfc 0 2024-04-30T23:16:03.167 INFO:tasks.workunit.client.0.smithi100.stdout:8/920: sync 2024-04-30T23:16:03.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/947: sync 2024-04-30T23:16:03.168 INFO:tasks.workunit.client.0.smithi100.stdout:5/948: dread - d1/d2c/d60/d66/d71/dcf/ffd zero size 2024-04-30T23:16:03.168 INFO:tasks.workunit.client.0.smithi100.stdout:8/921: write d2/d97/fd2 [4428151,26645] 0 2024-04-30T23:16:03.168 INFO:tasks.workunit.client.0.smithi100.stdout:4/987: dwrite d19/d1a/d6d/d64/f8a [0,4194304] 0 2024-04-30T23:16:03.170 INFO:tasks.workunit.client.0.smithi100.stdout:8/922: rename d2/d89/f40 to d2/d29/d9e/daf/f130 0 2024-04-30T23:16:03.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/988: rename d19/d1a/d21/d4a/f127 to d19/d1a/d29/d65/f13f 0 2024-04-30T23:16:03.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/989: getdents d19/d1a/d6d/d64/d78/d8c/d115 0 2024-04-30T23:16:03.175 INFO:tasks.workunit.client.0.smithi100.stdout:4/990: creat d19/d1a/d21/d4a/f140 x:0 0 0 2024-04-30T23:16:03.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/991: mknod d19/d1a/d6d/d4e/d6e/dcb/dd3/c141 0 2024-04-30T23:16:03.178 INFO:tasks.workunit.client.0.smithi100.stdout:4/992: symlink d19/d1a/d21/d4a/d10f/l142 0 2024-04-30T23:16:03.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/949: dread d1/d12/f31 [0,4194304] 0 2024-04-30T23:16:03.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/950: stat d1/cf 0 2024-04-30T23:16:03.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/711: dwrite d3/d16/d20/d24/f5c [0,4194304] 0 2024-04-30T23:16:03.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/712: fdatasync d3/d16/d20/d24/d69/f46 0 2024-04-30T23:16:03.190 INFO:tasks.workunit.client.0.smithi100.stdout:9/761: dwrite d4/d7/fca [0,4194304] 0 2024-04-30T23:16:03.190 INFO:tasks.workunit.client.0.smithi100.stdout:9/762: dread - d4/d9/d51/d89/dbb/dcc/fff zero size 2024-04-30T23:16:03.190 INFO:tasks.workunit.client.0.smithi100.stdout:1/713: rmdir d3/dbb/dcb/dd2 39 2024-04-30T23:16:03.190 INFO:tasks.workunit.client.0.smithi100.stdout:1/714: truncate d3/d18/f6d 816332 0 2024-04-30T23:16:03.191 INFO:tasks.workunit.client.0.smithi100.stdout:1/715: chown d3/d16/d20/d24/d51/d80/dae/dc4 566373812 1 2024-04-30T23:16:03.191 INFO:tasks.workunit.client.0.smithi100.stdout:1/716: fsync d3/d16/d20/d24/f6e 0 2024-04-30T23:16:03.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/763: rmdir d4/d9/d93/dd7 39 2024-04-30T23:16:03.192 INFO:tasks.workunit.client.0.smithi100.stdout:3/905: dwrite d1/d38/df5/d15/d32/d6f/da2/d26/f89 [0,4194304] 0 2024-04-30T23:16:03.193 INFO:tasks.workunit.client.0.smithi100.stdout:0/857: dwrite d2/d4c/f9a [0,4194304] 0 2024-04-30T23:16:03.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/764: creat d4/d9/d51/d89/f108 x:0 0 0 2024-04-30T23:16:03.203 INFO:tasks.workunit.client.0.smithi100.stdout:4/993: dread d19/d1a/d6d/d64/d78/d8c/df0/fef [0,4194304] 0 2024-04-30T23:16:03.203 INFO:tasks.workunit.client.0.smithi100.stdout:4/994: chown d19/c2e 1 1 2024-04-30T23:16:03.203 INFO:tasks.workunit.client.0.smithi100.stdout:4/995: stat d19/d1a/d6d 0 2024-04-30T23:16:03.206 INFO:tasks.workunit.client.0.smithi100.stdout:4/996: rmdir d19/d1a/d6d/d64/d78/d10c 39 2024-04-30T23:16:03.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/717: dread d3/d16/d20/d24/d51/d80/fba [0,4194304] 0 2024-04-30T23:16:03.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/718: fdatasync d3/d16/f84 0 2024-04-30T23:16:03.206 INFO:tasks.workunit.client.0.smithi100.stdout:4/997: read - d19/d1a/d6d/d64/dc8/f118 zero size 2024-04-30T23:16:03.206 INFO:tasks.workunit.client.0.smithi100.stdout:6/798: sync 2024-04-30T23:16:03.207 INFO:tasks.workunit.client.0.smithi100.stdout:1/719: truncate d3/db/f3e 687591 0 2024-04-30T23:16:03.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/799: write d7/d9/d86/d1b/d5a/de2/d98/f109 [252121,107818] 0 2024-04-30T23:16:03.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/800: stat d7/d11/d34/f26 0 2024-04-30T23:16:03.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/801: rename d7 to d7/df/d23/d24/d2e/d37/d85/d124 22 2024-04-30T23:16:03.213 INFO:tasks.workunit.client.0.smithi100.stdout:6/802: creat d7/d9/d86/d3e/d6b/f125 x:0 0 0 2024-04-30T23:16:03.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/803: symlink d7/d9/d86/d3e/d6b/dc2/l126 0 2024-04-30T23:16:03.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/804: readlink d7/d9/d86/db0/lf2 0 2024-04-30T23:16:03.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/805: read - d7/d9/ff5 zero size 2024-04-30T23:16:03.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/806: write d7/d9/d86/d3e/d6b/fb9 [1395970,117775] 0 2024-04-30T23:16:03.215 INFO:tasks.workunit.client.0.smithi100.stdout:5/951: dwrite d1/d37/f6d [0,4194304] 0 2024-04-30T23:16:03.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/807: creat d7/db/d3b/f127 x:0 0 0 2024-04-30T23:16:03.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/808: stat d7/df/d23/d24/f90 0 2024-04-30T23:16:03.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/809: fdatasync d7/db/d3b/f83 0 2024-04-30T23:16:03.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/952: creat d1/d2c/dac/f135 x:0 0 0 2024-04-30T23:16:03.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/953: chown d1/d3e/d9b 37542531 1 2024-04-30T23:16:03.218 INFO:tasks.workunit.client.0.smithi100.stdout:5/954: symlink d1/d2c/d60/d66/d71/db6/dd4/d85/l136 0 2024-04-30T23:16:03.220 INFO:tasks.workunit.client.0.smithi100.stdout:3/906: dwrite d1/d38/df5/d15/d32/d6f/da2/d6d/d81/fed [0,4194304] 0 2024-04-30T23:16:03.221 INFO:tasks.workunit.client.0.smithi100.stdout:3/907: write d1/d38/df5/d2b/f4c [1758609,32855] 0 2024-04-30T23:16:03.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/908: creat d1/d38/def/d10e/f11f x:0 0 0 2024-04-30T23:16:03.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/909: dread - d1/d38/df5/d15/d27/d5d/dd1/ff3 zero size 2024-04-30T23:16:03.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/858: dwrite d2/d14/d35/f43 [0,4194304] 0 2024-04-30T23:16:03.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/859: truncate d2/d50/d30/fbd 160837 0 2024-04-30T23:16:03.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/860: stat d2/d50/d38/fb2 0 2024-04-30T23:16:03.230 INFO:tasks.workunit.client.0.smithi100.stdout:3/910: symlink d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/db1/l120 0 2024-04-30T23:16:03.230 INFO:tasks.workunit.client.0.smithi100.stdout:3/911: chown d1/d38/df5/d15/d32/d6f/da2/d26/cab 27196808 1 2024-04-30T23:16:03.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/912: truncate d1/d38/df5/d15/d32/d71/da9/fd2 3101446 0 2024-04-30T23:16:03.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/913: write d1/d38/df5/d15/d2c/fe0 [1021766,10248] 0 2024-04-30T23:16:03.242 INFO:tasks.workunit.client.0.smithi100.stdout:4/998: dwrite d19/d1a/d6d/d64/d78/d10c/f114 [4194304,4194304] 0 2024-04-30T23:16:03.242 INFO:tasks.workunit.client.0.smithi100.stdout:4/999: chown d19/d33/d7d/fb3 828 1 2024-04-30T23:16:03.242 INFO:tasks.workunit.client.0.smithi100.stdout:9/765: dwrite d4/d9/d50/f5f [0,4194304] 0 2024-04-30T23:16:03.243 INFO:tasks.workunit.client.0.smithi100.stdout:9/766: fdatasync d4/d9/d51/d89/dbb/dcc/fdd 0 2024-04-30T23:16:03.244 INFO:tasks.workunit.client.0.smithi100.stdout:9/767: symlink d4/d7/d60/d69/d102/l109 0 2024-04-30T23:16:03.244 INFO:tasks.workunit.client.0.smithi100.stdout:6/810: dwrite d7/db/f5c [0,4194304] 0 2024-04-30T23:16:03.252 INFO:tasks.workunit.client.0.smithi100.stdout:5/955: dwrite d1/d2c/dac/f135 [0,4194304] 0 2024-04-30T23:16:03.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/861: dwrite d2/d50/d38/d5d/dc6/dd2/dd7/ff7 [0,4194304] 0 2024-04-30T23:16:03.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/862: read d2/d50/d38/d6c/d6e/f8a [298884,78740] 0 2024-04-30T23:16:03.260 INFO:tasks.workunit.client.0.smithi100.stdout:0/863: mknod d2/d50/d38/de6/cfd 0 2024-04-30T23:16:03.267 INFO:tasks.workunit.client.0.smithi100.stdout:9/768: dwrite d4/d7/dab/fe5 [0,4194304] 0 2024-04-30T23:16:03.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/956: dread d1/d37/f6d [0,4194304] 0 2024-04-30T23:16:03.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/957: write d1/f7 [3631712,55925] 0 2024-04-30T23:16:03.269 INFO:tasks.workunit.client.0.smithi100.stdout:5/958: readlink d1/d2c/d60/l7d 0 2024-04-30T23:16:03.270 INFO:tasks.workunit.client.0.smithi100.stdout:5/959: creat d1/d12/d1a/df2/f137 x:0 0 0 2024-04-30T23:16:03.271 INFO:tasks.workunit.client.0.smithi100.stdout:5/960: symlink d1/d3e/d99/dbf/l138 0 2024-04-30T23:16:03.271 INFO:tasks.workunit.client.0.smithi100.stdout:5/961: write d1/d12/d1a/d76/d77/f97 [1377915,88281] 0 2024-04-30T23:16:03.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/962: mkdir d1/d19/d78/d79/d139 0 2024-04-30T23:16:03.274 INFO:tasks.workunit.client.0.smithi100.stdout:9/769: write d4/fd [209434,39508] 0 2024-04-30T23:16:03.274 INFO:tasks.workunit.client.0.smithi100.stdout:9/770: fsync d4/d7/d5d/f75 0 2024-04-30T23:16:03.274 INFO:tasks.workunit.client.0.smithi100.stdout:0/864: dread d2/f59 [0,4194304] 0 2024-04-30T23:16:03.274 INFO:tasks.workunit.client.0.smithi100.stdout:5/963: rename d1/d12/d27/l54 to d1/d12/d1a/d76/dd7/l13a 0 2024-04-30T23:16:03.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/771: mkdir d4/d7/dab/db4/dbd/d10a 0 2024-04-30T23:16:03.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/772: fsync d4/d7/d8/d37/d3d/f41 0 2024-04-30T23:16:03.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/773: stat d4/l6d 0 2024-04-30T23:16:03.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/774: chown d4/d7/d8/d37/d3d/f40 16728 1 2024-04-30T23:16:03.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/775: dread - d4/d9/fe7 zero size 2024-04-30T23:16:03.277 INFO:tasks.workunit.client.0.smithi100.stdout:0/865: mkdir d2/d14/d35/d57/d62/dda/dfe 0 2024-04-30T23:16:03.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/776: mknod d4/d7/dab/db4/dbd/c10b 0 2024-04-30T23:16:03.284 INFO:tasks.workunit.client.0.smithi100.stdout:0/866: stat d2/d14/d35/d57/lc9 0 2024-04-30T23:16:03.284 INFO:tasks.workunit.client.0.smithi100.stdout:0/867: chown d2/d50/d38/d6c/d6e 1068444549 1 2024-04-30T23:16:03.284 INFO:tasks.workunit.client.0.smithi100.stdout:0/868: read - d2/d50/d38/d5d/f76 zero size 2024-04-30T23:16:03.284 INFO:tasks.workunit.client.0.smithi100.stdout:0/869: write d2/d14/d35/d57/f91 [142153,90285] 0 2024-04-30T23:16:03.285 INFO:tasks.workunit.client.0.smithi100.stdout:9/777: truncate d4/d7/d60/d69/fe9 70901 0 2024-04-30T23:16:03.285 INFO:tasks.workunit.client.0.smithi100.stdout:9/778: chown d4/d7/d60/ff6 6327417 1 2024-04-30T23:16:03.285 INFO:tasks.workunit.client.0.smithi100.stdout:9/779: fsync d4/d9/d8e/ff5 0 2024-04-30T23:16:03.285 INFO:tasks.workunit.client.0.smithi100.stdout:9/780: chown d4/d9/d10/db9/dc4/dda 298585314 1 2024-04-30T23:16:03.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/870: mknod d2/d14/d18/cff 0 2024-04-30T23:16:03.290 INFO:tasks.workunit.client.0.smithi100.stdout:9/781: creat d4/d9/d103/f10c x:0 0 0 2024-04-30T23:16:03.291 INFO:tasks.workunit.client.0.smithi100.stdout:9/782: creat d4/d7/d60/d69/f10d x:0 0 0 2024-04-30T23:16:03.293 INFO:tasks.workunit.client.0.smithi100.stdout:9/783: creat d4/d9/d6f/ddb/f10e x:0 0 0 2024-04-30T23:16:03.294 INFO:tasks.workunit.client.0.smithi100.stdout:9/784: truncate d4/d7/d8/d37/f6c 1658981 0 2024-04-30T23:16:03.296 INFO:tasks.workunit.client.0.smithi100.stdout:9/785: creat d4/d7/d60/d69/f10f x:0 0 0 2024-04-30T23:16:03.296 INFO:tasks.workunit.client.0.smithi100.stdout:5/964: dwrite d1/d2c/d60/d66/d71/db6/dd4/f102 [0,4194304] 0 2024-04-30T23:16:03.300 INFO:tasks.workunit.client.0.smithi100.stdout:5/965: dread d1/d3e/d99/dbf/dd0/fff [0,4194304] 0 2024-04-30T23:16:03.304 INFO:tasks.workunit.client.0.smithi100.stdout:5/966: symlink d1/d2c/d60/d66/l13b 0 2024-04-30T23:16:03.305 INFO:tasks.workunit.client.0.smithi100.stdout:5/967: dread - d1/d3e/d99/f11d zero size 2024-04-30T23:16:03.312 INFO:tasks.workunit.client.0.smithi100.stdout:0/871: dwrite d2/d50/d30/f3d [4194304,4194304] 0 2024-04-30T23:16:03.312 INFO:tasks.workunit.client.0.smithi100.stdout:0/872: rename d2/d50/d30 to d2/d50/d30/dc7/df6/d100 22 2024-04-30T23:16:03.312 INFO:tasks.workunit.client.0.smithi100.stdout:0/873: chown d2/d50/d38/d6c 6924192 1 2024-04-30T23:16:03.313 INFO:tasks.workunit.client.0.smithi100.stdout:0/874: getdents d2/d50/d38/d5d/dae 0 2024-04-30T23:16:03.314 INFO:tasks.workunit.client.0.smithi100.stdout:0/875: stat d2/d50/la6 0 2024-04-30T23:16:03.321 INFO:tasks.workunit.client.0.smithi100.stdout:9/786: dwrite d4/d9/d10/f27 [0,4194304] 0 2024-04-30T23:16:03.323 INFO:tasks.workunit.client.0.smithi100.stdout:9/787: getdents d4/d9/d51/d89 0 2024-04-30T23:16:03.324 INFO:tasks.workunit.client.0.smithi100.stdout:9/788: creat d4/d9/d51/f110 x:0 0 0 2024-04-30T23:16:03.325 INFO:tasks.workunit.client.0.smithi100.stdout:9/789: mkdir d4/d9/d10/d7f/d111 0 2024-04-30T23:16:03.329 INFO:tasks.workunit.client.0.smithi100.stdout:5/968: dwrite d1/d12/d74/fe5 [0,4194304] 0 2024-04-30T23:16:03.332 INFO:tasks.workunit.client.0.smithi100.stdout:5/969: getdents d1/d12 0 2024-04-30T23:16:03.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/970: unlink d1/d2c/l43 0 2024-04-30T23:16:03.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/971: readlink d1/d12/d1a/l2e 0 2024-04-30T23:16:03.348 INFO:tasks.workunit.client.0.smithi100.stdout:9/790: dwrite d4/d9/d10/f4a [4194304,4194304] 0 2024-04-30T23:16:03.351 INFO:tasks.workunit.client.0.smithi100.stdout:9/791: dread d4/f33 [0,4194304] 0 2024-04-30T23:16:03.352 INFO:tasks.workunit.client.0.smithi100.stdout:9/792: creat d4/d9/d10/f112 x:0 0 0 2024-04-30T23:16:03.353 INFO:tasks.workunit.client.0.smithi100.stdout:9/793: mkdir d4/d113 0 2024-04-30T23:16:03.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/923: sync 2024-04-30T23:16:03.365 INFO:tasks.workunit.client.0.smithi100.stdout:8/924: dread d2/d29/d71/d86/dc7/d126/d17/f4f [0,4194304] 0 2024-04-30T23:16:03.365 INFO:tasks.workunit.client.0.smithi100.stdout:8/925: write d2/d29/d71/d86/dc7/d126/d17/f46 [880229,31450] 0 2024-04-30T23:16:03.368 INFO:tasks.workunit.client.0.smithi100.stdout:9/794: dread d4/d7/d8/f86 [0,4194304] 0 2024-04-30T23:16:03.389 INFO:tasks.workunit.client.0.smithi100.stdout:9/795: dwrite d4/d7/d8/d37/f6c [0,4194304] 0 2024-04-30T23:16:03.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/926: dwrite d2/d89/f6c [0,4194304] 0 2024-04-30T23:16:03.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/927: fsync d2/d29/d71/d86/dc7/d126/d17/f4c 0 2024-04-30T23:16:03.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/928: fsync d2/d29/d71/d86/dc7/d126/d52/f121 0 2024-04-30T23:16:03.394 INFO:tasks.workunit.client.0.smithi100.stdout:8/929: creat d2/f131 x:0 0 0 2024-04-30T23:16:03.395 INFO:tasks.workunit.client.0.smithi100.stdout:8/930: write d2/d29/f58 [1460952,115329] 0 2024-04-30T23:16:03.395 INFO:tasks.workunit.client.0.smithi100.stdout:8/931: chown d2/d29/d71/d86/dc7 1207 1 2024-04-30T23:16:03.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/932: mknod d2/d29/d71/d86/dc7/d126/d17/d8f/c132 0 2024-04-30T23:16:03.397 INFO:tasks.workunit.client.0.smithi100.stdout:8/933: rmdir d2/d7/dfe 39 2024-04-30T23:16:03.397 INFO:tasks.workunit.client.0.smithi100.stdout:8/934: chown d2/d29/d71 8332477 1 2024-04-30T23:16:03.398 INFO:tasks.workunit.client.0.smithi100.stdout:8/935: rmdir d2/d69 39 2024-04-30T23:16:03.398 INFO:tasks.workunit.client.0.smithi100.stdout:8/936: stat d2/d29/d71/d86/dc7/d126/d17/f66 0 2024-04-30T23:16:03.398 INFO:tasks.workunit.client.0.smithi100.stdout:8/937: fdatasync d2/d29/d9e/daf/fbf 0 2024-04-30T23:16:03.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/938: unlink d2/d7/ff4 0 2024-04-30T23:16:03.403 INFO:tasks.workunit.client.0.smithi100.stdout:8/939: dread d2/d7/d18/d3a/da4/f103 [0,4194304] 0 2024-04-30T23:16:03.405 INFO:tasks.workunit.client.0.smithi100.stdout:8/940: rename d2/d29/d71/d86/dc7/d126/c28 to d2/d89/d7f/c133 0 2024-04-30T23:16:03.405 INFO:tasks.workunit.client.0.smithi100.stdout:8/941: chown d2/d29/d67 32932 1 2024-04-30T23:16:03.407 INFO:tasks.workunit.client.0.smithi100.stdout:8/942: rename d2/d29/d71/ddb/f115 to d2/d7/f134 0 2024-04-30T23:16:03.407 INFO:tasks.workunit.client.0.smithi100.stdout:8/943: write d2/d29/d71/d86/dc7/d126/d17/fae [698748,7567] 0 2024-04-30T23:16:03.407 INFO:tasks.workunit.client.0.smithi100.stdout:9/796: dwrite f3 [0,4194304] 0 2024-04-30T23:16:03.408 INFO:tasks.workunit.client.0.smithi100.stdout:9/797: read d4/f5e [22477,55752] 0 2024-04-30T23:16:03.408 INFO:tasks.workunit.client.0.smithi100.stdout:9/798: readlink d4/d7/d60/d69/ld1 0 2024-04-30T23:16:03.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/944: rmdir d2/d29/d8b 39 2024-04-30T23:16:03.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/945: unlink d2/l3b 0 2024-04-30T23:16:03.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/946: chown d2/d29/d71/d86/dc7/d126/d6e/dad/fcd 827839 1 2024-04-30T23:16:03.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/947: fsync d2/d29/d71/d86/dc7/d126/d17/f8c 0 2024-04-30T23:16:03.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/948: symlink d2/d29/d71/d86/dc7/d126/d6e/dad/l135 0 2024-04-30T23:16:03.425 INFO:tasks.workunit.client.0.smithi100.stdout:9/799: dwrite d4/f33 [0,4194304] 0 2024-04-30T23:16:03.425 INFO:tasks.workunit.client.0.smithi100.stdout:9/800: dread - d4/f68 zero size 2024-04-30T23:16:03.428 INFO:tasks.workunit.client.0.smithi100.stdout:8/949: dread d2/d29/f53 [0,4194304] 0 2024-04-30T23:16:03.428 INFO:tasks.workunit.client.0.smithi100.stdout:8/950: truncate d2/d29/d71/d86/f94 155535 0 2024-04-30T23:16:03.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/951: symlink d2/l136 0 2024-04-30T23:16:03.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/952: fsync d2/d89/d7f/f39 0 2024-04-30T23:16:03.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/953: getdents d2/d29/d71/d86/dc7/d126 0 2024-04-30T23:16:03.454 INFO:tasks.workunit.client.0.smithi100.stdout:8/954: dwrite d2/d29/d9e/d10f/f128 [0,4194304] 0 2024-04-30T23:16:03.454 INFO:tasks.workunit.client.0.smithi100.stdout:8/955: chown d2/d29/d71/d86/dc7/d126/d17/d8f/fb7 251 1 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:8/956: read d2/d29/d71/d86/dc7/d126/d17/d8f/fb1 [37419,65040] 0 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/801: dwrite d4/d9/d51/d89/dbb/fc1 [0,4194304] 0 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/802: chown d4/d9/d51/d89/cb1 23666369 1 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/803: chown d4/d9/fe7 5 1 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/804: chown d4/d7/d60/d69/fa4 128506 1 2024-04-30T23:16:03.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/805: fsync d4/d9/d51/d89/dbb/fc1 0 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/876: sync 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/720: sync 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:5/972: sync 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:6/811: sync 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:3/914: sync 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/877: readlink d2/d14/d35/d57/lb9 0 2024-04-30T23:16:03.465 INFO:tasks.workunit.client.0.smithi100.stdout:5/973: truncate d1/d3e/d99/f11d 305918 0 2024-04-30T23:16:03.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/957: read d2/d29/f61 [2520086,129468] 0 2024-04-30T23:16:03.466 INFO:tasks.workunit.client.0.smithi100.stdout:6/812: mkdir d7/d9/d86/d1b/d22/d38/d128 0 2024-04-30T23:16:03.466 INFO:tasks.workunit.client.0.smithi100.stdout:6/813: fdatasync d7/d9/d86/d1b/d5a/de2/d98/fa2 0 2024-04-30T23:16:03.467 INFO:tasks.workunit.client.0.smithi100.stdout:3/915: mknod d1/d38/df5/d15/d32/de8/c121 0 2024-04-30T23:16:03.468 INFO:tasks.workunit.client.0.smithi100.stdout:1/721: creat d3/d18/d60/d87/fd4 x:0 0 0 2024-04-30T23:16:03.468 INFO:tasks.workunit.client.0.smithi100.stdout:1/722: readlink d3/d99/l9c 0 2024-04-30T23:16:03.468 INFO:tasks.workunit.client.0.smithi100.stdout:0/878: creat d2/d50/d30/f101 x:0 0 0 2024-04-30T23:16:03.469 INFO:tasks.workunit.client.0.smithi100.stdout:5/974: mknod d1/d2c/d60/d66/d71/db6/dd4/c13c 0 2024-04-30T23:16:03.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/814: rename d7/df/d23/d2b/l63 to d7/df/d23/d24/dbf/l129 0 2024-04-30T23:16:03.471 INFO:tasks.workunit.client.0.smithi100.stdout:9/806: dread d4/d9/d10/db9/dc4/fdf [0,4194304] 0 2024-04-30T23:16:03.471 INFO:tasks.workunit.client.0.smithi100.stdout:1/723: mkdir d3/dd5 0 2024-04-30T23:16:03.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/879: unlink d2/d50/d38/d5d/de7/lfc 0 2024-04-30T23:16:03.473 INFO:tasks.workunit.client.0.smithi100.stdout:5/975: truncate d1/d12/d24/d34/f50 2816854 0 2024-04-30T23:16:03.476 INFO:tasks.workunit.client.0.smithi100.stdout:3/916: rename d1/c3b to d1/d38/df5/d15/d32/d6f/da2/d6d/c122 0 2024-04-30T23:16:03.478 INFO:tasks.workunit.client.0.smithi100.stdout:6/815: creat d7/df/d23/d24/d2e/f12a x:0 0 0 2024-04-30T23:16:03.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/958: dread d2/d97/fa8 [0,4194304] 0 2024-04-30T23:16:03.481 INFO:tasks.workunit.client.0.smithi100.stdout:1/724: rmdir d3/d16/d20/d24/d51/d80/dae/dc4 0 2024-04-30T23:16:03.482 INFO:tasks.workunit.client.0.smithi100.stdout:0/880: mknod d2/d50/d38/d5d/dc6/dce/c102 0 2024-04-30T23:16:03.483 INFO:tasks.workunit.client.0.smithi100.stdout:5/976: creat d1/d2c/d60/d66/d71/dcf/f13d x:0 0 0 2024-04-30T23:16:03.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/917: creat d1/d38/df5/d15/d32/d71/da9/f123 x:0 0 0 2024-04-30T23:16:03.486 INFO:tasks.workunit.client.0.smithi100.stdout:9/807: symlink d4/d9/d10/l114 0 2024-04-30T23:16:03.488 INFO:tasks.workunit.client.0.smithi100.stdout:1/725: mkdir d3/d16/d20/d24/d69/d63/dcf/dd6 0 2024-04-30T23:16:03.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/726: chown d3/d16/f3c 1523656617 1 2024-04-30T23:16:03.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/727: chown d3/d16/d20/d24/d51/d59 1834045429 1 2024-04-30T23:16:03.489 INFO:tasks.workunit.client.0.smithi100.stdout:6/816: write d7/d9/d86/d3e/d6b/fb8 [1544060,47866] 0 2024-04-30T23:16:03.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/977: dread d1/d12/d24/f4e [0,4194304] 0 2024-04-30T23:16:03.490 INFO:tasks.workunit.client.0.smithi100.stdout:0/881: truncate d2/d14/d18/f45 216380 0 2024-04-30T23:16:03.490 INFO:tasks.workunit.client.0.smithi100.stdout:0/882: write d2/d50/d38/d6c/fe4 [576020,112132] 0 2024-04-30T23:16:03.492 INFO:tasks.workunit.client.0.smithi100.stdout:3/918: creat d1/d38/df5/d21/d67/f124 x:0 0 0 2024-04-30T23:16:03.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/808: truncate d4/d9/d6f/f90 164301 0 2024-04-30T23:16:03.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/809: chown d4/d7/d60/d69/f10f 3694 1 2024-04-30T23:16:03.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/810: chown d4/d7/l3e 107973 1 2024-04-30T23:16:03.495 INFO:tasks.workunit.client.0.smithi100.stdout:5/978: mknod d1/d12/de1/c13e 0 2024-04-30T23:16:03.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/883: creat d2/d14/d18/f103 x:0 0 0 2024-04-30T23:16:03.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/884: getdents d2/d50/d30/dc7/df6 0 2024-04-30T23:16:03.498 INFO:tasks.workunit.client.0.smithi100.stdout:8/959: dwrite d2/d7/d18/f104 [0,4194304] 0 2024-04-30T23:16:03.499 INFO:tasks.workunit.client.0.smithi100.stdout:3/919: unlink d1/d38/df5/d21/l3c 0 2024-04-30T23:16:03.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/728: rename d3/d16/d20/d24/d69/d63/da9/db4 to d3/db/dd7 0 2024-04-30T23:16:03.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/979: symlink d1/d2c/d60/d66/d71/l13f 0 2024-04-30T23:16:03.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/980: stat d1/d3e/d9b/l12b 0 2024-04-30T23:16:03.509 INFO:tasks.workunit.client.0.smithi100.stdout:9/811: rename d4/d9/d10/db9/dc4/le8 to d4/d7/l115 0 2024-04-30T23:16:03.511 INFO:tasks.workunit.client.0.smithi100.stdout:1/729: creat d3/d99/fd8 x:0 0 0 2024-04-30T23:16:03.511 INFO:tasks.workunit.client.0.smithi100.stdout:6/817: dwrite d7/df/d23/d24/d2e/d37/d85/db4/dc6/f112 [0,4194304] 0 2024-04-30T23:16:03.511 INFO:tasks.workunit.client.0.smithi100.stdout:6/818: write d7/d9/f31 [1801179,1399] 0 2024-04-30T23:16:03.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/981: mkdir d1/d3e/d99/dbf/d140 0 2024-04-30T23:16:03.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/982: truncate d1/d12/d24/d34/f117 498008 0 2024-04-30T23:16:03.516 INFO:tasks.workunit.client.0.smithi100.stdout:9/812: rename d4/d9/d51/d89/dbb/dcc/cc7 to d4/d9/d10/db9/dc4/c116 0 2024-04-30T23:16:03.521 INFO:tasks.workunit.client.0.smithi100.stdout:1/730: symlink d3/d99/ld9 0 2024-04-30T23:16:03.522 INFO:tasks.workunit.client.0.smithi100.stdout:6/819: mknod d7/df/d23/d2b/d42/d87/c12b 0 2024-04-30T23:16:03.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/885: write d2/d14/d18/f93 [1952178,102544] 0 2024-04-30T23:16:03.524 INFO:tasks.workunit.client.0.smithi100.stdout:5/983: unlink d1/d3e/d99/f12f 0 2024-04-30T23:16:03.527 INFO:tasks.workunit.client.0.smithi100.stdout:9/813: symlink d4/d7/dab/db4/l117 0 2024-04-30T23:16:03.529 INFO:tasks.workunit.client.0.smithi100.stdout:8/960: dwrite d2/d29/d71/d86/dc7/d126/d17/f8c [0,4194304] 0 2024-04-30T23:16:03.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/731: truncate d3/d16/d20/d24/d69/f46 3602373 0 2024-04-30T23:16:03.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/732: stat d3/db/d4b/l8e 0 2024-04-30T23:16:03.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/820: rename d7/df/d23/d24/d2e/d9f/fca to d7/df/d23/d24/d2e/d9f/f12c 0 2024-04-30T23:16:03.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/920: dwrite d1/d38/df5/d15/d32/d92/f108 [0,4194304] 0 2024-04-30T23:16:03.534 INFO:tasks.workunit.client.0.smithi100.stdout:9/814: creat d4/d9/d103/f118 x:0 0 0 2024-04-30T23:16:03.536 INFO:tasks.workunit.client.0.smithi100.stdout:0/886: dread d2/d14/d18/f33 [0,4194304] 0 2024-04-30T23:16:03.536 INFO:tasks.workunit.client.0.smithi100.stdout:0/887: fdatasync d2/d50/d38/d5d/dae/ffa 0 2024-04-30T23:16:03.536 INFO:tasks.workunit.client.0.smithi100.stdout:0/888: stat d2/d50/d38/d5d/de7 0 2024-04-30T23:16:03.539 INFO:tasks.workunit.client.0.smithi100.stdout:5/984: dread d1/d12/f16 [0,4194304] 0 2024-04-30T23:16:03.539 INFO:tasks.workunit.client.0.smithi100.stdout:5/985: truncate d1/d12/d1a/df2/d11c/f133 1022662 0 2024-04-30T23:16:03.539 INFO:tasks.workunit.client.0.smithi100.stdout:5/986: stat d1/d12/d1a/d76/d8e 0 2024-04-30T23:16:03.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/961: link d2/d29/d9e/d10f/f128 d2/d89/d72/f137 0 2024-04-30T23:16:03.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/962: readlink d2/d29/d8b/l8d 0 2024-04-30T23:16:03.542 INFO:tasks.workunit.client.0.smithi100.stdout:1/733: symlink d3/d16/d20/d24/db7/lda 0 2024-04-30T23:16:03.544 INFO:tasks.workunit.client.0.smithi100.stdout:6/821: link d7/df/d23/d24/d2e/fba d7/df/d23/d24/d2e/d37/f12d 0 2024-04-30T23:16:03.548 INFO:tasks.workunit.client.0.smithi100.stdout:3/921: truncate d1/d38/df5/d15/f62 1260886 0 2024-04-30T23:16:03.549 INFO:tasks.workunit.client.0.smithi100.stdout:3/922: truncate d1/d38/df5/d2f/dc8/f107 194197 0 2024-04-30T23:16:03.549 INFO:tasks.workunit.client.0.smithi100.stdout:3/923: fsync d1/d38/df5/d21/f2d 0 2024-04-30T23:16:03.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/815: truncate d4/d7/d8/d37/d3d/fe1 759573 0 2024-04-30T23:16:03.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/816: read - d4/d9/d51/f100 zero size 2024-04-30T23:16:03.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/817: chown d4/d7/dab/db4/dbd/d10a 731746 1 2024-04-30T23:16:03.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/818: getdents d4/d9/d6f 0 2024-04-30T23:16:03.551 INFO:tasks.workunit.client.0.smithi100.stdout:8/963: getdents d2/d89/d72/d93 0 2024-04-30T23:16:03.552 INFO:tasks.workunit.client.0.smithi100.stdout:0/889: write d2/d50/d38/d5d/dc6/dd2/dd7/ff7 [3180615,39152] 0 2024-04-30T23:16:03.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/822: rename d7/d9/d86/d1b/d22/fbc to d7/d9/d86/d1b/d3f/f12e 0 2024-04-30T23:16:03.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/823: chown d7/df/l10a 527993500 1 2024-04-30T23:16:03.555 INFO:tasks.workunit.client.0.smithi100.stdout:3/924: stat d1/d38/fc1 0 2024-04-30T23:16:03.556 INFO:tasks.workunit.client.0.smithi100.stdout:9/819: truncate d4/d9/d51/f84 3547376 0 2024-04-30T23:16:03.556 INFO:tasks.workunit.client.0.smithi100.stdout:9/820: write d4/d9/d93/fc6 [131906,117047] 0 2024-04-30T23:16:03.557 INFO:tasks.workunit.client.0.smithi100.stdout:1/734: write d3/f5 [2661987,58361] 0 2024-04-30T23:16:03.558 INFO:tasks.workunit.client.0.smithi100.stdout:8/964: rmdir d2/d29/d71/d86/dc7/d126/d52/d9a/db9 39 2024-04-30T23:16:03.560 INFO:tasks.workunit.client.0.smithi100.stdout:0/890: mknod d2/d50/d38/c104 0 2024-04-30T23:16:03.560 INFO:tasks.workunit.client.0.smithi100.stdout:5/987: dwrite d1/d12/d74/f93 [0,4194304] 0 2024-04-30T23:16:03.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/925: mknod d1/d38/df5/d15/d27/d5d/c125 0 2024-04-30T23:16:03.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/821: unlink d4/d7/fd5 0 2024-04-30T23:16:03.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/822: dread - d4/d9/d51/f110 zero size 2024-04-30T23:16:03.565 INFO:tasks.workunit.client.0.smithi100.stdout:1/735: rmdir d3/dd5 0 2024-04-30T23:16:03.566 INFO:tasks.workunit.client.0.smithi100.stdout:8/965: write d2/d7/f26 [779022,74120] 0 2024-04-30T23:16:03.566 INFO:tasks.workunit.client.0.smithi100.stdout:8/966: chown d2/d29/d71/d86/dc7/d126/d52/d9a 3271548 1 2024-04-30T23:16:03.566 INFO:tasks.workunit.client.0.smithi100.stdout:8/967: fsync d2/d29/f30 0 2024-04-30T23:16:03.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/968: write d2/d29/d71/d86/dc7/d126/d17/fbb [826715,130403] 0 2024-04-30T23:16:03.567 INFO:tasks.workunit.client.0.smithi100.stdout:0/891: rmdir d2/d50/d38/d6c/d6e/dad 39 2024-04-30T23:16:03.567 INFO:tasks.workunit.client.0.smithi100.stdout:0/892: chown d2/l25 13939 1 2024-04-30T23:16:03.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/988: creat d1/d2c/d60/f141 x:0 0 0 2024-04-30T23:16:03.575 INFO:tasks.workunit.client.0.smithi100.stdout:3/926: rename d1/d38/df5/d15/f16 to d1/d38/df5/d15/d32/d71/df0/d118/f126 0 2024-04-30T23:16:03.576 INFO:tasks.workunit.client.0.smithi100.stdout:3/927: chown d1/d38/df5/d2f/lf6 104204319 1 2024-04-30T23:16:03.576 INFO:tasks.workunit.client.0.smithi100.stdout:3/928: fsync d1/d38/df5/d15/f6a 0 2024-04-30T23:16:03.576 INFO:tasks.workunit.client.0.smithi100.stdout:3/929: truncate d1/d38/df5/d15/d32/d71/da9/f123 395748 0 2024-04-30T23:16:03.576 INFO:tasks.workunit.client.0.smithi100.stdout:1/736: symlink d3/d16/d20/d24/d51/d59/d5f/db6/ldb 0 2024-04-30T23:16:03.579 INFO:tasks.workunit.client.0.smithi100.stdout:5/989: mknod d1/d12/d1a/d76/da9/d116/c142 0 2024-04-30T23:16:03.579 INFO:tasks.workunit.client.0.smithi100.stdout:5/990: dread - d1/d5f/fdf zero size 2024-04-30T23:16:03.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/824: dwrite d7/df/d23/d24/f90 [0,4194304] 0 2024-04-30T23:16:03.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/825: chown d7/df/d23/d2b/d42/d84/l119 670846 1 2024-04-30T23:16:03.582 INFO:tasks.workunit.client.0.smithi100.stdout:8/969: rename d2/d29/d71/d86/dc7/d126/d17/fae to d2/d29/d71/d86/dc7/d126/f138 0 2024-04-30T23:16:03.582 INFO:tasks.workunit.client.0.smithi100.stdout:8/970: stat d2/d29/d67 0 2024-04-30T23:16:03.583 INFO:tasks.workunit.client.0.smithi100.stdout:0/893: dread d2/d5a/f92 [0,4194304] 0 2024-04-30T23:16:03.583 INFO:tasks.workunit.client.0.smithi100.stdout:0/894: stat d2/d50/d38/c51 0 2024-04-30T23:16:03.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/930: mknod d1/d38/df5/d15/d27/d5d/d11c/c127 0 2024-04-30T23:16:03.591 INFO:tasks.workunit.client.0.smithi100.stdout:9/823: dwrite d4/d9/d10/d7f/f9a [0,4194304] 0 2024-04-30T23:16:03.591 INFO:tasks.workunit.client.0.smithi100.stdout:9/824: chown d4/d7/da7 475888819 1 2024-04-30T23:16:03.592 INFO:tasks.workunit.client.0.smithi100.stdout:1/737: symlink d3/d16/d20/d24/d51/ldc 0 2024-04-30T23:16:03.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/826: creat d7/df/d23/d24/d2e/d37/d85/db4/dc6/f12f x:0 0 0 2024-04-30T23:16:03.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/827: write d7/d9/d86/d1b/d5a/f66 [1041948,36544] 0 2024-04-30T23:16:03.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/828: write d7/d9/d86/d1b/d5a/de2/d98/fa2 [26506,55591] 0 2024-04-30T23:16:03.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/829: write d7/df/d23/d24/d2e/d9f/f12c [850207,65543] 0 2024-04-30T23:16:03.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/825: rename d4/d7/d8/l82 to d4/d9/d103/l119 0 2024-04-30T23:16:03.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/826: stat d4/d9/d51/d89 0 2024-04-30T23:16:03.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/991: write d1/d5f/f83 [1046118,51000] 0 2024-04-30T23:16:03.606 INFO:tasks.workunit.client.0.smithi100.stdout:5/992: creat d1/d12/d1a/df2/d11c/f143 x:0 0 0 2024-04-30T23:16:03.609 INFO:tasks.workunit.client.0.smithi100.stdout:5/993: creat d1/d12/d24/d34/f144 x:0 0 0 2024-04-30T23:16:03.609 INFO:tasks.workunit.client.0.smithi100.stdout:5/994: fdatasync d1/d12/de1/dea/f100 0 2024-04-30T23:16:03.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/895: dwrite d2/dba/fbc [0,4194304] 0 2024-04-30T23:16:03.610 INFO:tasks.workunit.client.0.smithi100.stdout:8/971: dwrite d2/d29/f7e [0,4194304] 0 2024-04-30T23:16:03.610 INFO:tasks.workunit.client.0.smithi100.stdout:8/972: chown d2/d7/d18/d3a/l59 3 1 2024-04-30T23:16:03.612 INFO:tasks.workunit.client.0.smithi100.stdout:8/973: dread d2/d29/d71/fcf [0,4194304] 0 2024-04-30T23:16:03.612 INFO:tasks.workunit.client.0.smithi100.stdout:8/974: write d2/d29/d71/d86/dc7/d126/d17/d8f/fb7 [1733039,113287] 0 2024-04-30T23:16:03.612 INFO:tasks.workunit.client.0.smithi100.stdout:8/975: truncate d2/d29/d71/d86/dc7/d126/d52/fe5 851191 0 2024-04-30T23:16:03.614 INFO:tasks.workunit.client.0.smithi100.stdout:0/896: link d2/d50/d30/dc7/f90 d2/d50/d30/f105 0 2024-04-30T23:16:03.616 INFO:tasks.workunit.client.0.smithi100.stdout:8/976: creat d2/f139 x:0 0 0 2024-04-30T23:16:03.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/738: dwrite d3/d16/d20/f27 [4194304,4194304] 0 2024-04-30T23:16:03.618 INFO:tasks.workunit.client.0.smithi100.stdout:0/897: mkdir d2/d50/d38/d5d/dc6/dce/d106 0 2024-04-30T23:16:03.618 INFO:tasks.workunit.client.0.smithi100.stdout:0/898: fsync d2/d4c/deb/ff4 0 2024-04-30T23:16:03.622 INFO:tasks.workunit.client.0.smithi100.stdout:8/977: mkdir d2/d29/d8b/d8e/d13a 0 2024-04-30T23:16:03.625 INFO:tasks.workunit.client.0.smithi100.stdout:0/899: creat d2/d14/d35/d40/d83/f107 x:0 0 0 2024-04-30T23:16:03.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/827: dread f3 [4194304,4194304] 0 2024-04-30T23:16:03.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/978: link d2/d7/d18/d3a/f84 d2/d29/d8b/d8e/d13a/f13b 0 2024-04-30T23:16:03.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/979: stat d2/d97/f101 0 2024-04-30T23:16:03.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/830: dwrite d7/df/d23/d24/d2e/d37/f9b [0,4194304] 0 2024-04-30T23:16:03.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/995: dread d1/d3e/d99/fc2 [0,4194304] 0 2024-04-30T23:16:03.632 INFO:tasks.workunit.client.0.smithi100.stdout:9/828: link d4/fb0 d4/d7/d8/d37/d3d/f11a 0 2024-04-30T23:16:03.637 INFO:tasks.workunit.client.0.smithi100.stdout:6/831: mknod d7/df/d23/d24/c130 0 2024-04-30T23:16:03.638 INFO:tasks.workunit.client.0.smithi100.stdout:5/996: creat d1/d12/d1a/df2/d11c/f145 x:0 0 0 2024-04-30T23:16:03.638 INFO:tasks.workunit.client.0.smithi100.stdout:1/739: write d3/d16/f84 [3254740,16770] 0 2024-04-30T23:16:03.638 INFO:tasks.workunit.client.0.smithi100.stdout:1/740: chown d3/d16/d20/d24/db0 326 1 2024-04-30T23:16:03.640 INFO:tasks.workunit.client.0.smithi100.stdout:9/829: creat d4/d9/d93/dd7/f11b x:0 0 0 2024-04-30T23:16:03.645 INFO:tasks.workunit.client.0.smithi100.stdout:9/830: dread d4/d9/d51/d89/fa9 [0,4194304] 0 2024-04-30T23:16:03.649 INFO:tasks.workunit.client.0.smithi100.stdout:0/900: dwrite d2/d14/d35/d57/f60 [0,4194304] 0 2024-04-30T23:16:03.652 INFO:tasks.workunit.client.0.smithi100.stdout:1/741: rmdir d3/db/d4b/dc8 0 2024-04-30T23:16:03.653 INFO:tasks.workunit.client.0.smithi100.stdout:1/742: mknod d3/d16/d20/d24/d69/d63/da9/cdd 0 2024-04-30T23:16:03.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/997: write d1/d12/d27/fa8 [2922045,130493] 0 2024-04-30T23:16:03.654 INFO:tasks.workunit.client.0.smithi100.stdout:1/743: symlink d3/d16/d20/d24/d69/d63/dcf/lde 0 2024-04-30T23:16:03.655 INFO:tasks.workunit.client.0.smithi100.stdout:5/998: mknod d1/d12/d24/c146 0 2024-04-30T23:16:03.655 INFO:tasks.workunit.client.0.smithi100.stdout:5/999: chown d1/d12/d1a/d76/lb1 240463 1 2024-04-30T23:16:03.656 INFO:tasks.workunit.client.0.smithi100.stdout:1/744: rename d3/d16/d20/d24/d69/d63/la3 to d3/d16/d20/d24/d51/d59/d5f/ldf 0 2024-04-30T23:16:03.673 INFO:tasks.workunit.client.0.smithi100.stdout:9/831: dread d4/d9/d50/f54 [0,4194304] 0 2024-04-30T23:16:03.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/832: dwrite d7/df/d23/d24/d2e/d37/d85/fb3 [0,4194304] 0 2024-04-30T23:16:03.674 INFO:tasks.workunit.client.0.smithi100.stdout:9/832: chown d4/d9/d51/d89 5022876 1 2024-04-30T23:16:03.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/833: write d7/d9/d86/d3e/d6b/f125 [662307,11446] 0 2024-04-30T23:16:03.680 INFO:tasks.workunit.client.0.smithi100.stdout:9/833: mknod d4/d7/d8/d37/d58/dd0/c11c 0 2024-04-30T23:16:03.680 INFO:tasks.workunit.client.0.smithi100.stdout:9/834: write d4/d9/d51/fc5 [866711,62243] 0 2024-04-30T23:16:03.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/835: rename d4/d9/d50/f5f to d4/d9/d93/f11d 0 2024-04-30T23:16:03.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/745: dwrite d3/f5 [4194304,4194304] 0 2024-04-30T23:16:03.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/746: mkdir d3/d16/de0 0 2024-04-30T23:16:03.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/747: symlink d3/d16/d20/d24/d69/d5e/d7a/le1 0 2024-04-30T23:16:03.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/748: creat d3/fe2 x:0 0 0 2024-04-30T23:16:03.688 INFO:tasks.workunit.client.0.smithi100.stdout:0/901: dwrite d2/d50/f71 [0,4194304] 0 2024-04-30T23:16:03.688 INFO:tasks.workunit.client.0.smithi100.stdout:0/902: fsync d2/d50/d30/f6f 0 2024-04-30T23:16:03.692 INFO:tasks.workunit.client.0.smithi100.stdout:0/903: write d2/d50/d30/d32/f5b [4026890,75902] 0 2024-04-30T23:16:03.693 INFO:tasks.workunit.client.0.smithi100.stdout:0/904: getdents d2/d14 0 2024-04-30T23:16:03.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/905: link d2/d14/d35/d57/f60 d2/d14/d35/f108 0 2024-04-30T23:16:03.697 INFO:tasks.workunit.client.0.smithi100.stdout:6/834: dwrite d7/df/d23/d24/d2e/fb7 [0,4194304] 0 2024-04-30T23:16:03.697 INFO:tasks.workunit.client.0.smithi100.stdout:6/835: fsync d7/df/d23/d2b/d42/d87/fe9 0 2024-04-30T23:16:03.698 INFO:tasks.workunit.client.0.smithi100.stdout:0/906: rename d2/d14/lb0 to d2/d50/d38/d5d/l109 0 2024-04-30T23:16:03.700 INFO:tasks.workunit.client.0.smithi100.stdout:9/836: dwrite d4/d9/d10/db9/dc4/fc8 [0,4194304] 0 2024-04-30T23:16:03.700 INFO:tasks.workunit.client.0.smithi100.stdout:9/837: dread - d4/d9/d93/dd7/fed zero size 2024-04-30T23:16:03.700 INFO:tasks.workunit.client.0.smithi100.stdout:1/749: dread d3/d16/d20/d24/d69/d5e/f8b [0,4194304] 0 2024-04-30T23:16:03.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/907: creat d2/d50/d38/d5d/dae/f10a x:0 0 0 2024-04-30T23:16:03.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/838: creat d4/d7/d8/f11e x:0 0 0 2024-04-30T23:16:03.710 INFO:tasks.workunit.client.0.smithi100.stdout:0/908: symlink d2/d14/d35/d40/l10b 0 2024-04-30T23:16:03.710 INFO:tasks.workunit.client.0.smithi100.stdout:6/836: write d7/df/d23/d24/d2e/d37/f74 [2036220,40574] 0 2024-04-30T23:16:03.711 INFO:tasks.workunit.client.0.smithi100.stdout:6/837: dread - d7/db/d3b/f83 zero size 2024-04-30T23:16:03.712 INFO:tasks.workunit.client.0.smithi100.stdout:0/909: mkdir d2/dba/d10c 0 2024-04-30T23:16:03.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/838: unlink d7/d9/d86/d1b/d5a/de2/d98/lf7 0 2024-04-30T23:16:03.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/750: dread d3/db/f3d [0,4194304] 0 2024-04-30T23:16:03.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/751: write d3/d99/f9b [270807,66616] 0 2024-04-30T23:16:03.714 INFO:tasks.workunit.client.0.smithi100.stdout:0/910: getdents d2/d50/d38/d5d/dc6/dd2/dd7 0 2024-04-30T23:16:03.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/911: unlink d2/d5a/fe2 0 2024-04-30T23:16:03.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/912: read - d2/d50/d38/d5d/dc6/dd2/fee zero size 2024-04-30T23:16:03.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/913: chown d2/d4c/deb/ff4 29762483 1 2024-04-30T23:16:03.720 INFO:tasks.workunit.client.0.smithi100.stdout:0/914: creat d2/d14/d35/d40/d83/f10d x:0 0 0 2024-04-30T23:16:03.725 INFO:tasks.workunit.client.0.smithi100.stdout:9/839: dwrite d4/d7/d60/d69/f10d [0,4194304] 0 2024-04-30T23:16:03.728 INFO:tasks.workunit.client.0.smithi100.stdout:9/840: rmdir d4/d9/d8e 39 2024-04-30T23:16:03.728 INFO:tasks.workunit.client.0.smithi100.stdout:9/841: chown d4/d9/d10/db9 5 1 2024-04-30T23:16:03.728 INFO:tasks.workunit.client.0.smithi100.stdout:9/842: rmdir d4/d9/d6f 39 2024-04-30T23:16:03.738 INFO:tasks.workunit.client.0.smithi100.stdout:6/839: dwrite d7/df/d23/d2b/d42/d87/f8b [0,4194304] 0 2024-04-30T23:16:03.746 INFO:tasks.workunit.client.0.smithi100.stdout:1/752: dwrite d3/d18/d60/d87/f8d [0,4194304] 0 2024-04-30T23:16:03.749 INFO:tasks.workunit.client.0.smithi100.stdout:0/915: dwrite d2/f3a [0,4194304] 0 2024-04-30T23:16:03.752 INFO:tasks.workunit.client.0.smithi100.stdout:0/916: creat d2/d14/d35/d57/d62/dda/f10e x:0 0 0 2024-04-30T23:16:03.753 INFO:tasks.workunit.client.0.smithi100.stdout:0/917: link d2/d14/d35/d57/led d2/d50/d38/d6c/d6e/dad/l10f 0 2024-04-30T23:16:03.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/918: rename d2/d50/d30/dd4/de1 to d2/d14/d35/d57/d62/dda/dfe/d110 0 2024-04-30T23:16:03.757 INFO:tasks.workunit.client.0.smithi100.stdout:0/919: unlink d2/d14/d35/d57/d62/d75/fc8 0 2024-04-30T23:16:03.758 INFO:tasks.workunit.client.0.smithi100.stdout:0/920: symlink d2/d14/d35/d57/d62/dda/dfe/l111 0 2024-04-30T23:16:03.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/921: fdatasync d2/d14/d35/d57/f91 0 2024-04-30T23:16:03.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/922: chown d2/d50/d30/dd8/cd9 467928 1 2024-04-30T23:16:03.759 INFO:tasks.workunit.client.0.smithi100.stdout:3/931: sync 2024-04-30T23:16:03.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/980: sync 2024-04-30T23:16:03.759 INFO:tasks.workunit.client.0.smithi100.stdout:6/840: dwrite d7/d11/f116 [0,4194304] 0 2024-04-30T23:16:03.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/841: truncate d7/f21 4628923 0 2024-04-30T23:16:03.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/932: creat d1/d38/df5/d15/d32/d71/f128 x:0 0 0 2024-04-30T23:16:03.762 INFO:tasks.workunit.client.0.smithi100.stdout:8/981: rename d2/d29/d67/f105 to d2/d29/d67/dea/f13c 0 2024-04-30T23:16:03.762 INFO:tasks.workunit.client.0.smithi100.stdout:8/982: chown d2/d29/d9e/d10f/f128 19196989 1 2024-04-30T23:16:03.762 INFO:tasks.workunit.client.0.smithi100.stdout:8/983: readlink d2/d29/d67/d73/ld7 0 2024-04-30T23:16:03.764 INFO:tasks.workunit.client.0.smithi100.stdout:3/933: symlink d1/d38/df5/d15/d32/d6f/da2/d26/l129 0 2024-04-30T23:16:03.765 INFO:tasks.workunit.client.0.smithi100.stdout:8/984: mknod d2/d29/d71/d86/dc7/d126/d52/c13d 0 2024-04-30T23:16:03.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/923: read d2/d50/d30/d32/f9d [905144,5714] 0 2024-04-30T23:16:03.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/924: truncate d2/d14/d35/f39 8608228 0 2024-04-30T23:16:03.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/925: mkdir d2/d4c/deb/d112 0 2024-04-30T23:16:03.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/926: chown d2/d50/d38/d6c/fa4 2 1 2024-04-30T23:16:03.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/927: rmdir d2/d4c/d68/dd1 39 2024-04-30T23:16:03.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/928: unlink d2/dba/fbc 0 2024-04-30T23:16:03.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/929: chown d2/d4c/deb 87367 1 2024-04-30T23:16:03.773 INFO:tasks.workunit.client.0.smithi100.stdout:8/985: write d2/d29/d71/d86/dc7/d126/d17/fbb [444663,12777] 0 2024-04-30T23:16:03.773 INFO:tasks.workunit.client.0.smithi100.stdout:8/986: chown d2/d97/l9f 21 1 2024-04-30T23:16:03.774 INFO:tasks.workunit.client.0.smithi100.stdout:0/930: creat d2/d50/d38/d6c/f113 x:0 0 0 2024-04-30T23:16:03.774 INFO:tasks.workunit.client.0.smithi100.stdout:0/931: write d2/d5a/fef [963612,7811] 0 2024-04-30T23:16:03.775 INFO:tasks.workunit.client.0.smithi100.stdout:1/753: dwrite d3/d16/d20/d24/f7c [0,4194304] 0 2024-04-30T23:16:03.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/932: symlink d2/d14/d35/d57/d62/dda/dfe/l114 0 2024-04-30T23:16:03.780 INFO:tasks.workunit.client.0.smithi100.stdout:1/754: rename d3/d16/d20/d24/d69/d5e/d7a/lab to d3/db/d4b/le3 0 2024-04-30T23:16:03.783 INFO:tasks.workunit.client.0.smithi100.stdout:6/842: dwrite d7/d9/d86/d1b/f36 [0,4194304] 0 2024-04-30T23:16:03.783 INFO:tasks.workunit.client.0.smithi100.stdout:3/934: dread d1/d38/df5/f11a [0,4194304] 0 2024-04-30T23:16:03.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/843: symlink d7/df/d23/d24/d2e/d37/d85/db4/dc6/dd8/l131 0 2024-04-30T23:16:03.786 INFO:tasks.workunit.client.0.smithi100.stdout:3/935: rmdir d1/d38/df5/d15/d32/d6f/da2/d6d/da8 39 2024-04-30T23:16:03.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/844: link d7/db/d3b/c4a d7/df/d23/d2b/d42/d87/c132 0 2024-04-30T23:16:03.787 INFO:tasks.workunit.client.0.smithi100.stdout:3/936: stat d1/d38/l64 0 2024-04-30T23:16:03.788 INFO:tasks.workunit.client.0.smithi100.stdout:6/845: link d7/d9/lb6 d7/d9/d86/d3e/l133 0 2024-04-30T23:16:03.788 INFO:tasks.workunit.client.0.smithi100.stdout:8/987: dread d2/d89/d72/f9b [0,4194304] 0 2024-04-30T23:16:03.788 INFO:tasks.workunit.client.0.smithi100.stdout:8/988: chown d2/d29/d67/d73/l92 68 1 2024-04-30T23:16:03.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/937: link d1/d38/df5/d15/d32/d71/cce d1/d38/df5/d2b/d57/daf/c12a 0 2024-04-30T23:16:03.790 INFO:tasks.workunit.client.0.smithi100.stdout:3/938: dread d1/d38/df5/d15/d32/d71/da9/f123 [0,4194304] 0 2024-04-30T23:16:03.791 INFO:tasks.workunit.client.0.smithi100.stdout:0/933: dread d2/d5a/f92 [0,4194304] 0 2024-04-30T23:16:03.791 INFO:tasks.workunit.client.0.smithi100.stdout:0/934: stat d2/d50/d30/d32 0 2024-04-30T23:16:03.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/939: getdents d1/d38/df5/d2f/dc8 0 2024-04-30T23:16:03.792 INFO:tasks.workunit.client.0.smithi100.stdout:3/940: rmdir d1/d38/df5/d15/d32/d6f/da2/d6d 39 2024-04-30T23:16:03.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/941: rename d1/d38/df5/d15/d32/d6f/da2/f74 to d1/d38/df5/d15/d2c/f12b 0 2024-04-30T23:16:03.796 INFO:tasks.workunit.client.0.smithi100.stdout:3/942: link d1/d38/df5/d2b/f4c d1/d38/df5/d21/d67/f12c 0 2024-04-30T23:16:03.796 INFO:tasks.workunit.client.0.smithi100.stdout:1/755: dread d3/d18/f5d [0,4194304] 0 2024-04-30T23:16:03.796 INFO:tasks.workunit.client.0.smithi100.stdout:1/756: truncate d3/d16/d20/f9a 496636 0 2024-04-30T23:16:03.797 INFO:tasks.workunit.client.0.smithi100.stdout:3/943: mkdir d1/d12d 0 2024-04-30T23:16:03.797 INFO:tasks.workunit.client.0.smithi100.stdout:3/944: dread - d1/d38/df5/d15/d32/fff zero size 2024-04-30T23:16:03.797 INFO:tasks.workunit.client.0.smithi100.stdout:1/757: mkdir d3/de4 0 2024-04-30T23:16:03.798 INFO:tasks.workunit.client.0.smithi100.stdout:3/945: getdents d1/d38/df5 0 2024-04-30T23:16:03.801 INFO:tasks.workunit.client.0.smithi100.stdout:3/946: creat d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/d90/f12e x:0 0 0 2024-04-30T23:16:03.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/846: dread d7/df/d23/d24/d2e/d37/fdc [0,4194304] 0 2024-04-30T23:16:03.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/847: truncate d7/db/f5c 9212197 0 2024-04-30T23:16:03.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/848: getdents d7/d9/d86/d1b/d22 0 2024-04-30T23:16:03.809 INFO:tasks.workunit.client.0.smithi100.stdout:0/935: dread d2/f59 [0,4194304] 0 2024-04-30T23:16:03.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/936: chown d2/d14/d35/f8e 0 1 2024-04-30T23:16:03.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/937: fsync d2/d50/d38/d6c/f74 0 2024-04-30T23:16:03.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/849: link d7/df/d23/d24/d2e/d37/f74 d7/d9/d86/d1b/d22/d38/d128/f134 0 2024-04-30T23:16:03.811 INFO:tasks.workunit.client.0.smithi100.stdout:0/938: fdatasync d2/d4c/d68/f72 0 2024-04-30T23:16:03.811 INFO:tasks.workunit.client.0.smithi100.stdout:8/989: read d2/d29/d71/d86/dc7/d126/d17/f8c [1213714,57038] 0 2024-04-30T23:16:03.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/939: rename d2/d14/d35/d57/l88 to d2/l115 0 2024-04-30T23:16:03.814 INFO:tasks.workunit.client.0.smithi100.stdout:8/990: creat d2/d69/f13e x:0 0 0 2024-04-30T23:16:03.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/758: dread d3/d16/f36 [4194304,4194304] 0 2024-04-30T23:16:03.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/759: stat d3/dbb/dcb 0 2024-04-30T23:16:03.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/760: chown d3/d16/d20/d24/d51/d59/d5f/l50 4 1 2024-04-30T23:16:03.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/761: stat d3/d16/d20/d24/d51/d80/dae/cb3 0 2024-04-30T23:16:03.822 INFO:tasks.workunit.client.0.smithi100.stdout:1/762: mkdir d3/d18/de5 0 2024-04-30T23:16:03.826 INFO:tasks.workunit.client.0.smithi100.stdout:3/947: dwrite d1/d38/df5/d2f/f7c [4194304,4194304] 0 2024-04-30T23:16:03.826 INFO:tasks.workunit.client.0.smithi100.stdout:3/948: truncate d1/d38/df5/d15/d32/d6f/da2/f110 855101 0 2024-04-30T23:16:03.826 INFO:tasks.workunit.client.0.smithi100.stdout:1/763: creat d3/d16/d20/d24/d51/fe6 x:0 0 0 2024-04-30T23:16:03.832 INFO:tasks.workunit.client.0.smithi100.stdout:3/949: unlink d1/l1a 0 2024-04-30T23:16:03.833 INFO:tasks.workunit.client.0.smithi100.stdout:1/764: creat d3/fe7 x:0 0 0 2024-04-30T23:16:03.835 INFO:tasks.workunit.client.0.smithi100.stdout:3/950: symlink d1/d38/df5/d15/d27/l12f 0 2024-04-30T23:16:03.837 INFO:tasks.workunit.client.0.smithi100.stdout:3/951: mknod d1/d38/df5/d2f/c130 0 2024-04-30T23:16:03.837 INFO:tasks.workunit.client.0.smithi100.stdout:3/952: read - d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/d90/f10c zero size 2024-04-30T23:16:03.837 INFO:tasks.workunit.client.0.smithi100.stdout:1/765: symlink d3/db/le8 0 2024-04-30T23:16:03.842 INFO:tasks.workunit.client.0.smithi100.stdout:1/766: link d3/f8 d3/d16/d20/d24/d69/d63/dcf/fe9 0 2024-04-30T23:16:03.842 INFO:tasks.workunit.client.0.smithi100.stdout:1/767: chown d3/d16/f84 1 1 2024-04-30T23:16:03.842 INFO:tasks.workunit.client.0.smithi100.stdout:1/768: symlink d3/de4/lea 0 2024-04-30T23:16:03.843 INFO:tasks.workunit.client.0.smithi100.stdout:8/991: dwrite d2/d29/d71/d86/dc7/d126/d17/f4c [0,4194304] 0 2024-04-30T23:16:03.843 INFO:tasks.workunit.client.0.smithi100.stdout:8/992: readlink d2/d89/l21 0 2024-04-30T23:16:03.843 INFO:tasks.workunit.client.0.smithi100.stdout:8/993: write d2/d29/d71/d86/dc7/d126/d52/f121 [823506,122098] 0 2024-04-30T23:16:03.848 INFO:tasks.workunit.client.0.smithi100.stdout:0/940: dwrite d2/d50/d38/d6c/fe4 [0,4194304] 0 2024-04-30T23:16:03.848 INFO:tasks.workunit.client.0.smithi100.stdout:8/994: creat d2/d29/d8b/d8e/d13a/f13f x:0 0 0 2024-04-30T23:16:03.852 INFO:tasks.workunit.client.0.smithi100.stdout:0/941: mknod d2/d50/d38/d5d/dae/c116 0 2024-04-30T23:16:03.854 INFO:tasks.workunit.client.0.smithi100.stdout:3/953: write d1/d38/df5/d15/d2c/fdb [843205,118787] 0 2024-04-30T23:16:03.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/995: rename d2/d29/d71/d86/dc7/d126/d6e/da0/f11d to d2/d29/d67/dea/f140 0 2024-04-30T23:16:03.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/996: write d2/d89/d7f/f120 [503591,118549] 0 2024-04-30T23:16:03.856 INFO:tasks.workunit.client.0.smithi100.stdout:1/769: dread d3/db/f39 [0,4194304] 0 2024-04-30T23:16:03.856 INFO:tasks.workunit.client.0.smithi100.stdout:1/770: dread - d3/fe2 zero size 2024-04-30T23:16:03.856 INFO:tasks.workunit.client.0.smithi100.stdout:0/942: creat d2/d50/d38/d5d/de8/f117 x:0 0 0 2024-04-30T23:16:03.873 INFO:tasks.workunit.client.0.smithi100.stdout:3/954: rmdir d1/d38/df5/d15/d27/d5d/d11c 39 2024-04-30T23:16:03.873 INFO:tasks.workunit.client.0.smithi100.stdout:1/771: truncate d3/d16/d20/d24/d69/d63/dcf/fe9 790587 0 2024-04-30T23:16:03.875 INFO:tasks.workunit.client.0.smithi100.stdout:8/997: dwrite d2/d29/f53 [0,4194304] 0 2024-04-30T23:16:03.878 INFO:tasks.workunit.client.0.smithi100.stdout:0/943: mknod d2/d50/d38/d5d/dc6/dce/c118 0 2024-04-30T23:16:03.878 INFO:tasks.workunit.client.0.smithi100.stdout:0/944: read d2/d50/d30/f3d [434101,42059] 0 2024-04-30T23:16:03.879 INFO:tasks.workunit.client.0.smithi100.stdout:1/772: truncate d3/d18/d60/d87/f93 894292 0 2024-04-30T23:16:03.882 INFO:tasks.workunit.client.0.smithi100.stdout:0/945: mkdir d2/d4c/deb/d119 0 2024-04-30T23:16:03.883 INFO:tasks.workunit.client.0.smithi100.stdout:1/773: rename d3/d16/d20/d24/l35 to d3/dbb/dcb/dd2/leb 0 2024-04-30T23:16:03.885 INFO:tasks.workunit.client.0.smithi100.stdout:0/946: symlink d2/d50/d38/d6c/l11a 0 2024-04-30T23:16:03.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/947: symlink d2/d50/d38/d5d/l11b 0 2024-04-30T23:16:03.890 INFO:tasks.workunit.client.0.smithi100.stdout:0/948: unlink d2/d50/d38/d5d/lc1 0 2024-04-30T23:16:03.892 INFO:tasks.workunit.client.0.smithi100.stdout:0/949: link d2/d50/d38/d5d/dae/f10a d2/d50/d38/d6c/f11c 0 2024-04-30T23:16:03.895 INFO:tasks.workunit.client.0.smithi100.stdout:3/955: read d1/d38/df5/d15/d32/d6f/da2/d6d/d81/fed [3458603,19271] 0 2024-04-30T23:16:03.902 INFO:tasks.workunit.client.0.smithi100.stdout:1/774: dread d3/d16/f3c [0,4194304] 0 2024-04-30T23:16:03.902 INFO:tasks.workunit.client.0.smithi100.stdout:1/775: truncate d3/d16/d20/d24/d69/d5e/d7a/fa6 998551 0 2024-04-30T23:16:03.905 INFO:tasks.workunit.client.0.smithi100.stdout:8/998: dwrite d2/d7/dfe/f10e [0,4194304] 0 2024-04-30T23:16:03.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/999: getdents d2/d29/d71/d86/dc7/d126/d52/d9a 0 2024-04-30T23:16:03.915 INFO:tasks.workunit.client.0.smithi100.stdout:3/956: dread d1/d38/df5/d15/d32/fdf [0,4194304] 0 2024-04-30T23:16:03.928 INFO:tasks.workunit.client.0.smithi100.stdout:3/957: dread d1/d38/f78 [0,4194304] 0 2024-04-30T23:16:03.928 INFO:tasks.workunit.client.0.smithi100.stdout:0/950: rename d2/d50/d38/d5d to d2/d50/d30/dd4/d11d 0 2024-04-30T23:16:03.928 INFO:tasks.workunit.client.0.smithi100.stdout:0/951: chown d2/d50/d38/c51 4916 1 2024-04-30T23:16:03.930 INFO:tasks.workunit.client.0.smithi100.stdout:3/958: mkdir d1/d38/df5/d15/d27/d5d/d11c/d131 0 2024-04-30T23:16:03.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/952: rename d2/d14/d18/f42 to d2/d50/d30/dd4/d11d/dd0/f11e 0 2024-04-30T23:16:03.933 INFO:tasks.workunit.client.0.smithi100.stdout:1/776: rename d3/d16/d20/d24/d69/f71 to d3/d16/d20/d24/d51/fec 0 2024-04-30T23:16:03.935 INFO:tasks.workunit.client.0.smithi100.stdout:1/777: unlink d3/d16/d20/d24/d51/d59/d5f/l50 0 2024-04-30T23:16:03.937 INFO:tasks.workunit.client.0.smithi100.stdout:1/778: creat d3/d16/d20/d24/d69/d5e/d7a/fed x:0 0 0 2024-04-30T23:16:03.938 INFO:tasks.workunit.client.0.smithi100.stdout:1/779: link d3/d16/d20/d24/d69/f9f d3/d99/fee 0 2024-04-30T23:16:03.939 INFO:tasks.workunit.client.0.smithi100.stdout:1/780: creat d3/d16/d20/d24/dca/fef x:0 0 0 2024-04-30T23:16:03.940 INFO:tasks.workunit.client.0.smithi100.stdout:1/781: symlink d3/d16/d20/d24/d51/d59/d5f/db6/lf0 0 2024-04-30T23:16:03.941 INFO:tasks.workunit.client.0.smithi100.stdout:1/782: readlink d3/d16/d20/d24/d69/d63/l88 0 2024-04-30T23:16:03.941 INFO:tasks.workunit.client.0.smithi100.stdout:6/850: sync 2024-04-30T23:16:03.941 INFO:tasks.workunit.client.0.smithi100.stdout:9/843: sync 2024-04-30T23:16:03.942 INFO:tasks.workunit.client.0.smithi100.stdout:1/783: mknod d3/d16/d20/d24/d51/d59/d5f/db6/cf1 0 2024-04-30T23:16:03.944 INFO:tasks.workunit.client.0.smithi100.stdout:6/851: mknod d7/d9/d86/d3e/c135 0 2024-04-30T23:16:03.944 INFO:tasks.workunit.client.0.smithi100.stdout:6/852: truncate d7/df/d23/d24/d2e/d37/f74 5366395 0 2024-04-30T23:16:03.945 INFO:tasks.workunit.client.0.smithi100.stdout:6/853: chown d7/d9/d86/d3e/d6b/d75/f7c 50841431 1 2024-04-30T23:16:03.945 INFO:tasks.workunit.client.0.smithi100.stdout:6/854: chown d7/d9/d86/d3e/d6b/c11d 12333853 1 2024-04-30T23:16:03.946 INFO:tasks.workunit.client.0.smithi100.stdout:1/784: unlink d3/d16/d20/d24/d51/c85 0 2024-04-30T23:16:03.946 INFO:tasks.workunit.client.0.smithi100.stdout:1/785: dread - d3/d16/d20/d24/d51/fe6 zero size 2024-04-30T23:16:03.947 INFO:tasks.workunit.client.0.smithi100.stdout:6/855: symlink d7/df/d23/d24/d2e/d37/d85/db4/dc6/dd8/l136 0 2024-04-30T23:16:03.949 INFO:tasks.workunit.client.0.smithi100.stdout:0/953: dread d2/d14/d35/d57/f95 [0,4194304] 0 2024-04-30T23:16:03.956 INFO:tasks.workunit.client.0.smithi100.stdout:3/959: dwrite d1/d38/df5/d15/d32/d6f/da2/d6d/fac [0,4194304] 0 2024-04-30T23:16:03.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/844: write d4/d9/d10/d7f/f95 [1606351,25784] 0 2024-04-30T23:16:03.968 INFO:tasks.workunit.client.0.smithi100.stdout:1/786: dwrite d3/d16/f3c [0,4194304] 0 2024-04-30T23:16:03.970 INFO:tasks.workunit.client.0.smithi100.stdout:1/787: dread d3/d99/fee [0,4194304] 0 2024-04-30T23:16:03.970 INFO:tasks.workunit.client.0.smithi100.stdout:1/788: truncate d3/f9 4432396 0 2024-04-30T23:16:03.971 INFO:tasks.workunit.client.0.smithi100.stdout:1/789: mkdir d3/d16/d20/d24/d69/d5e/df2 0 2024-04-30T23:16:03.973 INFO:tasks.workunit.client.0.smithi100.stdout:1/790: unlink d3/db/ce 0 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/791: rename d3/db to d3/d16/d20/d24/d69/d5e/df3 0 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/792: write d3/d18/f53 [5090250,19399] 0 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/793: read - d3/d18/d60/d87/fd4 zero size 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:6/856: dwrite d7/d11/d34/f26 [0,4194304] 0 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:6/857: stat d7/d9/d86/d3e/c135 0 2024-04-30T23:16:03.979 INFO:tasks.workunit.client.0.smithi100.stdout:6/858: dread - d7/d9/d86/d3e/d6b/fbb zero size 2024-04-30T23:16:03.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/794: truncate d3/d18/f95 778314 0 2024-04-30T23:16:03.980 INFO:tasks.workunit.client.0.smithi100.stdout:6/859: mkdir d7/df/d23/d4f/d137 0 2024-04-30T23:16:03.982 INFO:tasks.workunit.client.0.smithi100.stdout:1/795: rename d3/d16/d20/d24/f6e to d3/d16/d20/d24/d51/d59/d5f/db6/ff4 0 2024-04-30T23:16:03.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/960: read d1/d38/df5/d2b/d57/fa1 [345054,8564] 0 2024-04-30T23:16:03.984 INFO:tasks.workunit.client.0.smithi100.stdout:3/961: mknod d1/d38/df5/d15/d32/de8/c132 0 2024-04-30T23:16:03.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/962: symlink d1/d38/df5/d21/d67/d10b/l133 0 2024-04-30T23:16:03.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/963: read d1/d38/df5/d15/d32/d6f/fe5 [140590,102142] 0 2024-04-30T23:16:03.987 INFO:tasks.workunit.client.0.smithi100.stdout:3/964: creat d1/d38/df5/d21/f134 x:0 0 0 2024-04-30T23:16:03.987 INFO:tasks.workunit.client.0.smithi100.stdout:3/965: readlink d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/d102/l11d 0 2024-04-30T23:16:03.995 INFO:tasks.workunit.client.0.smithi100.stdout:1/796: read d3/d16/d20/d24/f86 [3229867,22127] 0 2024-04-30T23:16:03.997 INFO:tasks.workunit.client.0.smithi100.stdout:9/845: dwrite d4/d9/d10/d7f/f95 [4194304,4194304] 0 2024-04-30T23:16:03.997 INFO:tasks.workunit.client.0.smithi100.stdout:1/797: getdents d3/d16 0 2024-04-30T23:16:04.000 INFO:tasks.workunit.client.0.smithi100.stdout:9/846: rename d4/d7/l115 to d4/d9/d10/db9/dc4/l11f 0 2024-04-30T23:16:04.002 INFO:tasks.workunit.client.0.smithi100.stdout:1/798: symlink d3/d18/de5/lf5 0 2024-04-30T23:16:04.002 INFO:tasks.workunit.client.0.smithi100.stdout:1/799: write d3/d18/f9e [320712,121447] 0 2024-04-30T23:16:04.003 INFO:tasks.workunit.client.0.smithi100.stdout:9/847: rename d4/d7/d8/d37/d58/dd0/cef to d4/d9/d93/dd7/c120 0 2024-04-30T23:16:04.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/848: rename d4/d9/d50/la3 to d4/d9/l121 0 2024-04-30T23:16:04.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/849: readlink d4/d7/d60/d69/ld1 0 2024-04-30T23:16:04.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/850: readlink d4/d7/d60/d69/l91 0 2024-04-30T23:16:04.010 INFO:tasks.workunit.client.0.smithi100.stdout:6/860: dwrite d7/d9/d86/d3e/d6b/d75/f7c [0,4194304] 0 2024-04-30T23:16:04.014 INFO:tasks.workunit.client.0.smithi100.stdout:3/966: dwrite d1/d38/df5/d21/f8e [0,4194304] 0 2024-04-30T23:16:04.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/861: unlink d7/f89 0 2024-04-30T23:16:04.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/862: write d7/d9/d86/d3e/d6b/fb9 [2191662,126648] 0 2024-04-30T23:16:04.024 INFO:tasks.workunit.client.0.smithi100.stdout:1/800: dwrite d3/d16/d20/d24/d51/d59/d5f/db6/ff4 [0,4194304] 0 2024-04-30T23:16:04.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/851: dwrite d4/d9/d10/d7f/fa6 [4194304,4194304] 0 2024-04-30T23:16:04.036 INFO:tasks.workunit.client.0.smithi100.stdout:9/852: mknod d4/d9/d50/c122 0 2024-04-30T23:16:04.036 INFO:tasks.workunit.client.0.smithi100.stdout:3/967: dwrite d1/d38/df5/d15/d32/d6f/da2/f6b [4194304,4194304] 0 2024-04-30T23:16:04.037 INFO:tasks.workunit.client.0.smithi100.stdout:9/853: creat d4/d9/d51/d89/dbb/d106/f123 x:0 0 0 2024-04-30T23:16:04.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/968: link d1/d38/df5/c2e d1/d38/df5/d15/d27/d5d/d11c/c135 0 2024-04-30T23:16:04.042 INFO:tasks.workunit.client.0.smithi100.stdout:9/854: mknod d4/d7/d60/d69/c124 0 2024-04-30T23:16:04.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/969: creat d1/d38/df5/d15/d32/d6f/da2/d26/f136 x:0 0 0 2024-04-30T23:16:04.046 INFO:tasks.workunit.client.0.smithi100.stdout:6/863: dwrite d7/d9/d86/d3e/dd6/f121 [0,4194304] 0 2024-04-30T23:16:04.059 INFO:tasks.workunit.client.0.smithi100.stdout:6/864: write d7/df/d23/d24/d2e/d37/d85/db4/dc6/f112 [2855885,21379] 0 2024-04-30T23:16:04.060 INFO:tasks.workunit.client.0.smithi100.stdout:6/865: mknod d7/d9/d8e/c138 0 2024-04-30T23:16:04.062 INFO:tasks.workunit.client.0.smithi100.stdout:9/855: dwrite d4/d9/d10/fa2 [0,4194304] 0 2024-04-30T23:16:04.062 INFO:tasks.workunit.client.0.smithi100.stdout:9/856: write d4/d7/f38 [1012835,107761] 0 2024-04-30T23:16:04.064 INFO:tasks.workunit.client.0.smithi100.stdout:3/970: dwrite d1/d38/df5/f73 [4194304,4194304] 0 2024-04-30T23:16:04.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/857: symlink d4/d7/d8/d37/d58/dd0/dfd/l125 0 2024-04-30T23:16:04.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/858: fsync d4/d9/d10/f78 0 2024-04-30T23:16:04.065 INFO:tasks.workunit.client.0.smithi100.stdout:3/971: readlink d1/d38/d79/dde/l101 0 2024-04-30T23:16:04.065 INFO:tasks.workunit.client.0.smithi100.stdout:3/972: chown d1/d38/df5/d15/d2c/l56 8914647 1 2024-04-30T23:16:04.065 INFO:tasks.workunit.client.0.smithi100.stdout:3/973: fdatasync d1/f8d 0 2024-04-30T23:16:04.065 INFO:tasks.workunit.client.0.smithi100.stdout:3/974: write d1/d38/df5/d15/d32/d6f/da2/d6d/d81/dae/f10a [551260,32263] 0 2024-04-30T23:16:04.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/859: creat d4/d9/d10/db9/f126 x:0 0 0 2024-04-30T23:16:04.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/975: rename d1/d38/df5/d21/c49 to d1/d38/df5/d15/d32/d71/c137 0 2024-04-30T23:16:04.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/976: symlink d1/d38/df5/d15/d27/d5d/dd1/l138 0 2024-04-30T23:16:04.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/866: write d7/d9/d86/d62/faa [6640645,96529] 0 2024-04-30T23:16:04.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/867: fsync d7/df/d23/d24/d2e/d37/f9b 0 2024-04-30T23:16:04.076 INFO:tasks.workunit.client.0.smithi100.stdout:6/868: link d7/df/l1e d7/d9/d86/d62/l139 0 2024-04-30T23:16:04.077 INFO:tasks.workunit.client.0.smithi100.stdout:6/869: creat d7/df/d23/d24/f13a x:0 0 0 2024-04-30T23:16:04.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/870: creat d7/d9/d86/d62/dfe/f13b x:0 0 0 2024-04-30T23:16:04.090 INFO:tasks.workunit.client.0.smithi100.stdout:3/977: dwrite d1/d38/df5/d15/d32/f40 [4194304,4194304] 0 2024-04-30T23:16:04.090 INFO:tasks.workunit.client.0.smithi100.stdout:3/978: write d1/d38/df5/d15/d32/d6f/da2/d26/f45 [2234958,100110] 0 2024-04-30T23:16:04.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/871: dwrite d7/df/d23/d2b/d42/d87/f8b [0,4194304] 0 2024-04-30T23:16:04.111 INFO:tasks.workunit.client.0.smithi100.stdout:3/979: dwrite d1/d38/df5/d15/d32/d6f/da2/fee [0,4194304] 0 2024-04-30T23:16:04.113 INFO:tasks.workunit.client.0.smithi100.stdout:3/980: rmdir d1/d38/df5/d2f 39 2024-04-30T23:16:04.114 INFO:tasks.workunit.client.0.smithi100.stdout:3/981: creat d1/d38/df5/d15/d32/d6f/f139 x:0 0 0 2024-04-30T23:16:04.114 INFO:tasks.workunit.client.0.smithi100.stdout:3/982: fdatasync d1/d38/df5/d21/f134 0 2024-04-30T23:16:04.127 INFO:tasks.workunit.client.0.smithi100.stdout:3/983: dread d1/d38/df5/f5f [4194304,4194304] 0 2024-04-30T23:16:04.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/872: dwrite d7/d9/f31 [0,4194304] 0 2024-04-30T23:16:04.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/873: chown d7/d9/d8e/lc0 9462 1 2024-04-30T23:16:04.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/874: dread d7/df/d23/d24/d2e/d9f/f12c [0,4194304] 0 2024-04-30T23:16:04.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/875: chown d7/d9/d86/d3e/d6b/fa9 272531 1 2024-04-30T23:16:04.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/876: dread - d7/d9/d86/d3e/d6b/dc2/f102 zero size 2024-04-30T23:16:04.135 INFO:tasks.workunit.client.0.smithi100.stdout:3/984: dread d1/f8d [0,4194304] 0 2024-04-30T23:16:04.135 INFO:tasks.workunit.client.0.smithi100.stdout:6/877: unlink d7/df/l78 0 2024-04-30T23:16:04.135 INFO:tasks.workunit.client.0.smithi100.stdout:6/878: stat d7/d9/d86/db0/lf2 0 2024-04-30T23:16:04.135 INFO:tasks.workunit.client.0.smithi100.stdout:6/879: fdatasync d7/d9/d86/f30 0 2024-04-30T23:16:04.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/985: creat d1/d38/df5/d15/d32/d71/da9/f13a x:0 0 0 2024-04-30T23:16:04.149 INFO:tasks.workunit.client.0.smithi100.stdout:6/880: dread d7/d9/f31 [0,4194304] 0 2024-04-30T23:16:04.159 INFO:tasks.workunit.client.0.smithi100.stdout:3/986: dwrite d1/d38/df5/d2b/f4c [0,4194304] 0 2024-04-30T23:16:04.160 INFO:tasks.workunit.client.0.smithi100.stdout:3/987: symlink d1/d38/def/df8/l13b 0 2024-04-30T23:16:04.161 INFO:tasks.workunit.client.0.smithi100.stdout:3/988: creat d1/d38/df5/d15/d32/d6f/da2/d6d/da8/f13c x:0 0 0 2024-04-30T23:16:04.163 INFO:tasks.workunit.client.0.smithi100.stdout:3/989: link d1/d38/df5/d15/d27/d34/f97 d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/f13d 0 2024-04-30T23:16:04.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/990: unlink d1/d38/df5/d15/d27/d5d/c8f 0 2024-04-30T23:16:04.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/991: truncate d1/d38/df5/d15/d32/d6f/da2/d6d/d7b/fe9 843063 0 2024-04-30T23:16:04.165 INFO:tasks.workunit.client.0.smithi100.stdout:3/992: rename d1/d38/df5/d15/d27/fc2 to d1/d38/df5/d15/d32/d92/f13e 0 2024-04-30T23:16:04.166 INFO:tasks.workunit.client.0.smithi100.stdout:3/993: rename d1/d38/df5/d15/d32/d92/fa4 to d1/d38/df5/d15/d32/d92/f13f 0 2024-04-30T23:16:04.167 INFO:tasks.workunit.client.0.smithi100.stdout:3/994: chown d1/d38/df5/d2b/l46 1123 1 2024-04-30T23:16:04.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/995: dread d1/d38/f5c [0,4194304] 0 2024-04-30T23:16:04.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/996: chown d1/d38/df5/l58 61616 1 2024-04-30T23:16:04.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/997: read - d1/d38/df5/d21/f134 zero size 2024-04-30T23:16:04.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/998: write d1/d38/df5/d15/d32/d6f/da2/d26/f23 [4447949,43989] 0 2024-04-30T23:16:04.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/999: mknod d1/d38/df5/d15/d27/d5d/d11c/c140 0 2024-04-30T23:16:04.254 INFO:tasks.workunit.client.0.smithi100.stdout:0/954: sync 2024-04-30T23:16:04.254 INFO:tasks.workunit.client.0.smithi100.stdout:1/801: sync 2024-04-30T23:16:04.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/860: sync 2024-04-30T23:16:04.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/861: read d4/d7/d8/d37/f65 [2656765,23920] 0 2024-04-30T23:16:04.256 INFO:tasks.workunit.client.0.smithi100.stdout:9/862: dread d4/d9/d50/f54 [4194304,4194304] 0 2024-04-30T23:16:04.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/955: unlink d2/d50/d30/dc7/cb5 0 2024-04-30T23:16:04.256 INFO:tasks.workunit.client.0.smithi100.stdout:9/863: write d4/d7/d60/d69/fe9 [654819,55796] 0 2024-04-30T23:16:04.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/956: mkdir d2/d50/d30/dd4/d11d/dc6/d11f 0 2024-04-30T23:16:04.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/957: chown d2/d5a/f77 1933 1 2024-04-30T23:16:04.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/802: write d3/d18/d60/d87/f93 [720264,78617] 0 2024-04-30T23:16:04.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/803: fsync d3/d16/d20/d24/d69/d63/da9/fc0 0 2024-04-30T23:16:04.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/804: write d3/fe2 [621551,25519] 0 2024-04-30T23:16:04.258 INFO:tasks.workunit.client.0.smithi100.stdout:9/864: rename d4/d9/d103 to d4/d9/d10/d7f/d111/d127 0 2024-04-30T23:16:04.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/805: rename d3/d16/d20/d24/d51/d59/d5f/fac to d3/dbb/dcb/ff6 0 2024-04-30T23:16:04.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/806: chown d3/d16/d20/d24 65242203 1 2024-04-30T23:16:04.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/807: write d3/d16/d20/d24/d51/f70 [616798,94756] 0 2024-04-30T23:16:04.260 INFO:tasks.workunit.client.0.smithi100.stdout:9/865: truncate d4/d7/d8/d37/f65 1100824 0 2024-04-30T23:16:04.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/808: link d3/d16/d20/d24/d51/f70 d3/d16/d20/d24/d51/d59/ff7 0 2024-04-30T23:16:04.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/809: truncate d3/d16/d20/d24/d51/d59/d5f/fa5 308884 0 2024-04-30T23:16:04.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/810: truncate d3/d16/f36 3809738 0 2024-04-30T23:16:04.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/866: write d4/d7/d60/d69/f10d [1301597,7056] 0 2024-04-30T23:16:04.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/958: dwrite d2/d4c/ff8 [0,4194304] 0 2024-04-30T23:16:04.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/959: readlink d2/d50/d30/dd4/d11d/lc3 0 2024-04-30T23:16:04.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/960: truncate d2/d14/fca 152292 0 2024-04-30T23:16:04.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/811: dwrite d3/d16/d20/d24/d69/d5e/df3/f3d [0,4194304] 0 2024-04-30T23:16:04.291 INFO:tasks.workunit.client.0.smithi100.stdout:1/812: link d3/d16/d20/d24/d51/c77 d3/d16/d20/d24/d69/d5e/df3/dd7/cf8 0 2024-04-30T23:16:04.293 INFO:tasks.workunit.client.0.smithi100.stdout:1/813: truncate d3/f4d 544443 0 2024-04-30T23:16:04.300 INFO:tasks.workunit.client.0.smithi100.stdout:9/867: dwrite d4/d7/d8/d19/f4e [4194304,4194304] 0 2024-04-30T23:16:04.316 INFO:tasks.workunit.client.0.smithi100.stdout:0/961: dwrite d2/d50/d30/d32/f3b [4194304,4194304] 0 2024-04-30T23:16:04.316 INFO:tasks.workunit.client.0.smithi100.stdout:1/814: dwrite d3/d18/d60/d87/f8d [0,4194304] 0 2024-04-30T23:16:04.316 INFO:tasks.workunit.client.0.smithi100.stdout:1/815: readlink d3/d16/d20/d24/d69/d5e/df3/le8 0 2024-04-30T23:16:04.316 INFO:tasks.workunit.client.0.smithi100.stdout:1/816: fsync d3/fe7 0 2024-04-30T23:16:04.317 INFO:tasks.workunit.client.0.smithi100.stdout:1/817: mkdir d3/d16/df9 0 2024-04-30T23:16:04.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/818: rename d3/d99 to d3/d16/d20/d24/d69/d63/dfa 0 2024-04-30T23:16:04.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/962: dread d2/d14/d35/fa7 [0,4194304] 0 2024-04-30T23:16:04.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/819: dread d3/d18/f68 [0,4194304] 0 2024-04-30T23:16:04.335 INFO:tasks.workunit.client.0.smithi100.stdout:1/820: rename d3/d16/d20/d24/d69/d63/dfa/f9b to d3/d16/d20/d24/d69/d63/da9/ffb 0 2024-04-30T23:16:04.336 INFO:tasks.workunit.client.0.smithi100.stdout:1/821: mknod d3/d16/d20/d24/d69/d5e/df2/cfc 0 2024-04-30T23:16:04.336 INFO:tasks.workunit.client.0.smithi100.stdout:1/822: truncate d3/d16/d20/d24/d69/f9d 1372632 0 2024-04-30T23:16:04.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/823: creat d3/d16/d20/d24/db7/dbd/ffd x:0 0 0 2024-04-30T23:16:04.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/824: chown d3/l13 0 1 2024-04-30T23:16:04.338 INFO:tasks.workunit.client.0.smithi100.stdout:1/825: creat d3/d16/d20/d24/db7/ffe x:0 0 0 2024-04-30T23:16:04.338 INFO:tasks.workunit.client.0.smithi100.stdout:1/826: fdatasync d3/fe7 0 2024-04-30T23:16:04.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/827: rmdir d3/d16/d20/d24/d69/d63/dcf 39 2024-04-30T23:16:04.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/828: fsync d3/f5 0 2024-04-30T23:16:04.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/829: read d3/f8 [525508,43804] 0 2024-04-30T23:16:04.341 INFO:tasks.workunit.client.0.smithi100.stdout:1/830: mknod d3/d16/d20/d24/d69/d5e/df3/dd7/cff 0 2024-04-30T23:16:04.341 INFO:tasks.workunit.client.0.smithi100.stdout:1/831: fdatasync d3/f8 0 2024-04-30T23:16:04.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/963: read d2/f65 [2099210,42017] 0 2024-04-30T23:16:04.347 INFO:tasks.workunit.client.0.smithi100.stdout:0/964: creat d2/d50/d30/dd8/f120 x:0 0 0 2024-04-30T23:16:04.347 INFO:tasks.workunit.client.0.smithi100.stdout:0/965: fsync d2/d14/d18/f103 0 2024-04-30T23:16:04.353 INFO:tasks.workunit.client.0.smithi100.stdout:1/832: dread d3/d16/d20/d24/d51/d80/fba [0,4194304] 0 2024-04-30T23:16:04.353 INFO:tasks.workunit.client.0.smithi100.stdout:1/833: fsync d3/d16/d20/d24/d69/d5e/df3/f40 0 2024-04-30T23:16:04.358 INFO:tasks.workunit.client.0.smithi100.stdout:0/966: dread d2/d14/d35/fa7 [0,4194304] 0 2024-04-30T23:16:04.366 INFO:tasks.workunit.client.0.smithi100.stdout:1/834: dread d3/d18/f23 [0,4194304] 0 2024-04-30T23:16:04.368 INFO:tasks.workunit.client.0.smithi100.stdout:1/835: mknod d3/d16/d20/d24/c100 0 2024-04-30T23:16:04.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/881: sync 2024-04-30T23:16:04.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/882: write d7/df/d23/d2b/d42/fdf [502613,26174] 0 2024-04-30T23:16:04.371 INFO:tasks.workunit.client.0.smithi100.stdout:0/967: read d2/d14/d35/f43 [341154,60080] 0 2024-04-30T23:16:04.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/883: mknod d7/db/d3b/c13c 0 2024-04-30T23:16:04.373 INFO:tasks.workunit.client.0.smithi100.stdout:0/968: rename d2/d50/d38/d6c/f11c to d2/d50/d30/dd4/d11d/dae/f121 0 2024-04-30T23:16:04.373 INFO:tasks.workunit.client.0.smithi100.stdout:0/969: write d2/f73 [2568874,33777] 0 2024-04-30T23:16:04.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/884: truncate d7/f21 550385 0 2024-04-30T23:16:04.376 INFO:tasks.workunit.client.0.smithi100.stdout:6/885: truncate d7/d9/d8e/f10c 2862110 0 2024-04-30T23:16:04.379 INFO:tasks.workunit.client.0.smithi100.stdout:6/886: rename d7/d9/d86/d1b/f88 to d7/d9/d86/d62/dfe/f13d 0 2024-04-30T23:16:04.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/887: mknod d7/d9/d86/d1b/d3f/c13e 0 2024-04-30T23:16:04.383 INFO:tasks.workunit.client.0.smithi100.stdout:1/836: write d3/f9 [939668,58291] 0 2024-04-30T23:16:04.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/837: symlink d3/d16/d20/d24/d51/d59/d5f/l101 0 2024-04-30T23:16:04.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/970: dread d2/d14/d35/d40/d83/faf [0,4194304] 0 2024-04-30T23:16:04.393 INFO:tasks.workunit.client.0.smithi100.stdout:0/971: getdents d2/d50 0 2024-04-30T23:16:04.410 INFO:tasks.workunit.client.0.smithi100.stdout:6/888: dwrite d7/d9/d86/f73 [0,4194304] 0 2024-04-30T23:16:04.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/889: chown d7/d9/d86/d3e/d6b/d75/f11a 0 1 2024-04-30T23:16:04.411 INFO:tasks.workunit.client.0.smithi100.stdout:1/838: dwrite d3/d16/d20/d24/f5c [0,4194304] 0 2024-04-30T23:16:04.411 INFO:tasks.workunit.client.0.smithi100.stdout:1/839: dread - d3/d18/d60/d87/fb9 zero size 2024-04-30T23:16:04.415 INFO:tasks.workunit.client.0.smithi100.stdout:1/840: symlink d3/d16/d20/d24/dca/l102 0 2024-04-30T23:16:04.416 INFO:tasks.workunit.client.0.smithi100.stdout:1/841: mkdir d3/d16/d20/d24/d69/d63/da9/d103 0 2024-04-30T23:16:04.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/868: sync 2024-04-30T23:16:04.417 INFO:tasks.workunit.client.0.smithi100.stdout:6/890: dread d7/df/d23/d24/d2e/f69 [0,4194304] 0 2024-04-30T23:16:04.417 INFO:tasks.workunit.client.0.smithi100.stdout:0/972: dwrite d2/dba/fcd [0,4194304] 0 2024-04-30T23:16:04.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/842: rename d3/d16/d20/d24/d51/d59/d5f/db6/ldb to d3/d16/d20/d24/d69/d63/da9/l104 0 2024-04-30T23:16:04.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/843: chown d3/d16/d20/d24/d51/f70 32510521 1 2024-04-30T23:16:04.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/844: chown d3/c15 37920 1 2024-04-30T23:16:04.419 INFO:tasks.workunit.client.0.smithi100.stdout:9/869: creat d4/d7/d60/d69/f128 x:0 0 0 2024-04-30T23:16:04.421 INFO:tasks.workunit.client.0.smithi100.stdout:0/973: creat d2/d14/d35/d40/dbe/f122 x:0 0 0 2024-04-30T23:16:04.421 INFO:tasks.workunit.client.0.smithi100.stdout:1/845: mknod d3/d16/c105 0 2024-04-30T23:16:04.422 INFO:tasks.workunit.client.0.smithi100.stdout:9/870: mkdir d4/d7/d8/d37/d58/dd0/deb/d129 0 2024-04-30T23:16:04.423 INFO:tasks.workunit.client.0.smithi100.stdout:9/871: mknod d4/d7/c12a 0 2024-04-30T23:16:04.424 INFO:tasks.workunit.client.0.smithi100.stdout:9/872: readlink d4/d9/d51/d89/le3 0 2024-04-30T23:16:04.424 INFO:tasks.workunit.client.0.smithi100.stdout:0/974: link d2/d50/d30/d32/ca2 d2/d14/d35/d57/d62/c123 0 2024-04-30T23:16:04.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/975: chown d2/fc 66663258 1 2024-04-30T23:16:04.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/976: chown d2/d14/d35/c37 41538 1 2024-04-30T23:16:04.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/977: fdatasync d2/d50/d30/d32/fa9 0 2024-04-30T23:16:04.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/978: fsync d2/d50/d30/d32/dec/ffb 0 2024-04-30T23:16:04.428 INFO:tasks.workunit.client.0.smithi100.stdout:6/891: write d7/db/d3b/f6d [1139308,83578] 0 2024-04-30T23:16:04.429 INFO:tasks.workunit.client.0.smithi100.stdout:9/873: write d4/d9/d8e/f101 [968329,82849] 0 2024-04-30T23:16:04.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/874: unlink d4/d9/d51/d89/cb5 0 2024-04-30T23:16:04.435 INFO:tasks.workunit.client.0.smithi100.stdout:9/875: mkdir d4/d9/d6f/ddb/d12b 0 2024-04-30T23:16:04.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/846: dwrite d3/d16/d20/d24/d69/d63/f91 [0,4194304] 0 2024-04-30T23:16:04.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/847: write d3/d18/f9e [565314,127169] 0 2024-04-30T23:16:04.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/848: fsync d3/d16/d20/f22 0 2024-04-30T23:16:04.445 INFO:tasks.workunit.client.0.smithi100.stdout:1/849: mknod d3/d18/d60/c106 0 2024-04-30T23:16:04.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/850: creat d3/d16/d20/d24/db0/f107 x:0 0 0 2024-04-30T23:16:04.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/851: fsync d3/d16/d20/d24/d69/f9f 0 2024-04-30T23:16:04.448 INFO:tasks.workunit.client.0.smithi100.stdout:1/852: creat d3/dbb/f108 x:0 0 0 2024-04-30T23:16:04.448 INFO:tasks.workunit.client.0.smithi100.stdout:1/853: write d3/f4d [453016,80606] 0 2024-04-30T23:16:04.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/979: dwrite d2/d50/d30/dd4/d11d/dc6/dd2/fee [0,4194304] 0 2024-04-30T23:16:04.453 INFO:tasks.workunit.client.0.smithi100.stdout:6/892: dwrite d7/db/f16 [0,4194304] 0 2024-04-30T23:16:04.456 INFO:tasks.workunit.client.0.smithi100.stdout:0/980: mknod d2/d14/d18/c124 0 2024-04-30T23:16:04.460 INFO:tasks.workunit.client.0.smithi100.stdout:0/981: mkdir d2/d50/d30/dd4/d11d/dd0/d125 0 2024-04-30T23:16:04.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/982: write d2/d14/fca [863284,123233] 0 2024-04-30T23:16:04.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/983: write d2/d50/d38/d6c/f113 [553628,45186] 0 2024-04-30T23:16:04.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/984: fsync d2/d14/d35/f8e 0 2024-04-30T23:16:04.471 INFO:tasks.workunit.client.0.smithi100.stdout:1/854: dwrite d3/d16/d20/d24/faf [0,4194304] 0 2024-04-30T23:16:04.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/985: rename d2/d14/f24 to d2/d50/d38/d6c/f126 0 2024-04-30T23:16:04.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/855: rename d3/d16/d20/d24/dca/l102 to d3/d16/d20/d24/d51/d59/d5f/l109 0 2024-04-30T23:16:04.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/986: mkdir d2/dba/d127 0 2024-04-30T23:16:04.474 INFO:tasks.workunit.client.0.smithi100.stdout:1/856: mkdir d3/d16/d20/d24/db7/d10a 0 2024-04-30T23:16:04.474 INFO:tasks.workunit.client.0.smithi100.stdout:1/857: chown d3/d16/d20/d24/d51/c77 0 1 2024-04-30T23:16:04.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/858: creat d3/d16/d20/d24/d69/d5e/d7a/f10b x:0 0 0 2024-04-30T23:16:04.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/893: dread d7/df/d23/d24/d2e/d37/fb2 [0,4194304] 0 2024-04-30T23:16:04.477 INFO:tasks.workunit.client.0.smithi100.stdout:1/859: rename d3/d16/d20/d24/db7/dbe to d3/dbb/d10c 0 2024-04-30T23:16:04.478 INFO:tasks.workunit.client.0.smithi100.stdout:6/894: creat d7/df/d23/d24/dbf/d11f/f13f x:0 0 0 2024-04-30T23:16:04.485 INFO:tasks.workunit.client.0.smithi100.stdout:1/860: mknod d3/d18/de5/c10d 0 2024-04-30T23:16:04.485 INFO:tasks.workunit.client.0.smithi100.stdout:6/895: creat d7/df/d23/d24/dbf/dcf/f140 x:0 0 0 2024-04-30T23:16:04.485 INFO:tasks.workunit.client.0.smithi100.stdout:1/861: chown d3/d16/d20/d24/d51/d59/d5f/ca8 29140608 1 2024-04-30T23:16:04.485 INFO:tasks.workunit.client.0.smithi100.stdout:1/862: write d3/d16/d20/d24/f5c [9432137,86369] 0 2024-04-30T23:16:04.499 INFO:tasks.workunit.client.0.smithi100.stdout:6/896: dread d7/df/f41 [0,4194304] 0 2024-04-30T23:16:04.500 INFO:tasks.workunit.client.0.smithi100.stdout:6/897: getdents d7/d9/d86/db0 0 2024-04-30T23:16:04.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/898: rmdir d7/d9/d86/d1b/d5a/de2/d98 39 2024-04-30T23:16:04.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/899: chown d7/d9/d86/db0/lf2 0 1 2024-04-30T23:16:04.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/900: readlink d7/d9/d8e/lc0 0 2024-04-30T23:16:04.501 INFO:tasks.workunit.client.0.smithi100.stdout:1/863: dread d3/d16/d20/d24/d69/d5e/df3/f3d [0,4194304] 0 2024-04-30T23:16:04.502 INFO:tasks.workunit.client.0.smithi100.stdout:6/901: creat d7/d9/d86/dc7/f141 x:0 0 0 2024-04-30T23:16:04.503 INFO:tasks.workunit.client.0.smithi100.stdout:1/864: truncate d3/d16/d20/d24/d69/f46 945423 0 2024-04-30T23:16:04.503 INFO:tasks.workunit.client.0.smithi100.stdout:1/865: fsync d3/d16/d20/d24/d69/d63/f91 0 2024-04-30T23:16:04.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/987: dwrite d2/f2e [0,4194304] 0 2024-04-30T23:16:04.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/988: fdatasync d2/d14/d35/d40/dbe/f122 0 2024-04-30T23:16:04.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/989: fsync d2/d14/d18/f29 0 2024-04-30T23:16:04.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/866: creat d3/d16/d20/d24/d69/d5e/df3/f10e x:0 0 0 2024-04-30T23:16:04.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/867: write d3/d16/d20/d24/d69/d63/dfa/fd8 [84577,26366] 0 2024-04-30T23:16:04.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/868: truncate d3/d16/d20/d24/d69/d5e/d7a/f10b 139504 0 2024-04-30T23:16:04.506 INFO:tasks.workunit.client.0.smithi100.stdout:0/990: creat d2/d50/d30/dd4/d11d/f128 x:0 0 0 2024-04-30T23:16:04.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/991: creat d2/d50/d30/dc7/f129 x:0 0 0 2024-04-30T23:16:04.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/992: read d2/d14/d35/d40/f9b [934941,40805] 0 2024-04-30T23:16:04.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/993: readlink d2/d14/d35/d57/d62/laa 0 2024-04-30T23:16:04.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/994: getdents d2/d50/d30/dd4/d11d/dc6/dd2 0 2024-04-30T23:16:04.515 INFO:tasks.workunit.client.0.smithi100.stdout:6/902: write d7/d9/d86/d3e/f4c [3132994,130861] 0 2024-04-30T23:16:04.515 INFO:tasks.workunit.client.0.smithi100.stdout:6/903: dread - d7/d9/d86/d3e/d6b/dc2/f117 zero size 2024-04-30T23:16:04.517 INFO:tasks.workunit.client.0.smithi100.stdout:6/904: rename d7/df/d23/d4f/df4/l114 to d7/d9/d86/d1b/d22/l142 0 2024-04-30T23:16:04.524 INFO:tasks.workunit.client.0.smithi100.stdout:0/995: write d2/f8 [1936253,112006] 0 2024-04-30T23:16:04.525 INFO:tasks.workunit.client.0.smithi100.stdout:1/869: write d3/f2f [3800572,60824] 0 2024-04-30T23:16:04.526 INFO:tasks.workunit.client.0.smithi100.stdout:0/996: rename d2/d14/d35/c8d to d2/d50/d30/dd4/d11d/dd0/c12a 0 2024-04-30T23:16:04.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/870: mknod d3/d16/d20/d24/d69/d5e/df3/dd7/c10f 0 2024-04-30T23:16:04.529 INFO:tasks.workunit.client.0.smithi100.stdout:0/997: mknod d2/d14/d35/c12b 0 2024-04-30T23:16:04.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/871: symlink d3/d16/d20/d24/d69/d63/dcf/l110 0 2024-04-30T23:16:04.531 INFO:tasks.workunit.client.0.smithi100.stdout:0/998: unlink d2/d14/d35/d40/f56 0 2024-04-30T23:16:04.534 INFO:tasks.workunit.client.0.smithi100.stdout:1/872: rename d3/d16/d20/d24/db7/lda to d3/d16/d20/d24/d69/d63/dfa/l111 0 2024-04-30T23:16:04.534 INFO:tasks.workunit.client.0.smithi100.stdout:1/873: chown d3/d16/d20/d24/d69/d5e/d7a 42 1 2024-04-30T23:16:04.534 INFO:tasks.workunit.client.0.smithi100.stdout:1/874: write d3/d16/d20/d24/d51/d59/f73 [1879836,125925] 0 2024-04-30T23:16:04.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/999: unlink d2/d50/d38/d6c/d6e/c79 0 2024-04-30T23:16:04.549 INFO:tasks.workunit.client.0.smithi100.stdout:1/875: truncate d3/d16/d20/d24/faf 3985063 0 2024-04-30T23:16:04.550 INFO:tasks.workunit.client.0.smithi100.stdout:1/876: fdatasync d3/d16/d20/d24/db7/ffe 0 2024-04-30T23:16:04.551 INFO:tasks.workunit.client.0.smithi100.stdout:1/877: creat d3/d16/d20/d24/d69/d63/da9/d103/f112 x:0 0 0 2024-04-30T23:16:04.570 INFO:tasks.workunit.client.0.smithi100.stdout:1/878: dwrite d3/d16/d20/d24/d51/fec [0,4194304] 0 2024-04-30T23:16:04.572 INFO:tasks.workunit.client.0.smithi100.stdout:1/879: mkdir d3/d18/d113 0 2024-04-30T23:16:04.583 INFO:tasks.workunit.client.0.smithi100.stdout:1/880: dread d3/d16/f84 [0,4194304] 0 2024-04-30T23:16:04.584 INFO:tasks.workunit.client.0.smithi100.stdout:1/881: rename d3/d16/d20/d24/d51/d59/l78 to d3/d16/d20/d24/d69/l114 0 2024-04-30T23:16:04.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/882: mknod d3/d16/d20/d24/d69/d5e/df3/d4b/c115 0 2024-04-30T23:16:04.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/883: readlink d3/d16/d20/d24/d51/d59/d5f/l109 0 2024-04-30T23:16:04.587 INFO:tasks.workunit.client.0.smithi100.stdout:1/884: creat d3/d16/d20/d24/d69/d63/f116 x:0 0 0 2024-04-30T23:16:04.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/876: sync 2024-04-30T23:16:04.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/877: symlink d4/d7/d8/d37/d3d/l12c 0 2024-04-30T23:16:04.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/878: read d4/f5e [2957362,54155] 0 2024-04-30T23:16:04.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/879: symlink d4/d9/l12d 0 2024-04-30T23:16:04.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/880: chown d4/d9/d10/db9/dc4/fdf 5094710 1 2024-04-30T23:16:04.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/881: stat d4/d9/d10/f78 0 2024-04-30T23:16:04.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/885: dwrite d3/d16/d20/d24/db7/dbd/ffd [0,4194304] 0 2024-04-30T23:16:04.607 INFO:tasks.workunit.client.0.smithi100.stdout:1/886: mkdir d3/d16/d20/d24/d69/d5e/df3/dd7/d117 0 2024-04-30T23:16:04.607 INFO:tasks.workunit.client.0.smithi100.stdout:1/887: readlink d3/d16/d20/d24/d69/d63/dcf/l110 0 2024-04-30T23:16:04.607 INFO:tasks.workunit.client.0.smithi100.stdout:1/888: stat d3/c12 0 2024-04-30T23:16:04.610 INFO:tasks.workunit.client.0.smithi100.stdout:1/889: creat d3/d16/d20/d24/d69/d5e/f118 x:0 0 0 2024-04-30T23:16:04.611 INFO:tasks.workunit.client.0.smithi100.stdout:1/890: dread - d3/d16/d20/d24/dca/fef zero size 2024-04-30T23:16:04.613 INFO:tasks.workunit.client.0.smithi100.stdout:1/891: unlink d3/d18/d60/f64 0 2024-04-30T23:16:04.613 INFO:tasks.workunit.client.0.smithi100.stdout:1/892: write d3/f5 [2853738,51806] 0 2024-04-30T23:16:04.614 INFO:tasks.workunit.client.0.smithi100.stdout:1/893: mkdir d3/d16/d20/d24/db7/d10a/d119 0 2024-04-30T23:16:04.615 INFO:tasks.workunit.client.0.smithi100.stdout:1/894: creat d3/d16/d20/d24/d69/d5e/df3/dd7/d117/f11a x:0 0 0 2024-04-30T23:16:04.616 INFO:tasks.workunit.client.0.smithi100.stdout:1/895: mknod d3/d16/d20/d24/d69/d5e/df3/dd7/c11b 0 2024-04-30T23:16:04.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/896: chown d3/d18/c75 733028 1 2024-04-30T23:16:04.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/897: chown d3/d16/l4e 24238513 1 2024-04-30T23:16:04.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/898: getdents d3/d16/d20/d24/d69/d5e/d7a 0 2024-04-30T23:16:04.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/899: fsync d3/d16/d20/d24/d51/d59/d5f/db6/ff4 0 2024-04-30T23:16:04.619 INFO:tasks.workunit.client.0.smithi100.stdout:1/900: dread d3/d18/f95 [0,4194304] 0 2024-04-30T23:16:04.620 INFO:tasks.workunit.client.0.smithi100.stdout:1/901: mknod d3/d16/d20/d24/db7/d10a/c11c 0 2024-04-30T23:16:04.623 INFO:tasks.workunit.client.0.smithi100.stdout:9/882: dwrite d4/d9/d10/f4a [4194304,4194304] 0 2024-04-30T23:16:04.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/883: rmdir d4/d9/d51/dfe 39 2024-04-30T23:16:04.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/884: chown d4/d7/d5d/ca8 176 1 2024-04-30T23:16:04.632 INFO:tasks.workunit.client.0.smithi100.stdout:1/902: dread d3/f9 [0,4194304] 0 2024-04-30T23:16:04.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/903: rename d3/d16/d20/d24/d69/d5e/d7a/fed to d3/dbb/f11d 0 2024-04-30T23:16:04.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/904: link d3/fe2 d3/d16/d20/d24/f11e 0 2024-04-30T23:16:04.637 INFO:tasks.workunit.client.0.smithi100.stdout:1/905: creat d3/dbb/d10c/f11f x:0 0 0 2024-04-30T23:16:04.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/906: unlink d3/d16/d20/d24/c100 0 2024-04-30T23:16:04.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/907: readlink d3/d16/d20/l25 0 2024-04-30T23:16:04.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/908: chown d3/d16/d20/d24/d51/f70 103152925 1 2024-04-30T23:16:04.641 INFO:tasks.workunit.client.0.smithi100.stdout:1/909: symlink d3/d16/d20/d24/dca/l120 0 2024-04-30T23:16:04.646 INFO:tasks.workunit.client.0.smithi100.stdout:9/885: dwrite d4/d7/d8/d37/d3d/fe1 [0,4194304] 0 2024-04-30T23:16:04.650 INFO:tasks.workunit.client.0.smithi100.stdout:9/886: getdents d4/d7/d60/d69 0 2024-04-30T23:16:04.657 INFO:tasks.workunit.client.0.smithi100.stdout:1/910: write d3/dbb/dcb/ff6 [442666,117968] 0 2024-04-30T23:16:04.662 INFO:tasks.workunit.client.0.smithi100.stdout:6/905: sync 2024-04-30T23:16:04.668 INFO:tasks.workunit.client.0.smithi100.stdout:9/887: dread d4/f1e [0,4194304] 0 2024-04-30T23:16:04.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/911: dwrite d3/d16/d20/d24/d69/d63/da9/d103/f112 [0,4194304] 0 2024-04-30T23:16:04.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/912: chown d3/d16/d20/d24/d51/d59 73925224 1 2024-04-30T23:16:04.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/913: readlink d3/d16/l6b 0 2024-04-30T23:16:04.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/914: fsync d3/d18/f53 0 2024-04-30T23:16:04.687 INFO:tasks.workunit.client.0.smithi100.stdout:1/915: creat d3/d16/d20/d24/db7/dbd/f121 x:0 0 0 2024-04-30T23:16:04.687 INFO:tasks.workunit.client.0.smithi100.stdout:1/916: stat d3/d18/f95 0 2024-04-30T23:16:04.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/917: creat d3/d16/d20/d24/db0/f122 x:0 0 0 2024-04-30T23:16:04.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/918: rename d3/d18 to d3/d18/d123 22 2024-04-30T23:16:04.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/919: creat d3/d16/d20/d24/d69/d5e/df3/f124 x:0 0 0 2024-04-30T23:16:04.691 INFO:tasks.workunit.client.0.smithi100.stdout:6/906: dwrite d7/d9/d86/d3e/d6b/fbb [0,4194304] 0 2024-04-30T23:16:04.693 INFO:tasks.workunit.client.0.smithi100.stdout:6/907: mkdir d7/d143 0 2024-04-30T23:16:04.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/888: dwrite d4/d7/dab/fe5 [4194304,4194304] 0 2024-04-30T23:16:04.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/889: fsync d4/d9/d10/f7e 0 2024-04-30T23:16:04.694 INFO:tasks.workunit.client.0.smithi100.stdout:6/908: unlink d7/d9/d86/dc7/cd3 0 2024-04-30T23:16:04.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/909: symlink d7/df/d23/d2b/d42/d84/l144 0 2024-04-30T23:16:04.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/910: write d7/d9/d86/d62/fb5 [4306417,100399] 0 2024-04-30T23:16:04.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/911: write d7/f21 [930992,44764] 0 2024-04-30T23:16:04.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/912: readlink d7/db/dd1/df8/l11c 0 2024-04-30T23:16:04.699 INFO:tasks.workunit.client.0.smithi100.stdout:9/890: mkdir d4/d9/d10/d12e 0 2024-04-30T23:16:04.706 INFO:tasks.workunit.client.0.smithi100.stdout:6/913: creat d7/df/d23/d24/d2e/d37/d85/f145 x:0 0 0 2024-04-30T23:16:04.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/914: dread - d7/d9/ff5 zero size 2024-04-30T23:16:04.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/915: rename d7/df/d23/d2b/d42/dd7/l106 to d7/d9/d86/d1b/l146 0 2024-04-30T23:16:04.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/916: chown d7/df/f3c 0 1 2024-04-30T23:16:04.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/917: read d7/d9/d86/d1b/f36 [8224531,31131] 0 2024-04-30T23:16:04.710 INFO:tasks.workunit.client.0.smithi100.stdout:1/920: dwrite d3/d16/d20/d24/d51/f70 [0,4194304] 0 2024-04-30T23:16:04.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/918: write d7/d9/d86/d3e/d6b/d75/f7c [3161688,82605] 0 2024-04-30T23:16:04.726 INFO:tasks.workunit.client.0.smithi100.stdout:9/891: dwrite d4/d7/d8/d37/d58/fe6 [0,4194304] 0 2024-04-30T23:16:04.728 INFO:tasks.workunit.client.0.smithi100.stdout:9/892: creat d4/d9/d51/d89/dbb/d106/f12f x:0 0 0 2024-04-30T23:16:04.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/893: truncate d4/d7/d8/d37/f59 1385298 0 2024-04-30T23:16:04.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/894: link d4/d7/d60/d69/la5 d4/d7/d8/d37/d3d/l130 0 2024-04-30T23:16:04.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/895: dread - d4/d9/d6f/ddb/f10e zero size 2024-04-30T23:16:04.731 INFO:tasks.workunit.client.0.smithi100.stdout:9/896: mkdir d4/d9/d93/dd7/dd9/d131 0 2024-04-30T23:16:04.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/897: creat d4/d7/dab/db4/dbd/d10a/f132 x:0 0 0 2024-04-30T23:16:04.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/898: dread - d4/d7/fb6 zero size 2024-04-30T23:16:04.734 INFO:tasks.workunit.client.0.smithi100.stdout:9/899: mkdir d4/d9/d93/dd7/dd9/d133 0 2024-04-30T23:16:04.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/919: dwrite d7/db/fd0 [0,4194304] 0 2024-04-30T23:16:04.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/920: dread - d7/df/d23/d2b/d42/d87/fe9 zero size 2024-04-30T23:16:04.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/921: fdatasync d7/d9/d86/d3e/d6b/fd2 0 2024-04-30T23:16:04.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/922: creat d7/d9/d86/de5/f147 x:0 0 0 2024-04-30T23:16:04.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/923: rmdir d7/d9/d86/d1b/d22/d38 39 2024-04-30T23:16:04.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/924: chown d7/d9/ff5 19177 1 2024-04-30T23:16:04.750 INFO:tasks.workunit.client.0.smithi100.stdout:6/925: creat d7/d9/d86/d3e/d6b/f148 x:0 0 0 2024-04-30T23:16:04.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/926: stat d7/db/d3b/c4a 0 2024-04-30T23:16:04.753 INFO:tasks.workunit.client.0.smithi100.stdout:6/927: creat d7/d143/f149 x:0 0 0 2024-04-30T23:16:04.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/928: write d7/d9/d86/d3e/d6b/fa9 [589172,130893] 0 2024-04-30T23:16:04.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/929: mkdir d7/df/d23/d24/d2e/d37/d85/de7/d14a 0 2024-04-30T23:16:04.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/930: fdatasync d7/df/d23/d24/f90 0 2024-04-30T23:16:04.755 INFO:tasks.workunit.client.0.smithi100.stdout:6/931: creat d7/df/d23/f14b x:0 0 0 2024-04-30T23:16:04.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/932: dwrite d7/d9/f31 [4194304,4194304] 0 2024-04-30T23:16:04.786 INFO:tasks.workunit.client.0.smithi100.stdout:6/933: dread d7/d9/d86/f107 [0,4194304] 0 2024-04-30T23:16:04.786 INFO:tasks.workunit.client.0.smithi100.stdout:6/934: chown d7/db/f16 25275823 1 2024-04-30T23:16:04.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/935: truncate d7/d11/f116 4764848 0 2024-04-30T23:16:04.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/936: dwrite d7/d9/d8e/f96 [0,4194304] 0 2024-04-30T23:16:04.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/937: fdatasync d7/df/d23/d24/f13a 0 2024-04-30T23:16:04.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/938: fsync d7/db/d3b/f127 0 2024-04-30T23:16:04.809 INFO:tasks.workunit.client.0.smithi100.stdout:6/939: mkdir d7/d9/d86/d1b/d5a/d14c 0 2024-04-30T23:16:04.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/940: mkdir d7/df/d14d 0 2024-04-30T23:16:04.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/941: dwrite d7/d9/d86/d3e/d6b/d75/f11a [0,4194304] 0 2024-04-30T23:16:04.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/942: chown d7/df/d23/d24/d2e/d37/d85/db4/dc6/dd8/l136 23748148 1 2024-04-30T23:16:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:04 smithi104 ceph-mon[32987]: pgmap v447: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 218 MiB/s wr, 344 op/s 2024-04-30T23:16:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:04 smithi183 ceph-mon[33560]: pgmap v447: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 218 MiB/s wr, 344 op/s 2024-04-30T23:16:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:04 smithi100 ceph-mon[29745]: pgmap v447: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 218 MiB/s wr, 344 op/s 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/943: sync 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:1/921: sync 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:9/900: sync 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/944: fdatasync d7/df/d23/d24/dbf/dcf/f140 0 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/945: stat d7/df/lad 0 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:9/901: write d4/d7/d8/fdc [375159,12104] 0 2024-04-30T23:16:05.479 INFO:tasks.workunit.client.0.smithi100.stdout:1/922: write d3/f9 [1424841,123151] 0 2024-04-30T23:16:05.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/923: readlink d3/l65 0 2024-04-30T23:16:05.481 INFO:tasks.workunit.client.0.smithi100.stdout:1/924: creat d3/d18/d113/f125 x:0 0 0 2024-04-30T23:16:05.483 INFO:tasks.workunit.client.0.smithi100.stdout:1/925: mknod d3/d16/d20/d24/d51/d59/d5f/db6/c126 0 2024-04-30T23:16:05.483 INFO:tasks.workunit.client.0.smithi100.stdout:1/926: read d3/d16/d20/d24/d69/d63/f6c [4080123,87171] 0 2024-04-30T23:16:05.484 INFO:tasks.workunit.client.0.smithi100.stdout:1/927: truncate d3/d16/d20/d24/d69/d63/f116 746934 0 2024-04-30T23:16:05.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/928: dread d3/d16/d20/d24/d69/d5e/f8b [0,4194304] 0 2024-04-30T23:16:05.498 INFO:tasks.workunit.client.0.smithi100.stdout:1/929: link d3/d16/d20/l97 d3/d18/d60/l127 0 2024-04-30T23:16:05.505 INFO:tasks.workunit.client.0.smithi100.stdout:6/946: dwrite d7/df/d23/d24/d2e/d37/f9b [0,4194304] 0 2024-04-30T23:16:05.516 INFO:tasks.workunit.client.0.smithi100.stdout:9/902: rename d4/d9/d51/d89/f108 to d4/d9/d10/d7f/d111/f134 0 2024-04-30T23:16:05.517 INFO:tasks.workunit.client.0.smithi100.stdout:9/903: creat d4/d9/d10/d7f/d111/f135 x:0 0 0 2024-04-30T23:16:05.519 INFO:tasks.workunit.client.0.smithi100.stdout:1/930: dwrite d3/d16/d20/d24/f48 [0,4194304] 0 2024-04-30T23:16:05.519 INFO:tasks.workunit.client.0.smithi100.stdout:9/904: mkdir d4/d9/d51/d136 0 2024-04-30T23:16:05.520 INFO:tasks.workunit.client.0.smithi100.stdout:1/931: mknod d3/d18/d60/d87/c128 0 2024-04-30T23:16:05.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/932: rename d3/d16/d20/d24/d69/d63/dcf to d3/d18/de5/d129 0 2024-04-30T23:16:05.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/933: stat d3/d18/d60/d87/f8d 0 2024-04-30T23:16:05.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/934: chown d3/d16/l6b 5428290 1 2024-04-30T23:16:05.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/935: rmdir d3/d16/d20/d24/d69/d5e 39 2024-04-30T23:16:05.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/936: chown d3/d18/d60 139461 1 2024-04-30T23:16:05.523 INFO:tasks.workunit.client.0.smithi100.stdout:1/937: chown d3/d16/d20/d24/d51/c77 11162 1 2024-04-30T23:16:05.526 INFO:tasks.workunit.client.0.smithi100.stdout:9/905: dread d4/d7/d60/d69/f97 [0,4194304] 0 2024-04-30T23:16:05.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/938: dread d3/f6a [0,4194304] 0 2024-04-30T23:16:05.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/939: dread - d3/d16/d20/d24/d69/d5e/df3/f124 zero size 2024-04-30T23:16:05.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/940: write d3/d18/d113/f125 [716958,48590] 0 2024-04-30T23:16:05.529 INFO:tasks.workunit.client.0.smithi100.stdout:1/941: creat d3/d16/d20/d24/f12a x:0 0 0 2024-04-30T23:16:05.529 INFO:tasks.workunit.client.0.smithi100.stdout:1/942: chown d3/d16/d20/d24/f7c 729596 1 2024-04-30T23:16:05.531 INFO:tasks.workunit.client.0.smithi100.stdout:6/947: dwrite d7/df/d23/d24/d2e/f69 [0,4194304] 0 2024-04-30T23:16:05.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/948: mknod d7/c14e 0 2024-04-30T23:16:05.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/949: creat d7/df/d23/d24/d2e/d9f/f14f x:0 0 0 2024-04-30T23:16:05.552 INFO:tasks.workunit.client.0.smithi100.stdout:1/943: dwrite d3/fc3 [0,4194304] 0 2024-04-30T23:16:05.552 INFO:tasks.workunit.client.0.smithi100.stdout:1/944: chown d3/dbb/dcb/dd2 46214466 1 2024-04-30T23:16:05.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/950: dwrite d7/df/d23/d4f/fbd [0,4194304] 0 2024-04-30T23:16:05.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/951: fsync d7/d9/d86/d3e/d6b/dc2/f102 0 2024-04-30T23:16:05.555 INFO:tasks.workunit.client.0.smithi100.stdout:1/945: rename d3/d16/d20/d24/d51/fec to d3/d16/d20/d24/d69/d63/dfa/f12b 0 2024-04-30T23:16:05.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/952: creat d7/d9/d86/de5/f150 x:0 0 0 2024-04-30T23:16:05.559 INFO:tasks.workunit.client.0.smithi100.stdout:1/946: creat d3/d18/d113/f12c x:0 0 0 2024-04-30T23:16:05.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/953: rename d7/d9/d86/de5/f103 to d7/df/d23/d24/d2e/d37/f151 0 2024-04-30T23:16:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/947: symlink d3/d16/d20/d24/d69/d5e/df2/l12d 0 2024-04-30T23:16:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/948: write d3/d18/d113/f12c [552024,112183] 0 2024-04-30T23:16:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/949: chown d3/d18/de5/d129/lde 217347075 1 2024-04-30T23:16:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/950: fdatasync d3/dbb/f108 0 2024-04-30T23:16:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:6/954: symlink d7/df/l152 0 2024-04-30T23:16:05.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/951: symlink d3/d16/d20/d24/dca/l12e 0 2024-04-30T23:16:05.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/952: truncate d3/d16/d20/d24/d51/fe6 814587 0 2024-04-30T23:16:05.566 INFO:tasks.workunit.client.0.smithi100.stdout:1/953: write d3/fe2 [24551,24922] 0 2024-04-30T23:16:05.568 INFO:tasks.workunit.client.0.smithi100.stdout:1/954: unlink d3/d18/d60/l127 0 2024-04-30T23:16:05.569 INFO:tasks.workunit.client.0.smithi100.stdout:1/955: rmdir d3/d16/d20/d24/d51/d59 39 2024-04-30T23:16:05.569 INFO:tasks.workunit.client.0.smithi100.stdout:1/956: readlink d3/d16/d20/d24/d51/l89 0 2024-04-30T23:16:05.569 INFO:tasks.workunit.client.0.smithi100.stdout:1/957: symlink d3/dbb/l12f 0 2024-04-30T23:16:05.571 INFO:tasks.workunit.client.0.smithi100.stdout:1/958: link d3/d16/d20/d24/d69/l76 d3/d16/d20/d24/d69/d63/dfa/l130 0 2024-04-30T23:16:05.572 INFO:tasks.workunit.client.0.smithi100.stdout:1/959: link d3/d18/de5/d129/l110 d3/d16/d20/d24/d69/d5e/df2/l131 0 2024-04-30T23:16:05.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/960: symlink d3/d16/d20/d24/d69/d5e/df3/dd7/l132 0 2024-04-30T23:16:05.574 INFO:tasks.workunit.client.0.smithi100.stdout:1/961: creat d3/d16/d20/d24/d69/d63/dfa/f133 x:0 0 0 2024-04-30T23:16:05.574 INFO:tasks.workunit.client.0.smithi100.stdout:1/962: write d3/d16/d20/f22 [1042609,94281] 0 2024-04-30T23:16:05.574 INFO:tasks.workunit.client.0.smithi100.stdout:1/963: write d3/dbb/f11d [1045705,26564] 0 2024-04-30T23:16:05.575 INFO:tasks.workunit.client.0.smithi100.stdout:1/964: mkdir d3/d16/d20/d24/d69/d5e/df3/d4b/d134 0 2024-04-30T23:16:05.575 INFO:tasks.workunit.client.0.smithi100.stdout:6/955: dread d7/d9/d86/d1b/d5a/fb1 [0,4194304] 0 2024-04-30T23:16:05.577 INFO:tasks.workunit.client.0.smithi100.stdout:1/965: write d3/d16/d20/d24/d69/d63/dfa/fd8 [70743,32192] 0 2024-04-30T23:16:05.577 INFO:tasks.workunit.client.0.smithi100.stdout:1/966: write d3/d16/d20/d24/db0/f107 [319959,128576] 0 2024-04-30T23:16:05.578 INFO:tasks.workunit.client.0.smithi100.stdout:1/967: getdents d3/d16/df9 0 2024-04-30T23:16:05.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/956: rename d7/df/d23/d4f/c123 to d7/df/d23/d24/d2e/d37/d85/db4/dc6/c153 0 2024-04-30T23:16:05.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/957: creat d7/d9/d86/d1b/f154 x:0 0 0 2024-04-30T23:16:05.579 INFO:tasks.workunit.client.0.smithi100.stdout:6/958: creat d7/d143/f155 x:0 0 0 2024-04-30T23:16:05.579 INFO:tasks.workunit.client.0.smithi100.stdout:6/959: read - d7/d9/d86/d1b/d3f/f10f zero size 2024-04-30T23:16:05.591 INFO:tasks.workunit.client.0.smithi100.stdout:6/960: write d7/d9/d86/d3e/d6b/fbb [3313340,49960] 0 2024-04-30T23:16:05.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/968: dwrite d3/dbb/dcb/dd2/fd3 [0,4194304] 0 2024-04-30T23:16:05.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/969: fdatasync d3/d16/d20/d24/d69/d63/da9/fc0 0 2024-04-30T23:16:05.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/970: chown d3/dbb/dcb/dd2/fd3 5809842 1 2024-04-30T23:16:05.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/971: write d3/d16/d20/f22 [1848839,53622] 0 2024-04-30T23:16:05.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/972: creat d3/d16/d20/d24/db0/f135 x:0 0 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/973: dwrite d3/d16/d20/d24/d51/d80/fba [0,4194304] 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/974: write d3/f5 [1905092,80] 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/975: fdatasync d3/d16/d20/d24/d69/f46 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/976: fdatasync d3/d18/f6d 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/977: stat d3/dbb/dcb/dd2/fd3 0 2024-04-30T23:16:05.625 INFO:tasks.workunit.client.0.smithi100.stdout:1/978: fsync d3/d16/d20/f45 0 2024-04-30T23:16:05.628 INFO:tasks.workunit.client.0.smithi100.stdout:1/979: creat d3/d16/d20/d24/d51/d59/d5f/f136 x:0 0 0 2024-04-30T23:16:05.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/980: rename d3/d16/d20/d24/db0/f135 to d3/d18/d60/d87/f137 0 2024-04-30T23:16:05.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/981: read - d3/fe7 zero size 2024-04-30T23:16:05.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/982: readlink d3/d16/d20/d24/d51/d59/d5f/l101 0 2024-04-30T23:16:05.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/983: stat d3/d16/d20/f22 0 2024-04-30T23:16:05.630 INFO:tasks.workunit.client.0.smithi100.stdout:1/984: mknod d3/d16/d20/d24/d69/d5e/df3/dd7/c138 0 2024-04-30T23:16:05.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/985: dread d3/d18/d60/d87/f93 [0,4194304] 0 2024-04-30T23:16:05.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/986: write d3/d16/d20/d24/d69/d63/da9/d103/f112 [4682684,32142] 0 2024-04-30T23:16:05.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/987: mkdir d3/d16/d20/d24/d69/d5e/df3/d4b/d134/d139 0 2024-04-30T23:16:05.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/988: fsync d3/d16/d20/d24/d69/d63/da9/fc0 0 2024-04-30T23:16:05.637 INFO:tasks.workunit.client.0.smithi100.stdout:1/989: unlink d3/d16/d20/d24/d69/d5e/df3/dd7/l132 0 2024-04-30T23:16:05.637 INFO:tasks.workunit.client.0.smithi100.stdout:1/990: chown d3/f5 12813676 1 2024-04-30T23:16:05.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/991: truncate d3/d16/d20/d24/d69/d63/dfa/fee 857658 0 2024-04-30T23:16:05.647 INFO:tasks.workunit.client.0.smithi100.stdout:9/906: sync 2024-04-30T23:16:05.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/907: mknod d4/d7/d8/d37/d58/dd0/deb/c137 0 2024-04-30T23:16:05.649 INFO:tasks.workunit.client.0.smithi100.stdout:9/908: creat d4/d7/d8/d37/d58/f138 x:0 0 0 2024-04-30T23:16:05.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/992: write d3/d18/f5d [100822,111685] 0 2024-04-30T23:16:05.653 INFO:tasks.workunit.client.0.smithi100.stdout:1/993: creat d3/dbb/dcb/dd2/f13a x:0 0 0 2024-04-30T23:16:05.672 INFO:tasks.workunit.client.0.smithi100.stdout:9/909: dwrite d4/fb3 [0,4194304] 0 2024-04-30T23:16:05.674 INFO:tasks.workunit.client.0.smithi100.stdout:9/910: creat d4/d7/dab/db4/f139 x:0 0 0 2024-04-30T23:16:05.674 INFO:tasks.workunit.client.0.smithi100.stdout:9/911: dread - d4/d7/d8/f11e zero size 2024-04-30T23:16:05.674 INFO:tasks.workunit.client.0.smithi100.stdout:9/912: fsync d4/d9/d93/f9c 0 2024-04-30T23:16:05.676 INFO:tasks.workunit.client.0.smithi100.stdout:1/994: dwrite d3/d16/d20/d24/db0/f122 [0,4194304] 0 2024-04-30T23:16:05.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/995: mkdir d3/d16/d20/d24/d13b 0 2024-04-30T23:16:05.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/996: chown d3/de4 5262578 1 2024-04-30T23:16:05.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/997: symlink d3/d16/d20/d24/d69/d5e/d7a/l13c 0 2024-04-30T23:16:05.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/998: rename d3/d18/d60/d87/cc5 to d3/d16/d20/d24/d69/d63/dfa/c13d 0 2024-04-30T23:16:05.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/999: truncate d3/d16/d20/d24/d69/d63/f91 4862243 0 2024-04-30T23:16:05.692 INFO:tasks.workunit.client.0.smithi100.stdout:9/913: dwrite d4/f1e [0,4194304] 0 2024-04-30T23:16:05.694 INFO:tasks.workunit.client.0.smithi100.stdout:9/914: symlink d4/d9/d51/d89/dbb/l13a 0 2024-04-30T23:16:05.698 INFO:tasks.workunit.client.0.smithi100.stdout:6/961: sync 2024-04-30T23:16:05.699 INFO:tasks.workunit.client.0.smithi100.stdout:6/962: link d7/df/d23/d24/lc1 d7/d9/deb/l156 0 2024-04-30T23:16:05.700 INFO:tasks.workunit.client.0.smithi100.stdout:6/963: getdents d7/df/d23 0 2024-04-30T23:16:05.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/915: dwrite d4/d7/f62 [0,4194304] 0 2024-04-30T23:16:05.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/916: readlink d4/d9/d10/db9/lbe 0 2024-04-30T23:16:05.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/917: write d4/d9/d6f/fbf [1393550,17044] 0 2024-04-30T23:16:05.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/964: dwrite d7/df/d23/d24/d2e/f69 [0,4194304] 0 2024-04-30T23:16:05.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/965: fdatasync d7/d9/d8e/f10c 0 2024-04-30T23:16:05.723 INFO:tasks.workunit.client.0.smithi100.stdout:6/966: mknod d7/df/d23/d4f/c157 0 2024-04-30T23:16:05.723 INFO:tasks.workunit.client.0.smithi100.stdout:6/967: read - d7/d9/d86/de5/fe8 zero size 2024-04-30T23:16:05.723 INFO:tasks.workunit.client.0.smithi100.stdout:6/968: chown d7/df/d23/d24/d2e/d37 9 1 2024-04-30T23:16:05.724 INFO:tasks.workunit.client.0.smithi100.stdout:6/969: mkdir d7/d9/d86/d158 0 2024-04-30T23:16:05.726 INFO:tasks.workunit.client.0.smithi100.stdout:6/970: creat d7/df/d23/d24/d2e/d37/d85/db4/dc6/f159 x:0 0 0 2024-04-30T23:16:05.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/918: dwrite d4/d7/f62 [4194304,4194304] 0 2024-04-30T23:16:05.734 INFO:tasks.workunit.client.0.smithi100.stdout:9/919: symlink d4/d7/d8/d37/d58/dd0/l13b 0 2024-04-30T23:16:05.736 INFO:tasks.workunit.client.0.smithi100.stdout:9/920: unlink d4/d9/d93/dd7/c120 0 2024-04-30T23:16:05.737 INFO:tasks.workunit.client.0.smithi100.stdout:9/921: mknod d4/d9/d10/db9/dc4/c13c 0 2024-04-30T23:16:05.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/922: dread d4/d9/d93/fc6 [0,4194304] 0 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/971: dwrite d7/df/f3c [0,4194304] 0 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/972: write d7/d9/d86/d3e/d6b/fb8 [3219335,41907] 0 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/973: readlink d7/df/l10a 0 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/974: dread - d7/df/d23/f14b zero size 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:6/975: chown d7/df/d23/d2b/d42/d84/f93 341033 1 2024-04-30T23:16:05.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/923: read d4/d9/d51/d89/fa9 [313806,33144] 0 2024-04-30T23:16:05.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/924: dwrite d4/d9/d10/fa2 [0,4194304] 0 2024-04-30T23:16:05.773 INFO:tasks.workunit.client.0.smithi100.stdout:6/976: dwrite d7/df/d23/d4f/ff1 [0,4194304] 0 2024-04-30T23:16:05.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/925: stat d4/d9/d10/f7e 0 2024-04-30T23:16:05.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/926: chown d4/d9/d51/dfe/cb8 39 1 2024-04-30T23:16:05.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/927: fdatasync d4/d9/d10/f7e 0 2024-04-30T23:16:05.774 INFO:tasks.workunit.client.0.smithi100.stdout:6/977: write d7/db/d3b/f83 [493010,99094] 0 2024-04-30T23:16:05.775 INFO:tasks.workunit.client.0.smithi100.stdout:9/928: truncate d4/d7/d8/d37/f65 224649 0 2024-04-30T23:16:05.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/978: mknod d7/d9/d86/d1b/d22/d38/c15a 0 2024-04-30T23:16:05.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/979: readlink d7/d9/d8e/lc0 0 2024-04-30T23:16:05.777 INFO:tasks.workunit.client.0.smithi100.stdout:9/929: symlink d4/d7/dab/db4/dbd/d10a/l13d 0 2024-04-30T23:16:05.778 INFO:tasks.workunit.client.0.smithi100.stdout:6/980: getdents d7/d9/d86/de5 0 2024-04-30T23:16:05.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/930: rmdir d4/d9 39 2024-04-30T23:16:05.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/931: fdatasync d4/d7/f62 0 2024-04-30T23:16:05.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/932: dread - d4/d9/d10/db9/f126 zero size 2024-04-30T23:16:05.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/981: truncate d7/df/d23/d24/d2e/d9f/f12c 644325 0 2024-04-30T23:16:05.781 INFO:tasks.workunit.client.0.smithi100.stdout:9/933: creat d4/d9/d6f/ddb/f13e x:0 0 0 2024-04-30T23:16:05.783 INFO:tasks.workunit.client.0.smithi100.stdout:9/934: mknod d4/d9/d51/d89/c13f 0 2024-04-30T23:16:05.784 INFO:tasks.workunit.client.0.smithi100.stdout:9/935: mknod d4/d7/c140 0 2024-04-30T23:16:05.785 INFO:tasks.workunit.client.0.smithi100.stdout:9/936: link d4/f68 d4/d7/d8/d37/df9/f141 0 2024-04-30T23:16:05.787 INFO:tasks.workunit.client.0.smithi100.stdout:9/937: symlink d4/d7/da7/l142 0 2024-04-30T23:16:05.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/938: mkdir d4/d7/d143 0 2024-04-30T23:16:05.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/939: getdents d4/d7/d8/d37/d58/dd0/deb 0 2024-04-30T23:16:05.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/940: write d4/f68 [877475,7524] 0 2024-04-30T23:16:05.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/941: chown d4/d7/d60/d69/f97 21378151 1 2024-04-30T23:16:05.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/942: chown d4/d7/d8/d19/f4e 0 1 2024-04-30T23:16:05.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/943: write d4/d9/d10/d7f/d111/d127/f118 [701928,37651] 0 2024-04-30T23:16:05.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/944: rmdir d4/d9/d51/d89/dbb/dcc 39 2024-04-30T23:16:05.792 INFO:tasks.workunit.client.0.smithi100.stdout:6/982: read d7/db/f5c [3252506,70536] 0 2024-04-30T23:16:05.807 INFO:tasks.workunit.client.0.smithi100.stdout:9/945: dread d4/d7/d8/d37/d3d/fe1 [0,4194304] 0 2024-04-30T23:16:05.809 INFO:tasks.workunit.client.0.smithi100.stdout:9/946: symlink d4/d7/d8/d37/l144 0 2024-04-30T23:16:05.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/947: dwrite d4/d9/d10/f28 [0,4194304] 0 2024-04-30T23:16:05.835 INFO:tasks.workunit.client.0.smithi100.stdout:9/948: dread d4/d9/d10/d7f/fa6 [4194304,4194304] 0 2024-04-30T23:16:05.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/949: symlink d4/d9/l145 0 2024-04-30T23:16:05.837 INFO:tasks.workunit.client.0.smithi100.stdout:9/950: mkdir d4/d9/d10/db9/dc4/dda/d146 0 2024-04-30T23:16:05.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/983: sync 2024-04-30T23:16:05.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/984: dread d7/d9/d86/d1b/d5a/de2/d98/fa2 [0,4194304] 0 2024-04-30T23:16:05.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/985: stat d7/d9/d86/d62/c9c 0 2024-04-30T23:16:05.930 INFO:tasks.workunit.client.0.smithi100.stdout:6/986: unlink d7/df/l152 0 2024-04-30T23:16:05.931 INFO:tasks.workunit.client.0.smithi100.stdout:6/987: mknod d7/df/d23/d24/d2e/d37/d85/db4/c15b 0 2024-04-30T23:16:05.932 INFO:tasks.workunit.client.0.smithi100.stdout:6/988: chown d7/d9/d86/d1b/l146 165 1 2024-04-30T23:16:05.932 INFO:tasks.workunit.client.0.smithi100.stdout:6/989: mknod d7/d9/c15c 0 2024-04-30T23:16:06.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/951: sync 2024-04-30T23:16:06.008 INFO:tasks.workunit.client.0.smithi100.stdout:9/952: creat d4/d7/dab/db4/dbd/f147 x:0 0 0 2024-04-30T23:16:06.008 INFO:tasks.workunit.client.0.smithi100.stdout:9/953: truncate d4/d9/d10/db9/dc4/fdf 4778967 0 2024-04-30T23:16:06.009 INFO:tasks.workunit.client.0.smithi100.stdout:9/954: symlink d4/d9/d8e/l148 0 2024-04-30T23:16:06.009 INFO:tasks.workunit.client.0.smithi100.stdout:9/955: fdatasync d4/d9/d6f/f90 0 2024-04-30T23:16:06.010 INFO:tasks.workunit.client.0.smithi100.stdout:9/956: symlink d4/d9/d51/d89/dbb/d106/l149 0 2024-04-30T23:16:06.011 INFO:tasks.workunit.client.0.smithi100.stdout:9/957: creat d4/d9/d51/d136/f14a x:0 0 0 2024-04-30T23:16:06.029 INFO:tasks.workunit.client.0.smithi100.stdout:9/958: dwrite d4/d7/d8/f11e [0,4194304] 0 2024-04-30T23:16:06.031 INFO:tasks.workunit.client.0.smithi100.stdout:9/959: getdents d4/d9/d10 0 2024-04-30T23:16:06.032 INFO:tasks.workunit.client.0.smithi100.stdout:9/960: rmdir d4/d7/d8/d37/d58 39 2024-04-30T23:16:06.034 INFO:tasks.workunit.client.0.smithi100.stdout:9/961: creat d4/d9/d93/dd7/dd9/d133/f14b x:0 0 0 2024-04-30T23:16:06.034 INFO:tasks.workunit.client.0.smithi100.stdout:9/962: fsync d4/d9/f16 0 2024-04-30T23:16:06.114 INFO:tasks.workunit.client.0.smithi100.stdout:6/990: sync 2024-04-30T23:16:06.133 INFO:tasks.workunit.client.0.smithi100.stdout:6/991: dwrite d7/df/d23/d2b/d42/fdf [0,4194304] 0 2024-04-30T23:16:06.134 INFO:tasks.workunit.client.0.smithi100.stdout:9/963: sync 2024-04-30T23:16:06.135 INFO:tasks.workunit.client.0.smithi100.stdout:6/992: getdents d7/db/d3b 0 2024-04-30T23:16:06.136 INFO:tasks.workunit.client.0.smithi100.stdout:9/964: rename d4/d9/d10/f28 to d4/d9/d93/dd7/dd9/f14c 0 2024-04-30T23:16:06.136 INFO:tasks.workunit.client.0.smithi100.stdout:9/965: fsync d4/d7/d8/f4d 0 2024-04-30T23:16:06.137 INFO:tasks.workunit.client.0.smithi100.stdout:6/993: rmdir d7/d9/d86 39 2024-04-30T23:16:06.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/966: link d4/d7/l21 d4/d9/d10/db9/l14d 0 2024-04-30T23:16:06.139 INFO:tasks.workunit.client.0.smithi100.stdout:9/967: link d4/d7/d8/d37/f59 d4/d7/d5d/f14e 0 2024-04-30T23:16:06.142 INFO:tasks.workunit.client.0.smithi100.stdout:9/968: dread d4/d7/d8/fdc [0,4194304] 0 2024-04-30T23:16:06.142 INFO:tasks.workunit.client.0.smithi100.stdout:9/969: chown d4/d7/d8/d37/d58/dd0/deb 194659611 1 2024-04-30T23:16:06.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/970: link d4/f52 d4/d9/d51/f14f 0 2024-04-30T23:16:06.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/971: creat d4/d7/d60/d69/f150 x:0 0 0 2024-04-30T23:16:06.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/972: truncate d4/d9/d10/f7e 6378225 0 2024-04-30T23:16:06.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/973: write d4/d7/d60/fad [3069793,78979] 0 2024-04-30T23:16:06.160 INFO:tasks.workunit.client.0.smithi100.stdout:6/994: dwrite d7/d9/f31 [4194304,4194304] 0 2024-04-30T23:16:06.161 INFO:tasks.workunit.client.0.smithi100.stdout:6/995: unlink d7/df/d23/d24/d2e/d37/fdc 0 2024-04-30T23:16:06.163 INFO:tasks.workunit.client.0.smithi100.stdout:9/974: dread d4/d9/d93/f11d [0,4194304] 0 2024-04-30T23:16:06.164 INFO:tasks.workunit.client.0.smithi100.stdout:9/975: creat d4/d9/d51/f151 x:0 0 0 2024-04-30T23:16:06.173 INFO:tasks.workunit.client.0.smithi100.stdout:6/996: dread d7/df/d23/d24/f90 [0,4194304] 0 2024-04-30T23:16:06.175 INFO:tasks.workunit.client.0.smithi100.stdout:6/997: mknod d7/df/d23/d24/dbf/c15d 0 2024-04-30T23:16:06.175 INFO:tasks.workunit.client.0.smithi100.stdout:6/998: truncate d7/df/d23/d24/d2e/f12a 775004 0 2024-04-30T23:16:06.176 INFO:tasks.workunit.client.0.smithi100.stdout:6/999: mkdir d7/d9/d86/d3e/d104/d15e 0 2024-04-30T23:16:06.184 INFO:tasks.workunit.client.0.smithi100.stdout:9/976: dwrite d4/d9/d10/d7f/fce [0,4194304] 0 2024-04-30T23:16:06.184 INFO:tasks.workunit.client.0.smithi100.stdout:9/977: stat d4/d7/d60/d69/f10d 0 2024-04-30T23:16:06.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/978: dread d4/d7/d8/d37/f4b [0,4194304] 0 2024-04-30T23:16:06.196 INFO:tasks.workunit.client.0.smithi100.stdout:9/979: creat d4/d9/d10/d7f/d111/d127/f152 x:0 0 0 2024-04-30T23:16:06.197 INFO:tasks.workunit.client.0.smithi100.stdout:9/980: symlink d4/d9/d51/d89/l153 0 2024-04-30T23:16:06.197 INFO:tasks.workunit.client.0.smithi100.stdout:9/981: readlink d4/l56 0 2024-04-30T23:16:06.198 INFO:tasks.workunit.client.0.smithi100.stdout:9/982: rmdir d4/d9/d10/db9/dc4/dda/d146 0 2024-04-30T23:16:06.199 INFO:tasks.workunit.client.0.smithi100.stdout:9/983: creat d4/d113/f154 x:0 0 0 2024-04-30T23:16:06.199 INFO:tasks.workunit.client.0.smithi100.stdout:9/984: write d4/d9/d10/d7f/f95 [3594901,100677] 0 2024-04-30T23:16:06.217 INFO:tasks.workunit.client.0.smithi100.stdout:9/985: dwrite d4/d7/dab/db4/dbd/f147 [0,4194304] 0 2024-04-30T23:16:06.239 INFO:tasks.workunit.client.0.smithi100.stdout:9/986: dwrite d4/d9/d10/d7f/d111/d127/f152 [0,4194304] 0 2024-04-30T23:16:06.239 INFO:tasks.workunit.client.0.smithi100.stdout:9/987: fsync d4/d7/d8/d37/f6c 0 2024-04-30T23:16:06.241 INFO:tasks.workunit.client.0.smithi100.stdout:9/988: creat d4/d7/d8/d37/d58/dd0/deb/f155 x:0 0 0 2024-04-30T23:16:06.242 INFO:tasks.workunit.client.0.smithi100.stdout:9/989: fdatasync d4/d9/d50/faa 0 2024-04-30T23:16:06.242 INFO:tasks.workunit.client.0.smithi100.stdout:9/990: readlink d4/d7/l31 0 2024-04-30T23:16:06.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/991: write d4/d9/d6f/f90 [958220,94452] 0 2024-04-30T23:16:06.268 INFO:tasks.workunit.client.0.smithi100.stdout:9/992: dread d4/d9/d10/f4a [0,4194304] 0 2024-04-30T23:16:06.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/993: creat d4/d7/d8/d37/f156 x:0 0 0 2024-04-30T23:16:06.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/994: readlink d4/d7/d8/d37/d58/lea 0 2024-04-30T23:16:06.290 INFO:tasks.workunit.client.0.smithi100.stdout:9/995: dwrite d4/d9/d51/d89/fa9 [0,4194304] 0 2024-04-30T23:16:06.307 INFO:tasks.workunit.client.0.smithi100.stdout:9/996: dwrite d4/d9/d51/f151 [0,4194304] 0 2024-04-30T23:16:06.333 INFO:tasks.workunit.client.0.smithi100.stdout:9/997: dwrite d4/d9/d10/d7f/f95 [0,4194304] 0 2024-04-30T23:16:06.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/998: stat d4/d7/l31 0 2024-04-30T23:16:06.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/999: chown d4/d7/d8/d37/d3d/fe1 0 1 2024-04-30T23:16:06.339 INFO:tasks.workunit.client.0.smithi100.stderr:+ rm -rf -- ./tmp.kNdu7RDsyW 2024-04-30T23:16:07.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:06 smithi104 ceph-mon[32987]: pgmap v448: 129 pgs: 129 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 207 MiB/s rd, 269 MiB/s wr, 334 op/s 2024-04-30T23:16:07.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:06 smithi183 ceph-mon[33560]: pgmap v448: 129 pgs: 129 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 207 MiB/s rd, 269 MiB/s wr, 334 op/s 2024-04-30T23:16:07.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:06 smithi100 ceph-mon[29745]: pgmap v448: 129 pgs: 129 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 207 MiB/s rd, 269 MiB/s wr, 334 op/s 2024-04-30T23:16:09.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:08 smithi104 ceph-mon[32987]: pgmap v449: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 238 MiB/s wr, 332 op/s 2024-04-30T23:16:09.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:08 smithi183 ceph-mon[33560]: pgmap v449: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 238 MiB/s wr, 332 op/s 2024-04-30T23:16:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:08 smithi100 ceph-mon[29745]: pgmap v449: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 238 MiB/s wr, 332 op/s 2024-04-30T23:16:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:10 smithi104 ceph-mon[32987]: pgmap v450: 129 pgs: 129 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 180 MiB/s rd, 223 MiB/s wr, 338 op/s 2024-04-30T23:16:11.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:10 smithi183 ceph-mon[33560]: pgmap v450: 129 pgs: 129 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 180 MiB/s rd, 223 MiB/s wr, 338 op/s 2024-04-30T23:16:11.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:10 smithi100 ceph-mon[29745]: pgmap v450: 129 pgs: 129 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 180 MiB/s rd, 223 MiB/s wr, 338 op/s 2024-04-30T23:16:12.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:16:12.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:16:12.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- 172.21.15.100:0/3197291982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d01097c0 msgr2=0x7f72d010bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 --2- 172.21.15.100:0/3197291982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d01097c0 0x7f72d010bcd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009ca0 tx=0x7f72c802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- 172.21.15.100:0/3197291982 shutdown_connections 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 --2- 172.21.15.100:0/3197291982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d01097c0 0x7f72d010bcd0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 --2- 172.21.15.100:0/3197291982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d0106c50 0x7f72d0109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 --2- 172.21.15.100:0/3197291982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d0102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- 172.21.15.100:0/3197291982 >> 172.21.15.100:0/3197291982 conn(0x7f72d00fd380 msgr2=0x7f72d00ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- 172.21.15.100:0/3197291982 shutdown_connections 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- 172.21.15.100:0/3197291982 wait complete. 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 Processor -- start 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.303+0000 7f72d62d8640 1 -- start start 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d01097c0 0x7f72d01a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72d010f630 con 0x7f72d0106c50 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72d010f4b0 con 0x7f72d01097c0 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d62d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f72d010f7b0 con 0x7f72d0101e70 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56038/0 (socket says 172.21.15.100:56038) 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 -- 172.21.15.100:0/2455524106 learned_addr learned my addr 172.21.15.100:0/2455524106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72d4875640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d01097c0 0x7f72d01a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 -- 172.21.15.100:0/2455524106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 msgr2=0x7f72d019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 -- 172.21.15.100:0/2455524106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d01097c0 msgr2=0x7f72d01a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d01097c0 0x7f72d01a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 -- 172.21.15.100:0/2455524106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01a1d10 con 0x7f72d0106c50 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cffff640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.304+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e9f0 tx=0x7f72c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.305+0000 7f72cd7fa640 1 -- 172.21.15.100:0/2455524106 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c400cd80 con 0x7f72d0106c50 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.305+0000 7f72cd7fa640 1 -- 172.21.15.100:0/2455524106 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c40108e0 con 0x7f72d0106c50 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.305+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d01a1fa0 con 0x7f72d0106c50 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.305+0000 7f72cd7fa640 1 -- 172.21.15.100:0/2455524106 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4018980 con 0x7f72d0106c50 2024-04-30T23:16:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.305+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d01a2490 con 0x7f72d0106c50 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 Processor -- start 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 -- start start 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72cd7fa640 1 -- 172.21.15.100:0/2455524106 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f72c4018b20 con 0x7f72d0106c50 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 0x55a647cd84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647cd9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a647befb10 con 0x55a64790d4d0 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a647c3cd80 con 0x55a647936390 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.307+0000 7f72dd188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a647bf68b0 con 0x55a6479156b0 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56042/0 (socket says 172.21.15.100:56042) 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 -- 172.21.15.100:0/2024511345 learned_addr learned my addr 172.21.15.100:0/2024511345 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647cd9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72d4875640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 0x55a647cd84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 -- 172.21.15.100:0/2024511345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 msgr2=0x55a647cd9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647cd9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 -- 172.21.15.100:0/2024511345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 msgr2=0x55a647cd84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 0x55a647cd84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 -- 172.21.15.100:0/2024511345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a647bc7a40 con 0x55a64790d4d0 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72d4875640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 0x55a647cd84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cd7fa640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 0x7f72b80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cffff640 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f72c00114f0 tx=0x7f72c00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbacae22dd2fa4f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72d4875640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 0x7f72b80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72cd7fa640 1 -- 172.21.15.100:0/2455524106 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f72c40d0a90 con 0x7f72d0106c50 2024-04-30T23:16:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72b67fc640 1 -- 172.21.15.100:0/2024511345 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c001e070 con 0x55a64790d4d0 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72b67fc640 1 -- 172.21.15.100:0/2024511345 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c00035f0 con 0x55a64790d4d0 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.308+0000 7f72b67fc640 1 -- 172.21.15.100:0/2024511345 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c000f7c0 con 0x55a64790d4d0 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- 172.21.15.100:0/2024511345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 msgr2=0x55a647cd8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f72c00114f0 tx=0x7f72c00119b0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72d4875640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 0x7f72b80a60c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f72c802f500 tx=0x7f72c802f310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- 172.21.15.100:0/2024511345 shutdown_connections 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647cd9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647cd8a70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 --2- 172.21.15.100:0/2024511345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a647936390 0x55a647cd84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- 172.21.15.100:0/2024511345 >> 172.21.15.100:0/2024511345 conn(0x55a64792a4e0 msgr2=0x55a647cd3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- 172.21.15.100:0/2024511345 shutdown_connections 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- 172.21.15.100:0/2024511345 wait complete. 2024-04-30T23:16:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.309+0000 7f72dd188740 1 -- start start 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 Processor -- start 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a647936390 0x55a647ce9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a647bc3d10 con 0x55a64790d4d0 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a647c38d40 con 0x55a6479156b0 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a647cda210 con 0x55a647936390 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72dd188740 10 client.0 _ll_register_callbacks cb 0x55a647c49d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56044/0 (socket says 172.21.15.100:56044) 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 -- 172.21.15.100:0/3944901310 learned_addr learned my addr 172.21.15.100:0/3944901310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72d4875640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a647936390 0x55a647ce9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 -- 172.21.15.100:0/3944901310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a647936390 msgr2=0x55a647ce9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a647936390 0x55a647ce9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 -- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 msgr2=0x55a647ce2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cffff640 1 -- 172.21.15.100:0/3944901310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a647a187d0 con 0x55a64790d4d0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.310+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72cffff640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72c0011eb0 tx=0x7f72c0003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a3ae67cd920820 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c001e040 con 0x55a64790d4d0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c00035f0 con 0x55a64790d4d0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f72c0005040 con 0x55a64790d4d0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72c0032050 con 0x55a64790d4d0 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 10 client.16332 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:12.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a64794e3f0 con 0x55a64790d4d0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c00035f0 con 0x55a64790d4d0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f72c0021030 con 0x55a64790d4d0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 10 client.16332 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.311+0000 7f72dd188740 20 client.16332 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478f4f60 0x55a647cefab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72dd188740 4 client.16332 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a647c4a990 con 0x55a6478f4f60 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478f4f60 0x55a647cefab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72af7fe640 10 client.16332 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.312+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478f4f60 0x55a647cefab0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c6a0dde3bf7795 server_cookie=bac05349e639be24 in_seq=0 out_seq=0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72af7fe640 1 -- 172.21.15.100:0/3944901310 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55a647c4a990 con 0x55a6478f4f60 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72af7fe640 10 client.16332 handle_command_reply: tid=0 2024-04-30T23:16:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 client.16332 shutdown 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 msgr2=0x55a647ce22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72c0011eb0 tx=0x7f72c0003a50 comp rx=0 tx=0).stop 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 shutdown_connections 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478f4f60 0x55a647cefab0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a647936390 0x55a647ce9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72af7fe640 0 client.16332 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 --2- 172.21.15.100:0/3944901310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a64790d4d0 0x55a647ce22f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 >> 172.21.15.100:0/3944901310 conn(0x55a64792a4e0 msgr2=0x55a647cd6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 shutdown_connections 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 1 -- 172.21.15.100:0/3944901310 wait complete. 2024-04-30T23:16:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.313+0000 7f72dd188740 20 client.16332 trim_cache size 0 max 16384 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 Processor -- start 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 -- start start 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a64790d4d0 0x55a647ce28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647ce0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ac930 con 0x55a647936390 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ae530 con 0x55a64790d4d0 2024-04-30T23:16:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72dd188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ad000 con 0x55a6479156b0 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56048/0 (socket says 172.21.15.100:56048) 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 -- 172.21.15.100:0/602312253 learned_addr learned my addr 172.21.15.100:0/602312253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647ce0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72cffff640 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a64790d4d0 0x55a647ce28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 -- 172.21.15.100:0/602312253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 msgr2=0x55a647ce0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647ce0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 -- 172.21.15.100:0/602312253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a64790d4d0 msgr2=0x55a647ce28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.331+0000 7f72d4875640 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a64790d4d0 0x55a647ce28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.332+0000 7f72d4875640 1 -- 172.21.15.100:0/602312253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a64790e0f0 con 0x55a647936390 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.332+0000 7f72d4875640 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f72c8035000 tx=0x7f72c8044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d423e2a32f5c5635 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.332+0000 7f72b5ffb640 1 -- 172.21.15.100:0/602312253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8004040 con 0x55a647936390 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.332+0000 7f72b5ffb640 1 -- 172.21.15.100:0/602312253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c8036050 con 0x55a647936390 2024-04-30T23:16:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.332+0000 7f72b5ffb640 1 -- 172.21.15.100:0/602312253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c802fc90 con 0x55a647936390 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- 172.21.15.100:0/602312253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 msgr2=0x55a647ce96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f72c8035000 tx=0x7f72c8044000 comp rx=0 tx=0).stop 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- 172.21.15.100:0/602312253 shutdown_connections 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce96b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6479156b0 0x55a647ce0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- 172.21.15.100:0/602312253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a64790d4d0 0x55a647ce28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- 172.21.15.100:0/602312253 >> 172.21.15.100:0/602312253 conn(0x55a64792a4e0 msgr2=0x55a647cd6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- 172.21.15.100:0/602312253 shutdown_connections 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- 172.21.15.100:0/602312253 wait complete. 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 -- start start 2024-04-30T23:16:12.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 Processor -- start 2024-04-30T23:16:12.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 0x55a647ce8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.333+0000 7f72dd188740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01adda0 con 0x55a647936390 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ad6d0 con 0x55a6479156b0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01aa910 con 0x55a64790d4d0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 10 client.0 _ll_register_callbacks cb 0x7f72c001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72cffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 0x55a647ce8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72cffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 0x55a647ce8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:57322/0 (socket says 172.21.15.100:57322) 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56054/0 (socket says 172.21.15.100:56054) 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72cffff640 1 -- 172.21.15.100:0/53204042 learned_addr learned my addr 172.21.15.100:0/53204042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 -- 172.21.15.100:0/53204042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 msgr2=0x55a647ce8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 0x55a647ce8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 -- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 msgr2=0x55a647ce87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 -- 172.21.15.100:0/53204042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a647bfd4b0 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72cf7fe640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72d4875640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72c8043040 tx=0x7f72c802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696f5918f4c9409f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c805b070 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f72c802fe20 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c8036050 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.334+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72c8066050 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 10 client.16338 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a647d54fe0 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c8036050 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f72c8030930 con 0x55a647936390 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 10 client.16338 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 20 client.16338 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478ca3a0 0x55a647d57a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 4 client.16338 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a647c44800 con 0x55a6478ca3a0 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72cffff640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478ca3a0 0x55a647d57a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.335+0000 7f72af7fe640 10 client.16338 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72cffff640 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478ca3a0 0x55a647d57a40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab41a44b980edd2e server_cookie=5ea3c537a94411dd in_seq=0 out_seq=0 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72af7fe640 1 -- 172.21.15.100:0/53204042 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55a647c44800 con 0x55a6478ca3a0 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72af7fe640 10 client.16338 handle_command_reply: tid=0 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 client.16338 shutdown 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 msgr2=0x55a647ce8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72c8043040 tx=0x7f72c802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 shutdown_connections 2024-04-30T23:16:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a6478ca3a0 0x55a647d57a40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a647936390 0x55a647ce8d30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6479156b0 0x55a647ce87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72af7fe640 0 client.16338 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 --2- 172.21.15.100:0/53204042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a64790d4d0 0x55a647ce8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 >> 172.21.15.100:0/53204042 conn(0x55a64792a4e0 msgr2=0x55a647ce2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 shutdown_connections 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 1 -- 172.21.15.100:0/53204042 wait complete. 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.336+0000 7f72dd188740 20 client.16338 trim_cache size 0 max 16384 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:16:12.344 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {}, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:12.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:16:12.346 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:12.348 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:12.348 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:12.348 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 msgr2=0x7f72b80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 0x7f72b80a60c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f72c802f500 tx=0x7f72c802f310 comp rx=0 tx=0).stop 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 msgr2=0x7f72d019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e9f0 tx=0x7f72c400eeb0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 shutdown_connections 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f72b80a3bb0 0x7f72b80a60c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72d01097c0 0x7f72d01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72d0106c50 0x7f72d019a710 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 --2- 172.21.15.100:0/2455524106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72d0101e70 0x7f72d019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 >> 172.21.15.100:0/2455524106 conn(0x7f72d00fd380 msgr2=0x7f72d0107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 shutdown_connections 2024-04-30T23:16:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.337+0000 7f72d62d8640 1 -- 172.21.15.100:0/2455524106 wait complete. 2024-04-30T23:16:12.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T23:16:12.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:16:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 -- 172.21.15.100:0/855739308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 msgr2=0x7f8410105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 --2- 172.21.15.100:0/855739308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f8410105510 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8400009900 tx=0x7f840002a410 comp rx=0 tx=0).stop 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 -- 172.21.15.100:0/855739308 shutdown_connections 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 --2- 172.21.15.100:0/855739308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841010bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 --2- 172.21.15.100:0/855739308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 0x7f8410101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 --2- 172.21.15.100:0/855739308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f8410105510 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 -- 172.21.15.100:0/855739308 >> 172.21.15.100:0/855739308 conn(0x7f84100fd3d0 msgr2=0x7f84100ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 -- 172.21.15.100:0/855739308 shutdown_connections 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.464+0000 7f84163a5640 1 -- 172.21.15.100:0/855739308 wait complete. 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 Processor -- start 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 -- start start 2024-04-30T23:16:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 0x7f841019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f841010f670 con 0x7f8410105100 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f841010f4f0 con 0x7f84101022b0 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f84163a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f841010f7f0 con 0x7f84101017b0 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f8414942640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f840ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 0x7f841019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.465+0000 7f8414942640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56064/0 (socket says 172.21.15.100:56064) 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 -- 172.21.15.100:0/4204387009 learned_addr learned my addr 172.21.15.100:0/4204387009 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f840f7fe640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 -- 172.21.15.100:0/4204387009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 msgr2=0x7f841019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 0x7f841019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 -- 172.21.15.100:0/4204387009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 msgr2=0x7f841019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 -- 172.21.15.100:0/4204387009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84101a1db0 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f840f7fe640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f8414942640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f840800eb10 tx=0x7f840800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408004b20 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8408004cc0 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84101a20a0 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408010670 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.466+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84101a25a0 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.467+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8410108a90 con 0x7f8410105100 2024-04-30T23:16:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.468+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8408005020 con 0x7f8410105100 2024-04-30T23:16:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.469+0000 7f840d7fa640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 0x7f83f80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.469+0000 7f840ffff640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 0x7f83f80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.469+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f84080d0d10 con 0x7f8410105100 2024-04-30T23:16:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.469+0000 7f840ffff640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 0x7f83f80a60c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8400005ab0 tx=0x7f8400031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.474+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f840809d390 con 0x7f8410105100 2024-04-30T23:16:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.710+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f841002db90 con 0x7f8410105100 2024-04-30T23:16:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.711+0000 7f840d7fa640 1 -- 172.21.15.100:0/4204387009 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11963 (secure 0 0 0) 0x7f840809cc90 con 0x7f8410105100 2024-04-30T23:16:12.712 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:16:12.712 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:15:18.986989+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:16:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 31 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 msgr2=0x7f83f80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 0x7f83f80a60c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8400005ab0 tx=0x7f8400031400 comp rx=0 tx=0).stop 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 msgr2=0x7f84101a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f840800eb10 tx=0x7f840800c2d0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 shutdown_connections 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f83f80a3bb0 0x7f83f80a60c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410105100 0x7f84101a1740 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84101022b0 0x7f841019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 --2- 172.21.15.100:0/4204387009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84101017b0 0x7f841019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 >> 172.21.15.100:0/4204387009 conn(0x7f84100fd3d0 msgr2=0x7f8410105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 shutdown_connections 2024-04-30T23:16:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.713+0000 7f84163a5640 1 -- 172.21.15.100:0/4204387009 wait complete. 2024-04-30T23:16:12.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-30T23:16:12.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 -- 172.21.15.100:0/441460961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8102a20 msgr2=0x7f67b8103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/441460961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8102a20 0x7f67b8103720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009860 tx=0x7f67a802a340 comp rx=0 tx=0).stop 2024-04-30T23:16:12.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 -- 172.21.15.100:0/441460961 shutdown_connections 2024-04-30T23:16:12.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/441460961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8108960 0x7f67b810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/441460961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/441460961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8102a20 0x7f67b8103720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 -- 172.21.15.100:0/441460961 >> 172.21.15.100:0/441460961 conn(0x7f67b80fdc10 msgr2=0x7f67b81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 -- 172.21.15.100:0/441460961 shutdown_connections 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 -- 172.21.15.100:0/441460961 wait complete. 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.840+0000 7f67bdb3f640 1 Processor -- start 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 -- start start 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8102a20 0x7f67b8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8108960 0x7f67b81a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810e520 con 0x7f67b8103c60 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810e3a0 con 0x7f67b8108960 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810e6a0 con 0x7f67b8102a20 2024-04-30T23:16:12.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56088/0 (socket says 172.21.15.100:56088) 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 -- 172.21.15.100:0/1921798985 learned_addr learned my addr 172.21.15.100:0/1921798985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67b77fe640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8102a20 0x7f67b8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67b7fff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8108960 0x7f67b81a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 -- 172.21.15.100:0/1921798985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8102a20 msgr2=0x7f67b8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8102a20 0x7f67b8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 -- 172.21.15.100:0/1921798985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8108960 msgr2=0x7f67b81a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8108960 0x7f67b81a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 -- 172.21.15.100:0/1921798985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b81a0f90 con 0x7f67b8103c60 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67affff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f67a000e9c0 tx=0x7f67a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67b57fa640 1 -- 172.21.15.100:0/1921798985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a000ccc0 con 0x7f67b8103c60 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b81a1280 con 0x7f67b8103c60 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67b57fa640 1 -- 172.21.15.100:0/1921798985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a00054d0 con 0x7f67b8103c60 2024-04-30T23:16:12.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.841+0000 7f67b57fa640 1 -- 172.21.15.100:0/1921798985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0010430 con 0x7f67b8103c60 2024-04-30T23:16:12.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.842+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b81a1820 con 0x7f67b8103c60 2024-04-30T23:16:12.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67b57fa640 1 -- 172.21.15.100:0/1921798985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f67a0004f80 con 0x7f67b8103c60 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 Processor -- start 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 -- start start 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be962390 0x55a6bed03e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed04390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a6bec68d80 con 0x55a6be9416b0 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6bec22a20 con 0x55a6be962390 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67c49f4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a6bec64d40 con 0x55a6be9394d0 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed04390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56092/0 (socket says 172.21.15.100:56092) 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67affff640 1 -- 172.21.15.100:0/4249403545 learned_addr learned my addr 172.21.15.100:0/4249403545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.844+0000 7f67b7fff640 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be962390 0x55a6bed03e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b57fa640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 0x7f67a40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 -- 172.21.15.100:0/4249403545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be962390 msgr2=0x55a6bed03e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be962390 0x55a6bed03e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 -- 172.21.15.100:0/4249403545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 msgr2=0x55a6bed0b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 -- 172.21.15.100:0/4249403545 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6bec06e00 con 0x55a6be9394d0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b7fff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 0x7f67a40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b57fa640 1 -- 172.21.15.100:0/1921798985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f67a00d0c10 con 0x7f67b8103c60 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b77fe640 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed04390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67a802a860 tx=0x7f67a8005cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a2665a1551b7212 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67b7fff640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 0x7f67a40a60c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55a6bed04fe0 tx=0x7f67b0004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67adffb640 1 -- 172.21.15.100:0/4249403545 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8037040 con 0x55a6be9394d0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67adffb640 1 -- 172.21.15.100:0/4249403545 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a8030e10 con 0x55a6be9394d0 2024-04-30T23:16:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.845+0000 7f67adffb640 1 -- 172.21.15.100:0/4249403545 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8003970 con 0x55a6be9394d0 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- 172.21.15.100:0/4249403545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 msgr2=0x55a6bed04390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed04390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67a802a860 tx=0x7f67a8005cf0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- 172.21.15.100:0/4249403545 shutdown_connections 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed04390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4249403545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be962390 0x55a6bed03e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- 172.21.15.100:0/4249403545 >> 172.21.15.100:0/4249403545 conn(0x55a6be9564e0 msgr2=0x55a6becff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- 172.21.15.100:0/4249403545 shutdown_connections 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- 172.21.15.100:0/4249403545 wait complete. 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.846+0000 7f67c49f4740 1 -- start start 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 Processor -- start 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 0x55a6bed0da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be962390 0x55a6bed14f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a6bed0bc80 con 0x55a6be9416b0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6bebefdc0 con 0x55a6be9394d0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a6bed0be00 con 0x55a6be962390 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67c49f4740 10 client.0 _ll_register_callbacks cb 0x55a6bec0b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 0x55a6bed0da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56108/0 (socket says 172.21.15.100:56108) 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67affff640 1 -- 172.21.15.100:0/3198946216 learned_addr learned my addr 172.21.15.100:0/3198946216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b7fff640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be962390 0x55a6bed14f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 -- 172.21.15.100:0/3198946216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be962390 msgr2=0x55a6bed14f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be962390 0x55a6bed14f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 -- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 msgr2=0x55a6bed0dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67b77fe640 1 -- 172.21.15.100:0/3198946216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6bec2dc30 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.847+0000 7f67affff640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67b77fe640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 0x55a6bed0da60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de32c0fa336f6c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a804c070 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a8030e10 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f67a8030760 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f67a8058050 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67c49f4740 10 client.25829 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6be97a3f0 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a8030e10 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f67a8003b40 con 0x55a6be9394d0 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67c49f4740 10 client.25829 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.848+0000 7f67c49f4740 10 client.25829 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67c49f4740 20 client.25829 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:12.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be920f60 0x55a6bed1b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67c49f4740 4 client.25829 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6bec62810 con 0x55a6be920f60 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67affff640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be920f60 0x55a6bed1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f6796ffd640 10 client.25829 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.849+0000 7f67affff640 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be920f60 0x55a6bed1b350 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=802a08f00ebbb462 server_cookie=96ad94aee144edb0 in_seq=0 out_seq=0 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f6796ffd640 1 -- 172.21.15.100:0/3198946216 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55a6bec62810 con 0x55a6be920f60 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f6796ffd640 10 client.25829 handle_command_reply: tid=0 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 client.25829 shutdown 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 msgr2=0x55a6bed0da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 0x55a6bed0da60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000c00 tx=0x7f67a8004420 comp rx=0 tx=0).stop 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 shutdown_connections 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be920f60 0x55a6bed1b350 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be962390 0x55a6bed14f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f6796ffd640 0 client.25829 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9416b0 0x55a6bed0dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 --2- 172.21.15.100:0/3198946216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9394d0 0x55a6bed0da60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 >> 172.21.15.100:0/3198946216 conn(0x55a6be9564e0 msgr2=0x55a6becfe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 shutdown_connections 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 1 -- 172.21.15.100:0/3198946216 wait complete. 2024-04-30T23:16:12.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.850+0000 7f67c49f4740 20 client.25829 trim_cache size 0 max 16384 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 Processor -- start 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 -- start start 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9564e0 0x55a6bed0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 0x55a6bed1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81aa720 con 0x55a6be9394d0 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81ac320 con 0x55a6be9564e0 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67c49f4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81aadf0 con 0x55a6be9416b0 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56120/0 (socket says 172.21.15.100:56120) 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 -- 172.21.15.100:0/4157582260 learned_addr learned my addr 172.21.15.100:0/4157582260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67b7fff640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 0x55a6bed1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67b77fe640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9564e0 0x55a6bed0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 -- 172.21.15.100:0/4157582260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 msgr2=0x55a6bed1ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 0x55a6bed1ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 -- 172.21.15.100:0/4157582260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9564e0 msgr2=0x55a6bed0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9564e0 0x55a6bed0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.864+0000 7f67affff640 1 -- 172.21.15.100:0/4157582260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6bea447d0 con 0x55a6be9394d0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.865+0000 7f67b7fff640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 0x55a6bed1ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.865+0000 7f67affff640 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f67a00057a0 tx=0x7f67a00bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203b6838b781ae31 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.865+0000 7f67ad7fa640 1 -- 172.21.15.100:0/4157582260 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a009c6d0 con 0x55a6be9394d0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.865+0000 7f67ad7fa640 1 -- 172.21.15.100:0/4157582260 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a009d290 con 0x55a6be9394d0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.865+0000 7f67ad7fa640 1 -- 172.21.15.100:0/4157582260 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a009c4f0 con 0x55a6be9394d0 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- 172.21.15.100:0/4157582260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 msgr2=0x55a6bed1fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f67a00057a0 tx=0x7f67a00bd040 comp rx=0 tx=0).stop 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- 172.21.15.100:0/4157582260 shutdown_connections 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9416b0 0x55a6bed1ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9394d0 0x55a6bed1fa10 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 --2- 172.21.15.100:0/4157582260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9564e0 0x55a6bed0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- 172.21.15.100:0/4157582260 >> 172.21.15.100:0/4157582260 conn(0x55a6bed077f0 msgr2=0x55a6bed0d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- 172.21.15.100:0/4157582260 shutdown_connections 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- 172.21.15.100:0/4157582260 wait complete. 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 -- start start 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.866+0000 7f67c49f4740 1 Processor -- start 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 0x55a6bed121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 0x55a6bed130a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81abb90 con 0x55a6be9564e0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81ab4c0 con 0x55a6be9416b0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67b81a8700 con 0x55a6be9394d0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67c49f4740 10 client.0 _ll_register_callbacks cb 0x7f67a00d9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 0x55a6bed130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 0x55a6bed121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:57396/0 (socket says 172.21.15.100:57396) 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 0x55a6bed130a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56124/0 (socket says 172.21.15.100:56124) 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 -- 172.21.15.100:0/2211842133 learned_addr learned my addr 172.21.15.100:0/2211842133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 -- 172.21.15.100:0/2211842133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 msgr2=0x55a6bed121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 0x55a6bed121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 -- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 msgr2=0x55a6bed130a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 0x55a6bed130a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 -- 172.21.15.100:0/2211842133 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6bed13660 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67affff640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 0x55a6bed121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f67b77fe640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a6bed03ae0 tx=0x7f67a8004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8a45af97a12c335 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.867+0000 7f6796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8037070 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a009d290 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f67a8030e10 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f67a8063050 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 10 client.25834 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6bed814c0 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a009d290 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f67a803d5a0 con 0x55a6be9394d0 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 10 client.25834 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 10 client.25834 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-30T23:16:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 20 client.25834 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be962390 0x55a6bed83d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 4 client.25834 mds_command: new command op to 14664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 --> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6bec76990 con 0x55a6be962390 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.868+0000 7f67affff640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be962390 0x55a6bed83d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f6796ffd640 10 client.25834 ms_handle_connect on v2:172.21.15.100:6840/2201593414 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67affff640 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be962390 0x55a6bed83d50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=87921c9474de9708 server_cookie=c883a77cd4c67da7 in_seq=0 out_seq=0 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f6796ffd640 1 -- 172.21.15.100:0/2211842133 <== mds.4 v2:172.21.15.100:6840/2201593414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6bec76990 con 0x55a6be962390 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f6796ffd640 10 client.25834 handle_command_reply: tid=0 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 client.25834 shutdown 2024-04-30T23:16:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 msgr2=0x55a6bed11ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55a6bed03ae0 tx=0x7f67a8004740 comp rx=0 tx=0).stop 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 shutdown_connections 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:6840/2201593414,v1:172.21.15.100:6841/2201593414] conn(0x55a6be962390 0x55a6bed83d50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6be9564e0 0x55a6bed130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f6796ffd640 0 client.25834 ms_handle_reset on v2:172.21.15.100:6840/2201593414 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6be9416b0 0x55a6bed121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 --2- 172.21.15.100:0/2211842133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a6be9394d0 0x55a6bed11ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 >> 172.21.15.100:0/2211842133 conn(0x55a6bed077f0 msgr2=0x55a6bed0d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 shutdown_connections 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.869+0000 7f67c49f4740 1 -- 172.21.15.100:0/2211842133 wait complete. 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67c49f4740 20 client.25834 trim_cache size 0 max 16384 2024-04-30T23:16:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:16:12.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 msgr2=0x7f67a40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 0x7f67a40a60c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55a6bed04fe0 tx=0x7f67b0004a40 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 msgr2=0x7f67b8199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f67a000e9c0 tx=0x7f67a000ee80 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 shutdown_connections 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f67a40a3bb0 0x7f67a40a60c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67b8108960 0x7f67b81a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b8103c60 0x7f67b8199990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 --2- 172.21.15.100:0/1921798985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b8102a20 0x7f67b8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 >> 172.21.15.100:0/1921798985 conn(0x7f67b80fdc10 msgr2=0x7f67b8104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 shutdown_connections 2024-04-30T23:16:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:12.870+0000 7f67bdb3f640 1 -- 172.21.15.100:0/1921798985 wait complete. 2024-04-30T23:16:12.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-30T23:16:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.001+0000 7f246257d640 1 -- 172.21.15.100:0/355359636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10a130 msgr2=0x7f245c10ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.001+0000 7f246257d640 1 --2- 172.21.15.100:0/355359636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10a130 0x7f245c10ae30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f244c009900 tx=0x7f244c02a420 comp rx=0 tx=0).stop 2024-04-30T23:16:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.002+0000 7f246257d640 1 -- 172.21.15.100:0/355359636 shutdown_connections 2024-04-30T23:16:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.002+0000 7f246257d640 1 --2- 172.21.15.100:0/355359636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 0x7f245c112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.002+0000 7f246257d640 1 --2- 172.21.15.100:0/355359636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10b370 0x7f245c10b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.002+0000 7f246257d640 1 --2- 172.21.15.100:0/355359636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10a130 0x7f245c10ae30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.002+0000 7f246257d640 1 -- 172.21.15.100:0/355359636 >> 172.21.15.100:0/355359636 conn(0x7f245c078e20 msgr2=0x7f245c107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.003+0000 7f246257d640 1 -- 172.21.15.100:0/355359636 shutdown_connections 2024-04-30T23:16:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.003+0000 7f246257d640 1 -- 172.21.15.100:0/355359636 wait complete. 2024-04-30T23:16:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.003+0000 7f246257d640 1 Processor -- start 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.003+0000 7f246257d640 1 -- start start 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10b370 0x7f245c1a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 0x7f245c1a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f245c115d00 con 0x7f245c10b370 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f245c115b80 con 0x7f245c10a130 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f246257d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f245c115e80 con 0x7f245c110070 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f245bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f245bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:33648/0 (socket says 172.21.15.100:33648) 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f245bfff640 1 -- 172.21.15.100:0/3648223633 learned_addr learned my addr 172.21.15.100:0/3648223633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.004+0000 7f245b7fe640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10b370 0x7f245c1a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f2460b1a640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 0x7f245c1a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 -- 172.21.15.100:0/3648223633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 msgr2=0x7f245c1a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 0x7f245c1a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 -- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10b370 msgr2=0x7f245c1a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10b370 0x7f245c1a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 -- 172.21.15.100:0/3648223633 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1a8440 con 0x7f245c10a130 2024-04-30T23:16:13.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f245bfff640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f244c031440 tx=0x7f244c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f24597fa640 1 -- 172.21.15.100:0/3648223633 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c03f070 con 0x7f245c10a130 2024-04-30T23:16:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1a86d0 con 0x7f245c10a130 2024-04-30T23:16:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f24597fa640 1 -- 172.21.15.100:0/3648223633 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c031c50 con 0x7f245c10a130 2024-04-30T23:16:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f24597fa640 1 -- 172.21.15.100:0/3648223633 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c035030 con 0x7f245c10a130 2024-04-30T23:16:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.005+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1a8c40 con 0x7f245c10a130 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.009+0000 7f2469438740 1 Processor -- start 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.009+0000 7f2469438740 1 -- start start 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 0x55e875208e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e3e4d0 0x55e875209390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 0x55e875210290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e87516dd80 con 0x55e874e67390 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e875127a20 con 0x55e874e3e4d0 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2469438740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e875169d40 con 0x55e874e466b0 2024-04-30T23:16:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2460b1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 0x55e875208e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2460b1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 0x55e875208e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56138/0 (socket says 172.21.15.100:56138) 2024-04-30T23:16:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f2460b1a640 1 -- 172.21.15.100:0/3395503265 learned_addr learned my addr 172.21.15.100:0/3395503265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 0x55e875210290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f24597fa640 1 -- 172.21.15.100:0/3648223633 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f244c042070 con 0x7f245c10a130 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 -- 172.21.15.100:0/3395503265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e3e4d0 msgr2=0x55e875209390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e3e4d0 0x55e875209390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 -- 172.21.15.100:0/3395503265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 msgr2=0x55e875208e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 0x55e875208e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.010+0000 7f245b7fe640 1 -- 172.21.15.100:0/3395503265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87510be00 con 0x55e874e466b0 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.011+0000 7f245b7fe640 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 0x55e875210290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450009e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7207b108e5fcd4d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.011+0000 7f24427fc640 1 -- 172.21.15.100:0/3395503265 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450017070 con 0x55e874e466b0 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.011+0000 7f24597fa640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 0x7f24440a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.011+0000 7f24427fc640 1 -- 172.21.15.100:0/3395503265 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2450013470 con 0x55e874e466b0 2024-04-30T23:16:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.011+0000 7f24427fc640 1 -- 172.21.15.100:0/3395503265 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450012630 con 0x55e874e466b0 2024-04-30T23:16:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.012+0000 7f24597fa640 1 -- 172.21.15.100:0/3648223633 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f244c0f0fb0 con 0x7f245c10a130 2024-04-30T23:16:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.012+0000 7f2460b1a640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 0x7f24440a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 -- 172.21.15.100:0/3395503265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 msgr2=0x55e875210290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2460b1a640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 0x7f24440a6140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55e875209fe0 tx=0x7f2454009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 0x55e875210290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450009e10 comp rx=0 tx=0).stop 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 -- 172.21.15.100:0/3395503265 shutdown_connections 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e466b0 0x55e875210290 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450009e10 comp rx=0 tx=0).stop 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e3e4d0 0x55e875209390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 --2- 172.21.15.100:0/3395503265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e67390 0x55e875208e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.014+0000 7f2469438740 1 -- 172.21.15.100:0/3395503265 >> 172.21.15.100:0/3395503265 conn(0x55e874e5b4e0 msgr2=0x55e8752047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.015+0000 7f2469438740 1 -- 172.21.15.100:0/3395503265 shutdown_connections 2024-04-30T23:16:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.016+0000 7f2469438740 1 -- 172.21.15.100:0/3395503265 wait complete. 2024-04-30T23:16:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.017+0000 7f2469438740 1 -- start start 2024-04-30T23:16:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.017+0000 7f2469438740 1 Processor -- start 2024-04-30T23:16:13.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f2469438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56150/0 (socket says 172.21.15.100:56150) 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f245bfff640 1 -- 172.21.15.100:0/2982167767 learned_addr learned my addr 172.21.15.100:0/2982167767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e8752131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.018+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e25f60 0x55e87521a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e875210ce0 con 0x55e874e3e4d0 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e8750f4dc0 con 0x55e874e67390 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e875210e60 con 0x55e874e25f60 2024-04-30T23:16:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f2469438740 10 client.0 _ll_register_callbacks cb 0x55e875110600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f2460b1a640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e25f60 0x55e87521a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f245b7fe640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e8752131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f245bfff640 1 -- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e25f60 msgr2=0x55e87521a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.019+0000 7f245bfff640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e25f60 0x55e87521a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.020+0000 7f245bfff640 1 -- 172.21.15.100:0/2982167767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 msgr2=0x55e8752131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.020+0000 7f245bfff640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e8752131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.020+0000 7f245bfff640 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e875132c30 con 0x55e874e3e4d0 2024-04-30T23:16:13.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.020+0000 7f245bfff640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f244c0bcbd0 tx=0x7f244c0bcad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604603d52834c591 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.020+0000 7f243b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0d6060 con 0x55e874e3e4d0 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f244c03b460 con 0x55e874e3e4d0 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2450013470 con 0x55e874e3e4d0 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f244c049030 con 0x55e874e3e4d0 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f2469438740 10 client.16374 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e874e7f3f0 con 0x55e874e3e4d0 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.022+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2450013470 con 0x55e874e3e4d0 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f244c0d6200 con 0x55e874e3e4d0 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 10 client.16374 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 10 client.16374 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 20 client.16374 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e874dfb3a0 0x55e8752208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 4 client.16374 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:13.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.023+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e875167810 con 0x55e874dfb3a0 2024-04-30T23:16:13.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.024+0000 7f245b7fe640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e874dfb3a0 0x55e8752208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.026+0000 7f245b7fe640 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e874dfb3a0 0x55e8752208b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=340be6a9227cf46 server_cookie=8832dc776587384b in_seq=0 out_seq=0 2024-04-30T23:16:13.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.026+0000 7f243b7fe640 10 client.16374 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:16:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.027+0000 7f243b7fe640 1 -- 172.21.15.100:0/2982167767 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55e875167810 con 0x55e874dfb3a0 2024-04-30T23:16:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.027+0000 7f243b7fe640 10 client.16374 handle_command_reply: tid=0 2024-04-30T23:16:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.027+0000 7f2469438740 1 client.16374 shutdown 2024-04-30T23:16:13.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.027+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 msgr2=0x55e875212c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.027+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f244c0bcbd0 tx=0x7f244c0bcad0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 shutdown_connections 2024-04-30T23:16:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e874dfb3a0 0x55e8752208b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e25f60 0x55e87521a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e8752131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f243b7fe640 0 client.16374 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 --2- 172.21.15.100:0/2982167767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e3e4d0 0x55e875212c80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 >> 172.21.15.100:0/2982167767 conn(0x55e874e5b4e0 msgr2=0x55e8752039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 shutdown_connections 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 1 -- 172.21.15.100:0/2982167767 wait complete. 2024-04-30T23:16:13.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.028+0000 7f2469438740 20 client.16374 trim_cache size 0 max 16384 2024-04-30T23:16:13.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:12 smithi104 ceph-mon[32987]: pgmap v451: 129 pgs: 129 active+clean; 1.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 167 MiB/s wr, 278 op/s 2024-04-30T23:16:13.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:12 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4204387009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:16:13.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:12 smithi183 ceph-mon[33560]: pgmap v451: 129 pgs: 129 active+clean; 1.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 167 MiB/s wr, 278 op/s 2024-04-30T23:16:13.054 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:12 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4204387009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.052+0000 7f2469438740 1 Processor -- start 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.052+0000 7f2469438740 1 -- start start 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.052+0000 7f2469438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2469438740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e875211800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2469438740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875204160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2469438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b2fb0 con 0x55e874e25f60 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2469438740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b4bb0 con 0x55e874e67390 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2469438740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b3680 con 0x55e874e3e4d0 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56152/0 (socket says 172.21.15.100:56152) 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f245bfff640 1 -- 172.21.15.100:0/4010693208 learned_addr learned my addr 172.21.15.100:0/4010693208 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.053+0000 7f2460b1a640 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875204160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 -- 172.21.15.100:0/4010693208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 msgr2=0x55e875211800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e875211800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 -- 172.21.15.100:0/4010693208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 msgr2=0x55e875204160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875204160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 -- 172.21.15.100:0/4010693208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e874f497d0 con 0x55e874e25f60 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f245bfff640 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f244c000c00 tx=0x7f244c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a8fa5342f22725 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.054+0000 7f2441ffb640 1 -- 172.21.15.100:0/4010693208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0d6050 con 0x55e874e25f60 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.055+0000 7f2441ffb640 1 -- 172.21.15.100:0/4010693208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c0c1280 con 0x55e874e25f60 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.055+0000 7f2441ffb640 1 -- 172.21.15.100:0/4010693208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0bced0 con 0x55e874e25f60 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 -- 172.21.15.100:0/4010693208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 msgr2=0x55e8752112c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f244c000c00 tx=0x7f244c009260 comp rx=0 tx=0).stop 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 -- 172.21.15.100:0/4010693208 shutdown_connections 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875204160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e875211800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 --2- 172.21.15.100:0/4010693208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e8752112c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 -- 172.21.15.100:0/4010693208 >> 172.21.15.100:0/4010693208 conn(0x55e874e5b4e0 msgr2=0x55e87520d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 -- 172.21.15.100:0/4010693208 shutdown_connections 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.056+0000 7f2469438740 1 -- 172.21.15.100:0/4010693208 wait complete. 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 -- start start 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 Processor -- start 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e8752173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875218300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b4420 con 0x55e874e25f60 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b3d50 con 0x55e874e67390 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.057+0000 7f2469438740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b0f90 con 0x55e874e3e4d0 2024-04-30T23:16:13.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f2469438740 10 client.0 _ll_register_callbacks cb 0x7f244c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e8752173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56158/0 (socket says 172.21.15.100:56158) 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 -- 172.21.15.100:0/20690569 learned_addr learned my addr 172.21.15.100:0/20690569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f2460b1a640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875218300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 -- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 msgr2=0x55e8752173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e8752173d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 -- 172.21.15.100:0/20690569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 msgr2=0x55e875218300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875218300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.058+0000 7f245bfff640 1 -- 172.21.15.100:0/20690569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8752188c0 con 0x55e874e25f60 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.059+0000 7f245bfff640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f244c0c56b0 tx=0x7f244c0bcad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347fb39605d06482 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.059+0000 7f243b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.059+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0d6040 con 0x55e874e25f60 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.059+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f244c0319b0 con 0x55e874e25f60 2024-04-30T23:16:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.059+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244c0c1280 con 0x55e874e25f60 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f244c0b9170 con 0x55e874e25f60 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 10 client.16380 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e8752188c0 con 0x55e874e25f60 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c0c1280 con 0x55e874e25f60 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f244c0eebb0 con 0x55e874e25f60 2024-04-30T23:16:13.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 10 client.16380 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 10 client.16380 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 20 client.16380 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e875297ec0 0x55e87529a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 4 client.16380 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.060+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 --> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e87517b990 con 0x55e875297ec0 2024-04-30T23:16:13.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.061+0000 7f245b7fe640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e875297ec0 0x55e87529a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f243b7fe640 10 client.16380 ms_handle_connect on v2:172.21.15.183:6836/1464515486 2024-04-30T23:16:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f245b7fe640 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e875297ec0 0x55e87529a2e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42c38675da54498b server_cookie=42161e406be0c8e2 in_seq=0 out_seq=0 2024-04-30T23:16:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f243b7fe640 1 -- 172.21.15.100:0/20690569 <== mds.3 v2:172.21.15.183:6836/1464515486 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e87517b990 con 0x55e875297ec0 2024-04-30T23:16:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f243b7fe640 10 client.16380 handle_command_reply: tid=0 2024-04-30T23:16:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f2469438740 1 client.16380 shutdown 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 msgr2=0x55e875216e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f244c0c56b0 tx=0x7f244c0bcad0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 shutdown_connections 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.062+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:6836/1464515486,v1:172.21.15.183:6837/1464515486] conn(0x55e875297ec0 0x55e87529a2e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e874e67390 0x55e875218300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e874e3e4d0 0x55e8752173d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 --2- 172.21.15.100:0/20690569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e874e25f60 0x55e875216e90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 >> 172.21.15.100:0/20690569 conn(0x55e874e5b4e0 msgr2=0x55e875211200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f243b7fe640 0 client.16380 ms_handle_reset on v2:172.21.15.183:6836/1464515486 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 shutdown_connections 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 1 -- 172.21.15.100:0/20690569 wait complete. 2024-04-30T23:16:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.063+0000 7f2469438740 20 client.16380 trim_cache size 0 max 16384 2024-04-30T23:16:13.066 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:16:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.064+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 msgr2=0x7f24440a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.064+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 0x7f24440a6140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55e875209fe0 tx=0x7f2454009500 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.064+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 msgr2=0x7f245c1a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.064+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f244c031440 tx=0x7f244c003c10 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 shutdown_connections 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f24440a3c30 0x7f24440a6140 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f245c110070 0x7f245c1a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c10b370 0x7f245c1a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 --2- 172.21.15.100:0/3648223633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f245c10a130 0x7f245c1a0900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 >> 172.21.15.100:0/3648223633 conn(0x7f245c078e20 msgr2=0x7f245c10c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 shutdown_connections 2024-04-30T23:16:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.065+0000 7f246257d640 1 -- 172.21.15.100:0/3648223633 wait complete. 2024-04-30T23:16:13.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:12 smithi100 ceph-mon[29745]: pgmap v451: 129 pgs: 129 active+clean; 1.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 167 MiB/s wr, 278 op/s 2024-04-30T23:16:13.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:12 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4204387009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:16:13.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-30T23:16:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 -- 172.21.15.100:0/3656814034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4102a30 msgr2=0x7fc2e4103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 --2- 172.21.15.100:0/3656814034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4102a30 0x7fc2e4103730 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009900 tx=0x7fc2e002a410 comp rx=0 tx=0).stop 2024-04-30T23:16:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 -- 172.21.15.100:0/3656814034 shutdown_connections 2024-04-30T23:16:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 --2- 172.21.15.100:0/3656814034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4108970 0x7fc2e410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 --2- 172.21.15.100:0/3656814034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4103c70 0x7fc2e4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 --2- 172.21.15.100:0/3656814034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4102a30 0x7fc2e4103730 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 -- 172.21.15.100:0/3656814034 >> 172.21.15.100:0/3656814034 conn(0x7fc2e40fdc00 msgr2=0x7fc2e41000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 -- 172.21.15.100:0/3656814034 shutdown_connections 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.247+0000 7fc2eb896640 1 -- 172.21.15.100:0/3656814034 wait complete. 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 Processor -- start 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 -- start start 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4102a30 0x7fc2e4110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4108970 0x7fc2e410f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410e530 con 0x7fc2e4103c70 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410e3b0 con 0x7fc2e4102a30 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2eb896640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410e6b0 con 0x7fc2e4108970 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56172/0 (socket says 172.21.15.100:56172) 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 -- 172.21.15.100:0/2793071629 learned_addr learned my addr 172.21.15.100:0/2793071629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e9632640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4102a30 0x7fc2e4110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4108970 0x7fc2e410f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 -- 172.21.15.100:0/2793071629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4108970 msgr2=0x7fc2e410f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4108970 0x7fc2e410f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 -- 172.21.15.100:0/2793071629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4102a30 msgr2=0x7fc2e4110980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4102a30 0x7fc2e4110980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.248+0000 7fc2e8e31640 1 -- 172.21.15.100:0/2793071629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e419e170 con 0x7fc2e4103c70 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e9f0 tx=0x7fc2d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2da7fc640 1 -- 172.21.15.100:0/2793071629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400cd80 con 0x7fc2e4103c70 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e410fbc0 con 0x7fc2e4103c70 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2da7fc640 1 -- 172.21.15.100:0/2793071629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d40054d0 con 0x7fc2e4103c70 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2da7fc640 1 -- 172.21.15.100:0/2793071629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4010690 con 0x7fc2e4103c70 2024-04-30T23:16:13.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.249+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e41a8d70 con 0x7fc2e4103c70 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.251+0000 7fc2da7fc640 1 -- 172.21.15.100:0/2793071629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc2d4004e90 con 0x7fc2e4103c70 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 Processor -- start 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 -- start start 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 0x558cbc99fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 0x558cbc9a0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558cbc904d80 con 0x558cbc5fe390 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558cbc8bea20 con 0x558cbc5dd6b0 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2f2827740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558cbc900d40 con 0x558cbc5d54d0 2024-04-30T23:16:13.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9e33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 0x558cbc99fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 0x558cbc9a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9e33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 0x558cbc99fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56176/0 (socket says 172.21.15.100:56176) 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9e33640 1 -- 172.21.15.100:0/1743379782 learned_addr learned my addr 172.21.15.100:0/1743379782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2da7fc640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 0x7fc2d00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 0x7fc2d00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 -- 172.21.15.100:0/1743379782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 msgr2=0x558cbc9a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 -- 172.21.15.100:0/1743379782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 msgr2=0x558cbc99fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 0x558cbc99fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2e9632640 1 -- 172.21.15.100:0/1743379782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cbc8a2e00 con 0x558cbc5d54d0 2024-04-30T23:16:13.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.252+0000 7fc2da7fc640 1 -- 172.21.15.100:0/2793071629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc2d40d0c00 con 0x7fc2e4103c70 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.253+0000 7fc2e9632640 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 0x558cbc9a0390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc2e002a930 tx=0x7fc2e0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3132ed8cc8488786 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.253+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 0x7fc2d00a60c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558cbc9a0fe0 tx=0x7fc2dc004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.253+0000 7fc2cf7fe640 1 -- 172.21.15.100:0/1743379782 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0035030 con 0x558cbc5d54d0 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.253+0000 7fc2cf7fe640 1 -- 172.21.15.100:0/1743379782 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0040070 con 0x558cbc5d54d0 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.253+0000 7fc2cf7fe640 1 -- 172.21.15.100:0/1743379782 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0003970 con 0x558cbc5d54d0 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 -- 172.21.15.100:0/1743379782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 msgr2=0x558cbc9a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 0x558cbc9a0390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc2e002a930 tx=0x7fc2e0000bc0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 -- 172.21.15.100:0/1743379782 shutdown_connections 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5d54d0 0x558cbc9a0390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 --2- 172.21.15.100:0/1743379782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5fe390 0x558cbc99fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 -- 172.21.15.100:0/1743379782 >> 172.21.15.100:0/1743379782 conn(0x558cbc5f24e0 msgr2=0x558cbc99b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 -- 172.21.15.100:0/1743379782 shutdown_connections 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.254+0000 7fc2f2827740 1 -- 172.21.15.100:0/1743379782 wait complete. 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 -- start start 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 Processor -- start 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 0x558cbc9b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558cbc9a7c80 con 0x558cbc5d54d0 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558cbc88bdc0 con 0x558cbc5fe390 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558cbc9a7e00 con 0x558cbc5dd6b0 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2e9632640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2e9632640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56178/0 (socket says 172.21.15.100:56178) 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2e9632640 1 -- 172.21.15.100:0/2905083362 learned_addr learned my addr 172.21.15.100:0/2905083362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.255+0000 7fc2f2827740 10 client.0 _ll_register_callbacks cb 0x558cbc8a7600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 0x558cbc9b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 -- 172.21.15.100:0/2905083362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5dd6b0 msgr2=0x558cbc9a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 -- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 msgr2=0x558cbc9b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 0x558cbc9b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 -- 172.21.15.100:0/2905083362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cbc8c9c30 con 0x558cbc5d54d0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 0x558cbc9b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2e9632640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc2e002a450 tx=0x7fc2e0031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22e495ab0ee4e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0035070 con 0x558cbc5d54d0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc2e0004450 con 0x558cbc5d54d0 2024-04-30T23:16:13.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e0040070 con 0x558cbc5d54d0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc2e0059050 con 0x558cbc5d54d0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2f2827740 10 client.16392 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.256+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558cbc6163f0 con 0x558cbc5d54d0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0040070 con 0x558cbc5d54d0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fc2e00458c0 con 0x558cbc5d54d0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 10 client.16392 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 10 client.16392 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 20 client.16392 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5bcf60 0x558cbc9b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 4 client.16392 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cbc8fe810 con 0x558cbc5bcf60 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5bcf60 0x558cbc9b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2ccff9640 10 client.16392 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:16:13.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.257+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5bcf60 0x558cbc9b7380 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29bc49b76a26e3a7 server_cookie=255df44ce12c6d3d in_seq=0 out_seq=0 2024-04-30T23:16:13.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2ccff9640 1 -- 172.21.15.100:0/2905083362 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558cbc8fe810 con 0x558cbc5bcf60 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2ccff9640 10 client.16392 handle_command_reply: tid=0 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 client.16392 shutdown 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 msgr2=0x558cbc9a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc2e002a450 tx=0x7fc2e0031850 comp rx=0 tx=0).stop 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 shutdown_connections 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5bcf60 0x558cbc9b7380 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5fe390 0x558cbc9b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2ccff9640 0 client.16392 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 --2- 172.21.15.100:0/2905083362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9ab0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.258+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 >> 172.21.15.100:0/2905083362 conn(0x558cbc5f24e0 msgr2=0x558cbc99a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.259+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 shutdown_connections 2024-04-30T23:16:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.259+0000 7fc2f2827740 1 -- 172.21.15.100:0/2905083362 wait complete. 2024-04-30T23:16:13.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.259+0000 7fc2f2827740 20 client.16392 trim_cache size 0 max 16384 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.272+0000 7fc2f2827740 1 Processor -- start 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 -- start start 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc999f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b2ef0 con 0x558cbc5d54d0 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b4af0 con 0x558cbc5dd6b0 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2f2827740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b35c0 con 0x558cbc5fe390 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56192/0 (socket says 172.21.15.100:56192) 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 -- 172.21.15.100:0/60544688 learned_addr learned my addr 172.21.15.100:0/60544688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc999f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 -- 172.21.15.100:0/60544688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 msgr2=0x558cbc999f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc999f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 -- 172.21.15.100:0/60544688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 msgr2=0x558cbc9a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 -- 172.21.15.100:0/60544688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cbc6e07d0 con 0x558cbc5d54d0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.273+0000 7fc2e9632640 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0045e20 tx=0x7fc2e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bec2b25cc5b0468 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2ceffd640 1 -- 172.21.15.100:0/60544688 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0035070 con 0x558cbc5d54d0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2ceffd640 1 -- 172.21.15.100:0/60544688 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0040040 con 0x558cbc5d54d0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2ceffd640 1 -- 172.21.15.100:0/60544688 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e004a070 con 0x558cbc5d54d0 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 -- 172.21.15.100:0/60544688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 msgr2=0x558cbc9a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0045e20 tx=0x7fc2e0005fd0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 -- 172.21.15.100:0/60544688 shutdown_connections 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc999f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5dd6b0 0x558cbc9a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 --2- 172.21.15.100:0/60544688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5d54d0 0x558cbc9a9680 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 -- 172.21.15.100:0/60544688 >> 172.21.15.100:0/60544688 conn(0x558cbc5f24e0 msgr2=0x558cbc9a3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 -- 172.21.15.100:0/60544688 shutdown_connections 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.274+0000 7fc2f2827740 1 -- 172.21.15.100:0/60544688 wait complete. 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 -- start start 2024-04-30T23:16:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 Processor -- start 2024-04-30T23:16:13.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 0x558cbc9ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc9aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b4360 con 0x558cbc5dd6b0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b3c90 con 0x558cbc5d54d0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b0ed0 con 0x558cbc5fe390 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2f2827740 10 client.0 _ll_register_callbacks cb 0x7fc2dc008610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2e8e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2e8e31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56208/0 (socket says 172.21.15.100:56208) 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2e8e31640 1 -- 172.21.15.100:0/4187176144 learned_addr learned my addr 172.21.15.100:0/4187176144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2e9e33640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc9aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.275+0000 7fc2e9632640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 0x558cbc9ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 -- 172.21.15.100:0/4187176144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 msgr2=0x558cbc9aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc9aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 -- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 msgr2=0x558cbc9ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 0x558cbc9ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 -- 172.21.15.100:0/4187176144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cbc9af0a0 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e9632640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 0x558cbc9ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2e8e31640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4099550 tx=0x7fc2d4098f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8512e5b75a997 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40b5070 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc2d40046c0 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e0040040 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc2d4005680 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2f2827740 10 client.16398 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558cbc9b03f0 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0040040 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.276+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fc2d40991f0 con 0x558cbc5dd6b0 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 10 client.16398 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 10 client.16398 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 20 client.16398 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5923a0 0x558cbca1f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 4 client.16398 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 --> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cbc912990 con 0x558cbc5923a0 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2e9632640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5923a0 0x558cbca1f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2ccff9640 10 client.16398 ms_handle_connect on v2:172.21.15.104:6836/4190150609 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2e9632640 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5923a0 0x558cbca1f840 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4adbc9b19bbf7531 server_cookie=1c6abdb3d5ee50d5 in_seq=0 out_seq=0 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2ccff9640 1 -- 172.21.15.100:0/4187176144 <== mds.2 v2:172.21.15.104:6836/4190150609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cbc912990 con 0x558cbc5923a0 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2ccff9640 10 client.16398 handle_command_reply: tid=0 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 client.16398 shutdown 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 msgr2=0x558cbc9adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4099550 tx=0x7fc2d4098f50 comp rx=0 tx=0).stop 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 shutdown_connections 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558cbc5fe390 0x558cbc9aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cbc5dd6b0 0x558cbc9adbb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:6836/4190150609,v1:172.21.15.104:6837/4190150609] conn(0x558cbc5923a0 0x558cbca1f840 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 --2- 172.21.15.100:0/4187176144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558cbc5d54d0 0x558cbc9ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2ccff9640 0 client.16398 ms_handle_reset on v2:172.21.15.104:6836/4190150609 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.277+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 >> 172.21.15.100:0/4187176144 conn(0x558cbc5f24e0 msgr2=0x558cbc99e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 shutdown_connections 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2f2827740 1 -- 172.21.15.100:0/4187176144 wait complete. 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2f2827740 20 client.16398 trim_cache size 0 max 16384 2024-04-30T23:16:13.286 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 msgr2=0x7fc2d00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 0x7fc2d00a60c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558cbc9a0fe0 tx=0x7fc2dc004ab0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 msgr2=0x7fc2e410f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e9f0 tx=0x7fc2d400edf0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 shutdown_connections 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc2d00a3bb0 0x7fc2d00a60c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e4108970 0x7fc2e410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e4103c70 0x7fc2e410f020 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 --2- 172.21.15.100:0/2793071629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2e4102a30 0x7fc2e4110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 >> 172.21.15.100:0/2793071629 conn(0x7fc2e40fdc00 msgr2=0x7fc2e4100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 shutdown_connections 2024-04-30T23:16:13.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.278+0000 7fc2eb896640 1 -- 172.21.15.100:0/2793071629 wait complete. 2024-04-30T23:16:13.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 -- 172.21.15.100:0/2341436841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc4103f40 msgr2=0x7f6dc4102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 --2- 172.21.15.100:0/2341436841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc4103f40 0x7f6dc4102820 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009900 tx=0x7f6db402a410 comp rx=0 tx=0).stop 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 -- 172.21.15.100:0/2341436841 shutdown_connections 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 --2- 172.21.15.100:0/2341436841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 0x7f6dc410ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 --2- 172.21.15.100:0/2341436841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4104420 0x7f6dc4102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 --2- 172.21.15.100:0/2341436841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc4103f40 0x7f6dc4102820 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 -- 172.21.15.100:0/2341436841 >> 172.21.15.100:0/2341436841 conn(0x7f6dc40fd3c0 msgr2=0x7f6dc40ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.402+0000 7f6dca48b640 1 -- 172.21.15.100:0/2341436841 shutdown_connections 2024-04-30T23:16:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.403+0000 7f6dca48b640 1 -- 172.21.15.100:0/2341436841 wait complete. 2024-04-30T23:16:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.403+0000 7f6dca48b640 1 Processor -- start 2024-04-30T23:16:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.403+0000 7f6dca48b640 1 -- start start 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.403+0000 7f6dca48b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 0x7f6dc4198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 0x7f6dc4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc410e550 con 0x7f6dc419e240 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc410e3d0 con 0x7f6dc4108a70 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc410e6d0 con 0x7f6dc4103f40 2024-04-30T23:16:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 0x7f6dc4198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56220/0 (socket says 172.21.15.100:56220) 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 -- 172.21.15.100:0/808119193 learned_addr learned my addr 172.21.15.100:0/808119193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 0x7f6dc4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 -- 172.21.15.100:0/808119193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 msgr2=0x7f6dc4198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 0x7f6dc4198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 -- 172.21.15.100:0/808119193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 msgr2=0x7f6dc4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 0x7f6dc4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 -- 172.21.15.100:0/808119193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc41a0cd0 con 0x7f6dc419e240 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 0x7f6dc4198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc8a28640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00eb10 tx=0x7f6dbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc17fa640 1 -- 172.21.15.100:0/808119193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004b20 con 0x7f6dc419e240 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc17fa640 1 -- 172.21.15.100:0/808119193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dbc004cc0 con 0x7f6dc419e240 2024-04-30T23:16:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc41a0fc0 con 0x7f6dc419e240 2024-04-30T23:16:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dc17fa640 1 -- 172.21.15.100:0/808119193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc010670 con 0x7f6dc419e240 2024-04-30T23:16:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.404+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc41a1420 con 0x7f6dc419e240 2024-04-30T23:16:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc17fa640 1 -- 172.21.15.100:0/808119193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6dbc005020 con 0x7f6dc419e240 2024-04-30T23:16:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 Processor -- start 2024-04-30T23:16:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 -- start start 2024-04-30T23:16:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55972e342d80 con 0x55972e03c390 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55972e2fca20 con 0x55972e01b6b0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dd1412740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55972e33ed40 con 0x55972e0134d0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56228/0 (socket says 172.21.15.100:56228) 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc17fa640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 0x7f6dac0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:57538/0 (socket says 172.21.15.100:57538) 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc37fe640 1 -- 172.21.15.100:0/405133985 learned_addr learned my addr 172.21.15.100:0/405133985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.407+0000 7f6dc8a28640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 0x7f6dac0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 -- 172.21.15.100:0/405133985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 msgr2=0x55972e3e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc17fa640 1 -- 172.21.15.100:0/808119193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6dbc0d0cc0 con 0x7f6dc419e240 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 -- 172.21.15.100:0/405133985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 msgr2=0x55972e3e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 -- 172.21.15.100:0/405133985 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972e2e0e00 con 0x55972e0134d0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006010 tx=0x7f6db4032f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=337b142cdce7941d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6dc8a28640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 0x7f6dac0a60c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0ce7d0 tx=0x7f6dbc092120 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6daa7fc640 1 -- 172.21.15.100:0/405133985 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4035070 con 0x55972e0134d0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6daa7fc640 1 -- 172.21.15.100:0/405133985 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db40317a0 con 0x55972e0134d0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.408+0000 7f6daa7fc640 1 -- 172.21.15.100:0/405133985 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4003d00 con 0x55972e0134d0 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- 172.21.15.100:0/405133985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 msgr2=0x55972e3e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006010 tx=0x7f6db4032f90 comp rx=0 tx=0).stop 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- 172.21.15.100:0/405133985 shutdown_connections 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e05a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 --2- 172.21.15.100:0/405133985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- 172.21.15.100:0/405133985 >> 172.21.15.100:0/405133985 conn(0x55972e0304e0 msgr2=0x55972e3d97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- 172.21.15.100:0/405133985 shutdown_connections 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- 172.21.15.100:0/405133985 wait complete. 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 -- start start 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.409+0000 7f6dd1412740 1 Processor -- start 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55972e3e7e90 con 0x55972e03c390 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55972e2c9dc0 con 0x55972e01b6b0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55972e3e8010 con 0x55972e0134d0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dd1412740 10 client.0 _ll_register_callbacks cb 0x55972e2e5600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56240/0 (socket says 172.21.15.100:56240) 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 -- 172.21.15.100:0/389007545 learned_addr learned my addr 172.21.15.100:0/389007545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 -- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 msgr2=0x55972e3e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 -- 172.21.15.100:0/389007545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 msgr2=0x55972e3ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3ea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 -- 172.21.15.100:0/389007545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55972e307c30 con 0x55972e03c390 2024-04-30T23:16:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6db8013f20 tx=0x7f6db8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e661a40691e80d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6da37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.410+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8013260 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6db8005020 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db40317a0 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6db8005220 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 10 client.16410 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55972e0543f0 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db40317a0 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6db8005450 con 0x55972e03c390 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 10 client.16410 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 10 client.16410 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 20 client.16410 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dffaf60 0x55972e3f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 4 client.16410 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55972e33c810 con 0x55972dffaf60 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.411+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dffaf60 0x55972e3f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.412+0000 7f6da37fe640 10 client.16410 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.412+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dffaf60 0x55972e3f7a90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53b09e1a91f69f9a server_cookie=3b5b2c184fec08c4 in_seq=0 out_seq=0 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6da37fe640 1 -- 172.21.15.100:0/389007545 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55972e33c810 con 0x55972dffaf60 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6da37fe640 10 client.16410 handle_command_reply: tid=0 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 client.16410 shutdown 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 msgr2=0x55972e3f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6db8013f20 tx=0x7f6db8005f90 comp rx=0 tx=0).stop 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 shutdown_connections 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dffaf60 0x55972e3f7a90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e03c390 0x55972e3f10c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6da37fe640 0 client.16410 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 --2- 172.21.15.100:0/389007545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e0134d0 0x55972e3e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 >> 172.21.15.100:0/389007545 conn(0x55972e0304e0 msgr2=0x55972e3d89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 shutdown_connections 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 1 -- 172.21.15.100:0/389007545 wait complete. 2024-04-30T23:16:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.413+0000 7f6dd1412740 20 client.16410 trim_cache size 0 max 16384 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 Processor -- start 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 -- start start 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 0x55972e3f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e03c390 0x55972e3e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41aa620 con 0x55972e0134d0 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41ac220 con 0x55972e03c390 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dd1412740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41aacf0 con 0x55972e01b6b0 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56256/0 (socket says 172.21.15.100:56256) 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc37fe640 1 -- 172.21.15.100:0/3431673034 learned_addr learned my addr 172.21.15.100:0/3431673034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 0x55972e3f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e03c390 0x55972e3e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 -- 172.21.15.100:0/3431673034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e03c390 msgr2=0x55972e3e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e03c390 0x55972e3e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 -- 172.21.15.100:0/3431673034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 msgr2=0x55972e3d86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 -- 172.21.15.100:0/3431673034 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972e11e7d0 con 0x55972e01b6b0 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.427+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 0x55972e3f1050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6db402a930 tx=0x7f6db402a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d9de92bfdf79ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.428+0000 7f6da9ffb640 1 -- 172.21.15.100:0/3431673034 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4057020 con 0x55972e01b6b0 2024-04-30T23:16:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.428+0000 7f6da9ffb640 1 -- 172.21.15.100:0/3431673034 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db4031e10 con 0x55972e01b6b0 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.428+0000 7f6da9ffb640 1 -- 172.21.15.100:0/3431673034 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4035040 con 0x55972e01b6b0 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.428+0000 7f6dd1412740 1 -- 172.21.15.100:0/3431673034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 msgr2=0x55972e3f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.428+0000 7f6dd1412740 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 0x55972e3f1050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6db402a930 tx=0x7f6db402a9b0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- 172.21.15.100:0/3431673034 shutdown_connections 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e03c390 0x55972e3e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e01b6b0 0x55972e3f1050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- 172.21.15.100:0/3431673034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3d86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- 172.21.15.100:0/3431673034 >> 172.21.15.100:0/3431673034 conn(0x55972e0304e0 msgr2=0x55972e3d7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- 172.21.15.100:0/3431673034 shutdown_connections 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- 172.21.15.100:0/3431673034 wait complete. 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- start start 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 Processor -- start 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e03c390 0x55972e3efc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41aba90 con 0x55972e0134d0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41ab3c0 con 0x55972e01b6b0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc41a8600 con 0x55972e03c390 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dd1412740 10 client.0 _ll_register_callbacks cb 0x7f6db8009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56266/0 (socket says 172.21.15.100:56266) 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.429+0000 7f6dc37fe640 1 -- 172.21.15.100:0/1077481164 learned_addr learned my addr 172.21.15.100:0/1077481164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3eedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e03c390 0x55972e3efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 -- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e03c390 msgr2=0x55972e3efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e03c390 0x55972e3efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 -- 172.21.15.100:0/1077481164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 msgr2=0x55972e3eedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3eedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 -- 172.21.15.100:0/1077481164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55972e3f0240 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3eedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dc37fe640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6db8012610 tx=0x7f6db8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d4c39ddd9ddcc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6da37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8012ad0 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6db8012c70 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db4031e10 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6db8012e70 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dd1412740 10 client.16416 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55972e45dcf0 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.430+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db4031e10 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6db8033450 con 0x55972e0134d0 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 10 client.16416 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 10 client.16416 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 20 client.16416 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dfd03a0 0x55972e460430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 4 client.16416 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 --> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55972e350990 con 0x55972dfd03a0 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dfd03a0 0x55972e460430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.431+0000 7f6da37fe640 10 client.16416 ms_handle_connect on v2:172.21.15.183:6838/587252257 2024-04-30T23:16:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.432+0000 7f6dc3fff640 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dfd03a0 0x55972e460430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e218a85bf94b78a6 server_cookie=14fd9130529820b4 in_seq=0 out_seq=0 2024-04-30T23:16:13.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6da37fe640 1 -- 172.21.15.100:0/1077481164 <== mds.1 v2:172.21.15.183:6838/587252257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55972e350990 con 0x55972dfd03a0 2024-04-30T23:16:13.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6da37fe640 10 client.16416 handle_command_reply: tid=0 2024-04-30T23:16:13.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 client.16416 shutdown 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 msgr2=0x55972e3ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6db8012610 tx=0x7f6db8005850 comp rx=0 tx=0).stop 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 shutdown_connections 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:6838/587252257,v1:172.21.15.183:6839/587252257] conn(0x55972dfd03a0 0x55972e460430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55972e03c390 0x55972e3efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55972e01b6b0 0x55972e3eedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6da37fe640 0 client.16416 ms_handle_reset on v2:172.21.15.183:6838/587252257 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 --2- 172.21.15.100:0/1077481164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55972e0134d0 0x55972e3ee880 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 >> 172.21.15.100:0/1077481164 conn(0x55972e0304e0 msgr2=0x55972e3d7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 shutdown_connections 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 1 -- 172.21.15.100:0/1077481164 wait complete. 2024-04-30T23:16:13.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.434+0000 7f6dd1412740 20 client.16416 trim_cache size 0 max 16384 2024-04-30T23:16:13.441 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 msgr2=0x7f6dac0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 0x7f6dac0a60c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0ce7d0 tx=0x7f6dbc092120 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 msgr2=0x7f6dc41a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00eb10 tx=0x7f6dbc00c2d0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 shutdown_connections 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6dac0a3bb0 0x7f6dac0a60c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dc419e240 0x7f6dc41a0660 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dc4108a70 0x7f6dc4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 --2- 172.21.15.100:0/808119193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc4103f40 0x7f6dc4198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 >> 172.21.15.100:0/808119193 conn(0x7f6dc40fd3c0 msgr2=0x7f6dc40ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 shutdown_connections 2024-04-30T23:16:13.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.435+0000 7f6dca48b640 1 -- 172.21.15.100:0/808119193 wait complete. 2024-04-30T23:16:13.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-30T23:16:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.560+0000 7f53169b5640 1 -- 172.21.15.100:0/2114293231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 msgr2=0x7f5310103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.560+0000 7f53169b5640 1 --2- 172.21.15.100:0/2114293231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f5310103720 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5300009900 tx=0x7f530002a410 comp rx=0 tx=0).stop 2024-04-30T23:16:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 -- 172.21.15.100:0/2114293231 shutdown_connections 2024-04-30T23:16:13.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 --2- 172.21.15.100:0/2114293231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310108960 0x7f531010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 --2- 172.21.15.100:0/2114293231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310103c60 0x7f5310104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 --2- 172.21.15.100:0/2114293231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f5310103720 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 -- 172.21.15.100:0/2114293231 >> 172.21.15.100:0/2114293231 conn(0x7f53100fdc10 msgr2=0x7f53101000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 -- 172.21.15.100:0/2114293231 shutdown_connections 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 -- 172.21.15.100:0/2114293231 wait complete. 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 Processor -- start 2024-04-30T23:16:13.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.561+0000 7f53169b5640 1 -- start start 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310103c60 0x7f531019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310108960 0x7f53101a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f531010f650 con 0x7f5310102a20 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f531010f4d0 con 0x7f5310103c60 2024-04-30T23:16:13.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f53169b5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f531010f7d0 con 0x7f5310108960 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36528/0 (socket says 172.21.15.100:36528) 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 -- 172.21.15.100:0/1627184550 learned_addr learned my addr 172.21.15.100:0/1627184550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f5314f52640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310108960 0x7f53101a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530f7fe640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310103c60 0x7f531019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 -- 172.21.15.100:0/1627184550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310108960 msgr2=0x7f53101a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310108960 0x7f53101a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 -- 172.21.15.100:0/1627184550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310103c60 msgr2=0x7f531019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310103c60 0x7f531019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 -- 172.21.15.100:0/1627184550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53101a1db0 con 0x7f5310102a20 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530ffff640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5300006010 tx=0x7f5300004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.562+0000 7f530d7fa640 1 -- 172.21.15.100:0/1627184550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530003f030 con 0x7f5310102a20 2024-04-30T23:16:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.563+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53101a2040 con 0x7f5310102a20 2024-04-30T23:16:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.563+0000 7f530d7fa640 1 -- 172.21.15.100:0/1627184550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5300003aa0 con 0x7f5310102a20 2024-04-30T23:16:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.563+0000 7f530d7fa640 1 -- 172.21.15.100:0/1627184550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300035070 con 0x7f5310102a20 2024-04-30T23:16:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.563+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101a2580 con 0x7f5310102a20 2024-04-30T23:16:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 Processor -- start 2024-04-30T23:16:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 -- start start 2024-04-30T23:16:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f530d7fa640 1 -- 172.21.15.100:0/1627184550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5300042030 con 0x7f5310102a20 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0ff390 0x55b7aa4a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa405d80 con 0x55b7aa0de6b0 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa3bfa20 con 0x55b7aa0d64d0 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.565+0000 7f531d86b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa401d40 con 0x55b7aa0ff390 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f5314f52640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0ff390 0x55b7aa4a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36536/0 (socket says 172.21.15.100:36536) 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 -- 172.21.15.100:0/2630414203 learned_addr learned my addr 172.21.15.100:0/2630414203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530ffff640 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:49678/0 (socket says 172.21.15.100:49678) 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 -- 172.21.15.100:0/2630414203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0ff390 msgr2=0x55b7aa4a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0ff390 0x55b7aa4a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 -- 172.21.15.100:0/2630414203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 msgr2=0x55b7aa4a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530d7fa640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 0x7f52f80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 -- 172.21.15.100:0/2630414203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7aa3a3e00 con 0x55b7aa0de6b0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530ffff640 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f5314f52640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 0x7f52f80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530f7fe640 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5304009c20 tx=0x7f53040117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac15b654dbb398 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f530d7fa640 1 -- 172.21.15.100:0/1627184550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f53000f0d70 con 0x7f5310102a20 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f52f67fc640 1 -- 172.21.15.100:0/2630414203 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304004030 con 0x55b7aa0de6b0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f52f67fc640 1 -- 172.21.15.100:0/2630414203 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53040035f0 con 0x55b7aa0de6b0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.566+0000 7f52f67fc640 1 -- 172.21.15.100:0/2630414203 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53040126b0 con 0x55b7aa0de6b0 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 -- 172.21.15.100:0/2630414203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 msgr2=0x55b7aa4a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f5314f52640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 0x7f52f80a60c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b7aa4a1fe0 tx=0x7f5308007520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5304009c20 tx=0x7f53040117b0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 -- 172.21.15.100:0/2630414203 shutdown_connections 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4a8290 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 --2- 172.21.15.100:0/2630414203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0ff390 0x55b7aa4a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 -- 172.21.15.100:0/2630414203 >> 172.21.15.100:0/2630414203 conn(0x55b7aa0f34e0 msgr2=0x55b7aa49c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 -- 172.21.15.100:0/2630414203 shutdown_connections 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.567+0000 7f531d86b740 1 -- 172.21.15.100:0/2630414203 wait complete. 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 -- start start 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 Processor -- start 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 0x55b7aa4b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa4a8ce0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa38cdc0 con 0x55b7aa0ff390 2024-04-30T23:16:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b7aa4a8e60 con 0x55b7aa0de6b0 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f531d86b740 10 client.0 _ll_register_callbacks cb 0x55b7aa3a8600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f530f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36542/0 (socket says 172.21.15.100:36542) 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.568+0000 7f530ffff640 1 -- 172.21.15.100:0/3982230350 learned_addr learned my addr 172.21.15.100:0/3982230350 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f5314f52640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 0x55b7aa4b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 -- 172.21.15.100:0/3982230350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 msgr2=0x55b7aa4aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 -- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 msgr2=0x55b7aa4b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 0x55b7aa4b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 -- 172.21.15.100:0/3982230350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7aa3cac30 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f5314f52640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 0x55b7aa4b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f530ffff640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f53000bc9f0 tx=0x7f5300003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c401da5f1b4b1601 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f52ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300049040 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f53000baff0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.569+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53040035f0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f53000bcac0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 10 client.16428 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b7aa1173f0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53040035f0 con 0x55b7aa0d64d0 2024-04-30T23:16:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f53000f4020 con 0x55b7aa0d64d0 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 10 client.16428 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 20 client.16428 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0bdf60 0x55b7aa4b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 4 client.16428 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7aa3ff810 con 0x55b7aa0bdf60 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.570+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0bdf60 0x55b7aa4b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.571+0000 7f52ef7fe640 10 client.16428 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.571+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0bdf60 0x55b7aa4b87f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11d8de86228f38b1 server_cookie=ec2a5e2a7272bc2b in_seq=0 out_seq=0 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.571+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3982230350 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55b7aa3ff810 con 0x55b7aa0bdf60 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.571+0000 7f52ef7fe640 10 client.16428 handle_command_reply: tid=0 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.571+0000 7f531d86b740 1 client.16428 shutdown 2024-04-30T23:16:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 msgr2=0x55b7aa4aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f53000bc9f0 tx=0x7f5300003f90 comp rx=0 tx=0).stop 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 shutdown_connections 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0bdf60 0x55b7aa4b87f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0ff390 0x55b7aa4b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f52ef7fe640 0 client.16428 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 --2- 172.21.15.100:0/3982230350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4aaa80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 >> 172.21.15.100:0/3982230350 conn(0x55b7aa0f34e0 msgr2=0x55b7aa49b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 shutdown_connections 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 1 -- 172.21.15.100:0/3982230350 wait complete. 2024-04-30T23:16:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.572+0000 7f531d86b740 20 client.16428 trim_cache size 0 max 16384 2024-04-30T23:16:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 Processor -- start 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 -- start start 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53101aa690 con 0x55b7aa0bdf60 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f53101ac290 con 0x55b7aa0d64d0 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f531d86b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53101aad60 con 0x55b7aa0de6b0 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36550/0 (socket says 172.21.15.100:36550) 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f530ffff640 1 -- 172.21.15.100:0/2957842374 learned_addr learned my addr 172.21.15.100:0/2957842374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.586+0000 7f5314f52640 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 -- 172.21.15.100:0/2957842374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 msgr2=0x55b7aa4aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 -- 172.21.15.100:0/2957842374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 msgr2=0x55b7aa4a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 -- 172.21.15.100:0/2957842374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7aa1e17d0 con 0x55b7aa0bdf60 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f5314f52640 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f530ffff640 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f53000b9150 tx=0x7f530000b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaeacfc6105f6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f52f5ffb640 1 -- 172.21.15.100:0/2957842374 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300049070 con 0x55b7aa0bdf60 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f52f5ffb640 1 -- 172.21.15.100:0/2957842374 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53000d5020 con 0x55b7aa0bdf60 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.587+0000 7f52f5ffb640 1 -- 172.21.15.100:0/2957842374 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000bc650 con 0x55b7aa0bdf60 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- 172.21.15.100:0/2957842374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 msgr2=0x55b7aa4a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f53000b9150 tx=0x7f530000b1f0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- 172.21.15.100:0/2957842374 shutdown_connections 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa4aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 --2- 172.21.15.100:0/2957842374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4a9200 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- 172.21.15.100:0/2957842374 >> 172.21.15.100:0/2957842374 conn(0x55b7aa0f34e0 msgr2=0x55b7aa4a4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- 172.21.15.100:0/2957842374 shutdown_connections 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- 172.21.15.100:0/2957842374 wait complete. 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 -- start start 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.588+0000 7f531d86b740 1 Processor -- start 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa51ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53101abb00 con 0x55b7aa0bdf60 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f53101ab430 con 0x55b7aa0d64d0 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53101a8670 con 0x55b7aa0de6b0 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 10 client.0 _ll_register_callbacks cb 0x7f5300005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36556/0 (socket says 172.21.15.100:36556) 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 -- 172.21.15.100:0/3595557942 learned_addr learned my addr 172.21.15.100:0/3595557942 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f5314f52640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa51ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 -- 172.21.15.100:0/3595557942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 msgr2=0x55b7aa51ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa51ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 -- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 msgr2=0x55b7aa4ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 -- 172.21.15.100:0/3595557942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7aa51cf70 con 0x55b7aa0bdf60 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f530ffff640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f53000d6250 tx=0x7f5300003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0c25f77ef472aa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f52ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300049070 con 0x55b7aa0bdf60 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f53000dd0f0 con 0x55b7aa0bdf60 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.589+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53000d5020 con 0x55b7aa0bdf60 2024-04-30T23:16:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f53000bc830 con 0x55b7aa0bdf60 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 10 client.16434 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b7aa51cf70 con 0x55b7aa0bdf60 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53000d5020 con 0x55b7aa0bdf60 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f53000c54d0 con 0x55b7aa0bdf60 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 10 client.16434 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 20 client.16434 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0ff390 0x55b7aa520780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 4 client.16434 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7aa413990 con 0x55b7aa0ff390 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.590+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0ff390 0x55b7aa520780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f52ef7fe640 10 client.16434 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f530f7fe640 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0ff390 0x55b7aa520780 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffbc76675d47cf5 server_cookie=2df4c0d0076ade90 in_seq=0 out_seq=0 2024-04-30T23:16:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f52ef7fe640 1 -- 172.21.15.100:0/3595557942 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7aa413990 con 0x55b7aa0ff390 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f52ef7fe640 10 client.16434 handle_command_reply: tid=0 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 client.16434 shutdown 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 msgr2=0x55b7aa4ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f53000d6250 tx=0x7f5300003f90 comp rx=0 tx=0).stop 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 shutdown_connections 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b7aa0ff390 0x55b7aa520780 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b7aa0de6b0 0x55b7aa51ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7aa0d64d0 0x55b7aa4ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f52ef7fe640 0 client.16434 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 --2- 172.21.15.100:0/3595557942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7aa0bdf60 0x55b7aa4ae420 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 >> 172.21.15.100:0/3595557942 conn(0x55b7aa0f34e0 msgr2=0x55b7aa4a9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 shutdown_connections 2024-04-30T23:16:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 1 -- 172.21.15.100:0/3595557942 wait complete. 2024-04-30T23:16:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.591+0000 7f531d86b740 20 client.16434 trim_cache size 0 max 16384 2024-04-30T23:16:13.599 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 msgr2=0x7f52f80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 0x7f52f80a60c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b7aa4a1fe0 tx=0x7f5308007520 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 msgr2=0x7f531019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5300006010 tx=0x7f5300004270 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 shutdown_connections 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f52f80a3bb0 0x7f52f80a60c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5310108960 0x7f53101a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5310103c60 0x7f531019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 --2- 172.21.15.100:0/1627184550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5310102a20 0x7f531019a320 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 >> 172.21.15.100:0/1627184550 conn(0x7f53100fdc10 msgr2=0x7f5310104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 shutdown_connections 2024-04-30T23:16:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:13.592+0000 7f53169b5640 1 -- 172.21.15.100:0/1627184550 wait complete. 2024-04-30T23:16:14.605 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-30T23:16:14.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:16:14.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- 172.21.15.100:0/121954647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30103a80 msgr2=0x7fbd30103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/121954647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30103a80 0x7fbd30103e90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009900 tx=0x7fbd2002a410 comp rx=0 tx=0).stop 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- 172.21.15.100:0/121954647 shutdown_connections 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/121954647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30108780 0x7fbd3010aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/121954647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30103a80 0x7fbd30103e90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/121954647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30102840 0x7fbd30103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- 172.21.15.100:0/121954647 >> 172.21.15.100:0/121954647 conn(0x7fbd300fda30 msgr2=0x7fbd300ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- 172.21.15.100:0/121954647 shutdown_connections 2024-04-30T23:16:14.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- 172.21.15.100:0/121954647 wait complete. 2024-04-30T23:16:14.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 Processor -- start 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.724+0000 7fbd36b9d640 1 -- start start 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30103a80 0x7fbd3019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30108780 0x7fbd301a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3010f470 con 0x7fbd30102840 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3010f2f0 con 0x7fbd30103a80 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3010f5f0 con 0x7fbd30108780 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36574/0 (socket says 172.21.15.100:36574) 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2242174614 learned_addr learned my addr 172.21.15.100:0/2242174614 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd3639c640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30108780 0x7fbd301a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30103a80 0x7fbd3019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2242174614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30108780 msgr2=0x7fbd301a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30108780 0x7fbd301a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2242174614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30103a80 msgr2=0x7fbd3019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30103a80 0x7fbd3019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2242174614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd301a1c20 con 0x7fbd30102840 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e9f0 tx=0x7fbd2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd26ffd640 1 -- 172.21.15.100:0/2242174614 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00ccc0 con 0x7fbd30102840 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd26ffd640 1 -- 172.21.15.100:0/2242174614 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd2c0035f0 con 0x7fbd30102840 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd301a1f10 con 0x7fbd30102840 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.725+0000 7fbd26ffd640 1 -- 172.21.15.100:0/2242174614 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00ce60 con 0x7fbd30102840 2024-04-30T23:16:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.726+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd301a2370 con 0x7fbd30102840 2024-04-30T23:16:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.728+0000 7fbd26ffd640 1 -- 172.21.15.100:0/2242174614 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbd2c003aa0 con 0x7fbd30102840 2024-04-30T23:16:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.728+0000 7fbd3ed86740 1 Processor -- start 2024-04-30T23:16:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 -- start start 2024-04-30T23:16:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaec1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 0x55efeaec23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 0x55efeaec92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55efeae26b00 con 0x55efeaaff730 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55efeadc2920 con 0x55efeab20410 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55efeae22ac0 con 0x55efeaaf7550 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 0x55efeaec23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 0x55efeaec92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 0x55efeaec23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:45258/0 (socket says 172.21.15.100:45258) 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd35b9b640 1 -- 172.21.15.100:0/20757674 learned_addr learned my addr 172.21.15.100:0/20757674 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd26ffd640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 0x7fbd1c0a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3639c640 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaec1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3639c640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 0x7fbd1c0a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 -- 172.21.15.100:0/20757674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 msgr2=0x55efeaec23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 0x55efeaec23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 -- 172.21.15.100:0/20757674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 msgr2=0x55efeaec1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaec1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3539a640 1 -- 172.21.15.100:0/20757674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efeac007e0 con 0x55efeaaff730 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd3639c640 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaec1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.729+0000 7fbd26ffd640 1 -- 172.21.15.100:0/2242174614 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbd2c0d0ad0 con 0x7fbd30102840 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.730+0000 7fbd3539a640 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 0x55efeaec92e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbd20005ab0 tx=0x7fbd20009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc529681f653fd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.730+0000 7fbd3639c640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 0x7fbd1c0a60b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005c40 tx=0x7fbd28009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.730+0000 7fbd1bfff640 1 -- 172.21.15.100:0/20757674 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20035030 con 0x55efeaaff730 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.730+0000 7fbd1bfff640 1 -- 172.21.15.100:0/20757674 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd20040070 con 0x55efeaaff730 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.730+0000 7fbd1bfff640 1 -- 172.21.15.100:0/20757674 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003850 con 0x55efeaaff730 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- 172.21.15.100:0/20757674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 msgr2=0x55efeaec92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 0x55efeaec92e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbd20005ab0 tx=0x7fbd20009600 comp rx=0 tx=0).stop 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- 172.21.15.100:0/20757674 shutdown_connections 2024-04-30T23:16:14.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaff730 0x55efeaec92e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaf7550 0x55efeaec23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/20757674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaec1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- 172.21.15.100:0/20757674 >> 172.21.15.100:0/20757674 conn(0x55efeab14560 msgr2=0x55efeaebd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- 172.21.15.100:0/20757674 shutdown_connections 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- 172.21.15.100:0/20757674 wait complete. 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 -- start start 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.731+0000 7fbd3ed86740 1 Processor -- start 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaecbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55efeaec9cd0 con 0x55efeaaf7550 2024-04-30T23:16:14.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55efeadc05d0 con 0x55efeab20410 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55efeaec9e50 con 0x55efeaaff730 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 10 client.0 _ll_register_callbacks cb 0x55efeadcfa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36602/0 (socket says 172.21.15.100:36602) 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2518489060 learned_addr learned my addr 172.21.15.100:0/2518489060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaecbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3639c640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2518489060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 msgr2=0x55efeaecbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaecbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 msgr2=0x55efeaed2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2518489060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efeac60f70 con 0x55efeaaf7550 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaecbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c003a50 tx=0x7fbd2c09c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c00df628a905859 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd197fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c09d150 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbd2c0a5230 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.732+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd20040070 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbd2c09ca50 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 10 client.16446 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55efeaaf8170 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd20040070 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fbd2c06d020 con 0x55efeaaf7550 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 10 client.16446 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 20 client.16446 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaadf1f0 0x55efeaed9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 4 client.16446 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efeae34710 con 0x55efeaadf1f0 2024-04-30T23:16:14.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.733+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaadf1f0 0x55efeaed9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.734+0000 7fbd197fa640 10 client.16446 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.734+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaadf1f0 0x55efeaed9500 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2e94857b7ab16e server_cookie=109c31253a4c7662 in_seq=0 out_seq=0 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd197fa640 1 -- 172.21.15.100:0/2518489060 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55efeae34710 con 0x55efeaadf1f0 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd197fa640 10 client.16446 handle_command_reply: tid=0 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 client.16446 shutdown 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 msgr2=0x55efeaecba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c003a50 tx=0x7fbd2c09c650 comp rx=0 tx=0).stop 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 shutdown_connections 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaadf1f0 0x55efeaed9500 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaecbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2518489060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaecba50 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd197fa640 0 client.16446 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 >> 172.21.15.100:0/2518489060 conn(0x55efeab14560 msgr2=0x55efeaebc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 shutdown_connections 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2518489060 wait complete. 2024-04-30T23:16:14.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.735+0000 7fbd3ed86740 20 client.16446 trim_cache size 0 max 16384 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.755+0000 7fbd3ed86740 1 Processor -- start 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.755+0000 7fbd3ed86740 1 -- start start 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.755+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.755+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeaaff730 0x55efeaec1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.755+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeab20410 0x55efeaeded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301ac740 con 0x55efeaaf7550 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301ae340 con 0x55efeaaff730 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301ace10 con 0x55efeab20410 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36610/0 (socket says 172.21.15.100:36610) 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2822454573 learned_addr learned my addr 172.21.15.100:0/2822454573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd3639c640 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeab20410 0x55efeaeded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd3539a640 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeaaff730 0x55efeaec1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2822454573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeab20410 msgr2=0x55efeaeded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeab20410 0x55efeaeded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2822454573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeaaff730 msgr2=0x55efeaec1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeaaff730 0x55efeaec1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 -- 172.21.15.100:0/2822454573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efeaec1970 con 0x55efeaaf7550 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c09ad00 tx=0x7fbd2c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7949d10c555197c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd1b7fe640 1 -- 172.21.15.100:0/2822454573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c09d150 con 0x55efeaaf7550 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd1b7fe640 1 -- 172.21.15.100:0/2822454573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd2c0a0e00 con 0x55efeaaf7550 2024-04-30T23:16:14.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.756+0000 7fbd1b7fe640 1 -- 172.21.15.100:0/2822454573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a5230 con 0x55efeaaf7550 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2822454573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 msgr2=0x55efeaec0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c09ad00 tx=0x7fbd2c003e70 comp rx=0 tx=0).stop 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2822454573 shutdown_connections 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeab20410 0x55efeaeded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeaaff730 0x55efeaec1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/2822454573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaec0d00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2822454573 >> 172.21.15.100:0/2822454573 conn(0x55efeab14560 msgr2=0x55efeaec05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2822454573 shutdown_connections 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.757+0000 7fbd3ed86740 1 -- 172.21.15.100:0/2822454573 wait complete. 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 -- start start 2024-04-30T23:16:14.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 Processor -- start 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaed0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301adbb0 con 0x55efeaaf7550 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301ad4e0 con 0x55efeab20410 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301aa720 con 0x55efeaaff730 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3ed86740 10 client.0 _ll_register_callbacks cb 0x7fbd2c0045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd35b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36620/0 (socket says 172.21.15.100:36620) 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd35b9b640 1 -- 172.21.15.100:0/4177384114 learned_addr learned my addr 172.21.15.100:0/4177384114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3539a640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaed0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.758+0000 7fbd3639c640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 -- 172.21.15.100:0/4177384114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 msgr2=0x55efeaed0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaed0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 -- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 msgr2=0x55efeaed1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 -- 172.21.15.100:0/4177384114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efeaed1d10 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd35b9b640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c09c9e0 tx=0x7fbd2c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829abe347011e88a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c09d150 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbd2c09bea0 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd2c0a0e00 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbd2c003fb0 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 10 client.16452 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55efeaf3fd10 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd2c0a0e00 con 0x55efeaaf7550 2024-04-30T23:16:14.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fbd2c06d040 con 0x55efeaaf7550 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 10 client.16452 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 20 client.16452 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaab4630 0x55efeaf424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 4 client.16452 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.759+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55efeae2e580 con 0x55efeaab4630 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.760+0000 7fbd3539a640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaab4630 0x55efeaf424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.760+0000 7fbd197fa640 10 client.16452 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.760+0000 7fbd3539a640 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaab4630 0x55efeaf424b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=497f6b4572bae494 server_cookie=7d79b13e0ae20085 in_seq=0 out_seq=0 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd197fa640 1 -- 172.21.15.100:0/4177384114 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55efeae2e580 con 0x55efeaab4630 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd197fa640 10 client.16452 handle_command_reply: tid=0 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 client.16452 shutdown 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 msgr2=0x55efeaed0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c09c9e0 tx=0x7fbd2c005e70 comp rx=0 tx=0).stop 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 shutdown_connections 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55efeaab4630 0x55efeaf424b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55efeab20410 0x55efeaed1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55efeaaff730 0x55efeaed0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 --2- 172.21.15.100:0/4177384114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55efeaaf7550 0x55efeaed0330 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd197fa640 0 client.16452 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 >> 172.21.15.100:0/4177384114 conn(0x55efeab14560 msgr2=0x55efeaec1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 shutdown_connections 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 1 -- 172.21.15.100:0/4177384114 wait complete. 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.762+0000 7fbd3ed86740 20 client.16452 trim_cache size 0 max 16384 2024-04-30T23:16:14.769 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:16:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-04-30T23:16:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:16:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-04-30T23:16:14.770 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:16:14.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 msgr2=0x7fbd1c0a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 0x7fbd1c0a60b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005c40 tx=0x7fbd28009500 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 msgr2=0x7fbd3019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e9f0 tx=0x7fbd2c00eeb0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 shutdown_connections 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbd1c0a3ba0 0x7fbd1c0a60b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd30108780 0x7fbd301a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30103a80 0x7fbd3019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 --2- 172.21.15.100:0/2242174614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd30102840 0x7fbd3019a130 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 >> 172.21.15.100:0/2242174614 conn(0x7fbd300fda30 msgr2=0x7fbd30104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 shutdown_connections 2024-04-30T23:16:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.763+0000 7fbd36b9d640 1 -- 172.21.15.100:0/2242174614 wait complete. 2024-04-30T23:16:14.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:16:14.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:16:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 -- 172.21.15.100:0/876761114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc102a20 msgr2=0x7f20cc103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 --2- 172.21.15.100:0/876761114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc102a20 0x7f20cc103720 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009900 tx=0x7f20bc02a410 comp rx=0 tx=0).stop 2024-04-30T23:16:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 -- 172.21.15.100:0/876761114 shutdown_connections 2024-04-30T23:16:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 --2- 172.21.15.100:0/876761114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 0x7f20cc10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 --2- 172.21.15.100:0/876761114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc103c60 0x7f20cc104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 --2- 172.21.15.100:0/876761114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc102a20 0x7f20cc103720 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 -- 172.21.15.100:0/876761114 >> 172.21.15.100:0/876761114 conn(0x7f20cc0fdc10 msgr2=0x7f20cc1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 -- 172.21.15.100:0/876761114 shutdown_connections 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.897+0000 7f20d19be640 1 -- 172.21.15.100:0/876761114 wait complete. 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 Processor -- start 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 -- start start 2024-04-30T23:16:14.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 0x7f20cc19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 0x7f20cc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc10e500 con 0x7f20cc103c60 2024-04-30T23:16:14.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc10e380 con 0x7f20cc102a20 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20d19be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc10e680 con 0x7f20cc108960 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 0x7f20cc19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:49788/0 (socket says 172.21.15.100:49788) 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 0x7f20cc19f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36636/0 (socket says 172.21.15.100:36636) 2024-04-30T23:16:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20caffd640 1 -- 172.21.15.100:0/2596687992 learned_addr learned my addr 172.21.15.100:0/2596687992 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.898+0000 7f20cb7fe640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 0x7f20cc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 -- 172.21.15.100:0/2596687992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 msgr2=0x7f20cc1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 0x7f20cc1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 -- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 msgr2=0x7f20cc19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 0x7f20cc19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 -- 172.21.15.100:0/2596687992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc1a2080 con 0x7f20cc102a20 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20caffd640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006010 tx=0x7f20bc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20d09bc640 1 -- 172.21.15.100:0/2596687992 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc03f030 con 0x7f20cc102a20 2024-04-30T23:16:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20d09bc640 1 -- 172.21.15.100:0/2596687992 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc031910 con 0x7f20cc102a20 2024-04-30T23:16:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20cc1a2310 con 0x7f20cc102a20 2024-04-30T23:16:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20d09bc640 1 -- 172.21.15.100:0/2596687992 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc035070 con 0x7f20cc102a20 2024-04-30T23:16:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.899+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20cc1a2800 con 0x7f20cc102a20 2024-04-30T23:16:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.902+0000 7f20d09bc640 1 -- 172.21.15.100:0/2596687992 <== mon.2 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f20bc042030 con 0x7f20cc102a20 2024-04-30T23:16:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20d09bc640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 0x7f20b80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20d09bc640 1 -- 172.21.15.100:0/2596687992 <== mon.2 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f20bc0f0a80 con 0x7f20cc102a20 2024-04-30T23:16:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20c3fff640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 0x7f20b80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20d887c740 1 Processor -- start 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20d887c740 1 -- start start 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.903+0000 7f20d887c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f38420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20d887c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20d887c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f39640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20d887c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eac5e4fb10 con 0x55eac5b6d4d0 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20d887c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eac5e9cd80 con 0x55eac5b756b0 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20d887c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55eac5e568b0 con 0x55eac5b96390 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f39640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36644/0 (socket says 172.21.15.100:36644) 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 -- 172.21.15.100:0/3072687651 learned_addr learned my addr 172.21.15.100:0/3072687651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 0x7f20b80a60c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20cc06a2e0 tx=0x7f20b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20caffd640 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f38420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 -- 172.21.15.100:0/3072687651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 msgr2=0x55eac5f38420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f38420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 -- 172.21.15.100:0/3072687651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 msgr2=0x55eac5f39640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f39640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.904+0000 7f20c3fff640 1 -- 172.21.15.100:0/3072687651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac5e27a40 con 0x55eac5b6d4d0 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.905+0000 7f20c3fff640 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f20b400e630 tx=0x7f20b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86270572bf137fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.905+0000 7f20c1ffb640 1 -- 172.21.15.100:0/3072687651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4004030 con 0x55eac5b6d4d0 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.905+0000 7f20c1ffb640 1 -- 172.21.15.100:0/3072687651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b4021070 con 0x55eac5b6d4d0 2024-04-30T23:16:14.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.905+0000 7f20c1ffb640 1 -- 172.21.15.100:0/3072687651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4004b10 con 0x55eac5b6d4d0 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- 172.21.15.100:0/3072687651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 msgr2=0x55eac5f389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f20b400e630 tx=0x7f20b4014000 comp rx=0 tx=0).stop 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- 172.21.15.100:0/3072687651 shutdown_connections 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f39640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f389c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 --2- 172.21.15.100:0/3072687651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f38420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- 172.21.15.100:0/3072687651 >> 172.21.15.100:0/3072687651 conn(0x55eac5b8a4e0 msgr2=0x55eac5f33d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- 172.21.15.100:0/3072687651 shutdown_connections 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- 172.21.15.100:0/3072687651 wait complete. 2024-04-30T23:16:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.906+0000 7f20d887c740 1 -- start start 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.907+0000 7f20d887c740 1 Processor -- start 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36648/0 (socket says 172.21.15.100:36648) 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:49804/0 (socket says 172.21.15.100:49804) 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f51fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 -- 172.21.15.100:0/2586590324 learned_addr learned my addr 172.21.15.100:0/2586590324 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eac5e23d10 con 0x55eac5b756b0 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eac5e98d40 con 0x55eac5b6d4d0 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55eac5f3a160 con 0x55eac5b96390 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20cb7fe640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f51fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20d887c740 10 client.0 _ll_register_callbacks cb 0x55eac5ea9d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 -- 172.21.15.100:0/2586590324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 msgr2=0x55eac5f51fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f51fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 -- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 msgr2=0x55eac5f4ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eac5c787d0 con 0x55eac5b756b0 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20caffd640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20cb7fe640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f51fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20c3fff640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f20b400ef90 tx=0x7f20b4005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef46787b3a098c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.908+0000 7f20aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:14.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4004a10 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b4021070 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f20b4025420 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20b4036050 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20d887c740 10 client.16464 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55eac5bae3f0 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.909+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b4021070 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f20b401d550 con 0x55eac5b756b0 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 10 client.16464 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 20 client.16464 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b54f60 0x55eac5f58130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 4 client.16464 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:14.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eac5eaa990 con 0x55eac5b54f60 2024-04-30T23:16:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20caffd640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b54f60 0x55eac5f58130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.910+0000 7f20aaffd640 10 client.16464 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.911+0000 7f20caffd640 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b54f60 0x55eac5f58130 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d364b5fba44495e server_cookie=69cbdca2e6d6e4e2 in_seq=0 out_seq=0 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20aaffd640 1 -- 172.21.15.100:0/2586590324 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55eac5eaa990 con 0x55eac5b54f60 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20aaffd640 10 client.16464 handle_command_reply: tid=0 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 client.16464 shutdown 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 msgr2=0x55eac5f4b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f20b400ef90 tx=0x7f20b4005290 comp rx=0 tx=0).stop 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 shutdown_connections 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b54f60 0x55eac5f58130 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f51fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b756b0 0x55eac5f4b050 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 --2- 172.21.15.100:0/2586590324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 >> 172.21.15.100:0/2586590324 conn(0x55eac5b8a4e0 msgr2=0x55eac5f32ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20aaffd640 0 client.16464 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 shutdown_connections 2024-04-30T23:16:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.913+0000 7f20d887c740 1 -- 172.21.15.100:0/2586590324 wait complete. 2024-04-30T23:16:14.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.914+0000 7f20d887c740 20 client.16464 trim_cache size 0 max 16384 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 Processor -- start 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 -- start start 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f51ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f49130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1aa710 con 0x55eac5b6d4d0 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1ac310 con 0x55eac5b756b0 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20d887c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1aade0 con 0x55eac5b96390 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36662/0 (socket says 172.21.15.100:36662) 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 -- 172.21.15.100:0/1329170951 learned_addr learned my addr 172.21.15.100:0/1329170951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20c3fff640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f51ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20cb7fe640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f49130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 -- 172.21.15.100:0/1329170951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 msgr2=0x55eac5f49130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f49130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 -- 172.21.15.100:0/1329170951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 msgr2=0x55eac5f51ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f51ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20caffd640 1 -- 172.21.15.100:0/1329170951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac5f4b1f0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.936+0000 7f20c3fff640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f51ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.937+0000 7f20caffd640 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0ee270 tx=0x7f20bc0f0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2743815964b4dbf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.937+0000 7f20c17fa640 1 -- 172.21.15.100:0/1329170951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc049040 con 0x55eac5b6d4d0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.937+0000 7f20c17fa640 1 -- 172.21.15.100:0/1329170951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc0d7070 con 0x55eac5b6d4d0 2024-04-30T23:16:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.937+0000 7f20c17fa640 1 -- 172.21.15.100:0/1329170951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0bcd10 con 0x55eac5b6d4d0 2024-04-30T23:16:14.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- 172.21.15.100:0/1329170951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 msgr2=0x55eac5f2e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0ee270 tx=0x7f20bc0f0040 comp rx=0 tx=0).stop 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- 172.21.15.100:0/1329170951 shutdown_connections 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b96390 0x55eac5f49130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b756b0 0x55eac5f51ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 --2- 172.21.15.100:0/1329170951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b6d4d0 0x55eac5f2e990 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- 172.21.15.100:0/1329170951 >> 172.21.15.100:0/1329170951 conn(0x55eac5b8a4e0 msgr2=0x55eac5f459f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- 172.21.15.100:0/1329170951 shutdown_connections 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- 172.21.15.100:0/1329170951 wait complete. 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.938+0000 7f20d887c740 1 -- start start 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 Processor -- start 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b756b0 0x55eac5f4d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b96390 0x55eac5fbc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1abb80 con 0x55eac5b96390 2024-04-30T23:16:14.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1ab4b0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1a86f0 con 0x55eac5b756b0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20d887c740 10 client.0 _ll_register_callbacks cb 0x7f20c4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20caffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:49820/0 (socket says 172.21.15.100:49820) 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b756b0 0x55eac5f4d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20caffd640 1 -- 172.21.15.100:0/844812485 learned_addr learned my addr 172.21.15.100:0/844812485 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b96390 0x55eac5fbc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20caffd640 1 -- 172.21.15.100:0/844812485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b756b0 msgr2=0x55eac5f4d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.939+0000 7f20caffd640 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b756b0 0x55eac5f4d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20caffd640 1 -- 172.21.15.100:0/844812485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b96390 msgr2=0x55eac5fbc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20caffd640 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b96390 0x55eac5fbc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20caffd640 1 -- 172.21.15.100:0/844812485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eac5b6e0f0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20caffd640 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20bc031500 tx=0x7f20bc03b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9bfe43763572ae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc049050 con 0x55eac5b6d4d0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mon.2 v2:172.21.15.104:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f20bc0badb0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20bc0d7070 con 0x55eac5b6d4d0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20bc0bcd10 con 0x55eac5b6d4d0 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20d887c740 10 client.25919 fetch_fsmap learned FSMap version 31 2024-04-30T23:16:14.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.940+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55eac5e5d4b0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mon.2 v2:172.21.15.104:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc0bceb0 con 0x55eac5b6d4d0 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mon.2 v2:172.21.15.104:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f20bc0b8800 con 0x55eac5b6d4d0 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 10 client.25919 fetch_fsmap finished waiting for FSMap version 31 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 10 client.25919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 20 client.25919 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b2a3a0 0x55eac5fbfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 4 client.25919 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f20bc0d7070 con 0x55eac5b2a3a0 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20c3fff640 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b2a3a0 0x55eac5fbfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.941+0000 7f20aaffd640 10 client.25919 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.942+0000 7f20c3fff640 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b2a3a0 0x55eac5fbfdb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b20fc5018d2896 server_cookie=804c7014b3753292 in_seq=0 out_seq=0 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.945+0000 7f20aaffd640 1 -- 172.21.15.100:0/844812485 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1998 (crc 0 0 0) 0x7f20bc0d7070 con 0x55eac5b2a3a0 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.945+0000 7f20aaffd640 10 client.25919 handle_command_reply: tid=0 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 client.25919 shutdown 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 msgr2=0x55eac5f4cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20bc031500 tx=0x7f20bc03b4f0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 shutdown_connections 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eac5b2a3a0 0x55eac5fbfdb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eac5b96390 0x55eac5fbc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20aaffd640 0 client.25919 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eac5b756b0 0x55eac5f4d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 --2- 172.21.15.100:0/844812485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eac5b6d4d0 0x55eac5f4cb00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 >> 172.21.15.100:0/844812485 conn(0x55eac5b8a4e0 msgr2=0x55eac5f49060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.946+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 shutdown_connections 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d887c740 1 -- 172.21.15.100:0/844812485 wait complete. 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d887c740 20 client.25919 trim_cache size 0 max 16384 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "scrub active (353 inodes in the stack)", 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:16:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:16:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:14.954 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:16:14.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 msgr2=0x7f20b80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 0x7f20b80a60c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20cc06a2e0 tx=0x7f20b4005f90 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 msgr2=0x7f20cc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006010 tx=0x7f20bc004270 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 shutdown_connections 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20b80a3bb0 0x7f20b80a60c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20cc108960 0x7f20cc1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20cc103c60 0x7f20cc19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 --2- 172.21.15.100:0/2596687992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20cc102a20 0x7f20cc06a940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 >> 172.21.15.100:0/2596687992 conn(0x7f20cc0fdc10 msgr2=0x7f20cc104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.947+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 shutdown_connections 2024-04-30T23:16:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:14.948+0000 7f20d19be640 1 -- 172.21.15.100:0/2596687992 wait complete. 2024-04-30T23:16:14.960 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:14 smithi100 ceph-mon[29745]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s rd, 124 MiB/s wr, 231 op/s 2024-04-30T23:16:14.961 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:16:15.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:14 smithi104 ceph-mon[32987]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s rd, 124 MiB/s wr, 231 op/s 2024-04-30T23:16:15.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:14 smithi183 ceph-mon[33560]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s rd, 124 MiB/s wr, 231 op/s 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub queued for path: / 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:16.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:15 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub queued for path: / 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:16.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:15 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub queued for path: / 2024-04-30T23:16:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:15 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:17.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:16 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:17.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:16 smithi104 ceph-mon[32987]: pgmap v453: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 100 MiB/s wr, 232 op/s 2024-04-30T23:16:17.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:16 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:17.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:16 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:17.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:16 smithi183 ceph-mon[33560]: pgmap v453: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 100 MiB/s wr, 232 op/s 2024-04-30T23:16:17.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:16 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:16 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:16 smithi100 ceph-mon[29745]: pgmap v453: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 100 MiB/s wr, 232 op/s 2024-04-30T23:16:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:16 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:17.903 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-30T23:16:17.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-30T23:16:18.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:17 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:18.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:17 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:18.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:17 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:18 smithi104 ceph-mon[32987]: scrub summary: active paths [/] 2024-04-30T23:16:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:18 smithi104 ceph-mon[32987]: pgmap v454: 129 pgs: 129 active+clean; 611 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 36 MiB/s wr, 187 op/s 2024-04-30T23:16:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:18 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:18 smithi183 ceph-mon[33560]: scrub summary: active paths [/] 2024-04-30T23:16:19.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:18 smithi183 ceph-mon[33560]: pgmap v454: 129 pgs: 129 active+clean; 611 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 36 MiB/s wr, 187 op/s 2024-04-30T23:16:19.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:18 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:18 smithi100 ceph-mon[29745]: scrub summary: active paths [/] 2024-04-30T23:16:19.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:19.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:18 smithi100 ceph-mon[29745]: pgmap v454: 129 pgs: 129 active+clean; 611 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 36 MiB/s wr, 187 op/s 2024-04-30T23:16:19.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:18 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:20.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:19 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:20.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:19 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:20.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:19 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:21.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:20 smithi104 ceph-mon[32987]: pgmap v455: 129 pgs: 129 active+clean; 292 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 15 MiB/s wr, 163 op/s 2024-04-30T23:16:21.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:20 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:21.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:20 smithi183 ceph-mon[33560]: pgmap v455: 129 pgs: 129 active+clean; 292 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 15 MiB/s wr, 163 op/s 2024-04-30T23:16:21.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:20 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:21.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:20 smithi100 ceph-mon[29745]: pgmap v455: 129 pgs: 129 active+clean; 292 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 15 MiB/s wr, 163 op/s 2024-04-30T23:16:21.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:20 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:22.046 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:21 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:22.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:21 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:22.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:21 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:22 smithi104 ceph-mon[32987]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:22 smithi104 ceph-mon[32987]: pgmap v456: 129 pgs: 129 active+clean; 184 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-04-30T23:16:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:22 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:23.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:22 smithi183 ceph-mon[33560]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:23.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:22 smithi183 ceph-mon[33560]: pgmap v456: 129 pgs: 129 active+clean; 184 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-04-30T23:16:23.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:22 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:23.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:22 smithi100 ceph-mon[29745]: scrub summary: idle+waiting paths [/] 2024-04-30T23:16:23.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:22 smithi100 ceph-mon[29745]: pgmap v456: 129 pgs: 129 active+clean; 184 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-04-30T23:16:23.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:22 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:24.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:23 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:24.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:23 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:24.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:23 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:25.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:24 smithi104 ceph-mon[32987]: pgmap v457: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-04-30T23:16:25.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:24 smithi183 ceph-mon[33560]: pgmap v457: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-04-30T23:16:25.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:24 smithi100 ceph-mon[29745]: pgmap v457: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-04-30T23:16:27.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:26 smithi104 ceph-mon[32987]: pgmap v458: 129 pgs: 129 active+clean; 166 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 182 op/s 2024-04-30T23:16:27.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:26 smithi183 ceph-mon[33560]: pgmap v458: 129 pgs: 129 active+clean; 166 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 182 op/s 2024-04-30T23:16:27.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:26 smithi100 ceph-mon[29745]: pgmap v458: 129 pgs: 129 active+clean; 166 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 182 op/s 2024-04-30T23:16:29.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:28 smithi104 ceph-mon[32987]: pgmap v459: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 749 KiB/s wr, 150 op/s 2024-04-30T23:16:29.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:28 smithi183 ceph-mon[33560]: pgmap v459: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 749 KiB/s wr, 150 op/s 2024-04-30T23:16:29.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:28 smithi100 ceph-mon[29745]: pgmap v459: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 749 KiB/s wr, 150 op/s 2024-04-30T23:16:31.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:30 smithi104 ceph-mon[32987]: pgmap v460: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 944 KiB/s wr, 207 op/s 2024-04-30T23:16:31.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:30 smithi183 ceph-mon[33560]: pgmap v460: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 944 KiB/s wr, 207 op/s 2024-04-30T23:16:31.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:30 smithi100 ceph-mon[29745]: pgmap v460: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 944 KiB/s wr, 207 op/s 2024-04-30T23:16:33.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:32 smithi183 ceph-mon[33560]: pgmap v461: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.0 MiB/s wr, 224 op/s 2024-04-30T23:16:33.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:32 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:33.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:32 smithi100 ceph-mon[29745]: pgmap v461: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.0 MiB/s wr, 224 op/s 2024-04-30T23:16:33.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:32 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:33.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:32 smithi104 ceph-mon[32987]: pgmap v461: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.0 MiB/s wr, 224 op/s 2024-04-30T23:16:33.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:32 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:34 smithi183 ceph-mon[33560]: pgmap v462: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 234 op/s 2024-04-30T23:16:35.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:34 smithi100 ceph-mon[29745]: pgmap v462: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 234 op/s 2024-04-30T23:16:35.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:34 smithi104 ceph-mon[32987]: pgmap v462: 129 pgs: 129 active+clean; 170 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 234 op/s 2024-04-30T23:16:37.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:36 smithi100 ceph-mon[29745]: pgmap v463: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 262 op/s 2024-04-30T23:16:37.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:36 smithi104 ceph-mon[32987]: pgmap v463: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 262 op/s 2024-04-30T23:16:37.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:36 smithi183 ceph-mon[33560]: pgmap v463: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 262 op/s 2024-04-30T23:16:39.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:38 smithi100 ceph-mon[29745]: pgmap v464: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 966 KiB/s wr, 225 op/s 2024-04-30T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:38 smithi104 ceph-mon[32987]: pgmap v464: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 966 KiB/s wr, 225 op/s 2024-04-30T23:16:39.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:38 smithi183 ceph-mon[33560]: pgmap v464: 129 pgs: 129 active+clean; 172 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 966 KiB/s wr, 225 op/s 2024-04-30T23:16:41.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:40 smithi100 ceph-mon[29745]: pgmap v465: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 877 KiB/s wr, 230 op/s 2024-04-30T23:16:41.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:40 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:41.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:40 smithi104 ceph-mon[32987]: pgmap v465: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 877 KiB/s wr, 230 op/s 2024-04-30T23:16:41.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:40 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:41.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:40 smithi183 ceph-mon[33560]: pgmap v465: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 877 KiB/s wr, 230 op/s 2024-04-30T23:16:41.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:40 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:42.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:41 smithi100 ceph-mon[29745]: pgmap v466: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 223 op/s 2024-04-30T23:16:42.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:41 smithi104 ceph-mon[32987]: pgmap v466: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 223 op/s 2024-04-30T23:16:42.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:41 smithi183 ceph-mon[33560]: pgmap v466: 129 pgs: 129 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 223 op/s 2024-04-30T23:16:44.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:16:44.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:16:44.994 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:44 smithi100 ceph-mon[29745]: pgmap v467: 129 pgs: 129 active+clean; 171 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-30T23:16:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:44 smithi104 ceph-mon[32987]: pgmap v467: 129 pgs: 129 active+clean; 171 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-30T23:16:45.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:44 smithi183 ceph-mon[33560]: pgmap v467: 129 pgs: 129 active+clean; 171 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-30T23:16:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 -- 172.21.15.100:0/1413128453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 msgr2=0x7f33b010a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 --2- 172.21.15.100:0/1413128453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b010a510 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009ca0 tx=0x7f33a802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 -- 172.21.15.100:0/1413128453 shutdown_connections 2024-04-30T23:16:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 --2- 172.21.15.100:0/1413128453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b010a510 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 --2- 172.21.15.100:0/1413128453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 0x7f33b0103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 --2- 172.21.15.100:0/1413128453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 0x7f33b0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 -- 172.21.15.100:0/1413128453 >> 172.21.15.100:0/1413128453 conn(0x7f33b00fd380 msgr2=0x7f33b00ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 -- 172.21.15.100:0/1413128453 shutdown_connections 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.115+0000 7f33b54cd640 1 -- 172.21.15.100:0/1413128453 wait complete. 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 Processor -- start 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 -- start start 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 0x7f33b019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 0x7f33b019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33b010f650 con 0x7f33b01080f0 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f33b010f4d0 con 0x7f33b01021b0 2024-04-30T23:16:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33b54cd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f33b010f7d0 con 0x7f33b01033f0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 0x7f33b019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42564/0 (socket says 172.21.15.100:42564) 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 -- 172.21.15.100:0/3742627238 learned_addr learned my addr 172.21.15.100:0/3742627238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33a7fff640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 0x7f33b019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 -- 172.21.15.100:0/3742627238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 msgr2=0x7f33b019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 0x7f33b019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 -- 172.21.15.100:0/3742627238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 msgr2=0x7f33b019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 0x7f33b019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 -- 172.21.15.100:0/3742627238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b01a1d60 con 0x7f33b01080f0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.116+0000 7f33af7fe640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f33a8004af0 tx=0x7f33a8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.117+0000 7f33acff9640 1 -- 172.21.15.100:0/3742627238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8003b70 con 0x7f33b01080f0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.117+0000 7f33acff9640 1 -- 172.21.15.100:0/3742627238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33a8003d10 con 0x7f33b01080f0 2024-04-30T23:16:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.117+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b01a1ff0 con 0x7f33b01080f0 2024-04-30T23:16:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.117+0000 7f33acff9640 1 -- 172.21.15.100:0/3742627238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a802fb20 con 0x7f33b01080f0 2024-04-30T23:16:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.117+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b01a24b0 con 0x7f33b01080f0 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 Processor -- start 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33acff9640 1 -- 172.21.15.100:0/3742627238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f33a802fcc0 con 0x7f33b01080f0 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 -- start start 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887eb1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887eb2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558887dc8b10 con 0x558887aee6b0 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558887e15d80 con 0x558887ae64d0 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33bc382740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558887dcf8b0 con 0x558887b0f390 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:40480/0 (socket says 172.21.15.100:40480) 2024-04-30T23:16:45.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33a7fff640 1 -- 172.21.15.100:0/149085211 learned_addr learned my addr 172.21.15.100:0/149085211 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33aeffd640 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887eb1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.120+0000 7f33a7fff640 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887eb2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33acff9640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 0x7f339c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 -- 172.21.15.100:0/149085211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 msgr2=0x558887eb1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887eb1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 -- 172.21.15.100:0/149085211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 msgr2=0x558887eb2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887eb2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 -- 172.21.15.100:0/149085211 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558887da0a40 con 0x558887b0f390 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33af7fe640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 0x7f339c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33acff9640 1 -- 172.21.15.100:0/3742627238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f33a80f1c20 con 0x7f33b01080f0 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a7fff640 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3398011810 tx=0x7f33980097d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49133ae4f6b386c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a57fa640 1 -- 172.21.15.100:0/149085211 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398004030 con 0x558887b0f390 2024-04-30T23:16:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a57fa640 1 -- 172.21.15.100:0/149085211 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3398011e50 con 0x558887b0f390 2024-04-30T23:16:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.121+0000 7f33a57fa640 1 -- 172.21.15.100:0/149085211 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398003850 con 0x558887b0f390 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 -- 172.21.15.100:0/149085211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 msgr2=0x558887eb14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33af7fe640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 0x7f339c0a6140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c62e0 tx=0x7f33a80b2ff0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3398011810 tx=0x7f33980097d0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 -- 172.21.15.100:0/149085211 shutdown_connections 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887eb2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887eb1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 --2- 172.21.15.100:0/149085211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887b0f390 0x558887eb14f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 -- 172.21.15.100:0/149085211 >> 172.21.15.100:0/149085211 conn(0x558887b034e0 msgr2=0x558887eacd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 -- 172.21.15.100:0/149085211 shutdown_connections 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.122+0000 7f33bc382740 1 -- 172.21.15.100:0/149085211 wait complete. 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 -- start start 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 Processor -- start 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ebb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887b0f390 0x558887ec2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558887d9cd10 con 0x558887b0f390 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558887e11d40 con 0x558887ae64d0 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558887eb3210 con 0x558887aee6b0 2024-04-30T23:16:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33bc382740 10 client.0 _ll_register_callbacks cb 0x558887e22d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887b0f390 0x558887ec2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:40488/0 (socket says 172.21.15.100:40488) 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33aeffd640 1 -- 172.21.15.100:0/245120019 learned_addr learned my addr 172.21.15.100:0/245120019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.123+0000 7f33a7fff640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ebb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 -- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 msgr2=0x558887ebb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ebb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 -- 172.21.15.100:0/245120019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887b0f390 msgr2=0x558887ec2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887b0f390 0x558887ec2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 -- 172.21.15.100:0/245120019 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558887bf17d0 con 0x558887aee6b0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33aeffd640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33a0012700 tx=0x7f33a0012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9729d9aa1d145b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-04-30T23:16:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004050 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f33a00041f0 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3398011e50 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f33a00043f0 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33bc382740 10 client.25951 fetch_fsmap learned FSMap version 37 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558887b273f0 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3398011e50 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.124+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 37) ==== 8406+0+0 (secure 0 0 0) 0x7f33a0003ae0 con 0x558887aee6b0 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 10 client.25951 fetch_fsmap finished waiting for FSMap version 37 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 10 client.25951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 20 client.25951 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887acdf60 0x558887ec8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 4 client.25951 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558887e23990 con 0x558887acdf60 2024-04-30T23:16:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33a7fff640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887acdf60 0x558887ec8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33a7fff640 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887acdf60 0x558887ec8df0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc1947edef55ca4 server_cookie=9e3492ee2264f244 in_seq=0 out_seq=0 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.125+0000 7f33967fc640 10 client.25951 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33967fc640 1 -- 172.21.15.100:0/245120019 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558887e23990 con 0x558887acdf60 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33967fc640 10 client.25951 handle_command_reply: tid=0 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 client.25951 shutdown 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 msgr2=0x558887ebb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33a0012700 tx=0x7f33a0012bc0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 shutdown_connections 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887acdf60 0x558887ec8df0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887b0f390 0x558887ec2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887ebb8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33967fc640 0 client.25951 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 --2- 172.21.15.100:0/245120019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ebb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 >> 172.21.15.100:0/245120019 conn(0x558887b034e0 msgr2=0x558887eafc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 shutdown_connections 2024-04-30T23:16:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 1 -- 172.21.15.100:0/245120019 wait complete. 2024-04-30T23:16:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.126+0000 7f33bc382740 20 client.25951 trim_cache size 0 max 16384 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.144+0000 7f33bc382740 1 Processor -- start 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.144+0000 7f33bc382740 1 -- start start 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887ecdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01ac920 con 0x558887aee6b0 2024-04-30T23:16:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01ae5e0 con 0x558887ae64d0 2024-04-30T23:16:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33bc382740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01acff0 con 0x558887acdf60 2024-04-30T23:16:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887ecdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:40494/0 (socket says 172.21.15.100:40494) 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:55950/0 (socket says 172.21.15.100:55950) 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 -- 172.21.15.100:0/3005007660 learned_addr learned my addr 172.21.15.100:0/3005007660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 -- 172.21.15.100:0/3005007660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 msgr2=0x558887ecd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 -- 172.21.15.100:0/3005007660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 msgr2=0x558887ecdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887ecdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33a7fff640 1 -- 172.21.15.100:0/3005007660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558887ae70f0 con 0x558887acdf60 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.145+0000 7f33aeffd640 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.146+0000 7f33a7fff640 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3398000c00 tx=0x7f3398009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b82f93531626d91c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.146+0000 7f33a4ff9640 1 -- 172.21.15.100:0/3005007660 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339800fc80 con 0x558887acdf60 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.146+0000 7f33a4ff9640 1 -- 172.21.15.100:0/3005007660 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3398011e50 con 0x558887acdf60 2024-04-30T23:16:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.146+0000 7f33a4ff9640 1 -- 172.21.15.100:0/3005007660 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33980306c0 con 0x558887acdf60 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- 172.21.15.100:0/3005007660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 msgr2=0x558887ec2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3398000c00 tx=0x7f3398009b70 comp rx=0 tx=0).stop 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- 172.21.15.100:0/3005007660 shutdown_connections 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887aee6b0 0x558887ecdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887ae64d0 0x558887ecd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- 172.21.15.100:0/3005007660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887acdf60 0x558887ec2b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- 172.21.15.100:0/3005007660 >> 172.21.15.100:0/3005007660 conn(0x558887b034e0 msgr2=0x558887eb6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- 172.21.15.100:0/3005007660 shutdown_connections 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- 172.21.15.100:0/3005007660 wait complete. 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- start start 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 Processor -- start 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 0x558887f2a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887f30f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01ade50 con 0x558887ae64d0 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01ad6f0 con 0x558887acdf60 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f33b01aa900 con 0x558887aee6b0 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.147+0000 7f33bc382740 10 client.0 _ll_register_callbacks cb 0x7f33a0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 0x558887f2a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33a7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.100:55956/0 (socket says 172.21.15.100:55956) 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33a7fff640 1 -- 172.21.15.100:0/1286795676 learned_addr learned my addr 172.21.15.100:0/1286795676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33a7fff640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887f30f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 -- 172.21.15.100:0/1286795676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 msgr2=0x558887f30f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887f30f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 -- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 msgr2=0x558887f29b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 -- 172.21.15.100:0/1286795676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558887dd64b0 con 0x558887ae64d0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33a7fff640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33aeffd640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 0x558887f2a050 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x558887ead3e0 tx=0x7f33a0004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24950c80d87c0777 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33967fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0010b50 con 0x558887ae64d0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f33a0010cf0 con 0x558887ae64d0 2024-04-30T23:16:45.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3398011e50 con 0x558887ae64d0 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f33a0005020 con 0x558887ae64d0 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33bc382740 10 client.16488 fetch_fsmap learned FSMap version 37 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.148+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558887f32690 con 0x558887ae64d0 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3398011e50 con 0x558887ae64d0 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 37) ==== 8406+0+0 (secure 0 0 0) 0x7f33a0003aa0 con 0x558887ae64d0 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 10 client.16488 fetch_fsmap finished waiting for FSMap version 37 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 20 client.16488 populate_metadata read hostname 'smithi100' 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887b0f390 0x558887f35100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 4 client.16488 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558887e1d800 con 0x558887b0f390 2024-04-30T23:16:45.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33a7fff640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887b0f390 0x558887f35100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33a7fff640 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887b0f390 0x558887f35100 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4131deb4dd620725 server_cookie=afd39a201b0baecb in_seq=0 out_seq=0 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.149+0000 7f33967fc640 10 client.16488 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33967fc640 1 -- 172.21.15.100:0/1286795676 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x558887e1d800 con 0x558887b0f390 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33967fc640 10 client.16488 handle_command_reply: tid=0 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 client.16488 shutdown 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 msgr2=0x558887f2a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 0x558887f2a050 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x558887ead3e0 tx=0x7f33a0004200 comp rx=0 tx=0).stop 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 shutdown_connections 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558887b0f390 0x558887f35100 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33967fc640 0 client.16488 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558887aee6b0 0x558887f30f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558887ae64d0 0x558887f2a050 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 --2- 172.21.15.100:0/1286795676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558887acdf60 0x558887f29b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 >> 172.21.15.100:0/1286795676 conn(0x558887b034e0 msgr2=0x558887eb9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 shutdown_connections 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 1 -- 172.21.15.100:0/1286795676 wait complete. 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.150+0000 7f33bc382740 20 client.16488 trim_cache size 0 max 16384 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:16:45.161 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:16:45.163 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:16:45.164 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 msgr2=0x7f339c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 0x7f339c0a6140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c62e0 tx=0x7f33a80b2ff0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 msgr2=0x7f33b01a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f33a8004af0 tx=0x7f33a8031700 comp rx=0 tx=0).stop 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 shutdown_connections 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f339c0a3c30 0x7f339c0a6140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b01080f0 0x7f33b01a16f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b01033f0 0x7f33b019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 --2- 172.21.15.100:0/3742627238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b01021b0 0x7f33b019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:16:45.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 >> 172.21.15.100:0/3742627238 conn(0x7f33b00fd380 msgr2=0x7f33b01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:16:45.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 shutdown_connections 2024-04-30T23:16:45.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:16:45.151+0000 7f33b54cd640 1 -- 172.21.15.100:0/3742627238 wait complete. 2024-04-30T23:16:45.167 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:16:46.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:16:46.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:16:46.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:16:46.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:16:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:16:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:16:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:16:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:16:46.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:16:46.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:16:46.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:16:46.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:16:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:46 smithi104 ceph-mon[32987]: pgmap v468: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-04-30T23:16:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:46 smithi183 ceph-mon[33560]: pgmap v468: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-04-30T23:16:47.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:46 smithi100 ceph-mon[29745]: pgmap v468: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 268 op/s 2024-04-30T23:16:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:47 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:47 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:48.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:47 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:48 smithi104 ceph-mon[32987]: pgmap v469: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 263 op/s 2024-04-30T23:16:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:48 smithi183 ceph-mon[33560]: pgmap v469: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 263 op/s 2024-04-30T23:16:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:48 smithi100 ceph-mon[29745]: pgmap v469: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 263 op/s 2024-04-30T23:16:51.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:50 smithi104 ceph-mon[32987]: pgmap v470: 129 pgs: 129 active+clean; 162 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-04-30T23:16:51.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:50 smithi183 ceph-mon[33560]: pgmap v470: 129 pgs: 129 active+clean; 162 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-04-30T23:16:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:50 smithi100 ceph-mon[29745]: pgmap v470: 129 pgs: 129 active+clean; 162 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-04-30T23:16:52.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:51 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:52.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:51 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:52.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:51 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:16:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:52 smithi104 ceph-mon[32987]: pgmap v471: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-04-30T23:16:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:52 smithi183 ceph-mon[33560]: pgmap v471: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-04-30T23:16:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:52 smithi100 ceph-mon[29745]: pgmap v471: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-04-30T23:16:55.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:54 smithi104 ceph-mon[32987]: pgmap v472: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-04-30T23:16:55.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:54 smithi183 ceph-mon[33560]: pgmap v472: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-04-30T23:16:55.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:54 smithi100 ceph-mon[29745]: pgmap v472: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-04-30T23:16:57.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:56 smithi104 ceph-mon[32987]: pgmap v473: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 379 op/s 2024-04-30T23:16:57.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:56 smithi183 ceph-mon[33560]: pgmap v473: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 379 op/s 2024-04-30T23:16:57.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:56 smithi100 ceph-mon[29745]: pgmap v473: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 379 op/s 2024-04-30T23:16:59.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:16:58 smithi104 ceph-mon[32987]: pgmap v474: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-04-30T23:16:59.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:16:58 smithi183 ceph-mon[33560]: pgmap v474: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-04-30T23:16:59.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:16:58 smithi100 ceph-mon[29745]: pgmap v474: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-04-30T23:17:01.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:00 smithi104 ceph-mon[32987]: pgmap v475: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-04-30T23:17:01.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:00 smithi183 ceph-mon[33560]: pgmap v475: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-04-30T23:17:01.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:00 smithi100 ceph-mon[29745]: pgmap v475: 129 pgs: 129 active+clean; 167 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-04-30T23:17:03.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:02 smithi104 ceph-mon[32987]: pgmap v476: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 323 op/s 2024-04-30T23:17:03.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:02 smithi183 ceph-mon[33560]: pgmap v476: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 323 op/s 2024-04-30T23:17:03.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:02 smithi100 ceph-mon[29745]: pgmap v476: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 323 op/s 2024-04-30T23:17:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:04 smithi104 ceph-mon[32987]: pgmap v477: 129 pgs: 129 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 301 op/s 2024-04-30T23:17:05.051 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:04 smithi183 ceph-mon[33560]: pgmap v477: 129 pgs: 129 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 301 op/s 2024-04-30T23:17:05.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:04 smithi100 ceph-mon[29745]: pgmap v477: 129 pgs: 129 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 301 op/s 2024-04-30T23:17:07.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:06 smithi104 ceph-mon[32987]: pgmap v478: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-30T23:17:07.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:06 smithi183 ceph-mon[33560]: pgmap v478: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-30T23:17:07.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:06 smithi100 ceph-mon[29745]: pgmap v478: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-30T23:17:07.799 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-30T23:17:07.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-30T23:17:08.074 DEBUG:teuthology.parallel:result is None 2024-04-30T23:17:08.075 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-30T23:17:08.106 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-30T23:17:08.106 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-30T23:17:08.117 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-30T23:17:09.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:08 smithi104 ceph-mon[32987]: pgmap v479: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-04-30T23:17:09.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:08 smithi183 ceph-mon[33560]: pgmap v479: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-04-30T23:17:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:08 smithi100 ceph-mon[29745]: pgmap v479: 129 pgs: 129 active+clean; 166 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-04-30T23:17:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:10 smithi104 ceph-mon[32987]: pgmap v480: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-04-30T23:17:11.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:10 smithi183 ceph-mon[33560]: pgmap v480: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-04-30T23:17:11.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:10 smithi100 ceph-mon[29745]: pgmap v480: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-04-30T23:17:13.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:12 smithi104 ceph-mon[32987]: pgmap v481: 129 pgs: 129 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2024-04-30T23:17:13.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:12 smithi183 ceph-mon[33560]: pgmap v481: 129 pgs: 129 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2024-04-30T23:17:13.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:12 smithi100 ceph-mon[29745]: pgmap v481: 129 pgs: 129 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 254 op/s 2024-04-30T23:17:15.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:14 smithi183 ceph-mon[33560]: pgmap v482: 129 pgs: 129 active+clean; 162 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-04-30T23:17:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:14 smithi100 ceph-mon[29745]: pgmap v482: 129 pgs: 129 active+clean; 162 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-04-30T23:17:15.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:17:15.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 -- 172.21.15.100:0/3895055348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638103b30 msgr2=0x7f4638104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 --2- 172.21.15.100:0/3895055348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638103b30 0x7f4638104830 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f462c009900 tx=0x7f462c02a410 comp rx=0 tx=0).stop 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 -- 172.21.15.100:0/3895055348 shutdown_connections 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 --2- 172.21.15.100:0/3895055348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638109a70 0x7f463810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 --2- 172.21.15.100:0/3895055348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 0x7f4638105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 --2- 172.21.15.100:0/3895055348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638103b30 0x7f4638104830 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.290+0000 7f463f6e0640 1 -- 172.21.15.100:0/3895055348 >> 172.21.15.100:0/3895055348 conn(0x7f46380fed20 msgr2=0x7f46381011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- 172.21.15.100:0/3895055348 shutdown_connections 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- 172.21.15.100:0/3895055348 wait complete. 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 Processor -- start 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- start start 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638103b30 0x7f463819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 0x7f463819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f463810f690 con 0x7f4638109a70 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f463810f510 con 0x7f4638104d70 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.291+0000 7f463f6e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f463810f810 con 0x7f4638103b30 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60710/0 (socket says 172.21.15.100:60710) 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 -- 172.21.15.100:0/2417558507 learned_addr learned my addr 172.21.15.100:0/2417558507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 0x7f463819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463d47c640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638103b30 0x7f463819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 -- 172.21.15.100:0/2417558507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638103b30 msgr2=0x7f463819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638103b30 0x7f463819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 -- 172.21.15.100:0/2417558507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 msgr2=0x7f463819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 0x7f463819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 -- 172.21.15.100:0/2417558507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46381a1d80 con 0x7f4638109a70 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f463000cce0 tx=0x7f463000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f462a7fc640 1 -- 172.21.15.100:0/2417558507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463000f450 con 0x7f4638109a70 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46381a2070 con 0x7f4638109a70 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f462a7fc640 1 -- 172.21.15.100:0/2417558507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f463000faa0 con 0x7f4638109a70 2024-04-30T23:17:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f462a7fc640 1 -- 172.21.15.100:0/2417558507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630018a80 con 0x7f4638109a70 2024-04-30T23:17:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.292+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46381a2640 con 0x7f4638109a70 2024-04-30T23:17:15.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:14 smithi104 ceph-mon[32987]: pgmap v482: 129 pgs: 129 active+clean; 162 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f462a7fc640 1 -- 172.21.15.100:0/2417558507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f463000fc50 con 0x7f4638109a70 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 Processor -- start 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 -- start start 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f462a7fc640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 0x7f46240a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 0x565497df9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a2a4d0 0x565497df9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 0x565497dfab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565497d0cb10 con 0x565497a326b0 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x565497d59d80 con 0x565497a2a4d0 2024-04-30T23:17:15.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.295+0000 7f464659a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565497d138b0 con 0x565497a53390 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f462a7fc640 1 -- 172.21.15.100:0/2417558507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f46300d0c30 con 0x7f4638109a70 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 0x7f46240a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463d47c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 0x565497df9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 0x565497dfab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463cc7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a2a4d0 0x565497df9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463d47c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 0x565497df9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.100:33336/0 (socket says 172.21.15.100:33336) 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463d47c640 1 -- 172.21.15.100:0/3958716264 learned_addr learned my addr 172.21.15.100:0/3958716264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 -- 172.21.15.100:0/3958716264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 msgr2=0x565497df9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 0x565497df9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 -- 172.21.15.100:0/3958716264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a2a4d0 msgr2=0x565497df9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a2a4d0 0x565497df9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 -- 172.21.15.100:0/3958716264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565497ce4a40 con 0x565497a326b0 2024-04-30T23:17:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 0x7f46240a60c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4634009fd0 tx=0x7f4634009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 0x565497dfab10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4630017000 tx=0x7f463009c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faf22cb076ef5f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f46237fe640 1 -- 172.21.15.100:0/3958716264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463009cbb0 con 0x565497a326b0 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f46237fe640 1 -- 172.21.15.100:0/3958716264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46300a0f60 con 0x565497a326b0 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.296+0000 7f46237fe640 1 -- 172.21.15.100:0/3958716264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463009c000 con 0x565497a326b0 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 -- 172.21.15.100:0/3958716264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 msgr2=0x565497dfab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 0x565497dfab10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4630017000 tx=0x7f463009c7e0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 -- 172.21.15.100:0/3958716264 shutdown_connections 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a326b0 0x565497dfab10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a2a4d0 0x565497df9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 --2- 172.21.15.100:0/3958716264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a53390 0x565497df9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 -- 172.21.15.100:0/3958716264 >> 172.21.15.100:0/3958716264 conn(0x565497a474e0 msgr2=0x565497df0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 -- 172.21.15.100:0/3958716264 shutdown_connections 2024-04-30T23:17:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.297+0000 7f464659a740 1 -- 172.21.15.100:0/3958716264 wait complete. 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 -- start start 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 Processor -- start 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e03740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e03c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565497ce0d10 con 0x565497a53390 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x565497d55d40 con 0x565497a326b0 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565497dfb620 con 0x565497a2a4d0 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f464659a740 10 client.0 _ll_register_callbacks cb 0x565497d66d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60726/0 (socket says 172.21.15.100:60726) 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f463dc7d640 1 -- 172.21.15.100:0/2252180059 learned_addr learned my addr 172.21.15.100:0/2252180059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.298+0000 7f463d47c640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e03740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e03c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 -- 172.21.15.100:0/2252180059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 msgr2=0x565497e03740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e03740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 -- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 msgr2=0x565497e03c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e03c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 -- 172.21.15.100:0/2252180059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565497b357d0 con 0x565497a53390 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e03c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f46300ce420 tx=0x7f46300077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1320d6b35585477 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630061060 con 0x565497a53390 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f463009c000 con 0x565497a53390 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46300a0f60 con 0x565497a53390 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f463009cbb0 con 0x565497a53390 2024-04-30T23:17:15.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f464659a740 10 client.16500 fetch_fsmap learned FSMap version 39 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x565497a6b3f0 con 0x565497a53390 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46300a0f60 con 0x565497a53390 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7f4630020030 con 0x565497a53390 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f464659a740 10 client.16500 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.299+0000 7f464659a740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f464659a740 20 client.16500 populate_metadata read hostname 'smithi100' 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x565497a11f60 0x565497e10ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f464659a740 4 client.16500 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565497d67990 con 0x565497a11f60 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f463d47c640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x565497a11f60 0x565497e10ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f4620ff9640 10 client.16500 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.300+0000 7f463d47c640 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x565497a11f60 0x565497e10ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=714f7217e85aff69 server_cookie=ea84da0dc5ffb318 in_seq=0 out_seq=0 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f4620ff9640 1 -- 172.21.15.100:0/2252180059 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x565497d67990 con 0x565497a11f60 2024-04-30T23:17:15.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f4620ff9640 10 client.16500 handle_command_reply: tid=0 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 client.16500 shutdown 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 msgr2=0x565497e0abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f46300ce420 tx=0x7f46300077a0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 shutdown_connections 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x565497a11f60 0x565497e10ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e0abe0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e03c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 --2- 172.21.15.100:0/2252180059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e03740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f4620ff9640 0 client.16500 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 >> 172.21.15.100:0/2252180059 conn(0x565497a474e0 msgr2=0x565497defca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.301+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 shutdown_connections 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.302+0000 7f464659a740 1 -- 172.21.15.100:0/2252180059 wait complete. 2024-04-30T23:17:15.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.302+0000 7f464659a740 20 client.16500 trim_cache size 0 max 16384 2024-04-30T23:17:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 Processor -- start 2024-04-30T23:17:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 -- start start 2024-04-30T23:17:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497df05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46381aa720 con 0x565497a53390 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ac3e0 con 0x565497a326b0 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.319+0000 7f464659a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f46381aadf0 con 0x565497a2a4d0 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60736/0 (socket says 172.21.15.100:60736) 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 -- 172.21.15.100:0/3362681783 learned_addr learned my addr 172.21.15.100:0/3362681783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463cc7b640 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 -- 172.21.15.100:0/3362681783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 msgr2=0x565497df05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497df05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 -- 172.21.15.100:0/3362681783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 msgr2=0x565497e0ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e0ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 -- 172.21.15.100:0/3362681783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565497a2b0f0 con 0x565497a53390 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f463dc7d640 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f463009cb40 tx=0x7f463009d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267099853b1c1a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f4622ffd640 1 -- 172.21.15.100:0/3362681783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630061070 con 0x565497a53390 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f4622ffd640 1 -- 172.21.15.100:0/3362681783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46300a0f60 con 0x565497a53390 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.320+0000 7f4622ffd640 1 -- 172.21.15.100:0/3362681783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630061b80 con 0x565497a53390 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- 172.21.15.100:0/3362681783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 msgr2=0x565497df0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f463009cb40 tx=0x7f463009d2b0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- 172.21.15.100:0/3362681783 shutdown_connections 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497df0b30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e0ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 --2- 172.21.15.100:0/3362681783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497df05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- 172.21.15.100:0/3362681783 >> 172.21.15.100:0/3362681783 conn(0x565497a474e0 msgr2=0x565497e01d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- 172.21.15.100:0/3362681783 shutdown_connections 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- 172.21.15.100:0/3362681783 wait complete. 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 -- start start 2024-04-30T23:17:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.321+0000 7f464659a740 1 Processor -- start 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e08280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46381abc50 con 0x565497a53390 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ab4f0 con 0x565497a326b0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f46381a8700 con 0x565497a2a4d0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f464659a740 10 client.0 _ll_register_callbacks cb 0x7f4634009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60750/0 (socket says 172.21.15.100:60750) 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 -- 172.21.15.100:0/2133307372 learned_addr learned my addr 172.21.15.100:0/2133307372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463d47c640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e08280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 -- 172.21.15.100:0/2133307372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 msgr2=0x565497e08280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e08280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 -- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 msgr2=0x565497e087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 -- 172.21.15.100:0/2133307372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565497d1a4b0 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463cc7b640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f463dc7d640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f463009caf0 tx=0x7f463009ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7442bd3cc222aa22 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f4620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.322+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630061070 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f463009c200 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46300a0f60 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f463000f900 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 10 client.16506 fetch_fsmap learned FSMap version 39 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x565497d1a4b0 con 0x565497a53390 2024-04-30T23:17:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46300a0f60 con 0x565497a53390 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7f4630020070 con 0x565497a53390 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 10 client.16506 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 20 client.16506 populate_metadata read hostname 'smithi100' 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5654979e73a0 0x565497e791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 4 client.16506 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565497d61800 con 0x5654979e73a0 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.323+0000 7f463d47c640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5654979e73a0 0x565497e791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f4620ff9640 10 client.16506 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f463d47c640 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5654979e73a0 0x565497e791e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8aa2808b3af9c56 server_cookie=95eefd9022d860f6 in_seq=0 out_seq=0 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f4620ff9640 1 -- 172.21.15.100:0/2133307372 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x565497d61800 con 0x5654979e73a0 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f4620ff9640 10 client.16506 handle_command_reply: tid=0 2024-04-30T23:17:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 client.16506 shutdown 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 msgr2=0x565497e096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f463009caf0 tx=0x7f463009ba70 comp rx=0 tx=0).stop 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 shutdown_connections 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5654979e73a0 0x565497e791e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565497a53390 0x565497e096f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x565497a326b0 0x565497e087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f4620ff9640 0 client.16506 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 --2- 172.21.15.100:0/2133307372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565497a2a4d0 0x565497e08280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 >> 172.21.15.100:0/2133307372 conn(0x565497a474e0 msgr2=0x565497e01930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 shutdown_connections 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 1 -- 172.21.15.100:0/2133307372 wait complete. 2024-04-30T23:17:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.324+0000 7f464659a740 20 client.16506 trim_cache size 0 max 16384 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:17:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:17:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 msgr2=0x7f46240a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 0x7f46240a60c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4634009fd0 tx=0x7f4634009590 comp rx=0 tx=0).stop 2024-04-30T23:17:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 msgr2=0x7f46381a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f463000cce0 tx=0x7f463000a620 comp rx=0 tx=0).stop 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 shutdown_connections 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f46240a3bb0 0x7f46240a60c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4638109a70 0x7f46381a17c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4638104d70 0x7f463819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 --2- 172.21.15.100:0/2417558507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4638103b30 0x7f463819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 >> 172.21.15.100:0/2417558507 conn(0x7f46380fed20 msgr2=0x7f4638105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 shutdown_connections 2024-04-30T23:17:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:15.325+0000 7f463f6e0640 1 -- 172.21.15.100:0/2417558507 wait complete. 2024-04-30T23:17:15.340 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:17:17.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:16 smithi183 ceph-mon[33560]: pgmap v483: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 813 KiB/s wr, 197 op/s 2024-04-30T23:17:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:16 smithi100 ceph-mon[29745]: pgmap v483: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 813 KiB/s wr, 197 op/s 2024-04-30T23:17:17.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:16 smithi104 ceph-mon[32987]: pgmap v483: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 813 KiB/s wr, 197 op/s 2024-04-30T23:17:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:18 smithi100 ceph-mon[29745]: pgmap v484: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 477 KiB/s wr, 133 op/s 2024-04-30T23:17:19.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:18 smithi104 ceph-mon[32987]: pgmap v484: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 477 KiB/s wr, 133 op/s 2024-04-30T23:17:19.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:18 smithi183 ceph-mon[33560]: pgmap v484: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 477 KiB/s wr, 133 op/s 2024-04-30T23:17:21.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:20 smithi100 ceph-mon[29745]: pgmap v485: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 294 KiB/s wr, 100 op/s 2024-04-30T23:17:21.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:20 smithi104 ceph-mon[32987]: pgmap v485: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 294 KiB/s wr, 100 op/s 2024-04-30T23:17:21.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:20 smithi183 ceph-mon[33560]: pgmap v485: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 294 KiB/s wr, 100 op/s 2024-04-30T23:17:23.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:22 smithi100 ceph-mon[29745]: pgmap v486: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 192 KiB/s wr, 53 op/s 2024-04-30T23:17:23.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:22 smithi104 ceph-mon[32987]: pgmap v486: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 192 KiB/s wr, 53 op/s 2024-04-30T23:17:23.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:22 smithi183 ceph-mon[33560]: pgmap v486: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 192 KiB/s wr, 53 op/s 2024-04-30T23:17:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:24 smithi100 ceph-mon[29745]: pgmap v487: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-04-30T23:17:25.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:24 smithi104 ceph-mon[32987]: pgmap v487: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-04-30T23:17:25.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:24 smithi183 ceph-mon[33560]: pgmap v487: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-04-30T23:17:26.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:25 smithi104 ceph-mon[32987]: pgmap v488: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2024-04-30T23:17:26.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:25 smithi183 ceph-mon[33560]: pgmap v488: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2024-04-30T23:17:26.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:25 smithi100 ceph-mon[29745]: pgmap v488: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2024-04-30T23:17:29.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:28 smithi104 ceph-mon[32987]: pgmap v489: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 12 op/s 2024-04-30T23:17:29.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:28 smithi183 ceph-mon[33560]: pgmap v489: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 12 op/s 2024-04-30T23:17:29.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:28 smithi100 ceph-mon[29745]: pgmap v489: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 12 op/s 2024-04-30T23:17:31.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:30 smithi104 ceph-mon[32987]: pgmap v490: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:31.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:30 smithi183 ceph-mon[33560]: pgmap v490: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:31.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:30 smithi100 ceph-mon[29745]: pgmap v490: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:33.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:32 smithi104 ceph-mon[32987]: pgmap v491: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:33.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:32 smithi183 ceph-mon[33560]: pgmap v491: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:33.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:32 smithi100 ceph-mon[29745]: pgmap v491: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:35.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:34 smithi104 ceph-mon[32987]: pgmap v492: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:35.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:34 smithi183 ceph-mon[33560]: pgmap v492: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:35.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:34 smithi100 ceph-mon[29745]: pgmap v492: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:37.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:36 smithi104 ceph-mon[32987]: pgmap v493: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:37.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:36 smithi183 ceph-mon[33560]: pgmap v493: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:37.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:36 smithi100 ceph-mon[29745]: pgmap v493: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:39.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:38 smithi104 ceph-mon[32987]: pgmap v494: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:39.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:38 smithi183 ceph-mon[33560]: pgmap v494: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:39.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:38 smithi100 ceph-mon[29745]: pgmap v494: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:41.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:40 smithi104 ceph-mon[32987]: pgmap v495: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:41.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:40 smithi183 ceph-mon[33560]: pgmap v495: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:41.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:40 smithi100 ceph-mon[29745]: pgmap v495: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:42 smithi104 ceph-mon[32987]: pgmap v496: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:43.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:42 smithi183 ceph-mon[33560]: pgmap v496: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:42 smithi100 ceph-mon[29745]: pgmap v496: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:44 smithi104 ceph-mon[32987]: pgmap v497: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:44 smithi183 ceph-mon[33560]: pgmap v497: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:44 smithi100 ceph-mon[29745]: pgmap v497: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:45.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:17:45.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 -- 172.21.15.100:0/2982446515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 msgr2=0x7fa460109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 --2- 172.21.15.100:0/2982446515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa460109140 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa450009900 tx=0x7fa45002a410 comp rx=0 tx=0).stop 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 -- 172.21.15.100:0/2982446515 shutdown_connections 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 --2- 172.21.15.100:0/2982446515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 0x7fa46010bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 --2- 172.21.15.100:0/2982446515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa460109140 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 --2- 172.21.15.100:0/2982446515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 0x7fa460102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 -- 172.21.15.100:0/2982446515 >> 172.21.15.100:0/2982446515 conn(0x7fa4600fd390 msgr2=0x7fa4600ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 -- 172.21.15.100:0/2982446515 shutdown_connections 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 -- 172.21.15.100:0/2982446515 wait complete. 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.464+0000 7fa467b35640 1 Processor -- start 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 -- start start 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 0x7fa460104350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 0x7fa460102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010f640 con 0x7fa460106c60 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010f4c0 con 0x7fa460101e80 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa467b35640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010f7c0 con 0x7fa4601097d0 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33276/0 (socket says 172.21.15.100:33276) 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 -- 172.21.15.100:0/4139918979 learned_addr learned my addr 172.21.15.100:0/4139918979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:45.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4660d2640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 0x7fa460102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 -- 172.21.15.100:0/4139918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 msgr2=0x7fa460102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 0x7fa460102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 -- 172.21.15.100:0/4139918979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 msgr2=0x7fa460104350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4658d1640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 0x7fa460104350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 0x7fa460104350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 -- 172.21.15.100:0/4139918979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa460103660 con 0x7fa460106c60 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa4650d0640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa450004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa456ffd640 1 -- 172.21.15.100:0/4139918979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45003f030 con 0x7fa460106c60 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.465+0000 7fa456ffd640 1 -- 172.21.15.100:0/4139918979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa450003cb0 con 0x7fa460106c60 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.466+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4601a4310 con 0x7fa460106c60 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.466+0000 7fa456ffd640 1 -- 172.21.15.100:0/4139918979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450035070 con 0x7fa460106c60 2024-04-30T23:17:45.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.466+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a4770 con 0x7fa460106c60 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.468+0000 7fa46e9e0740 1 Processor -- start 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 -- start start 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa456ffd640 1 -- 172.21.15.100:0/4139918979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa450042030 con 0x7fa460106c60 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5620456beb10 con 0x562045405390 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56204570bd80 con 0x5620453e46b0 2024-04-30T23:17:45.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5620456c58b0 con 0x5620453dc4d0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33286/0 (socket says 172.21.15.100:33286) 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 -- 172.21.15.100:0/2301279095 learned_addr learned my addr 172.21.15.100:0/2301279095 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4658d1640 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4650d0640 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 -- 172.21.15.100:0/2301279095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 msgr2=0x5620457a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 -- 172.21.15.100:0/2301279095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 msgr2=0x5620457a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa4660d2640 1 -- 172.21.15.100:0/2301279095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562045696a40 con 0x562045405390 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.469+0000 7fa456ffd640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 0x7fa44c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa4658d1640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 0x7fa44c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa4660d2640 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa458009f20 tx=0x7fa45800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea8d8eb23d25966 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa456ffd640 1 -- 172.21.15.100:0/4139918979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa4500f0e40 con 0x7fa460106c60 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa44bfff640 1 -- 172.21.15.100:0/2301279095 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458015070 con 0x562045405390 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa44bfff640 1 -- 172.21.15.100:0/2301279095 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45801ab10 con 0x562045405390 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.470+0000 7fa44bfff640 1 -- 172.21.15.100:0/2301279095 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458011bb0 con 0x562045405390 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2301279095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 msgr2=0x5620457a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa458009f20 tx=0x7fa45800f7f0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa4658d1640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 0x7fa44c0a6140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5620457a7210 tx=0x7fa45c009450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2301279095 shutdown_connections 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2301279095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457a74f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2301279095 >> 172.21.15.100:0/2301279095 conn(0x5620453f94e0 msgr2=0x5620457a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2301279095 shutdown_connections 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2301279095 wait complete. 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 -- start start 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.471+0000 7fa46e9e0740 1 Processor -- start 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562045692d10 con 0x562045405390 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562045707d40 con 0x5620453e46b0 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5620457a9210 con 0x5620453dc4d0 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa46e9e0740 10 client.0 _ll_register_callbacks cb 0x562045718d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33298/0 (socket says 172.21.15.100:33298) 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 -- 172.21.15.100:0/3755803352 learned_addr learned my addr 172.21.15.100:0/3755803352 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4658d1640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4650d0640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 -- 172.21.15.100:0/3755803352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 msgr2=0x5620457b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 -- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 msgr2=0x5620457b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 -- 172.21.15.100:0/3755803352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620454e77d0 con 0x562045405390 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4660d2640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa458009370 tx=0x7fa458004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f85dc15dc52ab69 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.472+0000 7fa4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458028060 con 0x562045405390 2024-04-30T23:17:45.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa45801a670 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45801ab10 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa45802f050 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 10 client.16518 fetch_fsmap learned FSMap version 39 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56204541d3f0 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45801ab10 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7fa458005160 con 0x562045405390 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 10 client.16518 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 20 client.16518 populate_metadata read hostname 'smithi100' 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453c3f60 0x5620457beac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 4 client.16518 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562045719990 con 0x5620453c3f60 2024-04-30T23:17:45.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.473+0000 7fa4658d1640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453c3f60 0x5620457beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.474+0000 7fa4497fa640 10 client.16518 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.474+0000 7fa4658d1640 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453c3f60 0x5620457beac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179e28efc2aaff41 server_cookie=6faef0594d91012d in_seq=0 out_seq=0 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa4497fa640 1 -- 172.21.15.100:0/3755803352 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562045719990 con 0x5620453c3f60 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa4497fa640 10 client.16518 handle_command_reply: tid=0 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 client.16518 shutdown 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 msgr2=0x5620457b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa458009370 tx=0x7fa458004c70 comp rx=0 tx=0).stop 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 shutdown_connections 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453c3f60 0x5620457beac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b88f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453e46b0 0x5620457b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/3755803352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa4497fa640 0 client.16518 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 >> 172.21.15.100:0/3755803352 conn(0x5620453f94e0 msgr2=0x5620457a5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 shutdown_connections 2024-04-30T23:17:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 1 -- 172.21.15.100:0/3755803352 wait complete. 2024-04-30T23:17:45.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.475+0000 7fa46e9e0740 20 client.16518 trim_cache size 0 max 16384 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 Processor -- start 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 -- start start 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 0x5620457b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453e46b0 0x5620457b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601aea90 con 0x562045405390 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601b0750 con 0x5620453dc4d0 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601af160 con 0x5620453e46b0 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33304/0 (socket says 172.21.15.100:33304) 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 -- 172.21.15.100:0/1336443129 learned_addr learned my addr 172.21.15.100:0/1336443129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4658d1640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 0x5620457b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 -- 172.21.15.100:0/1336443129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453e46b0 msgr2=0x5620457b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4650d0640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453e46b0 0x5620457b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453e46b0 0x5620457b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 -- 172.21.15.100:0/1336443129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 msgr2=0x5620457b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 0x5620457b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4660d2640 1 -- 172.21.15.100:0/1336443129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620457bee30 con 0x562045405390 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.493+0000 7fa4658d1640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 0x5620457b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa4660d2640 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa458005b40 tx=0x7fa458009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd176fc2c6fa3895 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa44b7fe640 1 -- 172.21.15.100:0/1336443129 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458028070 con 0x562045405390 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa44b7fe640 1 -- 172.21.15.100:0/1336443129 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4580058d0 con 0x562045405390 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa44b7fe640 1 -- 172.21.15.100:0/1336443129 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458015070 con 0x562045405390 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 -- 172.21.15.100:0/1336443129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 msgr2=0x5620457b8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa458005b40 tx=0x7fa458009e20 comp rx=0 tx=0).stop 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 -- 172.21.15.100:0/1336443129 shutdown_connections 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562045405390 0x5620457b8810 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453e46b0 0x5620457b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/1336443129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620453dc4d0 0x5620457b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 -- 172.21.15.100:0/1336443129 >> 172.21.15.100:0/1336443129 conn(0x5620453f94e0 msgr2=0x5620457b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 -- 172.21.15.100:0/1336443129 shutdown_connections 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.494+0000 7fa46e9e0740 1 -- 172.21.15.100:0/1336443129 wait complete. 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 -- start start 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 Processor -- start 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 0x562045822c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601affc0 con 0x5620453e46b0 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601af860 con 0x562045405390 2024-04-30T23:17:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601aca70 con 0x5620453dc4d0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa46e9e0740 10 client.0 _ll_register_callbacks cb 0x7fa45c009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa4650d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa4650d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33308/0 (socket says 172.21.15.100:33308) 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa4650d0640 1 -- 172.21.15.100:0/2430885164 learned_addr learned my addr 172.21.15.100:0/2430885164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.495+0000 7fa4660d2640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 0x562045822c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4658d1640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 -- 172.21.15.100:0/2430885164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 msgr2=0x5620457b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 -- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 msgr2=0x562045822c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 0x562045822c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 -- 172.21.15.100:0/2430885164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620453dd0f0 con 0x5620453e46b0 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4660d2640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 0x562045822c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:17:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4658d1640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4650d0640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa4500ee5e0 tx=0x7fa450005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a369a98e73d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450049070 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa4500b9430 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4580058d0 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa4500bc720 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa46e9e0740 10 client.16524 fetch_fsmap learned FSMap version 39 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5620456cc4b0 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.496+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4580058d0 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7fa4500f2040 con 0x5620453e46b0 2024-04-30T23:17:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 10 client.16524 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:17:45.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:17:45.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 20 client.16524 populate_metadata read hostname 'smithi100' 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453993a0 0x5620458269a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 4 client.16524 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562045713800 con 0x5620453993a0 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4658d1640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453993a0 0x5620458269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4497fa640 10 client.16524 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4658d1640 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453993a0 0x5620458269a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e564c914e21ed83 server_cookie=1aef052c98bde34a in_seq=0 out_seq=0 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4497fa640 1 -- 172.21.15.100:0/2430885164 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x562045713800 con 0x5620453993a0 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa4497fa640 10 client.16524 handle_command_reply: tid=0 2024-04-30T23:17:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.497+0000 7fa46e9e0740 1 client.16524 shutdown 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 msgr2=0x5620457b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa4500ee5e0 tx=0x7fa450005d50 comp rx=0 tx=0).stop 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 shutdown_connections 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5620453993a0 0x5620458269a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562045405390 0x562045822c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620453e46b0 0x5620457b5b20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 --2- 172.21.15.100:0/2430885164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620453dc4d0 0x5620457b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa4497fa640 0 client.16524 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 >> 172.21.15.100:0/2430885164 conn(0x5620453f94e0 msgr2=0x5620457a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 shutdown_connections 2024-04-30T23:17:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 1 -- 172.21.15.100:0/2430885164 wait complete. 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa46e9e0740 20 client.16524 trim_cache size 0 max 16384 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:17:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.512 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:17:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:17:45.515 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 msgr2=0x7fa44c0a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 0x7fa44c0a6140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5620457a7210 tx=0x7fa45c009450 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 msgr2=0x7fa4601029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa450004340 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 shutdown_connections 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa44c0a3c30 0x7fa44c0a6140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4601097d0 0x7fa460102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106c60 0x7fa4601029f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 --2- 172.21.15.100:0/4139918979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa460101e80 0x7fa460104350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:17:45.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 >> 172.21.15.100:0/4139918979 conn(0x7fa4600fd390 msgr2=0x7fa46010a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:17:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 shutdown_connections 2024-04-30T23:17:45.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:17:45.498+0000 7fa467b35640 1 -- 172.21.15.100:0/4139918979 wait complete. 2024-04-30T23:17:45.518 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:17:46.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:45 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:17:46.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:45 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:17:46.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:45 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:17:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:46 smithi104 ceph-mon[32987]: pgmap v498: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:17:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:17:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:17:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:46 smithi183 ceph-mon[33560]: pgmap v498: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:17:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:17:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:17:47.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:46 smithi100 ceph-mon[29745]: pgmap v498: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:47.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:17:47.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:17:47.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:17:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:48 smithi104 ceph-mon[32987]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:48 smithi183 ceph-mon[33560]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:49.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:48 smithi100 ceph-mon[29745]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:51.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:50 smithi104 ceph-mon[32987]: pgmap v500: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:51.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:50 smithi183 ceph-mon[33560]: pgmap v500: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:51.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:50 smithi100 ceph-mon[29745]: pgmap v500: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:17:53.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:52 smithi104 ceph-mon[32987]: pgmap v501: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:52 smithi183 ceph-mon[33560]: pgmap v501: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:53.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:52 smithi100 ceph-mon[29745]: pgmap v501: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:17:55.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:54 smithi183 ceph-mon[33560]: pgmap v502: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:55.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:54 smithi100 ceph-mon[29745]: pgmap v502: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:55.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:54 smithi104 ceph-mon[32987]: pgmap v502: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:17:57.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:56 smithi183 ceph-mon[33560]: pgmap v503: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:57.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:56 smithi100 ceph-mon[29745]: pgmap v503: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:57.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:56 smithi104 ceph-mon[32987]: pgmap v503: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:17:59.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:17:58 smithi100 ceph-mon[29745]: pgmap v504: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:59.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:17:58 smithi104 ceph-mon[32987]: pgmap v504: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:17:59.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:17:58 smithi183 ceph-mon[33560]: pgmap v504: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:01.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:00 smithi100 ceph-mon[29745]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:01.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:00 smithi104 ceph-mon[32987]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:00 smithi183 ceph-mon[33560]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:03.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:02 smithi100 ceph-mon[29745]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:03.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:02 smithi104 ceph-mon[32987]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:03.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:02 smithi183 ceph-mon[33560]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:05.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:04 smithi100 ceph-mon[29745]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:05.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:04 smithi104 ceph-mon[32987]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:05.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:04 smithi183 ceph-mon[33560]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:07.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:06 smithi100 ceph-mon[29745]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:07.104 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:06 smithi183 ceph-mon[33560]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:07.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:06 smithi104 ceph-mon[32987]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:09.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:08 smithi100 ceph-mon[29745]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:09.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:08 smithi104 ceph-mon[32987]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:09.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:08 smithi183 ceph-mon[33560]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:10.198 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:09 smithi104 ceph-mon[32987]: pgmap v510: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:10.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:09 smithi183 ceph-mon[33560]: pgmap v510: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:10.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:09 smithi100 ceph-mon[29745]: pgmap v510: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:13.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:12 smithi104 ceph-mon[32987]: pgmap v511: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:13.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:12 smithi183 ceph-mon[33560]: pgmap v511: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:13.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:12 smithi100 ceph-mon[29745]: pgmap v511: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:15.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:14 smithi104 ceph-mon[32987]: pgmap v512: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:15.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:14 smithi183 ceph-mon[33560]: pgmap v512: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:14 smithi100 ceph-mon[29745]: pgmap v512: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:15.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:18:15.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 -- 172.21.15.100:0/748591045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0103b40 msgr2=0x7fc1f0104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/748591045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0103b40 0x7fc1f0104840 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009900 tx=0x7fc1e402a410 comp rx=0 tx=0).stop 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 -- 172.21.15.100:0/748591045 shutdown_connections 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/748591045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/748591045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0104d80 0x7fc1f0105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/748591045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0103b40 0x7fc1f0104840 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 -- 172.21.15.100:0/748591045 >> 172.21.15.100:0/748591045 conn(0x7fc1f00fed30 msgr2=0x7fc1f01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 -- 172.21.15.100:0/748591045 shutdown_connections 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.642+0000 7fc1f6c49640 1 -- 172.21.15.100:0/748591045 wait complete. 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 Processor -- start 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 -- start start 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0103b40 0x7fc1f019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f01a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f010f620 con 0x7fc1f0104d80 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f010f4a0 con 0x7fc1f0109a80 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f6c49640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f010f7a0 con 0x7fc1f0103b40 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38512/0 (socket says 172.21.15.100:38512) 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1effff640 1 -- 172.21.15.100:0/3087830390 learned_addr learned my addr 172.21.15.100:0/3087830390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0103b40 0x7fc1f019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.643+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f01a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 -- 172.21.15.100:0/3087830390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0103b40 msgr2=0x7fc1f019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0103b40 0x7fc1f019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 -- 172.21.15.100:0/3087830390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 msgr2=0x7fc1f01a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f01a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 -- 172.21.15.100:0/3087830390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f01a1df0 con 0x7fc1f0104d80 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f01a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1effff640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00d950 tx=0x7fc1dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1edffb640 1 -- 172.21.15.100:0/3087830390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc017070 con 0x7fc1f0104d80 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1edffb640 1 -- 172.21.15.100:0/3087830390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc009c30 con 0x7fc1f0104d80 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1edffb640 1 -- 172.21.15.100:0/3087830390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00f620 con 0x7fc1f0104d80 2024-04-30T23:18:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f01a20e0 con 0x7fc1f0104d80 2024-04-30T23:18:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.644+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f01a2630 con 0x7fc1f0104d80 2024-04-30T23:18:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1edffb640 1 -- 172.21.15.100:0/3087830390 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc1dc010460 con 0x7fc1f0104d80 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 Processor -- start 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 -- start start 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54a5390 0x564ea58474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea547c4d0 0x564ea5847a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564ea575eb10 con 0x564ea54846b0 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ea57abd80 con 0x564ea54a5390 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564ea57658b0 con 0x564ea547c4d0 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1edffb640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 0x7fc1e00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38520/0 (socket says 172.21.15.100:38520) 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1effff640 1 -- 172.21.15.100:0/4290912084 learned_addr learned my addr 172.21.15.100:0/4290912084 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.647+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 0x7fc1e00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea547c4d0 0x564ea5847a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54a5390 0x564ea58474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1edffb640 1 -- 172.21.15.100:0/3087830390 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc1dc0d0390 con 0x7fc1f0104d80 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 -- 172.21.15.100:0/4290912084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea547c4d0 msgr2=0x564ea5847a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea547c4d0 0x564ea5847a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 -- 172.21.15.100:0/4290912084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54a5390 msgr2=0x564ea58474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54a5390 0x564ea58474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 -- 172.21.15.100:0/4290912084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea5736a40 con 0x564ea54846b0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1effff640 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc098ce0 tx=0x7fc1dc010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b78e0a76be756cf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 0x7fc1e00a60c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800afd0 tx=0x7fc1e800ad00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1daffd640 1 -- 172.21.15.100:0/4290912084 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc020050 con 0x564ea54846b0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1daffd640 1 -- 172.21.15.100:0/4290912084 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc0a06c0 con 0x564ea54846b0 2024-04-30T23:18:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.648+0000 7fc1daffd640 1 -- 172.21.15.100:0/4290912084 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc098060 con 0x564ea54846b0 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/4290912084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 msgr2=0x564ea5848700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc098ce0 tx=0x7fc1dc010cb0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/4290912084 shutdown_connections 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5848700 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea547c4d0 0x564ea5847a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/4290912084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54a5390 0x564ea58474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/4290912084 >> 172.21.15.100:0/4290912084 conn(0x564ea54994e0 msgr2=0x564ea5842d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/4290912084 shutdown_connections 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/4290912084 wait complete. 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.649+0000 7fc1fdbd4740 1 -- start start 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 Processor -- start 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea58517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564ea5732d10 con 0x564ea547c4d0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ea57a7d40 con 0x564ea54846b0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564ea58491b0 con 0x564ea54a5390 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1fdbd4740 10 client.0 _ll_register_callbacks cb 0x564ea57b8d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38522/0 (socket says 172.21.15.100:38522) 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 -- 172.21.15.100:0/3070306631 learned_addr learned my addr 172.21.15.100:0/3070306631 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1effff640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea58517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 -- 172.21.15.100:0/3070306631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 msgr2=0x564ea58586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 -- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 msgr2=0x564ea58517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea58517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1f49e5640 1 -- 172.21.15.100:0/3070306631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea55877d0 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.650+0000 7fc1effff640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea58517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009230 tx=0x7fc1e40315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e025d09424cdccf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4035040 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc1e4004240 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1dc0a06c0 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc1e4004440 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 10 client.16536 fetch_fsmap learned FSMap version 39 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564ea54bd3f0 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc0a06c0 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7fc1e4044020 con 0x564ea547c4d0 2024-04-30T23:18:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 10 client.16536 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 20 client.16536 populate_metadata read hostname 'smithi100' 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea5463f60 0x564ea585ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 4 client.16536 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.651+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ea57b9990 con 0x564ea5463f60 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.652+0000 7fc1effff640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea5463f60 0x564ea585ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.652+0000 7fc1cffff640 10 client.16536 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.652+0000 7fc1effff640 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea5463f60 0x564ea585ec50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9b42ed0e20e4daf server_cookie=c3f65f85b81c4696 in_seq=0 out_seq=0 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1cffff640 1 -- 172.21.15.100:0/3070306631 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x7fc1dc081bf0 con 0x564ea5463f60 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1cffff640 10 client.16536 handle_command_reply: tid=0 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 client.16536 shutdown 2024-04-30T23:18:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 msgr2=0x564ea5851270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009230 tx=0x7fc1e40315a0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 shutdown_connections 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea5463f60 0x564ea585ec50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea58517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/3070306631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea5851270 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 >> 172.21.15.100:0/3070306631 conn(0x564ea54994e0 msgr2=0x564ea5845c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1cffff640 0 client.16536 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 shutdown_connections 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/3070306631 wait complete. 2024-04-30T23:18:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.653+0000 7fc1fdbd4740 20 client.16536 trim_cache size 0 max 16384 2024-04-30T23:18:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 Processor -- start 2024-04-30T23:18:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 -- start start 2024-04-30T23:18:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea5842dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01aa6e0 con 0x564ea547c4d0 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01ac3a0 con 0x564ea54846b0 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01aadb0 con 0x564ea54a5390 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38534/0 (socket says 172.21.15.100:38534) 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 -- 172.21.15.100:0/2382545961 learned_addr learned my addr 172.21.15.100:0/2382545961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 -- 172.21.15.100:0/2382545961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 msgr2=0x564ea58585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1effff640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea5842dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 -- 172.21.15.100:0/2382545961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 msgr2=0x564ea5842dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea5842dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f49e5640 1 -- 172.21.15.100:0/2382545961 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea547d0f0 con 0x564ea547c4d0 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1f51e6640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.671+0000 7fc1effff640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea5842dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4031a90 tx=0x7fc1e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33f4bbd3413f7d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1da7fc640 1 -- 172.21.15.100:0/2382545961 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4035070 con 0x564ea547c4d0 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1da7fc640 1 -- 172.21.15.100:0/2382545961 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e4046950 con 0x564ea547c4d0 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1da7fc640 1 -- 172.21.15.100:0/2382545961 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e403c6a0 con 0x564ea547c4d0 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/2382545961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 msgr2=0x564ea584c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4031a90 tx=0x7fc1e402a410 comp rx=0 tx=0).stop 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/2382545961 shutdown_connections 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea58585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea54846b0 0x564ea5842dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.672+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/2382545961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea547c4d0 0x564ea584c7c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/2382545961 >> 172.21.15.100:0/2382545961 conn(0x564ea54994e0 msgr2=0x564ea58426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/2382545961 shutdown_connections 2024-04-30T23:18:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/2382545961 wait complete. 2024-04-30T23:18:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- start start 2024-04-30T23:18:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 Processor -- start 2024-04-30T23:18:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea547c4d0 0x564ea5858d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea5855dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01abc10 con 0x564ea54846b0 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01ab4b0 con 0x564ea547c4d0 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f01a86c0 con 0x564ea54a5390 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1fdbd4740 10 client.0 _ll_register_callbacks cb 0x7fc1e4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38550/0 (socket says 172.21.15.100:38550) 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.673+0000 7fc1effff640 1 -- 172.21.15.100:0/1885861885 learned_addr learned my addr 172.21.15.100:0/1885861885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea547c4d0 0x564ea5858d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 -- 172.21.15.100:0/1885861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 msgr2=0x564ea5855dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea5855dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 -- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea547c4d0 msgr2=0x564ea5858d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea547c4d0 0x564ea5858d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 -- 172.21.15.100:0/1885861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea576c4b0 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1effff640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc09c010 tx=0x7fc1dc09a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5b0a1014786b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1cffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc020040 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc1dc098980 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e4046950 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc0a06c0 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1fdbd4740 10 client.16542 fetch_fsmap learned FSMap version 39 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564ea58c3e10 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.674+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc07c080 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 39) ==== 8418+0+0 (secure 0 0 0) 0x7fc1dc0980f0 con 0x564ea54846b0 2024-04-30T23:18:15.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 10 client.16542 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 20 client.16542 populate_metadata read hostname 'smithi100' 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea54393a0 0x564ea58c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 4 client.16542 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ea57b3800 con 0x564ea54393a0 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea54393a0 0x564ea58c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1cffff640 10 client.16542 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.675+0000 7fc1f49e5640 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea54393a0 0x564ea58c63c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2afa4b7c8132dca server_cookie=f41b84e424f8e26f in_seq=0 out_seq=0 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1cffff640 1 -- 172.21.15.100:0/1885861885 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x564ea57b3800 con 0x564ea54393a0 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1cffff640 10 client.16542 handle_command_reply: tid=0 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 client.16542 shutdown 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 msgr2=0x564ea5855880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc09c010 tx=0x7fc1dc09a610 comp rx=0 tx=0).stop 2024-04-30T23:18:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 shutdown_connections 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x564ea54393a0 0x564ea58c63c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564ea54a5390 0x564ea5855dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564ea54846b0 0x564ea5855880 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1cffff640 0 client.16542 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 --2- 172.21.15.100:0/1885861885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ea547c4d0 0x564ea5858d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 >> 172.21.15.100:0/1885861885 conn(0x564ea54994e0 msgr2=0x564ea5850db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 shutdown_connections 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 1 -- 172.21.15.100:0/1885861885 wait complete. 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.676+0000 7fc1fdbd4740 20 client.16542 trim_cache size 0 max 16384 2024-04-30T23:18:15.684 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:18:15.686 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:15.688 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:15.689 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:15.689 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:15.689 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 msgr2=0x7fc1e00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 0x7fc1e00a60c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800afd0 tx=0x7fc1e800ad00 comp rx=0 tx=0).stop 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 msgr2=0x7fc1f019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00d950 tx=0x7fc1dc00de10 comp rx=0 tx=0).stop 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 shutdown_connections 2024-04-30T23:18:15.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc1e00a3bb0 0x7fc1e00a60c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1f0109a80 0x7fc1f01a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1f0104d80 0x7fc1f019a7f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 --2- 172.21.15.100:0/3087830390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1f0103b40 0x7fc1f019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 >> 172.21.15.100:0/3087830390 conn(0x7fc1f00fed30 msgr2=0x7fc1f0105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 shutdown_connections 2024-04-30T23:18:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:15.677+0000 7fc1f6c49640 1 -- 172.21.15.100:0/3087830390 wait complete. 2024-04-30T23:18:15.691 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:18:17.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:16 smithi104 ceph-mon[32987]: pgmap v513: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:17.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:16 smithi183 ceph-mon[33560]: pgmap v513: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:17.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:16 smithi100 ceph-mon[29745]: pgmap v513: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:19.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:18 smithi104 ceph-mon[32987]: pgmap v514: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:19.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:18 smithi183 ceph-mon[33560]: pgmap v514: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:18 smithi100 ceph-mon[29745]: pgmap v514: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:21.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:20 smithi104 ceph-mon[32987]: pgmap v515: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:21.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:20 smithi183 ceph-mon[33560]: pgmap v515: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:21.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:20 smithi100 ceph-mon[29745]: pgmap v515: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:23.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:22 smithi104 ceph-mon[32987]: pgmap v516: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:23.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:22 smithi183 ceph-mon[33560]: pgmap v516: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:23.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:22 smithi100 ceph-mon[29745]: pgmap v516: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:25.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:24 smithi104 ceph-mon[32987]: pgmap v517: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:25.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:24 smithi183 ceph-mon[33560]: pgmap v517: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:24 smithi100 ceph-mon[29745]: pgmap v517: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:27.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:26 smithi183 ceph-mon[33560]: pgmap v518: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:27.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:26 smithi100 ceph-mon[29745]: pgmap v518: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:27.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:26 smithi104 ceph-mon[32987]: pgmap v518: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:29.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:28 smithi183 ceph-mon[33560]: pgmap v519: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:29.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:28 smithi100 ceph-mon[29745]: pgmap v519: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:29.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:28 smithi104 ceph-mon[32987]: pgmap v519: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:31.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:30 smithi100 ceph-mon[29745]: pgmap v520: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:31.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:30 smithi104 ceph-mon[32987]: pgmap v520: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:31.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:30 smithi183 ceph-mon[33560]: pgmap v520: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:32.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:31 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:32.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:31 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:32.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:31 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:33.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:32 smithi100 ceph-mon[29745]: pgmap v521: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:33.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:32 smithi104 ceph-mon[32987]: pgmap v521: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:33.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:32 smithi183 ceph-mon[33560]: pgmap v521: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:35.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:34 smithi100 ceph-mon[29745]: pgmap v522: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:35.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:34 smithi104 ceph-mon[32987]: pgmap v522: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:35.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:34 smithi183 ceph-mon[33560]: pgmap v522: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:35 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:35 smithi104 ceph-mon[32987]: pgmap v523: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:36.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:35 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:36.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:35 smithi183 ceph-mon[33560]: pgmap v523: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:35 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:35 smithi100 ceph-mon[29745]: pgmap v523: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:38.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:37 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:38.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:37 smithi183 ceph-mon[33560]: pgmap v524: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:37 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:37 smithi104 ceph-mon[32987]: pgmap v524: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:38.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:37 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:38.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:37 smithi100 ceph-mon[29745]: pgmap v524: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:41.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:40 smithi104 ceph-mon[32987]: pgmap v525: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:41.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:40 smithi183 ceph-mon[33560]: pgmap v525: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:41.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:40 smithi100 ceph-mon[29745]: pgmap v525: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:18:43.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:42 smithi104 ceph-mon[32987]: pgmap v526: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:43.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:42 smithi183 ceph-mon[33560]: pgmap v526: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:42 smithi100 ceph-mon[29745]: pgmap v526: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:18:45.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:44 smithi104 ceph-mon[32987]: pgmap v527: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:45.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:44 smithi183 ceph-mon[33560]: pgmap v527: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:44 smithi100 ceph-mon[29745]: pgmap v527: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:18:45.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:18:45.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:18:45.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 -- 172.21.15.100:0/3112327228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4101e90 msgr2=0x7f2cd41022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/3112327228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4101e90 0x7f2cd41022a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009900 tx=0x7f2cc402a410 comp rx=0 tx=0).stop 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 -- 172.21.15.100:0/3112327228 shutdown_connections 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/3112327228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 0x7f2cd410bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/3112327228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4106c70 0x7f2cd4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/3112327228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4101e90 0x7f2cd41022a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 -- 172.21.15.100:0/3112327228 >> 172.21.15.100:0/3112327228 conn(0x7f2cd40fd3c0 msgr2=0x7f2cd40ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 -- 172.21.15.100:0/3112327228 shutdown_connections 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.814+0000 7f2cda3ee640 1 -- 172.21.15.100:0/3112327228 wait complete. 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 Processor -- start 2024-04-30T23:18:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 -- start start 2024-04-30T23:18:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 0x7f2cd419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 0x7f2cd41a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd410f640 con 0x7f2cd4106c70 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd410f4c0 con 0x7f2cd4101e90 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.815+0000 7f2cda3ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd410f7c0 con 0x7f2cd41097e0 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53806/0 (socket says 172.21.15.100:53806) 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 -- 172.21.15.100:0/1336805722 learned_addr learned my addr 172.21.15.100:0/1336805722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 0x7f2cd419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 0x7f2cd41a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 -- 172.21.15.100:0/1336805722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 msgr2=0x7f2cd41a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 0x7f2cd41a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 -- 172.21.15.100:0/1336805722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 msgr2=0x7f2cd419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 0x7f2cd419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 -- 172.21.15.100:0/1336805722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd41a1dc0 con 0x7f2cd4106c70 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 0x7f2cd419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d950 tx=0x7f2cc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd17fa640 1 -- 172.21.15.100:0/1336805722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8017030 con 0x7f2cd4106c70 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd17fa640 1 -- 172.21.15.100:0/1336805722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cc8004020 con 0x7f2cd4106c70 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd41a20b0 con 0x7f2cd4106c70 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cd17fa640 1 -- 172.21.15.100:0/1336805722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80047a0 con 0x7f2cd4106c70 2024-04-30T23:18:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.816+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd41a2600 con 0x7f2cd4106c70 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.818+0000 7f2cd17fa640 1 -- 172.21.15.100:0/1336805722 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2cc8009a30 con 0x7f2cd4106c70 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 Processor -- start 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 -- start start 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca119390 0x5590ca4bf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590ca3d2b10 con 0x5590ca0f86b0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5590ca41fd80 con 0x5590ca0f04d0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2ce137f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5590ca3d98b0 con 0x5590ca119390 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd17fa640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 0x7f2cbc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53810/0 (socket says 172.21.15.100:53810) 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 -- 172.21.15.100:0/2455380012 learned_addr learned my addr 172.21.15.100:0/2455380012 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 0x7f2cbc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd17fa640 1 -- 172.21.15.100:0/1336805722 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2cc80d0300 con 0x7f2cd4106c70 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd898b640 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca119390 0x5590ca4bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 -- 172.21.15.100:0/2455380012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca119390 msgr2=0x5590ca4bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca119390 0x5590ca4bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 -- 172.21.15.100:0/2455380012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 msgr2=0x5590ca4bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.819+0000 7f2cd37fe640 1 -- 172.21.15.100:0/2455380012 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590ca3aaa40 con 0x5590ca0f86b0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.820+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005fd0 tx=0x7f2cc8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87316f9d609aeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.820+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 0x7f2cbc0a60c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5590ca4c0950 tx=0x7f2ccc0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.820+0000 7f2cba7fc640 1 -- 172.21.15.100:0/2455380012 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc809c280 con 0x5590ca0f86b0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.820+0000 7f2cba7fc640 1 -- 172.21.15.100:0/2455380012 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cc809c980 con 0x5590ca0f86b0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.820+0000 7f2cba7fc640 1 -- 172.21.15.100:0/2455380012 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8009d20 con 0x5590ca0f86b0 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- 172.21.15.100:0/2455380012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 msgr2=0x5590ca4c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005fd0 tx=0x7f2cc8021000 comp rx=0 tx=0).stop 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- 172.21.15.100:0/2455380012 shutdown_connections 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4c0b10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 --2- 172.21.15.100:0/2455380012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca119390 0x5590ca4bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- 172.21.15.100:0/2455380012 >> 172.21.15.100:0/2455380012 conn(0x5590ca10d4e0 msgr2=0x5590ca4b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- 172.21.15.100:0/2455380012 shutdown_connections 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- 172.21.15.100:0/2455380012 wait complete. 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 -- start start 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.821+0000 7f2ce137f740 1 Processor -- start 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 0x5590ca4c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590ca3a6d10 con 0x5590ca119390 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5590ca41bd40 con 0x5590ca0f86b0 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5590ca4c15c0 con 0x5590ca0f04d0 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2ce137f740 10 client.0 _ll_register_callbacks cb 0x5590ca42cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53824/0 (socket says 172.21.15.100:53824) 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 -- 172.21.15.100:0/3221289985 learned_addr learned my addr 172.21.15.100:0/3221289985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 0x5590ca4c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 -- 172.21.15.100:0/3221289985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 msgr2=0x5590ca4c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 -- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 msgr2=0x5590ca4c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 0x5590ca4c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 -- 172.21.15.100:0/3221289985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590ca1fb7d0 con 0x5590ca119390 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 0x5590ca4c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cd898b640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0108a0 tx=0x7f2ccc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146dcf5098d47560 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.822+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004d20 con 0x5590ca119390 2024-04-30T23:18:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc809c980 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2ccc011960 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2ccc031050 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 10 client.16554 fetch_fsmap learned FSMap version 42 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5590ca1313f0 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cc809c980 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 42) ==== 8402+0+0 (secure 0 0 0) 0x7f2ccc01d3f0 con 0x5590ca119390 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 10 client.16554 fetch_fsmap finished waiting for FSMap version 42 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 20 client.16554 populate_metadata read hostname 'smithi100' 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0d7f60 0x5590ca4d7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 4 client.16554 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590ca42d990 con 0x5590ca0d7f60 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.823+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0d7f60 0x5590ca4d7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.824+0000 7f2cb37fe640 10 client.16554 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.824+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0d7f60 0x5590ca4d7150 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0b8f8599c96f35 server_cookie=b3fdf8937da01af4 in_seq=0 out_seq=0 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3221289985 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5590ca42d990 con 0x5590ca0d7f60 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2cb37fe640 10 client.16554 handle_command_reply: tid=0 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 client.16554 shutdown 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 msgr2=0x5590ca4d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0108a0 tx=0x7f2ccc004ab0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 shutdown_connections 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0d7f60 0x5590ca4d7150 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4d0bd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2cb37fe640 0 client.16554 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f86b0 0x5590ca4c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3221289985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 >> 172.21.15.100:0/3221289985 conn(0x5590ca10d4e0 msgr2=0x5590ca4b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 shutdown_connections 2024-04-30T23:18:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 1 -- 172.21.15.100:0/3221289985 wait complete. 2024-04-30T23:18:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.825+0000 7f2ce137f740 20 client.16554 trim_cache size 0 max 16384 2024-04-30T23:18:45.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 Processor -- start 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 -- start start 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f86b0 0x5590ca4d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41aa820 con 0x5590ca119390 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41ac480 con 0x5590ca0f04d0 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2ce137f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41aaef0 con 0x5590ca0f86b0 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53840/0 (socket says 172.21.15.100:53840) 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 -- 172.21.15.100:0/1048719589 learned_addr learned my addr 172.21.15.100:0/1048719589 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f86b0 0x5590ca4d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 -- 172.21.15.100:0/1048719589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f86b0 msgr2=0x5590ca4d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f86b0 0x5590ca4d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 -- 172.21.15.100:0/1048719589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 msgr2=0x5590ca4db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4db900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 -- 172.21.15.100:0/1048719589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590ca0f10f0 con 0x5590ca119390 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.843+0000 7f2cd898b640 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc014010 tx=0x7f2ccc005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce544c5ac7aa64f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2cb9ffb640 1 -- 172.21.15.100:0/1048719589 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc03a070 con 0x5590ca119390 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2cb9ffb640 1 -- 172.21.15.100:0/1048719589 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ccc01d3e0 con 0x5590ca119390 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2cb9ffb640 1 -- 172.21.15.100:0/1048719589 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0288e0 con 0x5590ca119390 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 -- 172.21.15.100:0/1048719589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 msgr2=0x5590ca4dbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc014010 tx=0x7f2ccc005cc0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 -- 172.21.15.100:0/1048719589 shutdown_connections 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca119390 0x5590ca4dbe40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f86b0 0x5590ca4d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 --2- 172.21.15.100:0/1048719589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca0f04d0 0x5590ca4db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 -- 172.21.15.100:0/1048719589 >> 172.21.15.100:0/1048719589 conn(0x5590ca10d4e0 msgr2=0x5590ca4c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 -- 172.21.15.100:0/1048719589 shutdown_connections 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.844+0000 7f2ce137f740 1 -- 172.21.15.100:0/1048719589 wait complete. 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 -- start start 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 Processor -- start 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 0x5590ca4cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41abd20 con 0x5590ca0f86b0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41ab5f0 con 0x5590ca119390 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41a8800 con 0x5590ca0f04d0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2ce137f740 10 client.0 _ll_register_callbacks cb 0x7f2ccc009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2cd37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53848/0 (socket says 172.21.15.100:53848) 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2cd37fe640 1 -- 172.21.15.100:0/3445654675 learned_addr learned my addr 172.21.15.100:0/3445654675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.845+0000 7f2cd898b640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 0x5590ca4cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 -- 172.21.15.100:0/3445654675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 msgr2=0x5590ca4ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 -- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 msgr2=0x5590ca4cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:18:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 0x5590ca4cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 -- 172.21.15.100:0/3445654675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590ca3e04b0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd898b640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 0x5590ca4cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cd37fe640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800b5a0 tx=0x7f2cc80d0170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973b34a4030f8a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc809c980 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f2cc80b7da0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ccc01d3e0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2cc80a4ef0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 10 client.16560 fetch_fsmap learned FSMap version 42 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5590ca4d0bb0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ccc01d3e0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 42) ==== 8402+0+0 (secure 0 0 0) 0x7f2cc80bb0a0 con 0x5590ca0f86b0 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 10 client.16560 fetch_fsmap finished waiting for FSMap version 42 2024-04-30T23:18:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 20 client.16560 populate_metadata read hostname 'smithi100' 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0ad3a0 0x5590ca53f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 4 client.16560 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.846+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590ca427800 con 0x5590ca0ad3a0 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0ad3a0 0x5590ca53f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2cb37fe640 10 client.16560 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2cd3fff640 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0ad3a0 0x5590ca53f4d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c144fbe82aeed9d server_cookie=819ac501a98f076b in_seq=0 out_seq=0 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2cb37fe640 1 -- 172.21.15.100:0/3445654675 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5590ca427800 con 0x5590ca0ad3a0 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2cb37fe640 10 client.16560 handle_command_reply: tid=0 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.847+0000 7f2ce137f740 1 client.16560 shutdown 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 msgr2=0x5590ca4ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800b5a0 tx=0x7f2cc80d0170 comp rx=0 tx=0).stop 2024-04-30T23:18:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 shutdown_connections 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5590ca0ad3a0 0x5590ca53f4d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5590ca119390 0x5590ca4cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cb37fe640 0 client.16560 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590ca0f86b0 0x5590ca4ce590 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 --2- 172.21.15.100:0/3445654675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5590ca0f04d0 0x5590ca4ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 >> 172.21.15.100:0/3445654675 conn(0x5590ca10d4e0 msgr2=0x5590ca4b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 shutdown_connections 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 1 -- 172.21.15.100:0/3445654675 wait complete. 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2ce137f740 20 client.16560 trim_cache size 0 max 16384 2024-04-30T23:18:45.859 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.860 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:18:45.861 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:18:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:18:45.864 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 msgr2=0x7f2cbc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 0x7f2cbc0a60c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5590ca4c0950 tx=0x7f2ccc0094f0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 msgr2=0x7f2cd419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d950 tx=0x7f2cc800de10 comp rx=0 tx=0).stop 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 shutdown_connections 2024-04-30T23:18:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f2cbc0a3bb0 0x7f2cbc0a60c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd41097e0 0x7f2cd41a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd4106c70 0x7f2cd419a7c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 --2- 172.21.15.100:0/1336805722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd4101e90 0x7f2cd419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 >> 172.21.15.100:0/1336805722 conn(0x7f2cd40fd3c0 msgr2=0x7f2cd4107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 shutdown_connections 2024-04-30T23:18:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:18:45.848+0000 7f2cda3ee640 1 -- 172.21.15.100:0/1336805722 wait complete. 2024-04-30T23:18:45.866 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:18:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:46 smithi104 ceph-mon[32987]: pgmap v528: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:47.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:46 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:18:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:46 smithi183 ceph-mon[33560]: pgmap v528: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:47.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:46 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:18:47.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:46 smithi100 ceph-mon[29745]: pgmap v528: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:47.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:46 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:18:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:18:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:18:48.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:18:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:18:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:18:48.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:18:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:18:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:18:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:18:49.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:48 smithi104 ceph-mon[32987]: pgmap v529: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:18:49.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:48 smithi183 ceph-mon[33560]: pgmap v529: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:18:49.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:48 smithi100 ceph-mon[29745]: pgmap v529: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:18:51.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:50 smithi104 ceph-mon[32987]: pgmap v530: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:18:51.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:50 smithi183 ceph-mon[33560]: pgmap v530: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:18:51.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:50 smithi100 ceph-mon[29745]: pgmap v530: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:18:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:52 smithi183 ceph-mon[33560]: pgmap v531: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:18:53.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:52 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:53.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:52 smithi100 ceph-mon[29745]: pgmap v531: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:18:53.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:52 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:53.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:52 smithi104 ceph-mon[32987]: pgmap v531: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:18:53.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:52 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:55.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:54 smithi100 ceph-mon[29745]: pgmap v532: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:18:55.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:54 smithi104 ceph-mon[32987]: pgmap v532: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:18:55.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:54 smithi183 ceph-mon[33560]: pgmap v532: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:18:56.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:55 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:56.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:55 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:56.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:55 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:18:57.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:56 smithi100 ceph-mon[29745]: pgmap v533: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:57.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:56 smithi104 ceph-mon[32987]: pgmap v533: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:57.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:56 smithi183 ceph-mon[33560]: pgmap v533: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:18:59.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:18:58 smithi100 ceph-mon[29745]: pgmap v534: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:59.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:18:58 smithi104 ceph-mon[32987]: pgmap v534: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:18:59.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:18:58 smithi183 ceph-mon[33560]: pgmap v534: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:01.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:00 smithi104 ceph-mon[32987]: pgmap v535: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:01.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:00 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:00 smithi183 ceph-mon[33560]: pgmap v535: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:00 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:01.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:00 smithi100 ceph-mon[29745]: pgmap v535: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:01.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:00 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:02.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:01 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:01 smithi104 ceph-mon[32987]: pgmap v536: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:02.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:01 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:01 smithi183 ceph-mon[33560]: pgmap v536: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:02.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:01 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:02.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:01 smithi100 ceph-mon[29745]: pgmap v536: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:05.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:04 smithi104 ceph-mon[32987]: pgmap v537: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:05.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:04 smithi183 ceph-mon[33560]: pgmap v537: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:05.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:04 smithi100 ceph-mon[29745]: pgmap v537: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:07.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:06 smithi104 ceph-mon[32987]: pgmap v538: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:07.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:06 smithi183 ceph-mon[33560]: pgmap v538: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:07.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:06 smithi100 ceph-mon[29745]: pgmap v538: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:09.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:08 smithi104 ceph-mon[32987]: pgmap v539: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:09.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:08 smithi183 ceph-mon[33560]: pgmap v539: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:09.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:08 smithi100 ceph-mon[29745]: pgmap v539: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:10 smithi104 ceph-mon[32987]: pgmap v540: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:11.047 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:10 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:11.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:10 smithi183 ceph-mon[33560]: pgmap v540: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:11.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:10 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:11.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:10 smithi100 ceph-mon[29745]: pgmap v540: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:11.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:10 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:12.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:11 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:12.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:11 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:12.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:11 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:13.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:12 smithi100 ceph-mon[29745]: pgmap v541: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:13.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:12 smithi104 ceph-mon[32987]: pgmap v541: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:13.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:12 smithi183 ceph-mon[33560]: pgmap v541: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:14 smithi100 ceph-mon[29745]: pgmap v542: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:15.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:14 smithi104 ceph-mon[32987]: pgmap v542: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:15.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:14 smithi183 ceph-mon[33560]: pgmap v542: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:15.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:19:15.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:19:15.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 -- 172.21.15.100:0/3878495851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc801050e0 msgr2=0x7fcc801054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/3878495851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc801050e0 0x7fcc801054f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009900 tx=0x7fcc7402a410 comp rx=0 tx=0).stop 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 -- 172.21.15.100:0/3878495851 shutdown_connections 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/3878495851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80102290 0x7fcc8010bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/3878495851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 0x7fcc80101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/3878495851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc801050e0 0x7fcc801054f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 -- 172.21.15.100:0/3878495851 >> 172.21.15.100:0/3878495851 conn(0x7fcc800fd390 msgr2=0x7fcc800ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 -- 172.21.15.100:0/3878495851 shutdown_connections 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.991+0000 7fcc85d8d640 1 -- 172.21.15.100:0/3878495851 wait complete. 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 Processor -- start 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 -- start start 2024-04-30T23:19:15.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 0x7fcc8019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 0x7fcc801a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010f630 con 0x7fcc80102290 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010f4b0 con 0x7fcc801050e0 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc85d8d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010f7b0 con 0x7fcc80101790 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59502/0 (socket says 172.21.15.100:59502) 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc7effd640 1 -- 172.21.15.100:0/80035492 learned_addr learned my addr 172.21.15.100:0/80035492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 0x7fcc8019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.992+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 0x7fcc801a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 -- 172.21.15.100:0/80035492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 msgr2=0x7fcc8019a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 0x7fcc8019a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 -- 172.21.15.100:0/80035492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 msgr2=0x7fcc801a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 0x7fcc801a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 -- 172.21.15.100:0/80035492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc801a1dd0 con 0x7fcc80102290 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 0x7fcc801a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7effd640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000d950 tx=0x7fcc7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7cff9640 1 -- 172.21.15.100:0/80035492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70017070 con 0x7fcc80102290 2024-04-30T23:19:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc801a20c0 con 0x7fcc80102290 2024-04-30T23:19:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7cff9640 1 -- 172.21.15.100:0/80035492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc70009c30 con 0x7fcc80102290 2024-04-30T23:19:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc7cff9640 1 -- 172.21.15.100:0/80035492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000f620 con 0x7fcc80102290 2024-04-30T23:19:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.993+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc801a2610 con 0x7fcc80102290 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7cff9640 1 -- 172.21.15.100:0/80035492 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fcc70010460 con 0x7fcc80102290 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 Processor -- start 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 -- start start 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802df9b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802df9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55802deb2b10 con 0x55802dbd86b0 2024-04-30T23:19:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55802deffd80 con 0x55802dbd04d0 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55802deb98b0 con 0x55802dbf9390 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7cff9640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 0x7fcc680a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59516/0 (socket says 172.21.15.100:59516) 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7effd640 1 -- 172.21.15.100:0/3231324080 learned_addr learned my addr 172.21.15.100:0/3231324080 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802df9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802df9b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7cff9640 1 -- 172.21.15.100:0/80035492 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fcc700d0390 con 0x7fcc80102290 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.996+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 0x7fcc680a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 -- 172.21.15.100:0/3231324080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 msgr2=0x55802df9b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802df9b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 -- 172.21.15.100:0/3231324080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 msgr2=0x55802df9ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802df9ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 -- 172.21.15.100:0/3231324080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802de8aa40 con 0x55802dbd86b0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 0x7fcc680a60c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55802df9c540 tx=0x7fcc7800a370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc7effd640 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcc7009c4d0 tx=0x7fcc70010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428f54b495c8248c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc65ffb640 1 -- 172.21.15.100:0/3231324080 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70020070 con 0x55802dbd86b0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc65ffb640 1 -- 172.21.15.100:0/3231324080 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc7009c310 con 0x55802dbd86b0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.997+0000 7fcc65ffb640 1 -- 172.21.15.100:0/3231324080 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7009d2c0 con 0x55802dbd86b0 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- 172.21.15.100:0/3231324080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 msgr2=0x55802df9c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcc7009c4d0 tx=0x7fcc70010cb0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- 172.21.15.100:0/3231324080 shutdown_connections 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd86b0 0x55802df9c700 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802df9ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/3231324080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802df9b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- 172.21.15.100:0/3231324080 >> 172.21.15.100:0/3231324080 conn(0x55802dbed4e0 msgr2=0x55802df96d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- 172.21.15.100:0/3231324080 shutdown_connections 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- 172.21.15.100:0/3231324080 wait complete. 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.998+0000 7fcc8cc49740 1 -- start start 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 Processor -- start 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802dfa5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfa5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55802de86d10 con 0x55802dbf9390 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55802defbd40 con 0x55802dbd04d0 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55802df9d1b0 con 0x55802dbd86b0 2024-04-30T23:19:16.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc8cc49740 10 client.0 _ll_register_callbacks cb 0x55802df0cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59532/0 (socket says 172.21.15.100:59532) 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 -- 172.21.15.100:0/158395566 learned_addr learned my addr 172.21.15.100:0/158395566 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7effd640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfa5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802dfa5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 -- 172.21.15.100:0/158395566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 msgr2=0x55802dfa5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfa5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 -- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 msgr2=0x55802dfa5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802dfa5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 -- 172.21.15.100:0/158395566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802dcdb7d0 con 0x55802dbf9390 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802dfa5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800e6f0 tx=0x7fcc78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a721f3dcb213b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:15.999+0000 7fcc5effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:19:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78025070 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fcc7801f860 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55802df0d990 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcc78031050 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 10 client.16572 fetch_fsmap learned FSMap version 48 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55802dc113f0 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55802df0d990 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fcc7801e970 con 0x55802dbf9390 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 10 client.16572 fetch_fsmap finished waiting for FSMap version 48 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 20 client.16572 populate_metadata read hostname 'smithi100' 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802dbb7f60 0x55802dfb2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 4 client.16572 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.000+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55802df07800 con 0x55802dbb7f60 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.001+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802dbb7f60 0x55802dfb2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.001+0000 7fcc5effd640 10 client.16572 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.001+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802dbb7f60 0x55802dfb2af0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe395e34d7d72af server_cookie=f1116b4398f0556c in_seq=0 out_seq=0 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc5effd640 1 -- 172.21.15.100:0/158395566 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55802df07800 con 0x55802dbb7f60 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc5effd640 10 client.16572 handle_command_reply: tid=0 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 client.16572 shutdown 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 msgr2=0x55802dfac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800e6f0 tx=0x7fcc78004a40 comp rx=0 tx=0).stop 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 shutdown_connections 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802dbb7f60 0x55802dfb2af0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbf9390 0x55802dfac640 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfa5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/158395566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd04d0 0x55802dfa5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc5effd640 0 client.16572 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 >> 172.21.15.100:0/158395566 conn(0x55802dbed4e0 msgr2=0x55802df95ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 shutdown_connections 2024-04-30T23:19:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 1 -- 172.21.15.100:0/158395566 wait complete. 2024-04-30T23:19:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.002+0000 7fcc8cc49740 20 client.16572 trim_cache size 0 max 16384 2024-04-30T23:19:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 Processor -- start 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 -- start start 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbf9390 0x55802dfacaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801aca00 con 0x55802dbd04d0 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801ae570 con 0x55802dbf9390 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801ad0d0 con 0x55802dbd86b0 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59538/0 (socket says 172.21.15.100:59538) 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/1892462988 learned_addr learned my addr 172.21.15.100:0/1892462988 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7effd640 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/1892462988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 msgr2=0x55802dfac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfac560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/1892462988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbf9390 msgr2=0x55802dfacaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbf9390 0x55802dfacaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/1892462988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802dbd10f0 con 0x55802dbd04d0 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.020+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009850 tx=0x7fcc74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfcdacc8511ba40 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc657fa640 1 -- 172.21.15.100:0/1892462988 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74035040 con 0x55802dbd04d0 2024-04-30T23:19:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc657fa640 1 -- 172.21.15.100:0/1892462988 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc7404b070 con 0x55802dbd04d0 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc657fa640 1 -- 172.21.15.100:0/1892462988 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740035f0 con 0x55802dbd04d0 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 -- 172.21.15.100:0/1892462988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 msgr2=0x55802dfa3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009850 tx=0x7fcc74000bc0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 -- 172.21.15.100:0/1892462988 shutdown_connections 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbf9390 0x55802dfacaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbd86b0 0x55802dfac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/1892462988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa3f40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 -- 172.21.15.100:0/1892462988 >> 172.21.15.100:0/1892462988 conn(0x55802dbed4e0 msgr2=0x55802dfa3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 -- 172.21.15.100:0/1892462988 shutdown_connections 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.021+0000 7fcc8cc49740 1 -- 172.21.15.100:0/1892462988 wait complete. 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 -- start start 2024-04-30T23:19:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 Processor -- start 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd86b0 0x55802dfaa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802e016d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801adea0 con 0x55802dbd04d0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801ad7d0 con 0x55802dbd86b0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801aa9e0 con 0x55802dbf9390 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc8cc49740 10 client.0 _ll_register_callbacks cb 0x7fcc78010d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59546/0 (socket says 172.21.15.100:59546) 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.022+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/2745997353 learned_addr learned my addr 172.21.15.100:0/2745997353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7ffff640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802e016d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7effd640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd86b0 0x55802dfaa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/2745997353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 msgr2=0x55802e016d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802e016d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd86b0 msgr2=0x55802dfaa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd86b0 0x55802dfaa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 -- 172.21.15.100:0/2745997353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802dec04b0 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc7f7fe640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcc74046a00 tx=0x7fcc74046a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c832a42c48a9568f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc5effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74035030 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fcc74004240 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc7404b070 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcc74061050 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc8cc49740 10 client.16578 fetch_fsmap learned FSMap version 48 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55802e018150 con 0x55802dbd04d0 2024-04-30T23:19:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.023+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc7404b070 con 0x55802dbd04d0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fcc7403c440 con 0x55802dbd04d0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 10 client.16578 fetch_fsmap finished waiting for FSMap version 48 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 20 client.16578 populate_metadata read hostname 'smithi100' 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802db8d3a0 0x55802e01aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 4 client.16578 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55802de824a0 con 0x55802db8d3a0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc7effd640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802db8d3a0 0x55802e01aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc5effd640 10 client.16578 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc7effd640 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802db8d3a0 0x55802e01aba0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef782957b5f9750 server_cookie=132ef9c81565e124 in_seq=0 out_seq=0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc5effd640 1 -- 172.21.15.100:0/2745997353 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55802de824a0 con 0x55802db8d3a0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc5effd640 10 client.16578 handle_command_reply: tid=0 2024-04-30T23:19:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.024+0000 7fcc8cc49740 1 client.16578 shutdown 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 msgr2=0x55802dfa9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcc74046a00 tx=0x7fcc74046a30 comp rx=0 tx=0).stop 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 shutdown_connections 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55802db8d3a0 0x55802e01aba0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55802dbf9390 0x55802e016d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc5effd640 0 client.16578 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55802dbd86b0 0x55802dfaa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 --2- 172.21.15.100:0/2745997353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55802dbd04d0 0x55802dfa9d40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 >> 172.21.15.100:0/2745997353 conn(0x55802dbed4e0 msgr2=0x55802df95270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 shutdown_connections 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 1 -- 172.21.15.100:0/2745997353 wait complete. 2024-04-30T23:19:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc8cc49740 20 client.16578 trim_cache size 0 max 16384 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:19:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:16.040 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 msgr2=0x7fcc680a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 0x7fcc680a60c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55802df9c540 tx=0x7fcc7800a370 comp rx=0 tx=0).stop 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 msgr2=0x7fcc8019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000d950 tx=0x7fcc7000de10 comp rx=0 tx=0).stop 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 shutdown_connections 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcc680a3bb0 0x7fcc680a60c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801050e0 0x7fcc801a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80102290 0x7fcc8019a7d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 --2- 172.21.15.100:0/80035492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc80101790 0x7fcc8019a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.025+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 >> 172.21.15.100:0/80035492 conn(0x7fcc800fd390 msgr2=0x7fcc80105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.026+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 shutdown_connections 2024-04-30T23:19:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:16.026+0000 7fcc85d8d640 1 -- 172.21.15.100:0/80035492 wait complete. 2024-04-30T23:19:16.042 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:19:17.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:16 smithi100 ceph-mon[29745]: pgmap v543: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:17.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:16 smithi104 ceph-mon[32987]: pgmap v543: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:17.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:16 smithi183 ceph-mon[33560]: pgmap v543: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:18 smithi100 ceph-mon[29745]: pgmap v544: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:19.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:18 smithi104 ceph-mon[32987]: pgmap v544: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:19.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:18 smithi183 ceph-mon[33560]: pgmap v544: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:21.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:20 smithi104 ceph-mon[32987]: pgmap v545: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:21.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:20 smithi183 ceph-mon[33560]: pgmap v545: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:21.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:20 smithi100 ceph-mon[29745]: pgmap v545: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:23.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:22 smithi104 ceph-mon[32987]: pgmap v546: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:23.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:22 smithi183 ceph-mon[33560]: pgmap v546: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:23.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:22 smithi100 ceph-mon[29745]: pgmap v546: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:25.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:24 smithi104 ceph-mon[32987]: pgmap v547: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:25.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:24 smithi183 ceph-mon[33560]: pgmap v547: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:25.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:24 smithi100 ceph-mon[29745]: pgmap v547: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:26.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:25 smithi104 ceph-mon[32987]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:25 smithi183 ceph-mon[33560]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:25 smithi100 ceph-mon[29745]: pgmap v548: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:29.051 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:28 smithi104 ceph-mon[32987]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:29.052 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:28 smithi183 ceph-mon[33560]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:29.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:28 smithi100 ceph-mon[29745]: pgmap v549: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:31.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:30 smithi100 ceph-mon[29745]: pgmap v550: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:31.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:30 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:31.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:30 smithi104 ceph-mon[32987]: pgmap v550: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:31.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:30 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:31.306 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:30 smithi183 ceph-mon[33560]: pgmap v550: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:31.306 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:30 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:33.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:32 smithi100 ceph-mon[29745]: pgmap v551: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:33.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:32 smithi104 ceph-mon[32987]: pgmap v551: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:33.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:32 smithi183 ceph-mon[33560]: pgmap v551: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:34.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:33 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:34.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:33 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:34.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:33 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:35.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:34 smithi104 ceph-mon[32987]: pgmap v552: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:35.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:34 smithi183 ceph-mon[33560]: pgmap v552: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:35.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:34 smithi100 ceph-mon[29745]: pgmap v552: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:37.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:36 smithi104 ceph-mon[32987]: pgmap v553: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:37.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:36 smithi183 ceph-mon[33560]: pgmap v553: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:37.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:36 smithi100 ceph-mon[29745]: pgmap v553: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:38.204 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:37 smithi183 ceph-mon[33560]: pgmap v554: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:37 smithi104 ceph-mon[32987]: pgmap v554: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:38.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:37 smithi100 ceph-mon[29745]: pgmap v554: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:41.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:40 smithi183 ceph-mon[33560]: pgmap v555: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:41.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:40 smithi100 ceph-mon[29745]: pgmap v555: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:41.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:40 smithi104 ceph-mon[32987]: pgmap v555: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:43.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:42 smithi100 ceph-mon[29745]: pgmap v556: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:43.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:42 smithi104 ceph-mon[32987]: pgmap v556: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:43.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:42 smithi183 ceph-mon[33560]: pgmap v556: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:45.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:44 smithi100 ceph-mon[29745]: pgmap v557: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:45.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:44 smithi104 ceph-mon[32987]: pgmap v557: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:45.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:44 smithi183 ceph-mon[33560]: pgmap v557: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:46.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:19:46.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:19:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/3341897343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103000 msgr2=0x7f9d98103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/3341897343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103000 0x7f9d98103410 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009900 tx=0x7f9d8802a410 comp rx=0 tx=0).stop 2024-04-30T23:19:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/3341897343 shutdown_connections 2024-04-30T23:19:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/3341897343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d981046c0 0x7f9d9810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/3341897343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103b60 0x7f9d98104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/3341897343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103000 0x7f9d98103410 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/3341897343 >> 172.21.15.100:0/3341897343 conn(0x7f9d980fd380 msgr2=0x7f9d980ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/3341897343 shutdown_connections 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/3341897343 wait complete. 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 Processor -- start 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.164+0000 7f9d9ea2b640 1 -- start start 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103000 0x7f9d981022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d9819f370 0x7f9d981a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810e760 con 0x7f9d98103b60 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810e5e0 con 0x7f9d98103000 2024-04-30T23:19:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9ea2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810e8e0 con 0x7f9d9819f370 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45404/0 (socket says 172.21.15.100:45404) 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 -- 172.21.15.100:0/2338673744 learned_addr learned my addr 172.21.15.100:0/2338673744 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d97fff640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103000 0x7f9d981022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d9819f370 0x7f9d981a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 -- 172.21.15.100:0/2338673744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d9819f370 msgr2=0x7f9d981a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d9819f370 0x7f9d981a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 -- 172.21.15.100:0/2338673744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103000 msgr2=0x7f9d981022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103000 0x7f9d981022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 -- 172.21.15.100:0/2338673744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d981a1fd0 con 0x7f9d98103b60 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.165+0000 7f9d977fe640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00d950 tx=0x7f9d8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.166+0000 7f9d957fa640 1 -- 172.21.15.100:0/2338673744 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c017070 con 0x7f9d98103b60 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.166+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d981a22c0 con 0x7f9d98103b60 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.166+0000 7f9d957fa640 1 -- 172.21.15.100:0/2338673744 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d8c009c30 con 0x7f9d98103b60 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.166+0000 7f9d957fa640 1 -- 172.21.15.100:0/2338673744 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00f620 con 0x7f9d98103b60 2024-04-30T23:19:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.166+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d981a2810 con 0x7f9d98103b60 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 Processor -- start 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 -- start start 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9d957fa640 1 -- 172.21.15.100:0/2338673744 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9d8c00f7c0 con 0x7f9d98103b60 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f7f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f7f5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558b8f70bb10 con 0x558b8f4294d0 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b8f758d80 con 0x558b8f452390 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.168+0000 7f9da59c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8f7128b0 con 0x558b8f4316b0 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45416/0 (socket says 172.21.15.100:45416) 2024-04-30T23:19:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 -- 172.21.15.100:0/215611790 learned_addr learned my addr 172.21.15.100:0/215611790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d977fe640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f7f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f7f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 -- 172.21.15.100:0/215611790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 msgr2=0x558b8f7f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f7f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 -- 172.21.15.100:0/215611790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 msgr2=0x558b8f7f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f7f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 -- 172.21.15.100:0/215611790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8f6e3a40 con 0x558b8f4294d0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d957fa640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 0x7f9d800a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f7f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d957fa640 1 -- 172.21.15.100:0/2338673744 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9d8c0d02e0 con 0x7f9d98103b60 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 0x7f9d800a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d97fff640 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9d88031500 tx=0x7f9d88031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3667affac930127 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d7e7fc640 1 -- 172.21.15.100:0/215611790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88035030 con 0x558b8f4294d0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d7e7fc640 1 -- 172.21.15.100:0/215611790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d88040070 con 0x558b8f4294d0 2024-04-30T23:19:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.169+0000 7f9d7e7fc640 1 -- 172.21.15.100:0/215611790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88003a90 con 0x558b8f4294d0 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 -- 172.21.15.100:0/215611790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 msgr2=0x558b8f7f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9d88031500 tx=0x7f9d88031bc0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 0x7f9d800a60c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x558b8f7f5540 tx=0x7f9d90009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 -- 172.21.15.100:0/215611790 shutdown_connections 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f7f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4294d0 0x558b8f7f4a70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 --2- 172.21.15.100:0/215611790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f7f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 -- 172.21.15.100:0/215611790 >> 172.21.15.100:0/215611790 conn(0x558b8f4464e0 msgr2=0x558b8f7efd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 -- 172.21.15.100:0/215611790 shutdown_connections 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.170+0000 7f9da59c3740 1 -- 172.21.15.100:0/215611790 wait complete. 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 -- start start 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 Processor -- start 2024-04-30T23:19:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f805730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558b8f6dfd10 con 0x558b8f4316b0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b8f754d40 con 0x558b8f452390 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558b8f7f61b0 con 0x558b8f4294d0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9da59c3740 10 client.0 _ll_register_callbacks cb 0x558b8f765d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45430/0 (socket says 172.21.15.100:45430) 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9d977fe640 1 -- 172.21.15.100:0/3535312778 learned_addr learned my addr 172.21.15.100:0/3535312778 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.171+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f805730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 -- 172.21.15.100:0/3535312778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 msgr2=0x558b8f7fe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7fe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 -- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 msgr2=0x558b8f805730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f805730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 -- 172.21.15.100:0/3535312778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8f5347d0 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c09c010 tx=0x7f9d8c0d39b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2562864c3967261 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c020070 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9d8c09b760 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d88040070 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9d8c09bc70 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 10 client.16590 fetch_fsmap learned FSMap version 50 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558b8f46a3f0 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d88040070 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7f9d8c09b1d0 con 0x558b8f4316b0 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 10 client.16590 fetch_fsmap finished waiting for FSMap version 50 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:19:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 20 client.16590 populate_metadata read hostname 'smithi100' 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f410f60 0x558b8f80bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 4 client.16590 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.172+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b8f766990 con 0x558b8f410f60 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.173+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f410f60 0x558b8f80bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.173+0000 7f9d777fe640 10 client.16590 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.173+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f410f60 0x558b8f80bcc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ad40bc22354134 server_cookie=1f76b35ad617cb3b in_seq=0 out_seq=0 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9d777fe640 1 -- 172.21.15.100:0/3535312778 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558b8f766990 con 0x558b8f410f60 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9d777fe640 10 client.16590 handle_command_reply: tid=0 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 client.16590 shutdown 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 msgr2=0x558b8f7fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c09c010 tx=0x7f9d8c0d39b0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 shutdown_connections 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f410f60 0x558b8f80bcc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f452390 0x558b8f805730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f4316b0 0x558b8f7fe7d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3535312778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9d777fe640 0 client.16590 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 >> 172.21.15.100:0/3535312778 conn(0x558b8f4464e0 msgr2=0x558b8f7f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 shutdown_connections 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 1 -- 172.21.15.100:0/3535312778 wait complete. 2024-04-30T23:19:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.174+0000 7f9da59c3740 20 client.16590 trim_cache size 0 max 16384 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 Processor -- start 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 -- start start 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 0x558b8f7fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ac9a0 con 0x558b8f452390 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ae4e0 con 0x558b8f4316b0 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9da59c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ad070 con 0x558b8f4294d0 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9d9cfc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9d9cfc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45446/0 (socket says 172.21.15.100:45446) 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3036739468 learned_addr learned my addr 172.21.15.100:0/3036739468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:46.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.192+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 0x558b8f7fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3036739468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 msgr2=0x558b8f7f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3036739468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 msgr2=0x558b8f7fe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 0x558b8f7fe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3036739468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8f42a0f0 con 0x558b8f452390 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 0x558b8f7fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9d90003cf0 tx=0x7f9d90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29e0aa161222988 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d7dffb640 1 -- 172.21.15.100:0/3036739468 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9002c070 con 0x558b8f452390 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d7dffb640 1 -- 172.21.15.100:0/3036739468 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d90010490 con 0x558b8f452390 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.193+0000 7f9d7dffb640 1 -- 172.21.15.100:0/3036739468 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9001e660 con 0x558b8f452390 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- 172.21.15.100:0/3036739468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 msgr2=0x558b8f7fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9d90003cf0 tx=0x7f9d90015000 comp rx=0 tx=0).stop 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- 172.21.15.100:0/3036739468 shutdown_connections 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f7fcfc0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4316b0 0x558b8f7fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3036739468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4294d0 0x558b8f7f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- 172.21.15.100:0/3036739468 >> 172.21.15.100:0/3036739468 conn(0x558b8f4464e0 msgr2=0x558b8f7fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- 172.21.15.100:0/3036739468 shutdown_connections 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- 172.21.15.100:0/3036739468 wait complete. 2024-04-30T23:19:46.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 -- start start 2024-04-30T23:19:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.194+0000 7f9da59c3740 1 Processor -- start 2024-04-30T23:19:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 0x558b8f86cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f86d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ade10 con 0x558b8f452390 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ad740 con 0x558b8f4294d0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981aa980 con 0x558b8f4316b0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 10 client.0 _ll_register_callbacks cb 0x7f9d8c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45452/0 (socket says 172.21.15.100:45452) 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3498901879 learned_addr learned my addr 172.21.15.100:0/3498901879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d977fe640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f86d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 0x558b8f86cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3498901879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 msgr2=0x558b8f86d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f86d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 msgr2=0x558b8f86cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 0x558b8f86cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 -- 172.21.15.100:0/3498901879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8f7194b0 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 0x558b8f86cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d9cfc8640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9d90011010 tx=0x7f9d90003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10021a97b437885d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d777fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9002c030 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f9d90024040 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d90010490 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.195+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9d90010640 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 10 client.16596 fetch_fsmap learned FSMap version 50 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558b8f875860 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d90010490 con 0x558b8f452390 2024-04-30T23:19:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7f9d9000f040 con 0x558b8f452390 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 10 client.16596 fetch_fsmap finished waiting for FSMap version 50 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 20 client.16596 populate_metadata read hostname 'smithi100' 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f3e63a0 0x558b8f878230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 4 client.16596 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b8f760800 con 0x558b8f3e63a0 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f3e63a0 0x558b8f878230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9d777fe640 10 client.16596 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.196+0000 7f9d97fff640 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f3e63a0 0x558b8f878230 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4b9a1eebb88e2a8 server_cookie=ca4e2f3efcca4537 in_seq=0 out_seq=0 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9d777fe640 1 -- 172.21.15.100:0/3498901879 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x558b8f760800 con 0x558b8f3e63a0 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9d777fe640 10 client.16596 handle_command_reply: tid=0 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 client.16596 shutdown 2024-04-30T23:19:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 msgr2=0x558b8f8741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9d90011010 tx=0x7f9d90003f20 comp rx=0 tx=0).stop 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 shutdown_connections 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558b8f3e63a0 0x558b8f878230 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558b8f452390 0x558b8f8741e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558b8f4316b0 0x558b8f86d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 --2- 172.21.15.100:0/3498901879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b8f4294d0 0x558b8f86cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 >> 172.21.15.100:0/3498901879 conn(0x558b8f4464e0 msgr2=0x558b8f7fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9d777fe640 0 client.16596 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 shutdown_connections 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 1 -- 172.21.15.100:0/3498901879 wait complete. 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.197+0000 7f9da59c3740 20 client.16596 trim_cache size 0 max 16384 2024-04-30T23:19:46.207 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.208 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:19:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:19:46.211 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:19:46.212 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:19:46.212 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:46.212 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:19:46.212 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 msgr2=0x7f9d800a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 0x7f9d800a60c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x558b8f7f5540 tx=0x7f9d90009600 comp rx=0 tx=0).stop 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 msgr2=0x7f9d9819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00d950 tx=0x7f9d8c00de10 comp rx=0 tx=0).stop 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 shutdown_connections 2024-04-30T23:19:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f9d800a3bb0 0x7f9d800a60c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d9819f370 0x7f9d981a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d98103b60 0x7f9d9819ee30 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 --2- 172.21.15.100:0/2338673744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d98103000 0x7f9d981022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 >> 172.21.15.100:0/2338673744 conn(0x7f9d980fd380 msgr2=0x7f9d980ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 shutdown_connections 2024-04-30T23:19:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:19:46.198+0000 7f9d9ea2b640 1 -- 172.21.15.100:0/2338673744 wait complete. 2024-04-30T23:19:46.214 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:19:47.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:46 smithi100 ceph-mon[29745]: pgmap v558: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:47.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:46 smithi104 ceph-mon[32987]: pgmap v558: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:47.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:46 smithi183 ceph-mon[33560]: pgmap v558: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:47 smithi100 ceph-mon[29745]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:47 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:19:48.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:47 smithi104 ceph-mon[32987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:48.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:47 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:19:48.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:47 smithi183 ceph-mon[33560]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-30T23:19:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:47 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:19:49.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: pgmap v559: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:19:49.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: pgmap v559: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:19:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:19:49.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: pgmap v559: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:19:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:19:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:49 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:19:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:49 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:19:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:49 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:19:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:49 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:19:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:49 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:19:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:49 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:19:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:49 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:19:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:49 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:19:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:49 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:19:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:49 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:19:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:49 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:19:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:49 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:19:51.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:50 smithi104 ceph-mon[32987]: pgmap v560: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:51.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:50 smithi183 ceph-mon[33560]: pgmap v560: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:51.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:50 smithi100 ceph-mon[29745]: pgmap v560: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:19:53.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:52 smithi104 ceph-mon[32987]: pgmap v561: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:53.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:52 smithi183 ceph-mon[33560]: pgmap v561: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:52 smithi100 ceph-mon[29745]: pgmap v561: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:19:55.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:54 smithi104 ceph-mon[32987]: pgmap v562: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:55.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:54 smithi183 ceph-mon[33560]: pgmap v562: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:55.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:54 smithi100 ceph-mon[29745]: pgmap v562: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:19:56.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:55 smithi104 ceph-mon[32987]: pgmap v563: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:56.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:55 smithi183 ceph-mon[33560]: pgmap v563: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:56.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:55 smithi100 ceph-mon[29745]: pgmap v563: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:19:59.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:19:58 smithi100 ceph-mon[29745]: pgmap v564: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:19:58 smithi104 ceph-mon[32987]: pgmap v564: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:19:59.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:19:58 smithi183 ceph-mon[33560]: pgmap v564: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:01.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:00 smithi100 ceph-mon[29745]: pgmap v565: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:01.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:00 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:20:01.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:00 smithi104 ceph-mon[32987]: pgmap v565: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:01.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:00 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:20:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:00 smithi183 ceph-mon[33560]: pgmap v565: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:00 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:20:03.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:02 smithi100 ceph-mon[29745]: pgmap v566: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:03.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:02 smithi104 ceph-mon[32987]: pgmap v566: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:03.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:02 smithi183 ceph-mon[33560]: pgmap v566: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:05.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:04 smithi100 ceph-mon[29745]: pgmap v567: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:05.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:04 smithi104 ceph-mon[32987]: pgmap v567: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:05.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:04 smithi183 ceph-mon[33560]: pgmap v567: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:07.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:06 smithi100 ceph-mon[29745]: pgmap v568: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:07.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:06 smithi104 ceph-mon[32987]: pgmap v568: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:07.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:06 smithi183 ceph-mon[33560]: pgmap v568: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:09.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:08 smithi183 ceph-mon[33560]: pgmap v569: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:09.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:08 smithi104 ceph-mon[32987]: pgmap v569: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:08 smithi100 ceph-mon[29745]: pgmap v569: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:11.100 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:10 smithi104 ceph-mon[32987]: pgmap v570: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:11.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:10 smithi183 ceph-mon[33560]: pgmap v570: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:11.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:10 smithi100 ceph-mon[29745]: pgmap v570: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:13.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:12 smithi104 ceph-mon[32987]: pgmap v571: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:13.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:12 smithi183 ceph-mon[33560]: pgmap v571: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:13.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:12 smithi100 ceph-mon[29745]: pgmap v571: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:15.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:14 smithi104 ceph-mon[32987]: pgmap v572: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:15.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:14 smithi183 ceph-mon[33560]: pgmap v572: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:15.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:14 smithi100 ceph-mon[29745]: pgmap v572: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:16.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:20:16.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:20:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 -- 172.21.15.100:0/896676877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 msgr2=0x7fe22c105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 --2- 172.21.15.100:0/896676877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c105190 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe228009900 tx=0x7fe22802a410 comp rx=0 tx=0).stop 2024-04-30T23:20:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 -- 172.21.15.100:0/896676877 shutdown_connections 2024-04-30T23:20:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 --2- 172.21.15.100:0/896676877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 0x7fe22c10bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 --2- 172.21.15.100:0/896676877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c105190 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 --2- 172.21.15.100:0/896676877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 0x7fe22c104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 -- 172.21.15.100:0/896676877 >> 172.21.15.100:0/896676877 conn(0x7fe22c0fed50 msgr2=0x7fe22c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 -- 172.21.15.100:0/896676877 shutdown_connections 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.339+0000 7fe23384c640 1 -- 172.21.15.100:0/896676877 wait complete. 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 Processor -- start 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 -- start start 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 0x7fe22c1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 0x7fe22c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10d490 con 0x7fe22c104d80 2024-04-30T23:20:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10d310 con 0x7fe22c109a80 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe23384c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10d610 con 0x7fe22c103b40 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38044/0 (socket says 172.21.15.100:38044) 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 -- 172.21.15.100:0/3709889665 learned_addr learned my addr 172.21.15.100:0/3709889665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe231de9640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 0x7fe22c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 0x7fe22c1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 -- 172.21.15.100:0/3709889665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 msgr2=0x7fe22c1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 0x7fe22c1980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 -- 172.21.15.100:0/3709889665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 msgr2=0x7fe22c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 0x7fe22c19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.340+0000 7fe230de7640 1 -- 172.21.15.100:0/3709889665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c19fbe0 con 0x7fe22c104d80 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe230de7640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe228006010 tx=0x7fe228004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe2227fc640 1 -- 172.21.15.100:0/3709889665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22803f030 con 0x7fe22c104d80 2024-04-30T23:20:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe2227fc640 1 -- 172.21.15.100:0/3709889665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228003cb0 con 0x7fe22c104d80 2024-04-30T23:20:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c19fe70 con 0x7fe22c104d80 2024-04-30T23:20:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe2227fc640 1 -- 172.21.15.100:0/3709889665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228035070 con 0x7fe22c104d80 2024-04-30T23:20:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.341+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c1a0280 con 0x7fe22c104d80 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2227fc640 1 -- 172.21.15.100:0/3709889665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fe228042030 con 0x7fe22c104d80 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 Processor -- start 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 -- start start 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 0x562f088f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f088f3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f08809b10 con 0x562f085274d0 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562f08856d80 con 0x562f0852f6b0 2024-04-30T23:20:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe23a7df740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f088108b0 con 0x562f08550390 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38048/0 (socket says 172.21.15.100:38048) 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 -- 172.21.15.100:0/198948586 learned_addr learned my addr 172.21.15.100:0/198948586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2227fc640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 0x7fe2180a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe230de7640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f088f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe231de9640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 0x562f088f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 -- 172.21.15.100:0/198948586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 msgr2=0x562f088f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 0x562f088f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 -- 172.21.15.100:0/198948586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 msgr2=0x562f088f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f088f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe2315e8640 1 -- 172.21.15.100:0/198948586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f087e1a40 con 0x562f085274d0 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe231de9640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 0x562f088f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:20:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.344+0000 7fe231de9640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 0x7fe2180a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.345+0000 7fe2227fc640 1 -- 172.21.15.100:0/3709889665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe2280f1160 con 0x7fe22c104d80 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.345+0000 7fe2315e8640 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00bcd0 tx=0x7fe21c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980527fd94f6af41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.345+0000 7fe2177fe640 1 -- 172.21.15.100:0/198948586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c015070 con 0x562f085274d0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.345+0000 7fe2177fe640 1 -- 172.21.15.100:0/198948586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c0054d0 con 0x562f085274d0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.345+0000 7fe2177fe640 1 -- 172.21.15.100:0/198948586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0116a0 con 0x562f085274d0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- 172.21.15.100:0/198948586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 msgr2=0x562f088f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe231de9640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 0x7fe2180a60c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x562f088f3540 tx=0x7fe224004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00bcd0 tx=0x7fe21c00f730 comp rx=0 tx=0).stop 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- 172.21.15.100:0/198948586 shutdown_connections 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f088f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f088f2a70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 --2- 172.21.15.100:0/198948586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f08550390 0x562f088f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- 172.21.15.100:0/198948586 >> 172.21.15.100:0/198948586 conn(0x562f085444e0 msgr2=0x562f088edd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- 172.21.15.100:0/198948586 shutdown_connections 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- 172.21.15.100:0/198948586 wait complete. 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 -- start start 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.346+0000 7fe23a7df740 1 Processor -- start 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f088fc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f08550390 0x562f089037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f087ddd10 con 0x562f0852f6b0 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562f08852d40 con 0x562f08550390 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f088f4210 con 0x562f085274d0 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe23a7df740 10 client.0 _ll_register_callbacks cb 0x562f08863d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38050/0 (socket says 172.21.15.100:38050) 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 -- 172.21.15.100:0/3440069287 learned_addr learned my addr 172.21.15.100:0/3440069287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f088fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe231de9640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f08550390 0x562f089037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 -- 172.21.15.100:0/3440069287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 msgr2=0x562f088fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f088fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 -- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f08550390 msgr2=0x562f089037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f08550390 0x562f089037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 -- 172.21.15.100:0/3440069287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f086327d0 con 0x562f0852f6b0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe230de7640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe228005e00 tx=0x7fe22802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3377459ce91b352 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe214ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228049070 con 0x562f0852f6b0 2024-04-30T23:20:16.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.347+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe22803b460 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c0054d0 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fe2280bd7e0 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 10 client.16608 fetch_fsmap learned FSMap version 51 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562f085683f0 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c0054d0 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fe2280b9750 con 0x562f0852f6b0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 10 client.16608 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 20 client.16608 populate_metadata read hostname 'smithi100' 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f0850ef60 0x562f08909c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 4 client.16608 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f08864990 con 0x562f0850ef60 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.348+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f0850ef60 0x562f08909c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.349+0000 7fe214ff9640 10 client.16608 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:16.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.349+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f0850ef60 0x562f08909c10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95675f9815cecebb server_cookie=2680b10e7bce447c in_seq=0 out_seq=0 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.349+0000 7fe214ff9640 1 -- 172.21.15.100:0/3440069287 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562f08864990 con 0x562f0850ef60 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.349+0000 7fe214ff9640 10 client.16608 handle_command_reply: tid=0 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.349+0000 7fe23a7df740 1 client.16608 shutdown 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 msgr2=0x562f088fc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe228005e00 tx=0x7fe22802a410 comp rx=0 tx=0).stop 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 shutdown_connections 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f0850ef60 0x562f08909c10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f08550390 0x562f089037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0852f6b0 0x562f088fc870 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe214ff9640 0 client.16608 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3440069287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f088fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 >> 172.21.15.100:0/3440069287 conn(0x562f085444e0 msgr2=0x562f088f0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 shutdown_connections 2024-04-30T23:20:16.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 1 -- 172.21.15.100:0/3440069287 wait complete. 2024-04-30T23:20:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.350+0000 7fe23a7df740 20 client.16608 trim_cache size 0 max 16384 2024-04-30T23:20:16.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 Processor -- start 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 -- start start 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 0x562f0890e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f0852f6b0 0x562f0890e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1aa740 con 0x562f085274d0 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1ac280 con 0x562f0850ef60 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe23a7df740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1aae10 con 0x562f0852f6b0 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38058/0 (socket says 172.21.15.100:38058) 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 -- 172.21.15.100:0/1428537667 learned_addr learned my addr 172.21.15.100:0/1428537667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe231de9640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f0852f6b0 0x562f0890e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe2315e8640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 0x562f0890e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 -- 172.21.15.100:0/1428537667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f0852f6b0 msgr2=0x562f0890e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f0852f6b0 0x562f0890e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 -- 172.21.15.100:0/1428537667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 msgr2=0x562f0890e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 0x562f0890e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 -- 172.21.15.100:0/1428537667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f085280f0 con 0x562f085274d0 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe2315e8640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 0x562f0890e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe230de7640 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe2280b9ab0 tx=0x7fe228005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cd9ee98fc434b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.368+0000 7fe216ffd640 1 -- 172.21.15.100:0/1428537667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228049070 con 0x562f085274d0 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe216ffd640 1 -- 172.21.15.100:0/1428537667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2280c5d50 con 0x562f085274d0 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe216ffd640 1 -- 172.21.15.100:0/1428537667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2280c10a0 con 0x562f085274d0 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 -- 172.21.15.100:0/1428537667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 msgr2=0x562f089036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe2280b9ab0 tx=0x7fe228005890 comp rx=0 tx=0).stop 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 -- 172.21.15.100:0/1428537667 shutdown_connections 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f0852f6b0 0x562f0890e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f085274d0 0x562f089036f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 --2- 172.21.15.100:0/1428537667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0850ef60 0x562f0890e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 -- 172.21.15.100:0/1428537667 >> 172.21.15.100:0/1428537667 conn(0x562f085444e0 msgr2=0x562f088fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 -- 172.21.15.100:0/1428537667 shutdown_connections 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.369+0000 7fe23a7df740 1 -- 172.21.15.100:0/1428537667 wait complete. 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 -- start start 2024-04-30T23:20:16.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 Processor -- start 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f089027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f08902ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1abbb0 con 0x562f0850ef60 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1ab4e0 con 0x562f0852f6b0 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1a8720 con 0x562f085274d0 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe23a7df740 10 client.0 _ll_register_callbacks cb 0x7fe228005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38066/0 (socket says 172.21.15.100:38066) 2024-04-30T23:20:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 -- 172.21.15.100:0/3404240190 learned_addr learned my addr 172.21.15.100:0/3404240190 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe230de7640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f089027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe231de9640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f08902ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 -- 172.21.15.100:0/3404240190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 msgr2=0x562f089027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f089027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 -- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 msgr2=0x562f08902ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.370+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f08902ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe2315e8640 1 -- 172.21.15.100:0/3404240190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f088174b0 con 0x562f0850ef60 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe231de9640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f08902ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe2315e8640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x562f088f2210 tx=0x7fe21c00b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e088b9955e809c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c02b020 con 0x562f0850ef60 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe21c004840 con 0x562f0850ef60 2024-04-30T23:20:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2280c5d50 con 0x562f0850ef60 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fe21c036050 con 0x562f0850ef60 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 10 client.16614 fetch_fsmap learned FSMap version 51 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562f0896f160 con 0x562f0850ef60 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2280c5d50 con 0x562f0850ef60 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fe21c0271e0 con 0x562f0850ef60 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 10 client.16614 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 20 client.16614 populate_metadata read hostname 'smithi100' 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f08550390 0x562f08971970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 4 client.16614 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.371+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f0885e800 con 0x562f08550390 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe230de7640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f08550390 0x562f08971970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe230de7640 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f08550390 0x562f08971970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e0384ebba37989 server_cookie=d938c4e3d72d0536 in_seq=0 out_seq=0 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe214ff9640 10 client.16614 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe214ff9640 1 -- 172.21.15.100:0/3404240190 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x562f0885e800 con 0x562f08550390 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe214ff9640 10 client.16614 handle_command_reply: tid=0 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.372+0000 7fe23a7df740 1 client.16614 shutdown 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 msgr2=0x562f08902260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x562f088f2210 tx=0x7fe21c00b720 comp rx=0 tx=0).stop 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 shutdown_connections 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f08550390 0x562f08971970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f0852f6b0 0x562f08902ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f085274d0 0x562f089027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe214ff9640 0 client.16614 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 --2- 172.21.15.100:0/3404240190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f0850ef60 0x562f08902260 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 >> 172.21.15.100:0/3404240190 conn(0x562f085444e0 msgr2=0x562f088fa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 shutdown_connections 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 1 -- 172.21.15.100:0/3404240190 wait complete. 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23a7df740 20 client.16614 trim_cache size 0 max 16384 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:20:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:16.387 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 msgr2=0x7fe2180a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 0x7fe2180a60c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x562f088f3540 tx=0x7fe224004a40 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 msgr2=0x7fe22c1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe228006010 tx=0x7fe228004340 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 shutdown_connections 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe2180a3bb0 0x7fe2180a60c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe22c109a80 0x7fe22c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c104d80 0x7fe22c1985e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 --2- 172.21.15.100:0/3709889665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe22c103b40 0x7fe22c1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 >> 172.21.15.100:0/3709889665 conn(0x7fe22c0fed50 msgr2=0x7fe22c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:16.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 shutdown_connections 2024-04-30T23:20:16.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:16.373+0000 7fe23384c640 1 -- 172.21.15.100:0/3709889665 wait complete. 2024-04-30T23:20:16.390 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:20:17.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:16 smithi104 ceph-mon[32987]: pgmap v573: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:17.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:16 smithi183 ceph-mon[33560]: pgmap v573: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:17.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:16 smithi100 ceph-mon[29745]: pgmap v573: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:19.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:18 smithi104 ceph-mon[32987]: pgmap v574: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:19.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:18 smithi183 ceph-mon[33560]: pgmap v574: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:18 smithi100 ceph-mon[29745]: pgmap v574: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:20.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:19 smithi104 ceph-mon[32987]: pgmap v575: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:20.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:19 smithi183 ceph-mon[33560]: pgmap v575: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:20.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:19 smithi100 ceph-mon[29745]: pgmap v575: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:23.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:22 smithi100 ceph-mon[29745]: pgmap v576: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:23.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:22 smithi104 ceph-mon[32987]: pgmap v576: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:23.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:22 smithi183 ceph-mon[33560]: pgmap v576: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:24 smithi100 ceph-mon[29745]: pgmap v577: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:25.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:24 smithi104 ceph-mon[32987]: pgmap v577: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:25.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:24 smithi183 ceph-mon[33560]: pgmap v577: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:27.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:26 smithi100 ceph-mon[29745]: pgmap v578: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:27.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:26 smithi104 ceph-mon[32987]: pgmap v578: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:27.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:26 smithi183 ceph-mon[33560]: pgmap v578: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:29.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:28 smithi104 ceph-mon[32987]: pgmap v579: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:29.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:28 smithi183 ceph-mon[33560]: pgmap v579: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:29.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:28 smithi100 ceph-mon[29745]: pgmap v579: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:31.126 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:30 smithi100 ceph-mon[29745]: pgmap v580: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:31.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:30 smithi104 ceph-mon[32987]: pgmap v580: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:31.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:30 smithi183 ceph-mon[33560]: pgmap v580: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:33.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:32 smithi104 ceph-mon[32987]: pgmap v581: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:33.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:32 smithi183 ceph-mon[33560]: pgmap v581: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:33.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:32 smithi100 ceph-mon[29745]: pgmap v581: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:35.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:34 smithi104 ceph-mon[32987]: pgmap v582: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:35.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:34 smithi183 ceph-mon[33560]: pgmap v582: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:35.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:34 smithi100 ceph-mon[29745]: pgmap v582: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:37.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:36 smithi104 ceph-mon[32987]: pgmap v583: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:37.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:36 smithi183 ceph-mon[33560]: pgmap v583: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:37.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:36 smithi100 ceph-mon[29745]: pgmap v583: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:39.106 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:38 smithi183 ceph-mon[33560]: pgmap v584: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:39.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:38 smithi104 ceph-mon[32987]: pgmap v584: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:39.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:38 smithi100 ceph-mon[29745]: pgmap v584: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:41.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:40 smithi104 ceph-mon[32987]: pgmap v585: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:41.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:40 smithi183 ceph-mon[33560]: pgmap v585: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:41.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:40 smithi100 ceph-mon[29745]: pgmap v585: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:41 smithi104 ceph-mon[32987]: pgmap v586: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:42.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:41 smithi183 ceph-mon[33560]: pgmap v586: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:42.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:41 smithi100 ceph-mon[29745]: pgmap v586: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:45.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:44 smithi104 ceph-mon[32987]: pgmap v587: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:45.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:44 smithi183 ceph-mon[33560]: pgmap v587: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:45.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:44 smithi100 ceph-mon[29745]: pgmap v587: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:46.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:20:46.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:20:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 -- 172.21.15.100:0/959820472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0106c70 msgr2=0x7f6be0109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 --2- 172.21.15.100:0/959820472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0106c70 0x7f6be0109150 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009900 tx=0x7f6bdc02a410 comp rx=0 tx=0).stop 2024-04-30T23:20:46.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 -- 172.21.15.100:0/959820472 shutdown_connections 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 --2- 172.21.15.100:0/959820472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be01097e0 0x7f6be010bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 --2- 172.21.15.100:0/959820472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0106c70 0x7f6be0109150 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 --2- 172.21.15.100:0/959820472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be0101e90 0x7f6be01022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 -- 172.21.15.100:0/959820472 >> 172.21.15.100:0/959820472 conn(0x7f6be00fd3c0 msgr2=0x7f6be00ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 -- 172.21.15.100:0/959820472 shutdown_connections 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.512+0000 7f6be73eb640 1 -- 172.21.15.100:0/959820472 wait complete. 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 Processor -- start 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 -- start start 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be0106c70 0x7f6be0102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be01097e0 0x7f6be0102f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6be010f670 con 0x7f6be0101e90 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6be010f4f0 con 0x7f6be0106c70 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be73eb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6be010f7f0 con 0x7f6be01097e0 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50630/0 (socket says 172.21.15.100:50630) 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.513+0000 7f6be5187640 1 -- 172.21.15.100:0/2726446890 learned_addr learned my addr 172.21.15.100:0/2726446890 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be4986640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be0106c70 0x7f6be0102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5988640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be01097e0 0x7f6be0102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 -- 172.21.15.100:0/2726446890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be01097e0 msgr2=0x7f6be0102f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be01097e0 0x7f6be0102f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 -- 172.21.15.100:0/2726446890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be0106c70 msgr2=0x7f6be0102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be0106c70 0x7f6be0102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 -- 172.21.15.100:0/2726446890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be0103670 con 0x7f6be0101e90 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be5187640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c970 tx=0x7f6bd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6bd67fc640 1 -- 172.21.15.100:0/2726446890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0007bb0 con 0x7f6be0101e90 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6bd67fc640 1 -- 172.21.15.100:0/2726446890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd0007d50 con 0x7f6be0101e90 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01a4330 con 0x7f6be0101e90 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6bd67fc640 1 -- 172.21.15.100:0/2726446890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0018730 con 0x7f6be0101e90 2024-04-30T23:20:46.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.514+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be01a47a0 con 0x7f6be0101e90 2024-04-30T23:20:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.516+0000 7f6bd67fc640 1 -- 172.21.15.100:0/2726446890 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6bd000f990 con 0x7f6be0101e90 2024-04-30T23:20:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 Processor -- start 2024-04-30T23:20:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 -- start start 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bd67fc640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 0x7f6bcc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1acfe6b0 0x55df1b0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55df1afd8b10 con 0x55df1ad1f390 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55df1b025d80 con 0x55df1acfe6b0 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bd67fc640 1 -- 172.21.15.100:0/2726446890 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6bd00d0850 con 0x7f6be0101e90 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6bee377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55df1afdf8b0 con 0x55df1acf64d0 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6be5988640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 0x7f6bcc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50636/0 (socket says 172.21.15.100:50636) 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6be5187640 1 -- 172.21.15.100:0/4150204701 learned_addr learned my addr 172.21.15.100:0/4150204701 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:46.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.517+0000 7f6be4986640 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5988640 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1acfe6b0 0x55df1b0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 -- 172.21.15.100:0/4150204701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 msgr2=0x55df1b0c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 -- 172.21.15.100:0/4150204701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1acfe6b0 msgr2=0x55df1b0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1acfe6b0 0x55df1b0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 -- 172.21.15.100:0/4150204701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df1afb0a40 con 0x55df1ad1f390 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5988640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 0x7f6bcc0a60c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005fd0 tx=0x7f6bd8014ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6be5187640 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00a4f10 tx=0x7f6bd000fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9024cee080ac159 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6bcb7fe640 1 -- 172.21.15.100:0/4150204701 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00a5440 con 0x55df1ad1f390 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6bcb7fe640 1 -- 172.21.15.100:0/4150204701 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd009ab80 con 0x55df1ad1f390 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.518+0000 7f6bcb7fe640 1 -- 172.21.15.100:0/4150204701 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd009dd60 con 0x55df1ad1f390 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- 172.21.15.100:0/4150204701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 msgr2=0x55df1b0c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00a4f10 tx=0x7f6bd000fd30 comp rx=0 tx=0).stop 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- 172.21.15.100:0/4150204701 shutdown_connections 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1acfe6b0 0x55df1b0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 --2- 172.21.15.100:0/4150204701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1ad1f390 0x55df1b0c14f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- 172.21.15.100:0/4150204701 >> 172.21.15.100:0/4150204701 conn(0x55df1ad134e0 msgr2=0x55df1b0bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- 172.21.15.100:0/4150204701 shutdown_connections 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- 172.21.15.100:0/4150204701 wait complete. 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 -- start start 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.519+0000 7f6bee377740 1 Processor -- start 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55df1afacd10 con 0x55df1acfe6b0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55df1b021d40 con 0x55df1ad1f390 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55df1b0c3210 con 0x55df1acf64d0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bee377740 10 client.0 _ll_register_callbacks cb 0x55df1b032d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50650/0 (socket says 172.21.15.100:50650) 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 -- 172.21.15.100:0/541220116 learned_addr learned my addr 172.21.15.100:0/541220116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be5187640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be5988640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 -- 172.21.15.100:0/541220116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 msgr2=0x55df1b0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 -- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 msgr2=0x55df1b0d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 -- 172.21.15.100:0/541220116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df1ae017d0 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6be4986640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005ab0 tx=0x7f6bdc031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b36eff21aaae194 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.520+0000 7f6bc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035040 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6bdc004300 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd009ab80 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc04e050 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 10 client.16626 fetch_fsmap learned FSMap version 51 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55df1ad373f0 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd009ab80 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f6bdc004b40 con 0x55df1acfe6b0 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 10 client.16626 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:20:46.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 20 client.16626 populate_metadata read hostname 'smithi100' 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acddf60 0x55df1b0d8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 4 client.16626 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df1b033990 con 0x55df1acddf60 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.521+0000 7f6be5187640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acddf60 0x55df1b0d8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.522+0000 7f6bc8ff9640 10 client.16626 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.522+0000 7f6be5187640 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acddf60 0x55df1b0d8da0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf5810557fd3de63 server_cookie=8c1cbdaab55f6e0c in_seq=0 out_seq=0 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/541220116 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55df1b033990 con 0x55df1acddf60 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bc8ff9640 10 client.16626 handle_command_reply: tid=0 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 client.16626 shutdown 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 msgr2=0x55df1b0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005ab0 tx=0x7f6bdc031910 comp rx=0 tx=0).stop 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 shutdown_connections 2024-04-30T23:20:46.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acddf60 0x55df1b0d8da0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0cb890 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bc8ff9640 0 client.16626 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 --2- 172.21.15.100:0/541220116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 >> 172.21.15.100:0/541220116 conn(0x55df1ad134e0 msgr2=0x55df1b0bfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 shutdown_connections 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 1 -- 172.21.15.100:0/541220116 wait complete. 2024-04-30T23:20:46.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.523+0000 7f6bee377740 20 client.16626 trim_cache size 0 max 16384 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 Processor -- start 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 -- start start 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acfe6b0 0x55df1b0dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01aeab0 con 0x55df1acf64d0 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01b05f0 con 0x55df1ad1f390 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bee377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01af180 con 0x55df1acfe6b0 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50666/0 (socket says 172.21.15.100:50666) 2024-04-30T23:20:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 -- 172.21.15.100:0/3381153831 learned_addr learned my addr 172.21.15.100:0/3381153831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 -- 172.21.15.100:0/3381153831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acfe6b0 msgr2=0x55df1b0dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acfe6b0 0x55df1b0dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 -- 172.21.15.100:0/3381153831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 msgr2=0x55df1b0ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 -- 172.21.15.100:0/3381153831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df1acf70f0 con 0x55df1acf64d0 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6be5187640 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0098ce0 tx=0x7f6bd00870b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703f35cb4ace6ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bcaffd640 1 -- 172.21.15.100:0/3381153831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd007f020 con 0x55df1acf64d0 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bcaffd640 1 -- 172.21.15.100:0/3381153831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd00bb070 con 0x55df1acf64d0 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.541+0000 7f6bcaffd640 1 -- 172.21.15.100:0/3381153831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd009dd40 con 0x55df1acf64d0 2024-04-30T23:20:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 -- 172.21.15.100:0/3381153831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 msgr2=0x55df1b0dd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0098ce0 tx=0x7f6bd00870b0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 -- 172.21.15.100:0/3381153831 shutdown_connections 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b0ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acfe6b0 0x55df1b0dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 --2- 172.21.15.100:0/3381153831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acf64d0 0x55df1b0dd550 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 -- 172.21.15.100:0/3381153831 >> 172.21.15.100:0/3381153831 conn(0x55df1ad134e0 msgr2=0x55df1b0c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 -- 172.21.15.100:0/3381153831 shutdown_connections 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.542+0000 7f6bee377740 1 -- 172.21.15.100:0/3381153831 wait complete. 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 -- start start 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 Processor -- start 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01aff20 con 0x55df1acfe6b0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01af850 con 0x55df1ad1f390 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01aca90 con 0x55df1acf64d0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6bee377740 10 client.0 _ll_register_callbacks cb 0x7f6bdc005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50680/0 (socket says 172.21.15.100:50680) 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 -- 172.21.15.100:0/660722105 learned_addr learned my addr 172.21.15.100:0/660722105 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be5988640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be5187640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 -- 172.21.15.100:0/660722105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 msgr2=0x55df1b0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 -- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 msgr2=0x55df1b13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be4986640 1 -- 172.21.15.100:0/660722105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df1afe64b0 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be5988640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.543+0000 7f6be5187640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6be4986640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0096c0 tx=0x7f6bdc003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868b8c504d28239 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035070 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f6bdc004100 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd00bb070 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc0318f0 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 10 client.16632 fetch_fsmap learned FSMap version 51 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55df1b13eaa0 con 0x55df1acfe6b0 2024-04-30T23:20:46.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd00bb070 con 0x55df1acfe6b0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f6bdc004850 con 0x55df1acfe6b0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 10 client.16632 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 20 client.16632 populate_metadata read hostname 'smithi100' 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acb33a0 0x55df1b141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 4 client.16632 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.544+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df1b02d800 con 0x55df1acb33a0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6be5187640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acb33a0 0x55df1b141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bc8ff9640 10 client.16632 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6be5187640 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acb33a0 0x55df1b141510 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8cd7de3f2d5d0d7 server_cookie=d50e4d05e78fc0c4 in_seq=0 out_seq=0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bc8ff9640 1 -- 172.21.15.100:0/660722105 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55df1b02d800 con 0x55df1acb33a0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bc8ff9640 10 client.16632 handle_command_reply: tid=0 2024-04-30T23:20:46.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 client.16632 shutdown 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 msgr2=0x55df1b0d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0096c0 tx=0x7f6bdc003a10 comp rx=0 tx=0).stop 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 shutdown_connections 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55df1acb33a0 0x55df1b141510 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55df1ad1f390 0x55df1b13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55df1acfe6b0 0x55df1b0d1800 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bc8ff9640 0 client.16632 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 --2- 172.21.15.100:0/660722105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55df1acf64d0 0x55df1b0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.545+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 >> 172.21.15.100:0/660722105 conn(0x55df1ad134e0 msgr2=0x55df1b0bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 shutdown_connections 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6bee377740 1 -- 172.21.15.100:0/660722105 wait complete. 2024-04-30T23:20:46.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6bee377740 20 client.16632 trim_cache size 0 max 16384 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:46.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.557 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:20:46.558 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:20:46.560 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:20:46.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 msgr2=0x7f6bcc0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 0x7f6bcc0a60c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005fd0 tx=0x7f6bd8014ab0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 msgr2=0x7f6be0104360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c970 tx=0x7f6bd000ce30 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 shutdown_connections 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f6bcc0a3bb0 0x7f6bcc0a60c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be01097e0 0x7f6be0102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be0106c70 0x7f6be0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 --2- 172.21.15.100:0/2726446890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be0101e90 0x7f6be0104360 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 >> 172.21.15.100:0/2726446890 conn(0x7f6be00fd3c0 msgr2=0x7f6be0107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 shutdown_connections 2024-04-30T23:20:46.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:20:46.546+0000 7f6be73eb640 1 -- 172.21.15.100:0/2726446890 wait complete. 2024-04-30T23:20:46.563 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:20:47.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:46 smithi104 ceph-mon[32987]: pgmap v588: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:47.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:46 smithi183 ceph-mon[33560]: pgmap v588: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:47.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:46 smithi100 ceph-mon[29745]: pgmap v588: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:49.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: pgmap v589: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:20:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: pgmap v589: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:20:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:20:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: pgmap v589: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:20:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:20:49.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:20:49.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:20:49.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:20:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:49 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:20:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:49 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:20:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:49 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:20:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:49 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:20:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:49 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:20:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:49 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:20:51.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:50 smithi104 ceph-mon[32987]: pgmap v590: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:51.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:50 smithi183 ceph-mon[33560]: pgmap v590: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:51.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:50 smithi100 ceph-mon[29745]: pgmap v590: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:20:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:52 smithi104 ceph-mon[32987]: pgmap v591: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:53.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:52 smithi183 ceph-mon[33560]: pgmap v591: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:52 smithi100 ceph-mon[29745]: pgmap v591: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:20:54.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:53 smithi104 ceph-mon[32987]: pgmap v592: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:54.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:53 smithi183 ceph-mon[33560]: pgmap v592: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:54.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:53 smithi100 ceph-mon[29745]: pgmap v592: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:20:57.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:56 smithi104 ceph-mon[32987]: pgmap v593: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:57.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:56 smithi183 ceph-mon[33560]: pgmap v593: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:57.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:56 smithi100 ceph-mon[29745]: pgmap v593: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:20:59.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:20:58 smithi104 ceph-mon[32987]: pgmap v594: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:59.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:20:58 smithi183 ceph-mon[33560]: pgmap v594: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:20:59.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:20:58 smithi100 ceph-mon[29745]: pgmap v594: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:01.126 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:00 smithi100 ceph-mon[29745]: pgmap v595: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:01.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:00 smithi104 ceph-mon[32987]: pgmap v595: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:01.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:00 smithi183 ceph-mon[33560]: pgmap v595: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:03.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:02 smithi104 ceph-mon[32987]: pgmap v596: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:03.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:02 smithi183 ceph-mon[33560]: pgmap v596: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:03.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:02 smithi100 ceph-mon[29745]: pgmap v596: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:05.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:04 smithi104 ceph-mon[32987]: pgmap v597: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:05.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:04 smithi183 ceph-mon[33560]: pgmap v597: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:05.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:04 smithi100 ceph-mon[29745]: pgmap v597: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:07.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:06 smithi104 ceph-mon[32987]: pgmap v598: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:21:07.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:06 smithi183 ceph-mon[33560]: pgmap v598: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:21:07.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:06 smithi100 ceph-mon[29745]: pgmap v598: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-30T23:21:09.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:08 smithi183 ceph-mon[33560]: pgmap v599: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:09.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:08 smithi104 ceph-mon[32987]: pgmap v599: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:08 smithi100 ceph-mon[29745]: pgmap v599: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:09 smithi104 ceph-mon[32987]: pgmap v600: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:10.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:09 smithi183 ceph-mon[33560]: pgmap v600: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:10.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:09 smithi100 ceph-mon[29745]: pgmap v600: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:13.276 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:12 smithi104 ceph-mon[32987]: pgmap v601: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:13.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:12 smithi183 ceph-mon[33560]: pgmap v601: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:13.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:12 smithi100 ceph-mon[29745]: pgmap v601: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:15.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:14 smithi104 ceph-mon[32987]: pgmap v602: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:15.305 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:14 smithi183 ceph-mon[33560]: pgmap v602: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:15.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:14 smithi100 ceph-mon[29745]: pgmap v602: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:16.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:21:16.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:21:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 -- 172.21.15.100:0/3594745305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44104d70 msgr2=0x7f7e44105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 --2- 172.21.15.100:0/3594745305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44104d70 0x7f7e44105180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009900 tx=0x7f7e3402a410 comp rx=0 tx=0).stop 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 -- 172.21.15.100:0/3594745305 shutdown_connections 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 --2- 172.21.15.100:0/3594745305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44109a70 0x7f7e4410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 --2- 172.21.15.100:0/3594745305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44104d70 0x7f7e44105180 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 --2- 172.21.15.100:0/3594745305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 0x7f7e44104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 -- 172.21.15.100:0/3594745305 >> 172.21.15.100:0/3594745305 conn(0x7f7e440fed20 msgr2=0x7f7e441011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 -- 172.21.15.100:0/3594745305 shutdown_connections 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.686+0000 7f7e4b976640 1 -- 172.21.15.100:0/3594745305 wait complete. 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 Processor -- start 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 -- start start 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 0x7f7e4419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 0x7f7e4419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f650 con 0x7f7e44109a70 2024-04-30T23:21:16.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f4d0 con 0x7f7e44104d70 2024-04-30T23:21:16.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e4b976640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f7d0 con 0x7f7e44103b30 2024-04-30T23:21:16.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e49f13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e49f13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33044/0 (socket says 172.21.15.100:33044) 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e49f13640 1 -- 172.21.15.100:0/797117367 learned_addr learned my addr 172.21.15.100:0/797117367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.687+0000 7f7e49712640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 0x7f7e4419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e48f11640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 0x7f7e4419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 -- 172.21.15.100:0/797117367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 msgr2=0x7f7e4419a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 0x7f7e4419a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 -- 172.21.15.100:0/797117367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 msgr2=0x7f7e4419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 0x7f7e4419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 -- 172.21.15.100:0/797117367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e441a1d80 con 0x7f7e44109a70 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e48f11640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 0x7f7e4419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e49f13640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00eaa0 tx=0x7f7e3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e3a7fc640 1 -- 172.21.15.100:0/797117367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00cdb0 con 0x7f7e44109a70 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e3a7fc640 1 -- 172.21.15.100:0/797117367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e3c005020 con 0x7f7e44109a70 2024-04-30T23:21:16.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e3a7fc640 1 -- 172.21.15.100:0/797117367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0116d0 con 0x7f7e44109a70 2024-04-30T23:21:16.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e441a2070 con 0x7f7e44109a70 2024-04-30T23:21:16.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.688+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441a25c0 con 0x7f7e44109a70 2024-04-30T23:21:16.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.690+0000 7f7e3a7fc640 1 -- 172.21.15.100:0/797117367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7e3c0051d0 con 0x7f7e44109a70 2024-04-30T23:21:16.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 Processor -- start 2024-04-30T23:21:16.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 -- start start 2024-04-30T23:21:16.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b72390 0x558f13f144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f15700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f13e2bb10 con 0x558f13b494d0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f13e78d80 con 0x558f13b516b0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e5282d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558f13e328b0 con 0x558f13b72390 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e3a7fc640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 0x7f7e300a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e49712640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e49712640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33052/0 (socket says 172.21.15.100:33052) 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e49712640 1 -- 172.21.15.100:0/296729143 learned_addr learned my addr 172.21.15.100:0/296729143 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e49f13640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 0x7f7e300a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.691+0000 7f7e48f11640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f15700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e48f11640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b72390 0x558f13f144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e3a7fc640 1 -- 172.21.15.100:0/797117367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7e3c0d0950 con 0x7f7e44109a70 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 -- 172.21.15.100:0/296729143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b72390 msgr2=0x558f13f144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b72390 0x558f13f144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 -- 172.21.15.100:0/296729143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 msgr2=0x558f13f15700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f15700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 -- 172.21.15.100:0/296729143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f13e03a40 con 0x558f13b494d0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e48f11640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f15700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49f13640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 0x7f7e300a6140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c098cd0 tx=0x7f7e3c0c7980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e49712640 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000bc70 tx=0x7f7e400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf376ebdc3b4a1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e2f7fe640 1 -- 172.21.15.100:0/296729143 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4001c680 con 0x558f13b494d0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e2f7fe640 1 -- 172.21.15.100:0/296729143 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4000be20 con 0x558f13b494d0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.692+0000 7f7e2f7fe640 1 -- 172.21.15.100:0/296729143 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40011ac0 con 0x558f13b494d0 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- 172.21.15.100:0/296729143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 msgr2=0x558f13f14a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000bc70 tx=0x7f7e400107a0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- 172.21.15.100:0/296729143 shutdown_connections 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f15700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f14a70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 --2- 172.21.15.100:0/296729143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b72390 0x558f13f144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- 172.21.15.100:0/296729143 >> 172.21.15.100:0/296729143 conn(0x558f13b664e0 msgr2=0x558f13f0fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- 172.21.15.100:0/296729143 shutdown_connections 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- 172.21.15.100:0/296729143 wait complete. 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 -- start start 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.693+0000 7f7e5282d740 1 Processor -- start 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f1e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f1e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f13dffd10 con 0x558f13b72390 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f13e74d40 con 0x558f13b516b0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558f13f16210 con 0x558f13b494d0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e5282d740 10 client.0 _ll_register_callbacks cb 0x558f13e85d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33054/0 (socket says 172.21.15.100:33054) 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 -- 172.21.15.100:0/3972450528 learned_addr learned my addr 172.21.15.100:0/3972450528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f1e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e49712640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f1e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 -- 172.21.15.100:0/3972450528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 msgr2=0x558f13f1e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f1e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 -- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 msgr2=0x558f13f1e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f1e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.694+0000 7f7e48f11640 1 -- 172.21.15.100:0/3972450528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f13c547d0 con 0x558f13b72390 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e48f11640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009900 tx=0x7f7e34009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5e6f7b045aeba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34035040 con 0x558f13b72390 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7e34005020 con 0x558f13b72390 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4000be20 con 0x558f13b72390 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7e34052050 con 0x558f13b72390 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 10 client.16644 fetch_fsmap learned FSMap version 51 2024-04-30T23:21:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558f13b8a3f0 con 0x558f13b72390 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4000be20 con 0x558f13b72390 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f7e3403a040 con 0x558f13b72390 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 10 client.16644 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 20 client.16644 populate_metadata read hostname 'smithi100' 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b30f60 0x558f13f2bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 4 client.16644 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.695+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f13e86990 con 0x558f13b30f60 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.696+0000 7f7e49712640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b30f60 0x558f13f2bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.696+0000 7f7e2cff9640 10 client.16644 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.696+0000 7f7e49712640 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b30f60 0x558f13f2bbd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3191cf58f14130df server_cookie=8bc2642cdf76155 in_seq=0 out_seq=0 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e2cff9640 1 -- 172.21.15.100:0/3972450528 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558f13e86990 con 0x558f13b30f60 2024-04-30T23:21:16.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e2cff9640 10 client.16644 handle_command_reply: tid=0 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 client.16644 shutdown 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 msgr2=0x558f13f25770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009900 tx=0x7f7e34009260 comp rx=0 tx=0).stop 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 shutdown_connections 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b30f60 0x558f13f2bbd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b72390 0x558f13f25770 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e2cff9640 0 client.16644 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b516b0 0x558f13f1e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 --2- 172.21.15.100:0/3972450528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f1e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 >> 172.21.15.100:0/3972450528 conn(0x558f13b664e0 msgr2=0x558f13f12c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 shutdown_connections 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 1 -- 172.21.15.100:0/3972450528 wait complete. 2024-04-30T23:21:16.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.697+0000 7f7e5282d740 20 client.16644 trim_cache size 0 max 16384 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 Processor -- start 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 -- start start 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b516b0 0x558f13f1cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f31390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ac920 con 0x558f13b494d0 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ae460 con 0x558f13b72390 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e5282d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441acff0 con 0x558f13b516b0 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33068/0 (socket says 172.21.15.100:33068) 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 -- 172.21.15.100:0/1781772157 learned_addr learned my addr 172.21.15.100:0/1781772157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:16.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e49712640 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b516b0 0x558f13f1cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 -- 172.21.15.100:0/1781772157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b516b0 msgr2=0x558f13f1cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b516b0 0x558f13f1cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 -- 172.21.15.100:0/1781772157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 msgr2=0x558f13f31390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f31390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 -- 172.21.15.100:0/1781772157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f13b4a0f0 con 0x558f13b494d0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.715+0000 7f7e48f11640 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001eb0 tx=0x7f7e340057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f46568f28a0e620 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e2effd640 1 -- 172.21.15.100:0/1781772157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34035040 con 0x558f13b494d0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e2effd640 1 -- 172.21.15.100:0/1781772157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e34003690 con 0x558f13b494d0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e2effd640 1 -- 172.21.15.100:0/1781772157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004ff0 con 0x558f13b494d0 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 -- 172.21.15.100:0/1781772157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 msgr2=0x558f13f191b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001eb0 tx=0x7f7e340057b0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 -- 172.21.15.100:0/1781772157 shutdown_connections 2024-04-30T23:21:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f31390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b516b0 0x558f13f1cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 --2- 172.21.15.100:0/1781772157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b494d0 0x558f13f191b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 -- 172.21.15.100:0/1781772157 >> 172.21.15.100:0/1781772157 conn(0x558f13b664e0 msgr2=0x558f13f13530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 -- 172.21.15.100:0/1781772157 shutdown_connections 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.716+0000 7f7e5282d740 1 -- 172.21.15.100:0/1781772157 wait complete. 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 -- start start 2024-04-30T23:21:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 Processor -- start 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f25240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441add90 con 0x558f13b516b0 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ad6c0 con 0x558f13b72390 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441aa900 con 0x558f13b494d0 2024-04-30T23:21:16.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e5282d740 10 client.0 _ll_register_callbacks cb 0x7f7e34009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e49712640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e49712640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33080/0 (socket says 172.21.15.100:33080) 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e49712640 1 -- 172.21.15.100:0/2602902894 learned_addr learned my addr 172.21.15.100:0/2602902894 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e48f11640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f25240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.717+0000 7f7e48f11640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 -- 172.21.15.100:0/2602902894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 msgr2=0x558f13f247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 -- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 msgr2=0x558f13f25240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f25240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 -- 172.21.15.100:0/2602902894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f13e394b0 con 0x558f13b516b0 2024-04-30T23:21:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e48f11640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e49712640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000bc70 tx=0x7f7e4000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3732f363076fc75 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4002e070 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7e400055f0 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e34003690 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7e4003a050 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e5282d740 10 client.16650 fetch_fsmap learned FSMap version 51 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558f13f90de0 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e34003690 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.718+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f7e4002a270 con 0x558f13b516b0 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 10 client.16650 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:21:16.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 20 client.16650 populate_metadata read hostname 'smithi100' 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b063a0 0x558f13f934c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 4 client.16650 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f13e80800 con 0x558f13b063a0 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e48f11640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b063a0 0x558f13f934c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e2cff9640 10 client.16650 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e48f11640 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b063a0 0x558f13f934c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f2a4d7b881995c server_cookie=11b01846b953ad52 in_seq=0 out_seq=0 2024-04-30T23:21:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e2cff9640 1 -- 172.21.15.100:0/2602902894 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x558f13e80800 con 0x558f13b063a0 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e2cff9640 10 client.16650 handle_command_reply: tid=0 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.719+0000 7f7e5282d740 1 client.16650 shutdown 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 msgr2=0x558f13f24d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000bc70 tx=0x7f7e4000b990 comp rx=0 tx=0).stop 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 shutdown_connections 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558f13b063a0 0x558f13f934c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f13b72390 0x558f13f25240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f13b516b0 0x558f13f24d00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 --2- 172.21.15.100:0/2602902894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558f13b494d0 0x558f13f247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e2cff9640 0 client.16650 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 >> 172.21.15.100:0/2602902894 conn(0x558f13b664e0 msgr2=0x558f13f13530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 shutdown_connections 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 1 -- 172.21.15.100:0/2602902894 wait complete. 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e5282d740 20 client.16650 trim_cache size 0 max 16384 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:21:16.731 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:21:16.732 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.734 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.735 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:21:16.735 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:21:16.735 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:21:16.737 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:16.738 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:16.739 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:16.739 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 msgr2=0x7f7e300a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 0x7f7e300a6140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c098cd0 tx=0x7f7e3c0c7980 comp rx=0 tx=0).stop 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 msgr2=0x7f7e441a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00eaa0 tx=0x7f7e3c00ef60 comp rx=0 tx=0).stop 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 shutdown_connections 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e300a3c30 0x7f7e300a6140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e44109a70 0x7f7e441a1710 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e44104d70 0x7f7e4419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 --2- 172.21.15.100:0/797117367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e44103b30 0x7f7e4419a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:16.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 >> 172.21.15.100:0/797117367 conn(0x7f7e440fed20 msgr2=0x7f7e44105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:16.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 shutdown_connections 2024-04-30T23:21:16.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:16.720+0000 7f7e4b976640 1 -- 172.21.15.100:0/797117367 wait complete. 2024-04-30T23:21:16.742 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:21:17.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:16 smithi104 ceph-mon[32987]: pgmap v603: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:17.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:16 smithi183 ceph-mon[33560]: pgmap v603: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:17.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:16 smithi100 ceph-mon[29745]: pgmap v603: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:19.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:18 smithi104 ceph-mon[32987]: pgmap v604: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:19.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:18 smithi183 ceph-mon[33560]: pgmap v604: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:18 smithi100 ceph-mon[29745]: pgmap v604: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:21.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:20 smithi104 ceph-mon[32987]: pgmap v605: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:21.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:20 smithi183 ceph-mon[33560]: pgmap v605: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:21.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:20 smithi100 ceph-mon[29745]: pgmap v605: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:23.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:22 smithi104 ceph-mon[32987]: pgmap v606: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:23.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:22 smithi183 ceph-mon[33560]: pgmap v606: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:23.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:22 smithi100 ceph-mon[29745]: pgmap v606: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:23 smithi104 ceph-mon[32987]: pgmap v607: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:23 smithi183 ceph-mon[33560]: pgmap v607: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:24.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:23 smithi100 ceph-mon[29745]: pgmap v607: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:27.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:26 smithi104 ceph-mon[32987]: pgmap v608: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:21:27.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:26 smithi183 ceph-mon[33560]: pgmap v608: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:21:27.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:26 smithi100 ceph-mon[29745]: pgmap v608: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:21:29.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:28 smithi104 ceph-mon[32987]: pgmap v609: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:29.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:28 smithi183 ceph-mon[33560]: pgmap v609: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:29.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:28 smithi100 ceph-mon[29745]: pgmap v609: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:31.127 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:30 smithi100 ceph-mon[29745]: pgmap v610: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:31.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:30 smithi104 ceph-mon[32987]: pgmap v610: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:31.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:30 smithi183 ceph-mon[33560]: pgmap v610: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:33.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:32 smithi104 ceph-mon[32987]: pgmap v611: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:33.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:32 smithi183 ceph-mon[33560]: pgmap v611: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:33.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:32 smithi100 ceph-mon[29745]: pgmap v611: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:35.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:34 smithi104 ceph-mon[32987]: pgmap v612: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:35.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:34 smithi183 ceph-mon[33560]: pgmap v612: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:35.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:34 smithi100 ceph-mon[29745]: pgmap v612: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:36.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:35 smithi104 ceph-mon[32987]: pgmap v613: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:35 smithi183 ceph-mon[33560]: pgmap v613: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:35 smithi100 ceph-mon[29745]: pgmap v613: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:39.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:38 smithi104 ceph-mon[32987]: pgmap v614: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:39.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:38 smithi183 ceph-mon[33560]: pgmap v614: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:39.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:38 smithi100 ceph-mon[29745]: pgmap v614: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:41.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:40 smithi104 ceph-mon[32987]: pgmap v615: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:41.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:40 smithi183 ceph-mon[33560]: pgmap v615: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:41.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:40 smithi100 ceph-mon[29745]: pgmap v615: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:43.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:42 smithi104 ceph-mon[32987]: pgmap v616: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:43.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:42 smithi183 ceph-mon[33560]: pgmap v616: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:42 smithi100 ceph-mon[29745]: pgmap v616: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:45.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:44 smithi104 ceph-mon[32987]: pgmap v617: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:45.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:44 smithi183 ceph-mon[33560]: pgmap v617: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:45.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:44 smithi100 ceph-mon[29745]: pgmap v617: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:45 smithi104 ceph-mon[32987]: pgmap v618: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:45 smithi183 ceph-mon[33560]: pgmap v618: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:46.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:45 smithi100 ceph-mon[29745]: pgmap v618: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:46.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:21:46.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:21:46.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 -- 172.21.15.100:0/2241266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 msgr2=0x7f149c104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 --2- 172.21.15.100:0/2241266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c104830 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f148c009900 tx=0x7f148c02a410 comp rx=0 tx=0).stop 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 -- 172.21.15.100:0/2241266310 shutdown_connections 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 --2- 172.21.15.100:0/2241266310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 --2- 172.21.15.100:0/2241266310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 --2- 172.21.15.100:0/2241266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c104830 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 -- 172.21.15.100:0/2241266310 >> 172.21.15.100:0/2241266310 conn(0x7f149c0fed20 msgr2=0x7f149c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 -- 172.21.15.100:0/2241266310 shutdown_connections 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.867+0000 7f14a36c7640 1 -- 172.21.15.100:0/2241266310 wait complete. 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 Processor -- start 2024-04-30T23:21:46.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 -- start start 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c10f610 con 0x7f149c103b30 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f149c10f490 con 0x7f149c109a70 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a36c7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f149c10f790 con 0x7f149c104d70 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57608/0 (socket says 172.21.15.100:57608) 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 -- 172.21.15.100:0/1471809587 learned_addr learned my addr 172.21.15.100:0/1471809587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a0c62640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1c64640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 -- 172.21.15.100:0/1471809587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 msgr2=0x7f149c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.868+0000 7f14a1463640 1 -- 172.21.15.100:0/1471809587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 msgr2=0x7f149c1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a1463640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a1463640 1 -- 172.21.15.100:0/1471809587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c1a1d40 con 0x7f149c103b30 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a0c62640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a1c64640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a1463640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f148c006010 tx=0x7f148c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14927fc640 1 -- 172.21.15.100:0/1471809587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c03f030 con 0x7f149c103b30 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14927fc640 1 -- 172.21.15.100:0/1471809587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f148c003aa0 con 0x7f149c103b30 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14927fc640 1 -- 172.21.15.100:0/1471809587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c035070 con 0x7f149c103b30 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149c1a1fd0 con 0x7f149c103b30 2024-04-30T23:21:46.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.869+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f149c1a2380 con 0x7f149c103b30 2024-04-30T23:21:46.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.871+0000 7f14927fc640 1 -- 172.21.15.100:0/1471809587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f148c042030 con 0x7f149c103b30 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 Processor -- start 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 -- start start 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55813143a4d0 0x558131809e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813180ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55813171cb10 con 0x558131463390 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558131769d80 con 0x55813143a4d0 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14aa576740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5581317238b0 con 0x5581314426b0 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14927fc640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 0x7f14880a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57616/0 (socket says 172.21.15.100:57616) 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a1c64640 1 -- 172.21.15.100:0/2927407882 learned_addr learned my addr 172.21.15.100:0/2927407882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a1c64640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 0x7f14880a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a0c62640 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813180ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14927fc640 1 -- 172.21.15.100:0/1471809587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f148c0f0de0 con 0x7f149c103b30 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.872+0000 7f14a1463640 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55813143a4d0 0x558131809e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 -- 172.21.15.100:0/2927407882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 msgr2=0x55813180ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813180ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 -- 172.21.15.100:0/2927407882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55813143a4d0 msgr2=0x558131809e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55813143a4d0 0x558131809e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 -- 172.21.15.100:0/2927407882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581316f4a40 con 0x558131463390 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1494013ef0 tx=0x7f14940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737031c7c7e97a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14a1c64640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 0x7f14880a60c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1494007310 tx=0x7f1494015000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14877fe640 1 -- 172.21.15.100:0/2927407882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494021070 con 0x558131463390 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14877fe640 1 -- 172.21.15.100:0/2927407882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1494007c90 con 0x558131463390 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.873+0000 7f14877fe640 1 -- 172.21.15.100:0/2927407882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494005360 con 0x558131463390 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- 172.21.15.100:0/2927407882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 msgr2=0x558131809900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1494013ef0 tx=0x7f14940107a0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- 172.21.15.100:0/2927407882 shutdown_connections 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813180ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55813143a4d0 0x558131809e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 --2- 172.21.15.100:0/2927407882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131809900 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- 172.21.15.100:0/2927407882 >> 172.21.15.100:0/2927407882 conn(0x5581314574e0 msgr2=0x558131800d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- 172.21.15.100:0/2927407882 shutdown_connections 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- 172.21.15.100:0/2927407882 wait complete. 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 -- start start 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.874+0000 7f14aa576740 1 Processor -- start 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x558131813740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131813c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5581316f0d10 con 0x558131463390 2024-04-30T23:21:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558131765d40 con 0x5581314426b0 2024-04-30T23:21:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55813180b5c0 con 0x55813143a4d0 2024-04-30T23:21:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14aa576740 10 client.0 _ll_register_callbacks cb 0x558131776d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:21:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57624/0 (socket says 172.21.15.100:57624) 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 -- 172.21.15.100:0/3881847163 learned_addr learned my addr 172.21.15.100:0/3881847163 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a0c62640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131813c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1463640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x558131813740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 -- 172.21.15.100:0/3881847163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 msgr2=0x558131813740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x558131813740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 -- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 msgr2=0x558131813c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131813c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 -- 172.21.15.100:0/3881847163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581315457d0 con 0x558131463390 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1494007780 tx=0x7f1494004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41310a52f09f42f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.875+0000 7f1484ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494021040 con 0x558131463390 2024-04-30T23:21:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1494005310 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558131777990 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f149403a050 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 10 client.16662 fetch_fsmap learned FSMap version 51 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55813147b3f0 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558131777990 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f14940258c0 con 0x558131463390 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 10 client.16662 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 10 client.16662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 20 client.16662 populate_metadata read hostname 'smithi100' 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558131421f60 0x558131820fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 4 client.16662 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.876+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558131771800 con 0x558131421f60 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.877+0000 7f14a1463640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558131421f60 0x558131820fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.877+0000 7f1484ff9640 10 client.16662 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.877+0000 7f14a1463640 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558131421f60 0x558131820fd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226b6bceeb38bd8 server_cookie=470e9273ff290104 in_seq=0 out_seq=0 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f1484ff9640 1 -- 172.21.15.100:0/3881847163 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x558131771800 con 0x558131421f60 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f1484ff9640 10 client.16662 handle_command_reply: tid=0 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 client.16662 shutdown 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 msgr2=0x55813181abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1494007780 tx=0x7f1494004c30 comp rx=0 tx=0).stop 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 shutdown_connections 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x558131421f60 0x558131820fd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x55813181abe0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131813c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 --2- 172.21.15.100:0/3881847163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x558131813740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f1484ff9640 0 client.16662 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:46.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 >> 172.21.15.100:0/3881847163 conn(0x5581314574e0 msgr2=0x5581317ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 shutdown_connections 2024-04-30T23:21:46.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 1 -- 172.21.15.100:0/3881847163 wait complete. 2024-04-30T23:21:46.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.878+0000 7f14aa576740 20 client.16662 trim_cache size 0 max 16384 2024-04-30T23:21:46.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 Processor -- start 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 -- start start 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813181ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 0x558131813740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1aa690 con 0x55813143a4d0 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1ac1d0 con 0x558131463390 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14aa576740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1aad60 con 0x5581314426b0 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57634/0 (socket says 172.21.15.100:57634) 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 -- 172.21.15.100:0/570474938 learned_addr learned my addr 172.21.15.100:0/570474938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1c64640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 0x558131813740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 -- 172.21.15.100:0/570474938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 msgr2=0x55813181ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a0c62640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813181ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813181ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 -- 172.21.15.100:0/570474938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 msgr2=0x558131813740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.896+0000 7f14a1463640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 0x558131813740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f14a1463640 1 -- 172.21.15.100:0/570474938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55813143b0f0 con 0x55813143a4d0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f14a1c64640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 0x558131813740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f14a1463640 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f148c0b91c0 tx=0x7f148c0dd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355cd0b96ba3fc28 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f1486ffd640 1 -- 172.21.15.100:0/570474938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c049040 con 0x55813143a4d0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f1486ffd640 1 -- 172.21.15.100:0/570474938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f148c0c1110 con 0x55813143a4d0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.897+0000 7f1486ffd640 1 -- 172.21.15.100:0/570474938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c0b93d0 con 0x55813143a4d0 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- 172.21.15.100:0/570474938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 msgr2=0x55813180ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f148c0b91c0 tx=0x7f148c0dd040 comp rx=0 tx=0).stop 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- 172.21.15.100:0/570474938 shutdown_connections 2024-04-30T23:21:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558131463390 0x558131813740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5581314426b0 0x55813181ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- 172.21.15.100:0/570474938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55813143a4d0 0x55813180ec90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- 172.21.15.100:0/570474938 >> 172.21.15.100:0/570474938 conn(0x5581314574e0 msgr2=0x558131811d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- 172.21.15.100:0/570474938 shutdown_connections 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- 172.21.15.100:0/570474938 wait complete. 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- start start 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 Processor -- start 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x55813181ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131817680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1abb00 con 0x558131463390 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1ab430 con 0x5581314426b0 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1a8670 con 0x55813143a4d0 2024-04-30T23:21:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.898+0000 7f14aa576740 10 client.0 _ll_register_callbacks cb 0x7f148c005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57640/0 (socket says 172.21.15.100:57640) 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 -- 172.21.15.100:0/3876561110 learned_addr learned my addr 172.21.15.100:0/3876561110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a0c62640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131817680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1463640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x55813181ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 -- 172.21.15.100:0/3876561110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 msgr2=0x55813181ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x55813181ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 -- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 msgr2=0x558131817680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131817680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 -- 172.21.15.100:0/3876561110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55813172a4b0 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14a1c64640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1494013a70 tx=0x7f1494004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef7e2fd6cd21671 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f1484ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494021040 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1494025400 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148c0c1110 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f1494025600 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14aa576740 10 client.16668 fetch_fsmap learned FSMap version 51 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558131886280 con 0x558131463390 2024-04-30T23:21:46.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.899+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f148c0c1110 con 0x558131463390 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f1494005810 con 0x558131463390 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 10 client.16668 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 20 client.16668 populate_metadata read hostname 'smithi100' 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5581313f73a0 0x558131888cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 4 client.16668 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5581316ec4a0 con 0x5581313f73a0 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14a1463640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5581313f73a0 0x558131888cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f1484ff9640 10 client.16668 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.900+0000 7f14a1463640 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5581313f73a0 0x558131888cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e58deb5cfa7a5d7c server_cookie=2dcc52a6cb5c0b8d in_seq=0 out_seq=0 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f1484ff9640 1 -- 172.21.15.100:0/3876561110 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5581316ec4a0 con 0x5581313f73a0 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f1484ff9640 10 client.16668 handle_command_reply: tid=0 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 client.16668 shutdown 2024-04-30T23:21:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 msgr2=0x558131817cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1494013a70 tx=0x7f1494004f50 comp rx=0 tx=0).stop 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 shutdown_connections 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5581313f73a0 0x558131888cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558131463390 0x558131817cd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f1484ff9640 0 client.16668 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5581314426b0 0x558131817680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 --2- 172.21.15.100:0/3876561110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55813143a4d0 0x55813181ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 >> 172.21.15.100:0/3876561110 conn(0x5581314574e0 msgr2=0x558131803b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 shutdown_connections 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 1 -- 172.21.15.100:0/3876561110 wait complete. 2024-04-30T23:21:46.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.901+0000 7f14aa576740 20 client.16668 trim_cache size 0 max 16384 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:21:46.913 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.915 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:21:46.916 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:21:46.917 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 msgr2=0x7f14880a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 0x7f14880a60c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1494007310 tx=0x7f1494015000 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 msgr2=0x7f149c19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f148c006010 tx=0x7f148c031a50 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 shutdown_connections 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f14880a3bb0 0x7f14880a60c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f149c109a70 0x7f149c1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149c104d70 0x7f149c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 --2- 172.21.15.100:0/1471809587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c103b30 0x7f149c19a2b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:21:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 >> 172.21.15.100:0/1471809587 conn(0x7f149c0fed20 msgr2=0x7f149c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:21:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 shutdown_connections 2024-04-30T23:21:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:21:46.902+0000 7f14a36c7640 1 -- 172.21.15.100:0/1471809587 wait complete. 2024-04-30T23:21:46.920 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:21:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:48 smithi104 ceph-mon[32987]: pgmap v619: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:48 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:21:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:48 smithi183 ceph-mon[33560]: pgmap v619: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:48 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:21:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:48 smithi100 ceph-mon[29745]: pgmap v619: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:49.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:48 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:21:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:21:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:21:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:21:50.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:21:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:21:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:21:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:21:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:21:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:21:51.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:50 smithi104 ceph-mon[32987]: pgmap v620: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:51.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:50 smithi183 ceph-mon[33560]: pgmap v620: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:51.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:50 smithi100 ceph-mon[29745]: pgmap v620: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:51 smithi104 ceph-mon[32987]: pgmap v621: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:52.304 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:51 smithi183 ceph-mon[33560]: pgmap v621: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:52.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:51 smithi100 ceph-mon[29745]: pgmap v621: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:54 smithi104 ceph-mon[32987]: pgmap v622: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:54 smithi183 ceph-mon[33560]: pgmap v622: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:55.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:54 smithi100 ceph-mon[29745]: pgmap v622: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:21:57.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:56 smithi104 ceph-mon[32987]: pgmap v623: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:57.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:56 smithi183 ceph-mon[33560]: pgmap v623: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:57.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:56 smithi100 ceph-mon[29745]: pgmap v623: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:21:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:58 smithi104 ceph-mon[32987]: pgmap v624: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:59.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:58 smithi183 ceph-mon[33560]: pgmap v624: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:21:59.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:58 smithi100 ceph-mon[29745]: pgmap v624: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:21:59 smithi104 ceph-mon[32987]: pgmap v625: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:21:59 smithi183 ceph-mon[33560]: pgmap v625: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:00.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:21:59 smithi100 ceph-mon[29745]: pgmap v625: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:03.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:02 smithi104 ceph-mon[32987]: pgmap v626: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:03.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:02 smithi183 ceph-mon[33560]: pgmap v626: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:03.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:02 smithi100 ceph-mon[29745]: pgmap v626: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:05.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:04 smithi104 ceph-mon[32987]: pgmap v627: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:05.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:04 smithi183 ceph-mon[33560]: pgmap v627: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:05.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:04 smithi100 ceph-mon[29745]: pgmap v627: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:05 smithi104 ceph-mon[32987]: pgmap v628: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:05 smithi183 ceph-mon[33560]: pgmap v628: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:06.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:05 smithi100 ceph-mon[29745]: pgmap v628: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:09.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:08 smithi104 ceph-mon[32987]: pgmap v629: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:09.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:08 smithi183 ceph-mon[33560]: pgmap v629: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:08 smithi100 ceph-mon[29745]: pgmap v629: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:11.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:10 smithi104 ceph-mon[32987]: pgmap v630: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:11.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:10 smithi183 ceph-mon[33560]: pgmap v630: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:11.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:10 smithi100 ceph-mon[29745]: pgmap v630: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:11 smithi104 ceph-mon[32987]: pgmap v631: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:11 smithi183 ceph-mon[33560]: pgmap v631: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:12.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:11 smithi100 ceph-mon[29745]: pgmap v631: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:15.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:14 smithi104 ceph-mon[32987]: pgmap v632: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:15.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:14 smithi183 ceph-mon[33560]: pgmap v632: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:15.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:14 smithi100 ceph-mon[29745]: pgmap v632: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:15 smithi104 ceph-mon[32987]: pgmap v633: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:15 smithi183 ceph-mon[33560]: pgmap v633: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:16.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:15 smithi100 ceph-mon[29745]: pgmap v633: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:16.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:22:16.921 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:22:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 -- 172.21.15.100:0/1104526731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f81098f0 msgr2=0x7f75f810bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1104526731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f81098f0 0x7f75f810bd10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009ca0 tx=0x7f75f002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 -- 172.21.15.100:0/1104526731 shutdown_connections 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1104526731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f81098f0 0x7f75f810bd10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1104526731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f8106f90 0x7f75f81093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1104526731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 0x7f75f8106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 -- 172.21.15.100:0/1104526731 >> 172.21.15.100:0/1104526731 conn(0x7f75f80fdc30 msgr2=0x7f75f81000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 -- 172.21.15.100:0/1104526731 shutdown_connections 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.045+0000 7f75fe37d640 1 -- 172.21.15.100:0/1104526731 wait complete. 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 Processor -- start 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 -- start start 2024-04-30T23:22:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 0x7f75f819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 0x7f75f81a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75f810f670 con 0x7f75f8106f90 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75f810f4f0 con 0x7f75f81098f0 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.046+0000 7f75fe37d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f75f810f7f0 con 0x7f75f8104630 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39804/0 (socket says 172.21.15.100:39804) 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968490595 learned_addr learned my addr 172.21.15.100:0/1968490595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f7fff640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 0x7f75f819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75fc91a640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 0x7f75f81a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968490595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 msgr2=0x7f75f819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 0x7f75f819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968490595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 msgr2=0x7f75f81a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 0x7f75f81a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968490595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f81a1ce0 con 0x7f75f8106f90 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75fc91a640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 0x7f75f81a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c920 tx=0x7f75ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f57fa640 1 -- 172.21.15.100:0/1968490595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec007c70 con 0x7f75f8106f90 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f57fa640 1 -- 172.21.15.100:0/1968490595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec007e10 con 0x7f75f8106f90 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75f57fa640 1 -- 172.21.15.100:0/1968490595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec018820 con 0x7f75f8106f90 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f81a1fd0 con 0x7f75f8106f90 2024-04-30T23:22:17.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.047+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f81a2440 con 0x7f75f8106f90 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f75f57fa640 1 -- 172.21.15.100:0/1968490595 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f75ec00f450 con 0x7f75f8106f90 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 Processor -- start 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 -- start start 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b59390 0x557a46efb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b304d0 0x557a46efba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a46e12b10 con 0x557a46b386b0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557a46e5fd80 con 0x557a46b59390 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f760523b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557a46e198b0 con 0x557a46b304d0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f75f57fa640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 0x7f75e00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.050+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39820/0 (socket says 172.21.15.100:39820) 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 -- 172.21.15.100:0/3394078678 learned_addr learned my addr 172.21.15.100:0/3394078678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f7fff640 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b304d0 0x557a46efba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75fc91a640 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b59390 0x557a46efb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75fc91a640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 0x7f75e00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f57fa640 1 -- 172.21.15.100:0/1968490595 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f75ec0d0870 con 0x7f75f8106f90 2024-04-30T23:22:17.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 -- 172.21.15.100:0/3394078678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b304d0 msgr2=0x557a46efba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b304d0 0x557a46efba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 -- 172.21.15.100:0/3394078678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b59390 msgr2=0x557a46efb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b59390 0x557a46efb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 -- 172.21.15.100:0/3394078678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a46deaa40 con 0x557a46b386b0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0991c0 tx=0x7f75ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5408fcfce562f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75fc91a640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 0x7f75e00a60c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557a46efc540 tx=0x7f75f0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75de7fc640 1 -- 172.21.15.100:0/3394078678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0d3e60 con 0x557a46b386b0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75de7fc640 1 -- 172.21.15.100:0/3394078678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec09c7f0 con 0x557a46b386b0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.051+0000 7f75de7fc640 1 -- 172.21.15.100:0/3394078678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00f740 con 0x557a46b386b0 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- 172.21.15.100:0/3394078678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 msgr2=0x557a46efc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0991c0 tx=0x7f75ec000bc0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- 172.21.15.100:0/3394078678 shutdown_connections 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46efc700 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b304d0 0x557a46efba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 --2- 172.21.15.100:0/3394078678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b59390 0x557a46efb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- 172.21.15.100:0/3394078678 >> 172.21.15.100:0/3394078678 conn(0x557a46b4d4e0 msgr2=0x557a46ef6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- 172.21.15.100:0/3394078678 shutdown_connections 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- 172.21.15.100:0/3394078678 wait complete. 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.052+0000 7f760523b740 1 -- start start 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 Processor -- start 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f05860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a46de6d10 con 0x557a46b304d0 2024-04-30T23:22:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557a46e5bd40 con 0x557a46b386b0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557a46efd210 con 0x557a46b59390 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f760523b740 10 client.0 _ll_register_callbacks cb 0x557a46e6cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39834/0 (socket says 172.21.15.100:39834) 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 -- 172.21.15.100:0/2148857739 learned_addr learned my addr 172.21.15.100:0/2148857739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f77fe640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f05860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75fc91a640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 -- 172.21.15.100:0/2148857739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 msgr2=0x557a46f0c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 -- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 msgr2=0x557a46f05860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f05860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75f7fff640 1 -- 172.21.15.100:0/2148857739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a46c3b7d0 con 0x557a46b304d0 2024-04-30T23:22:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.053+0000 7f75fc91a640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75f7fff640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b990 tx=0x7f75e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b1299fd9854b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8005020 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f75e80051c0 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ec09c7f0 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f75e80053c0 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 10 client.16680 fetch_fsmap learned FSMap version 51 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557a46b713f0 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec09c7f0 con 0x557a46b304d0 2024-04-30T23:22:17.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f75e801b590 con 0x557a46b304d0 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 10 client.16680 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 20 client.16680 populate_metadata read hostname 'smithi100' 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46b17f60 0x557a46f12da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 4 client.16680 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.054+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a46e6d990 con 0x557a46b17f60 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.055+0000 7f75f77fe640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46b17f60 0x557a46f12da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.055+0000 7f75d77fe640 10 client.16680 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.055+0000 7f75f77fe640 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46b17f60 0x557a46f12da0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb908a254e7c3efd server_cookie=126de65c10a5ff26 in_seq=0 out_seq=0 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f75d77fe640 1 -- 172.21.15.100:0/2148857739 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x557a46e6d990 con 0x557a46b17f60 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f75d77fe640 10 client.16680 handle_command_reply: tid=0 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 client.16680 shutdown 2024-04-30T23:22:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 msgr2=0x557a46f05320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b990 tx=0x7f75e800be50 comp rx=0 tx=0).stop 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 shutdown_connections 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46b17f60 0x557a46f12da0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f05860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f75d77fe640 0 client.16680 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 --2- 172.21.15.100:0/2148857739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f05320 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 >> 172.21.15.100:0/2148857739 conn(0x557a46b4d4e0 msgr2=0x557a46ef9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 shutdown_connections 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 1 -- 172.21.15.100:0/2148857739 wait complete. 2024-04-30T23:22:17.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.056+0000 7f760523b740 20 client.16680 trim_cache size 0 max 16384 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 Processor -- start 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 -- start start 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 0x557a46f03fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81ac8c0 con 0x557a46b386b0 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81ae400 con 0x557a46b304d0 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f760523b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81acf90 con 0x557a46b59390 2024-04-30T23:22:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39842/0 (socket says 172.21.15.100:39842) 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968656414 learned_addr learned my addr 172.21.15.100:0/1968656414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75fc91a640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f7fff640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 0x557a46f03fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968656414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 msgr2=0x557a46f0c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968656414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 msgr2=0x557a46f03fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 0x557a46f03fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f77fe640 1 -- 172.21.15.100:0/1968656414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a46b310f0 con 0x557a46b386b0 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.074+0000 7f75f7fff640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 0x557a46f03fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f75f77fe640 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f75ec09c780 tx=0x7f75ec087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc07ecf6088fc2e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f75ddffb640 1 -- 172.21.15.100:0/1968656414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec09aaf0 con 0x557a46b386b0 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f75ddffb640 1 -- 172.21.15.100:0/1968656414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec00f740 con 0x557a46b386b0 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f75ddffb640 1 -- 172.21.15.100:0/1968656414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec098e60 con 0x557a46b386b0 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 -- 172.21.15.100:0/1968656414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 msgr2=0x557a46f05600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f75ec09c780 tx=0x7f75ec087040 comp rx=0 tx=0).stop 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 -- 172.21.15.100:0/1968656414 shutdown_connections 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f0c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b386b0 0x557a46f05600 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 --2- 172.21.15.100:0/1968656414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b304d0 0x557a46f03fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 -- 172.21.15.100:0/1968656414 >> 172.21.15.100:0/1968656414 conn(0x557a46b4d4e0 msgr2=0x557a46f04ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.075+0000 7f760523b740 1 -- 172.21.15.100:0/1968656414 shutdown_connections 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 -- 172.21.15.100:0/1968656414 wait complete. 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 -- start start 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 Processor -- start 2024-04-30T23:22:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81add30 con 0x557a46b304d0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81ad660 con 0x557a46b386b0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f75f81aa8a0 con 0x557a46b59390 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f760523b740 10 client.0 _ll_register_callbacks cb 0x7f75e80042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f75f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f75f7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39850/0 (socket says 172.21.15.100:39850) 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f75f7fff640 1 -- 172.21.15.100:0/3559902746 learned_addr learned my addr 172.21.15.100:0/3559902746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.076+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75fc91a640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 -- 172.21.15.100:0/3559902746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 msgr2=0x557a46f77030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f77030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 -- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 msgr2=0x557a46f0a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f0a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 -- 172.21.15.100:0/3559902746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a46e204b0 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75fc91a640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f77030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75f7fff640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f75e8000c00 tx=0x7f75e80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc096c90ad4a62fc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e801b680 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f75e8011440 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ec00f740 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f75e8011660 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f760523b740 10 client.16686 fetch_fsmap learned FSMap version 51 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557a46f783c0 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ec00f740 con 0x557a46b304d0 2024-04-30T23:22:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.077+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f75e80287f0 con 0x557a46b304d0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 10 client.16686 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 20 client.16686 populate_metadata read hostname 'smithi100' 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46aed3a0 0x557a46f7ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 4 client.16686 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a46e67800 con 0x557a46aed3a0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46aed3a0 0x557a46f7ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f75d77fe640 10 client.16686 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.078+0000 7f75f77fe640 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46aed3a0 0x557a46f7ae00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503b5d5c91f0ab22 server_cookie=9ffac92b1371d8b8 in_seq=0 out_seq=0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75d77fe640 1 -- 172.21.15.100:0/3559902746 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x557a46e67800 con 0x557a46aed3a0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75d77fe640 10 client.16686 handle_command_reply: tid=0 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 client.16686 shutdown 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 msgr2=0x557a46f09d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f75e8000c00 tx=0x7f75e80055e0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 shutdown_connections 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x557a46aed3a0 0x557a46f7ae00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a46b59390 0x557a46f77030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557a46b386b0 0x557a46f0a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75d77fe640 0 client.16686 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 --2- 172.21.15.100:0/3559902746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a46b304d0 0x557a46f09d70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 >> 172.21.15.100:0/3559902746 conn(0x557a46b4d4e0 msgr2=0x557a46f05600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 shutdown_connections 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 1 -- 172.21.15.100:0/3559902746 wait complete. 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f760523b740 20 client.16686 trim_cache size 0 max 16384 2024-04-30T23:22:17.089 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.090 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:22:17.091 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.092 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:17.093 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:17.094 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:17.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:17.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:17.094 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:22:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 msgr2=0x7f75e00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 0x7f75e00a60c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557a46efc540 tx=0x7f75f0005fd0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 msgr2=0x7f75f819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.079+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c920 tx=0x7f75ec00cde0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 shutdown_connections 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f75e00a3bb0 0x7f75e00a60c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f81098f0 0x7f75f81a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75f8106f90 0x7f75f819a790 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 --2- 172.21.15.100:0/1968490595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75f8104630 0x7f75f819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 >> 172.21.15.100:0/1968490595 conn(0x7f75f80fdc30 msgr2=0x7f75f8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 shutdown_connections 2024-04-30T23:22:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:17.080+0000 7f75fe37d640 1 -- 172.21.15.100:0/1968490595 wait complete. 2024-04-30T23:22:17.096 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:22:19.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:18 smithi104 ceph-mon[32987]: pgmap v634: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:19.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:18 smithi183 ceph-mon[33560]: pgmap v634: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:18 smithi100 ceph-mon[29745]: pgmap v634: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:19 smithi104 ceph-mon[32987]: pgmap v635: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:19 smithi183 ceph-mon[33560]: pgmap v635: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:20.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:19 smithi100 ceph-mon[29745]: pgmap v635: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:23.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:22 smithi104 ceph-mon[32987]: pgmap v636: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:23.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:22 smithi183 ceph-mon[33560]: pgmap v636: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:23.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:22 smithi100 ceph-mon[29745]: pgmap v636: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:23 smithi104 ceph-mon[32987]: pgmap v637: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:23 smithi183 ceph-mon[33560]: pgmap v637: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:24.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:23 smithi100 ceph-mon[29745]: pgmap v637: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:25 smithi104 ceph-mon[32987]: pgmap v638: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:25 smithi183 ceph-mon[33560]: pgmap v638: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:26.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:25 smithi100 ceph-mon[29745]: pgmap v638: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:27 smithi104 ceph-mon[32987]: pgmap v639: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:27 smithi183 ceph-mon[33560]: pgmap v639: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:28.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:27 smithi100 ceph-mon[29745]: pgmap v639: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:29 smithi104 ceph-mon[32987]: pgmap v640: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:29 smithi183 ceph-mon[33560]: pgmap v640: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:30.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:29 smithi100 ceph-mon[29745]: pgmap v640: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:31 smithi104 ceph-mon[32987]: pgmap v641: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:22:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:31 smithi183 ceph-mon[33560]: pgmap v641: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:22:32.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:31 smithi100 ceph-mon[29745]: pgmap v641: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:22:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:33 smithi104 ceph-mon[32987]: pgmap v642: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:33 smithi183 ceph-mon[33560]: pgmap v642: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:34.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:33 smithi100 ceph-mon[29745]: pgmap v642: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:35 smithi104 ceph-mon[32987]: pgmap v643: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-30T23:22:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:35 smithi183 ceph-mon[33560]: pgmap v643: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-30T23:22:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:35 smithi100 ceph-mon[29745]: pgmap v643: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-30T23:22:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:37 smithi104 ceph-mon[32987]: pgmap v644: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:22:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:37 smithi183 ceph-mon[33560]: pgmap v644: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:22:38.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:37 smithi100 ceph-mon[29745]: pgmap v644: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:22:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:39 smithi104 ceph-mon[32987]: pgmap v645: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:39 smithi183 ceph-mon[33560]: pgmap v645: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:40.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:39 smithi100 ceph-mon[29745]: pgmap v645: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:22:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:41 smithi104 ceph-mon[32987]: pgmap v646: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:41 smithi183 ceph-mon[33560]: pgmap v646: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:42.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:41 smithi100 ceph-mon[29745]: pgmap v646: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:43 smithi104 ceph-mon[32987]: pgmap v647: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:44.306 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:43 smithi183 ceph-mon[33560]: pgmap v647: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:44.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:43 smithi100 ceph-mon[29745]: pgmap v647: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:45 smithi104 ceph-mon[32987]: pgmap v648: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:22:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:45 smithi183 ceph-mon[33560]: pgmap v648: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:22:46.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:45 smithi100 ceph-mon[29745]: pgmap v648: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-30T23:22:47.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:22:47.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 -- 172.21.15.100:0/1314059187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac102a30 msgr2=0x7f56ac103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 --2- 172.21.15.100:0/1314059187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac102a30 0x7f56ac103730 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f569c009900 tx=0x7f569c02a410 comp rx=0 tx=0).stop 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 -- 172.21.15.100:0/1314059187 shutdown_connections 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 --2- 172.21.15.100:0/1314059187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac108970 0x7f56ac10ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 --2- 172.21.15.100:0/1314059187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac103c70 0x7f56ac104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 --2- 172.21.15.100:0/1314059187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac102a30 0x7f56ac103730 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 -- 172.21.15.100:0/1314059187 >> 172.21.15.100:0/1314059187 conn(0x7f56ac0fdc20 msgr2=0x7f56ac1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 -- 172.21.15.100:0/1314059187 shutdown_connections 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 -- 172.21.15.100:0/1314059187 wait complete. 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.219+0000 7f56b29e0640 1 Processor -- start 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 -- start start 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 0x7f56ac06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 0x7f56ac19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10e530 con 0x7f56ac108970 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10e3b0 con 0x7f56ac103c70 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b29e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10e6b0 con 0x7f56ac102a30 2024-04-30T23:22:47.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39926/0 (socket says 172.21.15.100:39926) 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 -- 172.21.15.100:0/3171640139 learned_addr learned my addr 172.21.15.100:0/3171640139 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 0x7f56ac19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56abfff640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 0x7f56ac06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 -- 172.21.15.100:0/3171640139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 msgr2=0x7f56ac06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 0x7f56ac06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 -- 172.21.15.100:0/3171640139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 msgr2=0x7f56ac19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 0x7f56ac19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56b0f7d640 1 -- 172.21.15.100:0/3171640139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac1a1e40 con 0x7f56ac108970 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56abfff640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 0x7f56ac06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.220+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 0x7f56ac19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56b0f7d640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f56a400eaa0 tx=0x7f56a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56a97fa640 1 -- 172.21.15.100:0/3171640139 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400cdb0 con 0x7f56ac108970 2024-04-30T23:22:47.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac1a2130 con 0x7f56ac108970 2024-04-30T23:22:47.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56a97fa640 1 -- 172.21.15.100:0/3171640139 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4005020 con 0x7f56ac108970 2024-04-30T23:22:47.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56a97fa640 1 -- 172.21.15.100:0/3171640139 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a40116d0 con 0x7f56ac108970 2024-04-30T23:22:47.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.221+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac1a2630 con 0x7f56ac108970 2024-04-30T23:22:47.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56a97fa640 1 -- 172.21.15.100:0/3171640139 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f56a40051d0 con 0x7f56ac108970 2024-04-30T23:22:47.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56b9970740 1 Processor -- start 2024-04-30T23:22:47.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56b9970740 1 -- start start 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56b9970740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e5c390 0x555f99202900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56b9970740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.223+0000 7f56b9970740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f99203b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56b9970740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f99115b10 con 0x555f98e334d0 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56b9970740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555f99162d80 con 0x555f98e3b6b0 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56b9970740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555f9911c8b0 con 0x555f98e5c390 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39942/0 (socket says 172.21.15.100:39942) 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 -- 172.21.15.100:0/3665622807 learned_addr learned my addr 172.21.15.100:0/3665622807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56a97fa640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 0x7f56940a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e5c390 0x555f99202900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56b0f7d640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 0x7f56940a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f99203b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 -- 172.21.15.100:0/3665622807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e5c390 msgr2=0x555f99202900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e5c390 0x555f99202900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 -- 172.21.15.100:0/3665622807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 msgr2=0x555f99203b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f99203b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 -- 172.21.15.100:0/3665622807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f990eda40 con 0x555f98e334d0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56a97fa640 1 -- 172.21.15.100:0/3171640139 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f56a40d0a10 con 0x7f56ac108970 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56abfff640 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f569c000c00 tx=0x7f569c032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c23218f1c90824 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56927fc640 1 -- 172.21.15.100:0/3665622807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c03f070 con 0x555f98e334d0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56b0f7d640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 0x7f56940a60c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f56a409c920 tx=0x7f56a4087040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56927fc640 1 -- 172.21.15.100:0/3665622807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569c032e40 con 0x555f98e334d0 2024-04-30T23:22:47.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.224+0000 7f56927fc640 1 -- 172.21.15.100:0/3665622807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c035070 con 0x555f98e334d0 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 -- 172.21.15.100:0/3665622807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 msgr2=0x555f99202e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f569c000c00 tx=0x7f569c032c50 comp rx=0 tx=0).stop 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 -- 172.21.15.100:0/3665622807 shutdown_connections 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f99203b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99202e80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 --2- 172.21.15.100:0/3665622807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e5c390 0x555f99202900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 -- 172.21.15.100:0/3665622807 >> 172.21.15.100:0/3665622807 conn(0x555f98e504e0 msgr2=0x555f991f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 -- 172.21.15.100:0/3665622807 shutdown_connections 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.225+0000 7f56b9970740 1 -- 172.21.15.100:0/3665622807 wait complete. 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 -- start start 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 Processor -- start 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f9920c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f9920cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f990e9d10 con 0x555f98e5c390 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555f9915ed40 con 0x555f98e3b6b0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555f992045c0 con 0x555f98e334d0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56b9970740 10 client.0 _ll_register_callbacks cb 0x555f9916fd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39950/0 (socket says 172.21.15.100:39950) 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56ab7fe640 1 -- 172.21.15.100:0/3771314919 learned_addr learned my addr 172.21.15.100:0/3771314919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.226+0000 7f56abfff640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f9920cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f9920c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 -- 172.21.15.100:0/3771314919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 msgr2=0x555f9920c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f9920c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 -- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 msgr2=0x555f9920cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f9920cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 -- 172.21.15.100:0/3771314919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f98f3e7d0 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b390 tx=0x7f56a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154af10300fe8b5c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f568b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0011e80 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f56a0020410 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f99170990 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f56a0028050 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56b9970740 10 client.16698 fetch_fsmap learned FSMap version 51 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555f98e743f0 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.227+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555f99170990 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f56a000f040 con 0x555f98e5c390 2024-04-30T23:22:47.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 10 client.16698 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 20 client.16698 populate_metadata read hostname 'smithi100' 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98e1af60 0x555f99219fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 4 client.16698 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f9916a800 con 0x555f98e1af60 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56abfff640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98e1af60 0x555f99219fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f568b7fe640 10 client.16698 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.228+0000 7f56abfff640 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98e1af60 0x555f99219fa0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec71bfa58df6db02 server_cookie=843ac44acb713036 in_seq=0 out_seq=0 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f568b7fe640 1 -- 172.21.15.100:0/3771314919 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x555f9916a800 con 0x555f98e1af60 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f568b7fe640 10 client.16698 handle_command_reply: tid=0 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 client.16698 shutdown 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 msgr2=0x555f99213ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b390 tx=0x7f56a00046c0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 shutdown_connections 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98e1af60 0x555f99219fa0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213ac0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f9920cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f568b7fe640 0 client.16698 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 --2- 172.21.15.100:0/3771314919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f9920c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 >> 172.21.15.100:0/3771314919 conn(0x555f98e504e0 msgr2=0x555f991fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 shutdown_connections 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 1 -- 172.21.15.100:0/3771314919 wait complete. 2024-04-30T23:22:47.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.229+0000 7f56b9970740 20 client.16698 trim_cache size 0 max 16384 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 Processor -- start 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 -- start start 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f991f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f991f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1aa800 con 0x555f98e5c390 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1ac340 con 0x555f98e3b6b0 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56b9970740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1aaed0 con 0x555f98e334d0 2024-04-30T23:22:47.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39952/0 (socket says 172.21.15.100:39952) 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 -- 172.21.15.100:0/2487370389 learned_addr learned my addr 172.21.15.100:0/2487370389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f991f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56abfff640 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f991f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 -- 172.21.15.100:0/2487370389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 msgr2=0x555f991f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f991f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 -- 172.21.15.100:0/2487370389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 msgr2=0x555f991f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f991f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.247+0000 7f56ab7fe640 1 -- 172.21.15.100:0/2487370389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f98e340f0 con 0x555f98e5c390 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b400 tx=0x7f56a0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df380d763533dd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f5691ffb640 1 -- 172.21.15.100:0/2487370389 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0011e80 con 0x555f98e5c390 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f5691ffb640 1 -- 172.21.15.100:0/2487370389 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a001f3c0 con 0x555f98e5c390 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f5691ffb640 1 -- 172.21.15.100:0/2487370389 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0013280 con 0x555f98e5c390 2024-04-30T23:22:47.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f56b9970740 1 -- 172.21.15.100:0/2487370389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 msgr2=0x555f99213a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.248+0000 7f56b9970740 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b400 tx=0x7f56a0005c90 comp rx=0 tx=0).stop 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- 172.21.15.100:0/2487370389 shutdown_connections 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e5c390 0x555f99213a50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e3b6b0 0x555f991f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- 172.21.15.100:0/2487370389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e334d0 0x555f991f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- 172.21.15.100:0/2487370389 >> 172.21.15.100:0/2487370389 conn(0x555f98e504e0 msgr2=0x555f99207500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- 172.21.15.100:0/2487370389 shutdown_connections 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- 172.21.15.100:0/2487370389 wait complete. 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- start start 2024-04-30T23:22:47.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 Processor -- start 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e3b6b0 0x555f992115b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e5c390 0x555f9927e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1abc70 con 0x555f98e334d0 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1ab5a0 con 0x555f98e5c390 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1a87e0 con 0x555f98e3b6b0 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56b9970740 10 client.0 _ll_register_callbacks cb 0x7f56a000b580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:22:47.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39968/0 (socket says 172.21.15.100:39968) 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.249+0000 7f56ab7fe640 1 -- 172.21.15.100:0/1380138169 learned_addr learned my addr 172.21.15.100:0/1380138169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e5c390 0x555f9927e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56abfff640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e3b6b0 0x555f992115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 -- 172.21.15.100:0/1380138169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e3b6b0 msgr2=0x555f992115b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e3b6b0 0x555f992115b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 -- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e5c390 msgr2=0x555f9927e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e5c390 0x555f9927e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 -- 172.21.15.100:0/1380138169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f991234b0 con 0x555f98e334d0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56ab7fe640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f56a0013e30 tx=0x7f56a000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72575d11c21d10f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f568b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0035020 con 0x555f98e334d0 2024-04-30T23:22:47.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f56a0013250 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f990e54a0 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f56a0011e80 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56b9970740 10 client.16704 fetch_fsmap learned FSMap version 51 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555f9927f4b0 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.250+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555f990e54a0 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f56a002c430 con 0x555f98e334d0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 10 client.16704 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 20 client.16704 populate_metadata read hostname 'smithi100' 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98df03a0 0x555f99281d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 4 client.16704 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f99133240 con 0x555f98df03a0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56abfff640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98df03a0 0x555f99281d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f568b7fe640 10 client.16704 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:47.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.251+0000 7f56abfff640 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98df03a0 0x555f99281d70 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af17f598df9d0a05 server_cookie=49609feaa7c48b26 in_seq=0 out_seq=0 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f568b7fe640 1 -- 172.21.15.100:0/1380138169 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x555f99133240 con 0x555f98df03a0 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f568b7fe640 10 client.16704 handle_command_reply: tid=0 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 client.16704 shutdown 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 msgr2=0x555f99211070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f56a0013e30 tx=0x7f56a000b6f0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 shutdown_connections 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x555f98df03a0 0x555f99281d70 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555f98e5c390 0x555f9927e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f568b7fe640 0 client.16704 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f98e3b6b0 0x555f992115b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 --2- 172.21.15.100:0/1380138169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f98e334d0 0x555f99211070 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 >> 172.21.15.100:0/1380138169 conn(0x555f98e504e0 msgr2=0x555f991fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 shutdown_connections 2024-04-30T23:22:47.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 1 -- 172.21.15.100:0/1380138169 wait complete. 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.252+0000 7f56b9970740 20 client.16704 trim_cache size 0 max 16384 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:22:47.261 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.262 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:22:47.263 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:22:47.264 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:22:47.265 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:22:47.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 msgr2=0x7f56940a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 0x7f56940a60c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f56a409c920 tx=0x7f56a4087040 comp rx=0 tx=0).stop 2024-04-30T23:22:47.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 msgr2=0x7f56ac1a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:22:47.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f56a400eaa0 tx=0x7f56a400ef60 comp rx=0 tx=0).stop 2024-04-30T23:22:47.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 shutdown_connections 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f56940a3bb0 0x7f56940a60c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac108970 0x7f56ac1a1620 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac103c70 0x7f56ac19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 --2- 172.21.15.100:0/3171640139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56ac102a30 0x7f56ac06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 >> 172.21.15.100:0/3171640139 conn(0x7f56ac0fdc20 msgr2=0x7f56ac104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 shutdown_connections 2024-04-30T23:22:47.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:22:47.253+0000 7f56b29e0640 1 -- 172.21.15.100:0/3171640139 wait complete. 2024-04-30T23:22:47.273 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:22:48.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:47 smithi104 ceph-mon[32987]: pgmap v649: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:47 smithi183 ceph-mon[33560]: pgmap v649: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:48.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:47 smithi100 ceph-mon[29745]: pgmap v649: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:50.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:49 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:22:50.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:49 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:22:50.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:49 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:22:51.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:50 smithi104 ceph-mon[32987]: pgmap v650: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:51.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:50 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:22:51.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:50 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:22:51.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:50 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:22:51.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:50 smithi183 ceph-mon[33560]: pgmap v650: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:51.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:50 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:22:51.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:50 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:22:51.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:50 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:22:51.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:50 smithi100 ceph-mon[29745]: pgmap v650: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:51.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:50 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:22:51.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:50 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:22:51.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:50 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:22:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:51 smithi104 ceph-mon[32987]: pgmap v651: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:51 smithi183 ceph-mon[33560]: pgmap v651: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:52.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:51 smithi100 ceph-mon[29745]: pgmap v651: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:54.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:53 smithi104 ceph-mon[32987]: pgmap v652: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:54.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:53 smithi183 ceph-mon[33560]: pgmap v652: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:54.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:53 smithi100 ceph-mon[29745]: pgmap v652: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:22:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:55 smithi104 ceph-mon[32987]: pgmap v653: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:55 smithi183 ceph-mon[33560]: pgmap v653: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:56.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:55 smithi100 ceph-mon[29745]: pgmap v653: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:22:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:57 smithi104 ceph-mon[32987]: pgmap v654: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:57 smithi183 ceph-mon[33560]: pgmap v654: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:22:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:57 smithi100 ceph-mon[29745]: pgmap v654: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-04-30T23:23:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:22:59 smithi104 ceph-mon[32987]: pgmap v655: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:22:59 smithi183 ceph-mon[33560]: pgmap v655: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:00.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:22:59 smithi100 ceph-mon[29745]: pgmap v655: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:01 smithi104 ceph-mon[32987]: pgmap v656: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:01 smithi183 ceph-mon[33560]: pgmap v656: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:02.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:01 smithi100 ceph-mon[29745]: pgmap v656: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:04.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:03 smithi104 ceph-mon[32987]: pgmap v657: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:04.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:03 smithi183 ceph-mon[33560]: pgmap v657: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:04.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:03 smithi100 ceph-mon[29745]: pgmap v657: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:05 smithi104 ceph-mon[32987]: pgmap v658: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:23:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:05 smithi183 ceph-mon[33560]: pgmap v658: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:23:06.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:05 smithi100 ceph-mon[29745]: pgmap v658: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:23:08.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:07 smithi104 ceph-mon[32987]: pgmap v659: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:23:08.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:07 smithi183 ceph-mon[33560]: pgmap v659: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:23:08.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:07 smithi100 ceph-mon[29745]: pgmap v659: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 11 op/s 2024-04-30T23:23:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:09 smithi104 ceph-mon[32987]: pgmap v660: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:10.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:09 smithi183 ceph-mon[33560]: pgmap v660: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:10.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:09 smithi100 ceph-mon[29745]: pgmap v660: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:23:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:11 smithi104 ceph-mon[32987]: pgmap v661: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:11 smithi183 ceph-mon[33560]: pgmap v661: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:12.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:11 smithi100 ceph-mon[29745]: pgmap v661: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:23:14.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:13 smithi104 ceph-mon[32987]: pgmap v662: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:14.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:13 smithi183 ceph-mon[33560]: pgmap v662: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:14.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:13 smithi100 ceph-mon[29745]: pgmap v662: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:15 smithi104 ceph-mon[32987]: pgmap v663: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:15 smithi183 ceph-mon[33560]: pgmap v663: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:16.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:15 smithi100 ceph-mon[29745]: pgmap v663: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:17.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:23:17.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 -- 172.21.15.100:0/1741129565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458102a20 msgr2=0x7f3458103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 --2- 172.21.15.100:0/1741129565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458102a20 0x7f3458103720 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3448009ca0 tx=0x7f344802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 -- 172.21.15.100:0/1741129565 shutdown_connections 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 --2- 172.21.15.100:0/1741129565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458108960 0x7f345810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 --2- 172.21.15.100:0/1741129565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458103c60 0x7f3458104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 --2- 172.21.15.100:0/1741129565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458102a20 0x7f3458103720 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 -- 172.21.15.100:0/1741129565 >> 172.21.15.100:0/1741129565 conn(0x7f34580fdc10 msgr2=0x7f34581000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 -- 172.21.15.100:0/1741129565 shutdown_connections 2024-04-30T23:23:17.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.396+0000 7f345ca4a640 1 -- 172.21.15.100:0/1741129565 wait complete. 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 Processor -- start 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 -- start start 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458102a20 0x7f345819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458103c60 0x7f345819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f345810f640 con 0x7f3458108960 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f345810f4c0 con 0x7f3458102a20 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.397+0000 7f345ca4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f345810f7c0 con 0x7f3458103c60 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43280/0 (socket says 172.21.15.100:43280) 2024-04-30T23:23:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 -- 172.21.15.100:0/3079303452 learned_addr learned my addr 172.21.15.100:0/3079303452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f345659c640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458102a20 0x7f345819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3455d9b640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458103c60 0x7f345819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 -- 172.21.15.100:0/3079303452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458103c60 msgr2=0x7f345819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458103c60 0x7f345819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 -- 172.21.15.100:0/3079303452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458102a20 msgr2=0x7f345819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458102a20 0x7f345819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 -- 172.21.15.100:0/3079303452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34581a20c0 con 0x7f3458108960 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f3456d9d640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f345000d750 tx=0x7f345000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f34477fe640 1 -- 172.21.15.100:0/3079303452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450017070 con 0x7f3458108960 2024-04-30T23:23:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34581a23b0 con 0x7f3458108960 2024-04-30T23:23:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f34477fe640 1 -- 172.21.15.100:0/3079303452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34500054d0 con 0x7f3458108960 2024-04-30T23:23:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f34477fe640 1 -- 172.21.15.100:0/3079303452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450004c60 con 0x7f3458108960 2024-04-30T23:23:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.398+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a2950 con 0x7f3458108960 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.401+0000 7f34639e4740 1 Processor -- start 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.401+0000 7f34477fe640 1 -- 172.21.15.100:0/3079303452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3450009bd0 con 0x7f3458108960 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 -- start start 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b5e4d0 0x55b707f29a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b707e40b10 con 0x55b707b666b0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b707e8dd80 con 0x55b707b5e4d0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34639e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b707e478b0 con 0x55b707b87390 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43288/0 (socket says 172.21.15.100:43288) 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 -- 172.21.15.100:0/4242540745 learned_addr learned my addr 172.21.15.100:0/4242540745 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34477fe640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 0x7f34400a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f345659c640 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b5e4d0 0x55b707f29a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3456d9d640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 0x7f34400a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 -- 172.21.15.100:0/4242540745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 msgr2=0x55b707f294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f294f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 -- 172.21.15.100:0/4242540745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b5e4d0 msgr2=0x55b707f29a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b5e4d0 0x55b707f29a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f34477fe640 1 -- 172.21.15.100:0/3079303452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f34500d0050 con 0x7f3458108960 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.402+0000 7f3455d9b640 1 -- 172.21.15.100:0/4242540745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b707e18a40 con 0x55b707b666b0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.403+0000 7f3455d9b640 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f344c0058a0 tx=0x7f344c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f15e1fa6f09fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.403+0000 7f3456d9d640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 0x7f34400a60c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f34500a4710 tx=0x7f3450066780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.403+0000 7f3444ff9640 1 -- 172.21.15.100:0/4242540745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c012d00 con 0x55b707b666b0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.403+0000 7f3444ff9640 1 -- 172.21.15.100:0/4242540745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c010c20 con 0x55b707b666b0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.403+0000 7f3444ff9640 1 -- 172.21.15.100:0/4242540745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c01ea00 con 0x55b707b666b0 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- 172.21.15.100:0/4242540745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 msgr2=0x55b707f2a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f344c0058a0 tx=0x7f344c00b7c0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- 172.21.15.100:0/4242540745 shutdown_connections 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f2a700 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b5e4d0 0x55b707f29a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 --2- 172.21.15.100:0/4242540745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f294f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- 172.21.15.100:0/4242540745 >> 172.21.15.100:0/4242540745 conn(0x55b707b7b4e0 msgr2=0x55b707f24d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- 172.21.15.100:0/4242540745 shutdown_connections 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- 172.21.15.100:0/4242540745 wait complete. 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 -- start start 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.404+0000 7f34639e4740 1 Processor -- start 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b666b0 0x55b707f337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f3a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b707e14d10 con 0x55b707b5e4d0 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b707e89d40 con 0x55b707b87390 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b707f2b210 con 0x55b707b666b0 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 10 client.0 _ll_register_callbacks cb 0x55b707e9ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43290/0 (socket says 172.21.15.100:43290) 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 -- 172.21.15.100:0/466436618 learned_addr learned my addr 172.21.15.100:0/466436618 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:17.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f3a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f345659c640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b666b0 0x55b707f337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 -- 172.21.15.100:0/466436618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b666b0 msgr2=0x55b707f337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b666b0 0x55b707f337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 -- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 msgr2=0x55b707f3a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f3a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 -- 172.21.15.100:0/466436618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b707c697d0 con 0x55b707b5e4d0 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f3455d9b640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f344c005bc0 tx=0x7f344c012580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94894b1b31212c5b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f343dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c024040 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f344c004030 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c010c20 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f344c033050 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 10 client.16716 fetch_fsmap learned FSMap version 51 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.405+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b707b9f3f0 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c010c20 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f344c0035f0 con 0x55b707b5e4d0 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 10 client.16716 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 20 client.16716 populate_metadata read hostname 'smithi100' 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b45f60 0x55b707f40850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 4 client.16716 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b707e9b990 con 0x55b707b45f60 2024-04-30T23:23:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.406+0000 7f345659c640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b45f60 0x55b707f40850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f343dffb640 10 client.16716 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f345659c640 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b45f60 0x55b707f40850 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=485127aaeec34935 server_cookie=aabf9ab967926275 in_seq=0 out_seq=0 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f343dffb640 1 -- 172.21.15.100:0/466436618 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55b707e9b990 con 0x55b707b45f60 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f343dffb640 10 client.16716 handle_command_reply: tid=0 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f34639e4740 1 client.16716 shutdown 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 msgr2=0x55b707f33290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.407+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f344c005bc0 tx=0x7f344c012580 comp rx=0 tx=0).stop 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 shutdown_connections 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b45f60 0x55b707f40850 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f3a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f343dffb640 0 client.16716 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b666b0 0x55b707f337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 --2- 172.21.15.100:0/466436618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f33290 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 >> 172.21.15.100:0/466436618 conn(0x55b707b7b4e0 msgr2=0x55b707f27c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 shutdown_connections 2024-04-30T23:23:17.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 1 -- 172.21.15.100:0/466436618 wait complete. 2024-04-30T23:23:17.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.408+0000 7f34639e4740 20 client.16716 trim_cache size 0 max 16384 2024-04-30T23:23:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.425+0000 7f34639e4740 1 Processor -- start 2024-04-30T23:23:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 -- start start 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b666b0 0x55b707f28040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f3a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ac900 con 0x55b707b5e4d0 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ae440 con 0x55b707b666b0 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f34639e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34581acfd0 con 0x55b707b87390 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43306/0 (socket says 172.21.15.100:43306) 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 -- 172.21.15.100:0/439337467 learned_addr learned my addr 172.21.15.100:0/439337467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 -- 172.21.15.100:0/439337467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 msgr2=0x55b707f3a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f3a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 -- 172.21.15.100:0/439337467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b666b0 msgr2=0x55b707f28040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b666b0 0x55b707f28040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 -- 172.21.15.100:0/439337467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b707b5f0f0 con 0x55b707b5e4d0 2024-04-30T23:23:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f3455d9b640 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b840 tx=0x7f344c003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b87fed46ce9bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f343ffff640 1 -- 172.21.15.100:0/439337467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c00be90 con 0x55b707b5e4d0 2024-04-30T23:23:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f343ffff640 1 -- 172.21.15.100:0/439337467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c02f070 con 0x55b707b5e4d0 2024-04-30T23:23:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.426+0000 7f343ffff640 1 -- 172.21.15.100:0/439337467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c010bc0 con 0x55b707b5e4d0 2024-04-30T23:23:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- 172.21.15.100:0/439337467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 msgr2=0x55b707f27b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b840 tx=0x7f344c003e80 comp rx=0 tx=0).stop 2024-04-30T23:23:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- 172.21.15.100:0/439337467 shutdown_connections 2024-04-30T23:23:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b87390 0x55b707f3a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b666b0 0x55b707f28040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 --2- 172.21.15.100:0/439337467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b5e4d0 0x55b707f27b00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- 172.21.15.100:0/439337467 >> 172.21.15.100:0/439337467 conn(0x55b707b7b4e0 msgr2=0x55b707f2e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- 172.21.15.100:0/439337467 shutdown_connections 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- 172.21.15.100:0/439337467 wait complete. 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.427+0000 7f34639e4740 1 -- start start 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 Processor -- start 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b5e4d0 0x55b707f3adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34581add70 con 0x55b707b666b0 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34581ad6a0 con 0x55b707b87390 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f34581aa8e0 con 0x55b707b5e4d0 2024-04-30T23:23:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 10 client.0 _ll_register_callbacks cb 0x7f3448005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43318/0 (socket says 172.21.15.100:43318) 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 -- 172.21.15.100:0/3844736449 learned_addr learned my addr 172.21.15.100:0/3844736449 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 -- 172.21.15.100:0/3844736449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b5e4d0 msgr2=0x55b707f3adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f3455d9b640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b5e4d0 0x55b707f3adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b5e4d0 0x55b707f3adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 -- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 msgr2=0x55b707f37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 -- 172.21.15.100:0/3844736449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b707e4e4b0 con 0x55b707b666b0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f345659c640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3448005e30 tx=0x7f3448031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3601f78aca0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f343dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448047630 con 0x55b707b666b0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f34480477d0 con 0x55b707b666b0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.428+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c02f070 con 0x55b707b666b0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3448057050 con 0x55b707b666b0 2024-04-30T23:23:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 10 client.16722 fetch_fsmap learned FSMap version 51 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b707fa5b40 con 0x55b707b666b0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c02f070 con 0x55b707b666b0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f34480305c0 con 0x55b707b666b0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 10 client.16722 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 20 client.16722 populate_metadata read hostname 'smithi100' 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b1b3a0 0x55b707fa8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 4 client.16722 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b707e95800 con 0x55b707b1b3a0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.429+0000 7f3455d9b640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b1b3a0 0x55b707fa8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f343dffb640 10 client.16722 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f3455d9b640 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b1b3a0 0x55b707fa8560 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0fdb57e9d398884 server_cookie=e6dcb52bac856004 in_seq=0 out_seq=0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f343dffb640 1 -- 172.21.15.100:0/3844736449 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55b707e95800 con 0x55b707b1b3a0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f343dffb640 10 client.16722 handle_command_reply: tid=0 2024-04-30T23:23:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 client.16722 shutdown 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 msgr2=0x55b707f379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3448005e30 tx=0x7f3448031640 comp rx=0 tx=0).stop 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 shutdown_connections 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55b707b1b3a0 0x55b707fa8560 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b707b87390 0x55b707f37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f343dffb640 0 client.16722 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b707b666b0 0x55b707f379c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 --2- 172.21.15.100:0/3844736449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b707b5e4d0 0x55b707f3adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 >> 172.21.15.100:0/3844736449 conn(0x55b707b7b4e0 msgr2=0x55b707f32e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 shutdown_connections 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 1 -- 172.21.15.100:0/3844736449 wait complete. 2024-04-30T23:23:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.430+0000 7f34639e4740 20 client.16722 trim_cache size 0 max 16384 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.439 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:17.442 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:17.443 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:17.443 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:17.443 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:17.443 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:17.443 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 msgr2=0x7f34400a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 0x7f34400a60c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f34500a4710 tx=0x7f3450066780 comp rx=0 tx=0).stop 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 msgr2=0x7f34581a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f345000d750 tx=0x7f345000dc10 comp rx=0 tx=0).stop 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 shutdown_connections 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f34400a3bb0 0x7f34400a60c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3458108960 0x7f34581a1a50 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458103c60 0x7f345819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 --2- 172.21.15.100:0/3079303452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458102a20 0x7f345819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 >> 172.21.15.100:0/3079303452 conn(0x7f34580fdc10 msgr2=0x7f3458104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 shutdown_connections 2024-04-30T23:23:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:17.431+0000 7f345ca4a640 1 -- 172.21.15.100:0/3079303452 wait complete. 2024-04-30T23:23:17.445 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:23:18.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:17 smithi104 ceph-mon[32987]: pgmap v664: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:18.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:17 smithi183 ceph-mon[33560]: pgmap v664: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:18.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:17 smithi100 ceph-mon[29745]: pgmap v664: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:19 smithi104 ceph-mon[32987]: pgmap v665: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:19 smithi183 ceph-mon[33560]: pgmap v665: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:20.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:19 smithi100 ceph-mon[29745]: pgmap v665: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:22.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:21 smithi104 ceph-mon[32987]: pgmap v666: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:22.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:21 smithi183 ceph-mon[33560]: pgmap v666: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:22.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:21 smithi100 ceph-mon[29745]: pgmap v666: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:23 smithi104 ceph-mon[32987]: pgmap v667: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:23 smithi183 ceph-mon[33560]: pgmap v667: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:24.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:23 smithi100 ceph-mon[29745]: pgmap v667: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:25 smithi104 ceph-mon[32987]: pgmap v668: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:25 smithi183 ceph-mon[33560]: pgmap v668: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:25 smithi100 ceph-mon[29745]: pgmap v668: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:27 smithi104 ceph-mon[32987]: pgmap v669: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:27 smithi183 ceph-mon[33560]: pgmap v669: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:28.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:27 smithi100 ceph-mon[29745]: pgmap v669: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:29 smithi104 ceph-mon[32987]: pgmap v670: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:29 smithi183 ceph-mon[33560]: pgmap v670: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:30.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:29 smithi100 ceph-mon[29745]: pgmap v670: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:31 smithi104 ceph-mon[32987]: pgmap v671: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:31 smithi183 ceph-mon[33560]: pgmap v671: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:32.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:31 smithi100 ceph-mon[29745]: pgmap v671: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:33 smithi104 ceph-mon[32987]: pgmap v672: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:33 smithi183 ceph-mon[33560]: pgmap v672: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:34.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:33 smithi100 ceph-mon[29745]: pgmap v672: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:35 smithi104 ceph-mon[32987]: pgmap v673: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:35 smithi183 ceph-mon[33560]: pgmap v673: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:36.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:35 smithi100 ceph-mon[29745]: pgmap v673: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:37 smithi104 ceph-mon[32987]: pgmap v674: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:37 smithi183 ceph-mon[33560]: pgmap v674: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:38.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:37 smithi100 ceph-mon[29745]: pgmap v674: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:39 smithi104 ceph-mon[32987]: pgmap v675: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:39 smithi183 ceph-mon[33560]: pgmap v675: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:40.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:39 smithi100 ceph-mon[29745]: pgmap v675: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:41 smithi104 ceph-mon[32987]: pgmap v676: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:41 smithi183 ceph-mon[33560]: pgmap v676: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:42.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:41 smithi100 ceph-mon[29745]: pgmap v676: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:43 smithi104 ceph-mon[32987]: pgmap v677: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:44.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:43 smithi183 ceph-mon[33560]: pgmap v677: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:44.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:43 smithi100 ceph-mon[29745]: pgmap v677: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:45 smithi104 ceph-mon[32987]: pgmap v678: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:45 smithi183 ceph-mon[33560]: pgmap v678: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:46.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:45 smithi100 ceph-mon[29745]: pgmap v678: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:47.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:23:47.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/3639488167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0102290 msgr2=0x7ff9f010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/3639488167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0102290 0x7ff9f010bcf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009ca0 tx=0x7ff9e802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/3639488167 shutdown_connections 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/3639488167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0102290 0x7ff9f010bcf0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/3639488167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0101790 0x7ff9f0101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/3639488167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 0x7ff9f01054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/3639488167 >> 172.21.15.100:0/3639488167 conn(0x7ff9f00fd390 msgr2=0x7ff9f00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/3639488167 shutdown_connections 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.567+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/3639488167 wait complete. 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 Processor -- start 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 -- start start 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 0x7ff9f019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 0x7ff9f01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010f650 con 0x7ff9f0101790 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010f4d0 con 0x7ff9f0102290 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f6cd9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010f7d0 con 0x7ff9f01050e0 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34570/0 (socket says 172.21.15.100:34570) 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 -- 172.21.15.100:0/720182305 learned_addr learned my addr 172.21.15.100:0/720182305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9effff640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 0x7ff9f019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 -- 172.21.15.100:0/720182305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 msgr2=0x7ff9f01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f5276640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 0x7ff9f01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 0x7ff9f01a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 -- 172.21.15.100:0/720182305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 msgr2=0x7ff9f019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 0x7ff9f019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9f4a75640 1 -- 172.21.15.100:0/720182305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f01a1cd0 con 0x7ff9f0101790 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.568+0000 7ff9effff640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 0x7ff9f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4005fd0 tx=0x7ff9e400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9edffb640 1 -- 172.21.15.100:0/720182305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4017070 con 0x7ff9f0101790 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9edffb640 1 -- 172.21.15.100:0/720182305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e4009c30 con 0x7ff9f0101790 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f01a1fc0 con 0x7ff9f0101790 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9edffb640 1 -- 172.21.15.100:0/720182305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4003d10 con 0x7ff9f0101790 2024-04-30T23:23:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.569+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f01a2420 con 0x7ff9f0101790 2024-04-30T23:23:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9edffb640 1 -- 172.21.15.100:0/720182305 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff9e4003eb0 con 0x7ff9f0101790 2024-04-30T23:23:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 Processor -- start 2024-04-30T23:23:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 -- start start 2024-04-30T23:23:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 0x5633155884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x563315589700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56331549fb10 con 0x5633151bd4d0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5633154ecd80 con 0x5633151c56b0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5633154a68b0 con 0x5633151e6390 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.572+0000 7ff9edffb640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 0x7ff9e00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34584/0 (socket says 172.21.15.100:34584) 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 -- 172.21.15.100:0/3444272228 learned_addr learned my addr 172.21.15.100:0/3444272228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x563315589700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f5276640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 0x7ff9e00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f5276640 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 0x5633155884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9edffb640 1 -- 172.21.15.100:0/720182305 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff9e40d0460 con 0x7ff9f0101790 2024-04-30T23:23:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 -- 172.21.15.100:0/3444272228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 msgr2=0x5633155884f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 0x5633155884f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 -- 172.21.15.100:0/3444272228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 msgr2=0x563315589700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x563315589700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 -- 172.21.15.100:0/3444272228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563315477a40 con 0x5633151bd4d0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f5276640 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 0x5633155884f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4020000 tx=0x7ff9e4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40f142263ac916c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9f5276640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 0x7ff9e00a60c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8004af0 tx=0x7ff9e8004a60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9daffd640 1 -- 172.21.15.100:0/3444272228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4009de0 con 0x5633151bd4d0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9daffd640 1 -- 172.21.15.100:0/3444272228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e409c3e0 con 0x5633151bd4d0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.573+0000 7ff9daffd640 1 -- 172.21.15.100:0/3444272228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4098a50 con 0x5633151bd4d0 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3444272228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 msgr2=0x563315588a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4020000 tx=0x7ff9e4021000 comp rx=0 tx=0).stop 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3444272228 shutdown_connections 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x563315589700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151bd4d0 0x563315588a70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3444272228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151e6390 0x5633155884f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3444272228 >> 172.21.15.100:0/3444272228 conn(0x5633151da4e0 msgr2=0x563315583d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3444272228 shutdown_connections 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.574+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3444272228 wait complete. 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 -- start start 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 Processor -- start 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x563315596800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563315473d10 con 0x5633151c56b0 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5633154e8d40 con 0x5633151e6390 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56331558a210 con 0x5633151bd4d0 2024-04-30T23:23:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9fdb8e740 10 client.0 _ll_register_callbacks cb 0x5633154f9d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34598/0 (socket says 172.21.15.100:34598) 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9effff640 1 -- 172.21.15.100:0/496638057 learned_addr learned my addr 172.21.15.100:0/496638057 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9f5276640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.575+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x563315596800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 -- 172.21.15.100:0/496638057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 msgr2=0x563315596800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x563315596800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 -- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 msgr2=0x56331559dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 -- 172.21.15.100:0/496638057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633152c87d0 con 0x5633151c56b0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9effff640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00bf70 tx=0x7ff9dc0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc03d242edeccfa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9cffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:23:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0035f0 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff9dc003790 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e409c3e0 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc003990 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9fdb8e740 10 client.16734 fetch_fsmap learned FSMap version 51 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5633151fe3f0 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.576+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e409c3e0 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7ff9dc019070 con 0x5633151c56b0 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 10 client.16734 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 20 client.16734 populate_metadata read hostname 'smithi100' 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5633151a4f60 0x5633155a4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 4 client.16734 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:23:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633154fa990 con 0x5633151a4f60 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5633151a4f60 0x5633155a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9cffff640 10 client.16734 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.577+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5633151a4f60 0x5633155a4290 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4a7517fd714d57f server_cookie=6ef9f598fcf0034e in_seq=0 out_seq=0 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9cffff640 1 -- 172.21.15.100:0/496638057 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5633154fa990 con 0x5633151a4f60 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9cffff640 10 client.16734 handle_command_reply: tid=0 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 client.16734 shutdown 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 msgr2=0x563315596d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00bf70 tx=0x7ff9dc0128e0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 shutdown_connections 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5633151a4f60 0x5633155a4290 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x563315596d40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/496638057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x563315596800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9cffff640 0 client.16734 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 >> 172.21.15.100:0/496638057 conn(0x5633151da4e0 msgr2=0x563315586c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.578+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 shutdown_connections 2024-04-30T23:23:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.579+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/496638057 wait complete. 2024-04-30T23:23:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.579+0000 7ff9fdb8e740 20 client.16734 trim_cache size 0 max 16384 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 Processor -- start 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 -- start start 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x5633155a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x56331559dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aa740 con 0x5633151e6390 2024-04-30T23:23:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ac280 con 0x5633151c56b0 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aae10 con 0x5633151bd4d0 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9f5276640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9f5276640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34604/0 (socket says 172.21.15.100:34604) 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.596+0000 7ff9f5276640 1 -- 172.21.15.100:0/3641409305 learned_addr learned my addr 172.21.15.100:0/3641409305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x5633155a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9effff640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x56331559dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 -- 172.21.15.100:0/3641409305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 msgr2=0x5633155a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x5633155a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 -- 172.21.15.100:0/3641409305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 msgr2=0x56331559dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x56331559dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 -- 172.21.15.100:0/3641409305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633151be0f0 con 0x5633151e6390 2024-04-30T23:23:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9effff640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x56331559dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9f5276640 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035000 tx=0x7ff9e803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7a64fd9d13008a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9da7fc640 1 -- 172.21.15.100:0/3641409305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8050070 con 0x5633151e6390 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9da7fc640 1 -- 172.21.15.100:0/3641409305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8036030 con 0x5633151e6390 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.597+0000 7ff9da7fc640 1 -- 172.21.15.100:0/3641409305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e802f660 con 0x5633151e6390 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3641409305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 msgr2=0x56331559e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035000 tx=0x7ff9e803f070 comp rx=0 tx=0).stop 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3641409305 shutdown_connections 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151e6390 0x56331559e100 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151c56b0 0x56331559dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/3641409305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x5633155a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3641409305 >> 172.21.15.100:0/3641409305 conn(0x5633151da4e0 msgr2=0x563315594e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3641409305 shutdown_connections 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/3641409305 wait complete. 2024-04-30T23:23:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 -- start start 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.598+0000 7ff9fdb8e740 1 Processor -- start 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x56331559b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01abbb0 con 0x5633151c56b0 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ab4e0 con 0x5633151e6390 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01a8720 con 0x5633151bd4d0 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 10 client.0 _ll_register_callbacks cb 0x7ff9dc00b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34610/0 (socket says 172.21.15.100:34610) 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 -- 172.21.15.100:0/270788526 learned_addr learned my addr 172.21.15.100:0/270788526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:23:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x56331559b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 -- 172.21.15.100:0/270788526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 msgr2=0x56331559b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x56331559b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 -- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 msgr2=0x56331559ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 -- 172.21.15.100:0/270788526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633154ad4b0 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9effff640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc010de0 tx=0x7ff9dc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45deceecb64c2421 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9cffff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc02d030 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e8036030 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff9dc003b30 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc037050 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 10 client.16740 fetch_fsmap learned FSMap version 51 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.599+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56331559e0e0 con 0x5633151c56b0 2024-04-30T23:23:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8036030 con 0x5633151c56b0 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7ff9dc019050 con 0x5633151c56b0 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 10 client.16740 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 20 client.16740 populate_metadata read hostname 'smithi100' 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56331517a3a0 0x56331560c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 4 client.16740 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633154f4800 con 0x56331517a3a0 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.600+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56331517a3a0 0x56331560c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9cffff640 10 client.16740 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9f4a75640 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56331517a3a0 0x56331560c6a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1049ee908aaf3b6 server_cookie=f8e8e2361f1718b6 in_seq=0 out_seq=0 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9cffff640 1 -- 172.21.15.100:0/270788526 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5633154f4800 con 0x56331517a3a0 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9cffff640 10 client.16740 handle_command_reply: tid=0 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 client.16740 shutdown 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 msgr2=0x56331559baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc010de0 tx=0x7ff9dc0038a0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 shutdown_connections 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56331517a3a0 0x56331560c6a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5633151e6390 0x56331559ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633151c56b0 0x56331559baf0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9cffff640 0 client.16740 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 --2- 172.21.15.100:0/270788526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5633151bd4d0 0x56331559b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 >> 172.21.15.100:0/270788526 conn(0x5633151da4e0 msgr2=0x563315586b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 shutdown_connections 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 1 -- 172.21.15.100:0/270788526 wait complete. 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.601+0000 7ff9fdb8e740 20 client.16740 trim_cache size 0 max 16384 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:23:47.611 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.613 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.614 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:23:47.615 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 msgr2=0x7ff9e00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 0x7ff9e00a60c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8004af0 tx=0x7ff9e8004a60 comp rx=0 tx=0).stop 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 msgr2=0x7ff9f019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4005fd0 tx=0x7ff9e400dde0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 shutdown_connections 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff9e00a3bb0 0x7ff9e00a60c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01050e0 0x7ff9f01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f0102290 0x7ff9f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 --2- 172.21.15.100:0/720182305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f0101790 0x7ff9f019a190 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:23:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 >> 172.21.15.100:0/720182305 conn(0x7ff9f00fd390 msgr2=0x7ff9f0107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:23:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 shutdown_connections 2024-04-30T23:23:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:23:47.602+0000 7ff9f6cd9640 1 -- 172.21.15.100:0/720182305 wait complete. 2024-04-30T23:23:47.618 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:23:48.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:47 smithi104 ceph-mon[32987]: pgmap v679: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:47 smithi183 ceph-mon[33560]: pgmap v679: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:48.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:47 smithi100 ceph-mon[29745]: pgmap v679: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:49 smithi104 ceph-mon[32987]: pgmap v680: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:49 smithi183 ceph-mon[33560]: pgmap v680: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:49 smithi100 ceph-mon[29745]: pgmap v680: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:51.187 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:50 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:23:51.190 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:50 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:23:51.194 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:50 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:23:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:51 smithi104 ceph-mon[32987]: pgmap v681: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:51 smithi183 ceph-mon[33560]: pgmap v681: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:52.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:51 smithi100 ceph-mon[29745]: pgmap v681: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:23:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:23:53.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:53 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:23:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:53 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:23:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:53 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:23:54.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:54 smithi104 ceph-mon[32987]: pgmap v682: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:54.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:54 smithi183 ceph-mon[33560]: pgmap v682: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:54.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:54 smithi100 ceph-mon[29745]: pgmap v682: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:23:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:55 smithi104 ceph-mon[32987]: pgmap v683: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:55 smithi183 ceph-mon[33560]: pgmap v683: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:56.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:55 smithi100 ceph-mon[29745]: pgmap v683: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:23:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:57 smithi104 ceph-mon[32987]: pgmap v684: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:57 smithi183 ceph-mon[33560]: pgmap v684: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:23:58.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:57 smithi100 ceph-mon[29745]: pgmap v684: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:23:59 smithi104 ceph-mon[32987]: pgmap v685: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:23:59 smithi183 ceph-mon[33560]: pgmap v685: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:00.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:23:59 smithi100 ceph-mon[29745]: pgmap v685: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:01 smithi104 ceph-mon[32987]: pgmap v686: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:01 smithi183 ceph-mon[33560]: pgmap v686: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:02.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:01 smithi100 ceph-mon[29745]: pgmap v686: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:04.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:03 smithi104 ceph-mon[32987]: pgmap v687: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:04.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:03 smithi183 ceph-mon[33560]: pgmap v687: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:04.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:03 smithi100 ceph-mon[29745]: pgmap v687: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:05 smithi104 ceph-mon[32987]: pgmap v688: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:05 smithi183 ceph-mon[33560]: pgmap v688: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:06.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:05 smithi100 ceph-mon[29745]: pgmap v688: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:08.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:07 smithi104 ceph-mon[32987]: pgmap v689: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:08.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:07 smithi183 ceph-mon[33560]: pgmap v689: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:08.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:07 smithi100 ceph-mon[29745]: pgmap v689: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:09 smithi104 ceph-mon[32987]: pgmap v690: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:10.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:09 smithi183 ceph-mon[33560]: pgmap v690: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:10.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:09 smithi100 ceph-mon[29745]: pgmap v690: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:12.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:11 smithi100 ceph-mon[29745]: pgmap v691: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:11 smithi104 ceph-mon[32987]: pgmap v691: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:11 smithi183 ceph-mon[33560]: pgmap v691: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:14.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:13 smithi104 ceph-mon[32987]: pgmap v692: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:14.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:13 smithi183 ceph-mon[33560]: pgmap v692: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:14.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:13 smithi100 ceph-mon[29745]: pgmap v692: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:15 smithi104 ceph-mon[32987]: pgmap v693: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:15 smithi183 ceph-mon[33560]: pgmap v693: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:16.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:15 smithi100 ceph-mon[29745]: pgmap v693: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:17.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:24:17.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 -- 172.21.15.100:0/1380439532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 msgr2=0x7f4ce0103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/1380439532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce0103720 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009900 tx=0x7f4cd002a410 comp rx=0 tx=0).stop 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 -- 172.21.15.100:0/1380439532 shutdown_connections 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/1380439532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 0x7f4ce010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/1380439532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 0x7f4ce0104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/1380439532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce0103720 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 -- 172.21.15.100:0/1380439532 >> 172.21.15.100:0/1380439532 conn(0x7f4ce00fdc10 msgr2=0x7f4ce01000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 -- 172.21.15.100:0/1380439532 shutdown_connections 2024-04-30T23:24:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.746+0000 7f4ce66bf640 1 -- 172.21.15.100:0/1380439532 wait complete. 2024-04-30T23:24:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 Processor -- start 2024-04-30T23:24:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 -- start start 2024-04-30T23:24:17.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 0x7f4ce01999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 0x7f4ce01a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce010e500 con 0x7f4ce0102a20 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce010e380 con 0x7f4ce0103c60 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce66bf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce010e680 con 0x7f4ce0108960 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4cdffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4cdffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49964/0 (socket says 172.21.15.100:49964) 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4cdffff640 1 -- 172.21.15.100:0/3847362266 learned_addr learned my addr 172.21.15.100:0/3847362266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 0x7f4ce01999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.747+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 0x7f4ce01a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 -- 172.21.15.100:0/3847362266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 msgr2=0x7f4ce01a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 0x7f4ce01a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 -- 172.21.15.100:0/3847362266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 msgr2=0x7f4ce01999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 0x7f4ce01999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 -- 172.21.15.100:0/3847362266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce01a0f40 con 0x7f4ce0102a20 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdffff640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0006010 tx=0x7f4cd0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdd7fa640 1 -- 172.21.15.100:0/3847362266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd003f030 con 0x7f4ce0102a20 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce01a11d0 con 0x7f4ce0102a20 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdd7fa640 1 -- 172.21.15.100:0/3847362266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd0003aa0 con 0x7f4ce0102a20 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4cdd7fa640 1 -- 172.21.15.100:0/3847362266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0035070 con 0x7f4ce0102a20 2024-04-30T23:24:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.748+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce01a16c0 con 0x7f4ce0102a20 2024-04-30T23:24:17.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.750+0000 7f4cdd7fa640 1 -- 172.21.15.100:0/3847362266 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4cd0042030 con 0x7f4ce0102a20 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.750+0000 7f4ced574740 1 Processor -- start 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 -- start start 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039cdc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cdcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564039bf1b10 con 0x5640399176b0 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564039c3ed80 con 0x56403990f4d0 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ced574740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564039bf88b0 con 0x564039938390 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49980/0 (socket says 172.21.15.100:49980) 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/4096904776 learned_addr learned my addr 172.21.15.100:0/4096904776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039cdc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdd7fa640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 0x7f4cc80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdffff640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cdcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 0x7f4cc80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/4096904776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 msgr2=0x564039cdc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039cdc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/4096904776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 msgr2=0x564039cdcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cdcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/4096904776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564039bc9a40 con 0x5640399176b0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdffff640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cdcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.751+0000 7f4cdd7fa640 1 -- 172.21.15.100:0/3847362266 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4cd00f0d20 con 0x7f4ce0102a20 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.752+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400bd10 tx=0x7f4cd40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6e36c9bde5a39e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.752+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 0x7f4cc80a60c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x564039cdd750 tx=0x7f4cd8004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.752+0000 7f4cc67fc640 1 -- 172.21.15.100:0/4096904776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4005220 con 0x5640399176b0 2024-04-30T23:24:17.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.752+0000 7f4cc67fc640 1 -- 172.21.15.100:0/4096904776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4004c50 con 0x5640399176b0 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.752+0000 7f4cc67fc640 1 -- 172.21.15.100:0/4096904776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011680 con 0x5640399176b0 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- 172.21.15.100:0/4096904776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 msgr2=0x564039cdd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400bd10 tx=0x7f4cd40107a0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- 172.21.15.100:0/4096904776 shutdown_connections 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cdd910 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cdcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- 172.21.15.100:0/4096904776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039cdc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- 172.21.15.100:0/4096904776 >> 172.21.15.100:0/4096904776 conn(0x56403992c4e0 msgr2=0x564039cd5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- 172.21.15.100:0/4096904776 shutdown_connections 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- 172.21.15.100:0/4096904776 wait complete. 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 -- start start 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 Processor -- start 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56403990f4d0 0x564039ce6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640399176b0 0x564039ce6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.753+0000 7f4ced574740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564039bc5d10 con 0x564039938390 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564039c3ad40 con 0x5640399176b0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564039cde420 con 0x56403990f4d0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 10 client.0 _ll_register_callbacks cb 0x564039c4bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49996/0 (socket says 172.21.15.100:49996) 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 -- 172.21.15.100:0/4161330689 learned_addr learned my addr 172.21.15.100:0/4161330689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cdffff640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56403990f4d0 0x564039ce6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640399176b0 0x564039ce6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 -- 172.21.15.100:0/4161330689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56403990f4d0 msgr2=0x564039ce6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56403990f4d0 0x564039ce6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 -- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640399176b0 msgr2=0x564039ce6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640399176b0 0x564039ce6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 -- 172.21.15.100:0/4161330689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564039a1a7d0 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8010ea0 tx=0x7f4cd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de4deb4821f8076 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8023070 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4cd8003970 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cd4004c50 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4cd8018070 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 10 client.16752 fetch_fsmap learned FSMap version 51 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.754+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5640399503f0 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4004c50 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f4cd801f400 con 0x564039938390 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 10 client.16752 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 20 client.16752 populate_metadata read hostname 'smithi100' 2024-04-30T23:24:17.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398f6f60 0x564039cf3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 4 client.16752 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564039c4c990 con 0x5640398f6f60 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.755+0000 7f4cdffff640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398f6f60 0x564039cf3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.756+0000 7f4cbf7fe640 10 client.16752 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.756+0000 7f4cdffff640 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398f6f60 0x564039cf3f60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a64f42e4a591b3 server_cookie=6a5feb99d54b5c3a in_seq=0 out_seq=0 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.756+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/4161330689 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x564039c4c990 con 0x5640398f6f60 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.756+0000 7f4cbf7fe640 10 client.16752 handle_command_reply: tid=0 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.756+0000 7f4ced574740 1 client.16752 shutdown 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 msgr2=0x564039ceda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8010ea0 tx=0x7f4cd8004a40 comp rx=0 tx=0).stop 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 shutdown_connections 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398f6f60 0x564039cf3f60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564039938390 0x564039ceda00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4cbf7fe640 0 client.16752 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640399176b0 0x564039ce6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 --2- 172.21.15.100:0/4161330689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56403990f4d0 0x564039ce6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 >> 172.21.15.100:0/4161330689 conn(0x56403992c4e0 msgr2=0x564039cd4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 shutdown_connections 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 1 -- 172.21.15.100:0/4161330689 wait complete. 2024-04-30T23:24:17.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.757+0000 7f4ced574740 20 client.16752 trim_cache size 0 max 16384 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 Processor -- start 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 -- start start 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cd56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ced920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01aa6d0 con 0x5640399176b0 2024-04-30T23:24:17.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01ac210 con 0x56403990f4d0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.774+0000 7f4ced574740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01aada0 con 0x564039938390 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50002/0 (socket says 172.21.15.100:50002) 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/2001969001 learned_addr learned my addr 172.21.15.100:0/2001969001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdffff640 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cd56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/2001969001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 msgr2=0x564039ced920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ced920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/2001969001 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 msgr2=0x564039cd56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cd56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/2001969001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640399100f0 con 0x5640399176b0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4010ca0 tx=0x7f4cd400bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9588da1244d271 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cc5ffb640 1 -- 172.21.15.100:0/2001969001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011440 con 0x5640399176b0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cc5ffb640 1 -- 172.21.15.100:0/2001969001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4011a90 con 0x5640399176b0 2024-04-30T23:24:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.775+0000 7f4cc5ffb640 1 -- 172.21.15.100:0/2001969001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd401b9a0 con 0x5640399176b0 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- 172.21.15.100:0/2001969001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 msgr2=0x564039cd5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4010ca0 tx=0x7f4cd400bc10 comp rx=0 tx=0).stop 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- 172.21.15.100:0/2001969001 shutdown_connections 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ced920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039cd5c00 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 --2- 172.21.15.100:0/2001969001 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cd56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- 172.21.15.100:0/2001969001 >> 172.21.15.100:0/2001969001 conn(0x56403992c4e0 msgr2=0x564039ce1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- 172.21.15.100:0/2001969001 shutdown_connections 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- 172.21.15.100:0/2001969001 wait complete. 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 -- start start 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.776+0000 7f4ced574740 1 Processor -- start 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ceb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01abb40 con 0x5640399176b0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01ab470 con 0x56403990f4d0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01a86b0 con 0x564039938390 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 10 client.0 _ll_register_callbacks cb 0x7f4cd8007d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50016/0 (socket says 172.21.15.100:50016) 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/434231092 learned_addr learned my addr 172.21.15.100:0/434231092 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdffff640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ce4c5c640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ceb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/434231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 msgr2=0x564039ceb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ceb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 msgr2=0x564039cee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 -- 172.21.15.100:0/434231092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564039bff4b0 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdffff640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cdf7fe640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400bd10 tx=0x7f4cd4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7882005b5bf1d2f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4033060 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4cd4011650 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.777+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cd4011a90 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4cd403a050 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 10 client.16758 fetch_fsmap learned FSMap version 51 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564039d59210 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4011a90 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f4cd401ba10 con 0x5640399176b0 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 10 client.16758 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:24:17.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 20 client.16758 populate_metadata read hostname 'smithi100' 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398cc3a0 0x564039d5b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 4 client.16758 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564039c46800 con 0x5640398cc3a0 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.778+0000 7f4cdffff640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398cc3a0 0x564039d5b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4cbf7fe640 10 client.16758 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4cdffff640 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398cc3a0 0x564039d5b990 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b013ab8c767b3dea server_cookie=9a801cb4b7bb5558 in_seq=0 out_seq=0 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4cbf7fe640 1 -- 172.21.15.100:0/434231092 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x564039c46800 con 0x5640398cc3a0 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4cbf7fe640 10 client.16758 handle_command_reply: tid=0 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 client.16758 shutdown 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 msgr2=0x564039ceacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400bd10 tx=0x7f4cd4011e70 comp rx=0 tx=0).stop 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 shutdown_connections 2024-04-30T23:24:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5640398cc3a0 0x564039d5b990 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564039938390 0x564039ceb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640399176b0 0x564039ceacc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4cbf7fe640 0 client.16758 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 --2- 172.21.15.100:0/434231092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56403990f4d0 0x564039cee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 >> 172.21.15.100:0/434231092 conn(0x56403992c4e0 msgr2=0x564039cd56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 shutdown_connections 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 1 -- 172.21.15.100:0/434231092 wait complete. 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.779+0000 7f4ced574740 20 client.16758 trim_cache size 0 max 16384 2024-04-30T23:24:17.789 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.790 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:24:17.791 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.792 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:17.793 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:17.794 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:17.794 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:17.794 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 msgr2=0x7f4cc80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 0x7f4cc80a60c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x564039cdd750 tx=0x7f4cd8004ab0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 msgr2=0x7f4ce01994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0006010 tx=0x7f4cd0031a50 comp rx=0 tx=0).stop 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 shutdown_connections 2024-04-30T23:24:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f4cc80a3bb0 0x7f4cc80a60c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ce0108960 0x7f4ce01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ce0103c60 0x7f4ce01999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 --2- 172.21.15.100:0/3847362266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ce0102a20 0x7f4ce01994b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 >> 172.21.15.100:0/3847362266 conn(0x7f4ce00fdc10 msgr2=0x7f4ce0104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 shutdown_connections 2024-04-30T23:24:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:17.780+0000 7f4ce66bf640 1 -- 172.21.15.100:0/3847362266 wait complete. 2024-04-30T23:24:17.796 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:24:18.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:17 smithi104 ceph-mon[32987]: pgmap v694: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:18.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:17 smithi183 ceph-mon[33560]: pgmap v694: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:18.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:17 smithi100 ceph-mon[29745]: pgmap v694: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:19 smithi104 ceph-mon[32987]: pgmap v695: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:19 smithi183 ceph-mon[33560]: pgmap v695: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:20.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:19 smithi100 ceph-mon[29745]: pgmap v695: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:22.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:21 smithi104 ceph-mon[32987]: pgmap v696: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:22.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:21 smithi183 ceph-mon[33560]: pgmap v696: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:21 smithi100 ceph-mon[29745]: pgmap v696: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:23 smithi104 ceph-mon[32987]: pgmap v697: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:23 smithi183 ceph-mon[33560]: pgmap v697: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:24.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:23 smithi100 ceph-mon[29745]: pgmap v697: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:25 smithi104 ceph-mon[32987]: pgmap v698: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:25 smithi183 ceph-mon[33560]: pgmap v698: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:25 smithi100 ceph-mon[29745]: pgmap v698: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:27 smithi104 ceph-mon[32987]: pgmap v699: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:27 smithi183 ceph-mon[33560]: pgmap v699: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:28.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:27 smithi100 ceph-mon[29745]: pgmap v699: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:29 smithi104 ceph-mon[32987]: pgmap v700: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:30.305 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:29 smithi183 ceph-mon[33560]: pgmap v700: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:30.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:29 smithi100 ceph-mon[29745]: pgmap v700: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:31 smithi104 ceph-mon[32987]: pgmap v701: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:31 smithi183 ceph-mon[33560]: pgmap v701: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:32.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:31 smithi100 ceph-mon[29745]: pgmap v701: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:33 smithi104 ceph-mon[32987]: pgmap v702: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:33 smithi183 ceph-mon[33560]: pgmap v702: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:34.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:33 smithi100 ceph-mon[29745]: pgmap v702: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:35 smithi104 ceph-mon[32987]: pgmap v703: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:35 smithi183 ceph-mon[33560]: pgmap v703: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:35 smithi100 ceph-mon[29745]: pgmap v703: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:37 smithi104 ceph-mon[32987]: pgmap v704: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:37 smithi183 ceph-mon[33560]: pgmap v704: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:38.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:37 smithi100 ceph-mon[29745]: pgmap v704: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:39 smithi104 ceph-mon[32987]: pgmap v705: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:39 smithi183 ceph-mon[33560]: pgmap v705: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:40.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:39 smithi100 ceph-mon[29745]: pgmap v705: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:41 smithi104 ceph-mon[32987]: pgmap v706: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:41 smithi183 ceph-mon[33560]: pgmap v706: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:42.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:41 smithi100 ceph-mon[29745]: pgmap v706: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:43 smithi104 ceph-mon[32987]: pgmap v707: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:44.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:43 smithi183 ceph-mon[33560]: pgmap v707: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:44.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:43 smithi100 ceph-mon[29745]: pgmap v707: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:45 smithi104 ceph-mon[32987]: pgmap v708: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:45 smithi183 ceph-mon[33560]: pgmap v708: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:46.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:45 smithi100 ceph-mon[29745]: pgmap v708: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:47.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:24:47.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:24:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.920+0000 7f20862d1640 1 -- 172.21.15.100:0/3655393593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080103c60 msgr2=0x7f2080104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.920+0000 7f20862d1640 1 --2- 172.21.15.100:0/3655393593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080103c60 0x7f2080104070 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f207402a410 comp rx=0 tx=0).stop 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 -- 172.21.15.100:0/3655393593 shutdown_connections 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 --2- 172.21.15.100:0/3655393593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080108960 0x7f208010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 --2- 172.21.15.100:0/3655393593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080103c60 0x7f2080104070 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 --2- 172.21.15.100:0/3655393593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080102a20 0x7f2080103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 -- 172.21.15.100:0/3655393593 >> 172.21.15.100:0/3655393593 conn(0x7f20800fdc10 msgr2=0x7f20801000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 -- 172.21.15.100:0/3655393593 shutdown_connections 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 -- 172.21.15.100:0/3655393593 wait complete. 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 Processor -- start 2024-04-30T23:24:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.921+0000 7f20862d1640 1 -- start start 2024-04-30T23:24:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080103c60 0x7f208019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 0x7f20801a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f208010e520 con 0x7f2080102a20 2024-04-30T23:24:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f208010e3a0 con 0x7f2080108960 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f208010e6a0 con 0x7f2080103c60 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47926/0 (socket says 172.21.15.100:47926) 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 -- 172.21.15.100:0/642501136 learned_addr learned my addr 172.21.15.100:0/642501136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207f7fe640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080103c60 0x7f208019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f208486e640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 0x7f20801a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 -- 172.21.15.100:0/642501136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080103c60 msgr2=0x7f208019f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080103c60 0x7f208019f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 -- 172.21.15.100:0/642501136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 msgr2=0x7f20801a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 0x7f20801a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 -- 172.21.15.100:0/642501136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20801a2000 con 0x7f2080102a20 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f208486e640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 0x7f20801a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207ffff640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f207000d740 tx=0x7f207000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207d7fa640 1 -- 172.21.15.100:0/642501136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070017070 con 0x7f2080102a20 2024-04-30T23:24:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20801a22f0 con 0x7f2080102a20 2024-04-30T23:24:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207d7fa640 1 -- 172.21.15.100:0/642501136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207000de50 con 0x7f2080102a20 2024-04-30T23:24:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.922+0000 7f207d7fa640 1 -- 172.21.15.100:0/642501136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070003c30 con 0x7f2080102a20 2024-04-30T23:24:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.923+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a2840 con 0x7f2080102a20 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.925+0000 7f208d184740 1 Processor -- start 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.925+0000 7f207d7fa640 1 -- 172.21.15.100:0/642501136 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2070003dd0 con 0x7f2080102a20 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 -- start start 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d845390 0x55e03dbe74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbe7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e03dafeb10 con 0x55e03d8246b0 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e03db4bd80 con 0x55e03d81c4d0 2024-04-30T23:24:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208d184740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e03db058b0 con 0x55e03d845390 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47938/0 (socket says 172.21.15.100:47938) 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 -- 172.21.15.100:0/3421694387 learned_addr learned my addr 172.21.15.100:0/3421694387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208486e640 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d845390 0x55e03dbe74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207d7fa640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 0x7f20680a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207ffff640 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbe7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 -- 172.21.15.100:0/3421694387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d845390 msgr2=0x55e03dbe74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d845390 0x55e03dbe74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f208486e640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 0x7f20680a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 -- 172.21.15.100:0/3421694387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 msgr2=0x55e03dbe7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbe7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207f7fe640 1 -- 172.21.15.100:0/3421694387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03dad6a40 con 0x55e03d8246b0 2024-04-30T23:24:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.926+0000 7f207d7fa640 1 -- 172.21.15.100:0/642501136 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f20700d0190 con 0x7f2080102a20 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.927+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2074031500 tx=0x7f2074031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1dd50feea88f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.927+0000 7f20667fc640 1 -- 172.21.15.100:0/3421694387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074035030 con 0x55e03d8246b0 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.927+0000 7f208486e640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 0x7f20680a60c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55e03dbe8540 tx=0x7f2078004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.927+0000 7f20667fc640 1 -- 172.21.15.100:0/3421694387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074040070 con 0x55e03d8246b0 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.927+0000 7f20667fc640 1 -- 172.21.15.100:0/3421694387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074003bb0 con 0x55e03d8246b0 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- 172.21.15.100:0/3421694387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 msgr2=0x55e03dbe8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2074031500 tx=0x7f2074031de0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- 172.21.15.100:0/3421694387 shutdown_connections 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbe8700 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbe7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 --2- 172.21.15.100:0/3421694387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d845390 0x55e03dbe74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- 172.21.15.100:0/3421694387 >> 172.21.15.100:0/3421694387 conn(0x55e03d8394e0 msgr2=0x55e03dbe2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- 172.21.15.100:0/3421694387 shutdown_connections 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- 172.21.15.100:0/3421694387 wait complete. 2024-04-30T23:24:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 -- start start 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 Processor -- start 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.928+0000 7f208d184740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbf1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d8246b0 0x55e03dbf1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e03dad2d10 con 0x55e03d845390 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e03db47d40 con 0x55e03d81c4d0 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e03dbe91b0 con 0x55e03d8246b0 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 10 client.0 _ll_register_callbacks cb 0x55e03db58d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47954/0 (socket says 172.21.15.100:47954) 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 -- 172.21.15.100:0/3023639540 learned_addr learned my addr 172.21.15.100:0/3023639540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d8246b0 0x55e03dbf1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f207ffff640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbf1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 -- 172.21.15.100:0/3023639540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d8246b0 msgr2=0x55e03dbf1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d8246b0 0x55e03dbf1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 -- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 msgr2=0x55e03dbf1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbf1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 -- 172.21.15.100:0/3023639540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e03d9277d0 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208486e640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2078012f20 tx=0x7f2078008540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5df6e7be82d742 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f205f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078022070 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f207801e840 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.929+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2074040070 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f207802e050 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 10 client.16770 fetch_fsmap learned FSMap version 51 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e03d85d3f0 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074040070 con 0x55e03d845390 2024-04-30T23:24:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f207801da90 con 0x55e03d845390 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 10 client.16770 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 20 client.16770 populate_metadata read hostname 'smithi100' 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d803f60 0x55e03dbfed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 4 client.16770 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e03db59990 con 0x55e03d803f60 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.930+0000 7f207ffff640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d803f60 0x55e03dbfed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.931+0000 7f205f7fe640 10 client.16770 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.931+0000 7f207ffff640 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d803f60 0x55e03dbfed10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f0e6413175fac1e server_cookie=768597b79f42835c in_seq=0 out_seq=0 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.931+0000 7f205f7fe640 1 -- 172.21.15.100:0/3023639540 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55e03db59990 con 0x55e03d803f60 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.931+0000 7f205f7fe640 10 client.16770 handle_command_reply: tid=0 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.931+0000 7f208d184740 1 client.16770 shutdown 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 msgr2=0x55e03dbf86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2078012f20 tx=0x7f2078008540 comp rx=0 tx=0).stop 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 shutdown_connections 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d803f60 0x55e03dbfed10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf86f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d8246b0 0x55e03dbf1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f205f7fe640 0 client.16770 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 --2- 172.21.15.100:0/3023639540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d81c4d0 0x55e03dbf1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 >> 172.21.15.100:0/3023639540 conn(0x55e03d8394e0 msgr2=0x55e03dbe1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 shutdown_connections 2024-04-30T23:24:47.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 1 -- 172.21.15.100:0/3023639540 wait complete. 2024-04-30T23:24:47.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.932+0000 7f208d184740 20 client.16770 trim_cache size 0 max 16384 2024-04-30T23:24:47.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 Processor -- start 2024-04-30T23:24:47.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 -- start start 2024-04-30T23:24:47.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbe26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d845390 0x55e03dbe2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ac800 con 0x55e03d8246b0 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ae340 con 0x55e03d845390 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208d184740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20801aced0 con 0x55e03d81c4d0 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47970/0 (socket says 172.21.15.100:47970) 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 -- 172.21.15.100:0/3342614338 learned_addr learned my addr 172.21.15.100:0/3342614338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f208486e640 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d845390 0x55e03dbe2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207ffff640 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbe26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 -- 172.21.15.100:0/3342614338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 msgr2=0x55e03dbe26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbe26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 -- 172.21.15.100:0/3342614338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d845390 msgr2=0x55e03dbe2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d845390 0x55e03dbe2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.950+0000 7f207f7fe640 1 -- 172.21.15.100:0/3342614338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03d81d0f0 con 0x55e03d8246b0 2024-04-30T23:24:47.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.951+0000 7f207f7fe640 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f2074005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457a6953394938db server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.951+0000 7f2065ffb640 1 -- 172.21.15.100:0/3342614338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074053070 con 0x55e03d8246b0 2024-04-30T23:24:47.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.951+0000 7f2065ffb640 1 -- 172.21.15.100:0/3342614338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074040040 con 0x55e03d8246b0 2024-04-30T23:24:47.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.951+0000 7f2065ffb640 1 -- 172.21.15.100:0/3342614338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074035050 con 0x55e03d8246b0 2024-04-30T23:24:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- 172.21.15.100:0/3342614338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 msgr2=0x55e03dbf8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f2074005fd0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- 172.21.15.100:0/3342614338 shutdown_connections 2024-04-30T23:24:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d845390 0x55e03dbe2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d8246b0 0x55e03dbf8610 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- 172.21.15.100:0/3342614338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbe26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- 172.21.15.100:0/3342614338 >> 172.21.15.100:0/3342614338 conn(0x55e03d8394e0 msgr2=0x55e03dbec130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- 172.21.15.100:0/3342614338 shutdown_connections 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- 172.21.15.100:0/3342614338 wait complete. 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 -- start start 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 Processor -- start 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbf3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 0x55e03dbf3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.952+0000 7f208d184740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20801adc70 con 0x55e03d845390 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ad5a0 con 0x55e03d8246b0 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20801aa7e0 con 0x55e03d81c4d0 2024-04-30T23:24:47.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 10 client.0 _ll_register_callbacks cb 0x7f2078008410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47976/0 (socket says 172.21.15.100:47976) 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 -- 172.21.15.100:0/2571311030 learned_addr learned my addr 172.21.15.100:0/2571311030 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f207f7fe640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 0x55e03dbf3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f207ffff640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbf3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 -- 172.21.15.100:0/2571311030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 msgr2=0x55e03dbf3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbf3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 -- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 msgr2=0x55e03dbf3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 0x55e03dbf3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 -- 172.21.15.100:0/2571311030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e03db0c4b0 con 0x55e03d845390 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f207f7fe640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 0x55e03dbf3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208486e640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2078012970 tx=0x7f207801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78210be7a2a6ec88 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f205f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:24:47.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078022040 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f207801ccc0 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2074040040 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f2078043050 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 10 client.16776 fetch_fsmap learned FSMap version 51 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.953+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e03dbf8250 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074040040 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f207801d3c0 con 0x55e03d845390 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 10 client.16776 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 20 client.16776 populate_metadata read hostname 'smithi100' 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d7d93a0 0x55e03dc67060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 4 client.16776 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e03db53800 con 0x55e03d7d93a0 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f207ffff640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d7d93a0 0x55e03dc67060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:24:47.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f205f7fe640 10 client.16776 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.954+0000 7f207ffff640 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d7d93a0 0x55e03dc67060 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48bd6226eff9a57c server_cookie=88b2d97d09002ce5 in_seq=0 out_seq=0 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f205f7fe640 1 -- 172.21.15.100:0/2571311030 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55e03db53800 con 0x55e03d7d93a0 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f205f7fe640 10 client.16776 handle_command_reply: tid=0 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 client.16776 shutdown 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 msgr2=0x55e03dbf6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2078012970 tx=0x7f207801c6c0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 shutdown_connections 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55e03d7d93a0 0x55e03dc67060 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e03d845390 0x55e03dbf6bd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e03d8246b0 0x55e03dbf3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f205f7fe640 0 client.16776 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 --2- 172.21.15.100:0/2571311030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e03d81c4d0 0x55e03dbf3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 >> 172.21.15.100:0/2571311030 conn(0x55e03d8394e0 msgr2=0x55e03dbe25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 shutdown_connections 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 1 -- 172.21.15.100:0/2571311030 wait complete. 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.955+0000 7f208d184740 20 client.16776 trim_cache size 0 max 16384 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:47.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.965 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.966 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:24:47.967 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:24:47.968 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:24:47.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 msgr2=0x7f20680a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 0x7f20680a60c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55e03dbe8540 tx=0x7f2078004ab0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 msgr2=0x7f208006a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:24:47.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f207000d740 tx=0x7f207000dc00 comp rx=0 tx=0).stop 2024-04-30T23:24:47.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 shutdown_connections 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f20680a3bb0 0x7f20680a60c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2080108960 0x7f20801a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2080103c60 0x7f208019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 --2- 172.21.15.100:0/642501136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2080102a20 0x7f208006a9a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 >> 172.21.15.100:0/642501136 conn(0x7f20800fdc10 msgr2=0x7f2080104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 shutdown_connections 2024-04-30T23:24:47.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:24:47.956+0000 7f20862d1640 1 -- 172.21.15.100:0/642501136 wait complete. 2024-04-30T23:24:47.970 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:24:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:47 smithi100 ceph-mon[29745]: pgmap v709: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:48.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:47 smithi104 ceph-mon[32987]: pgmap v709: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:47 smithi183 ceph-mon[33560]: pgmap v709: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:49 smithi104 ceph-mon[32987]: pgmap v710: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:49 smithi183 ceph-mon[33560]: pgmap v710: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:50.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:49 smithi100 ceph-mon[29745]: pgmap v710: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:51 smithi104 ceph-mon[32987]: pgmap v711: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:51 smithi183 ceph-mon[33560]: pgmap v711: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:52.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:51 smithi100 ceph-mon[29745]: pgmap v711: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:24:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:52 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:24:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:52 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:24:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:52 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:24:54.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.798 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: pgmap v712: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:24:54.799 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.803 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.803 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: pgmap v712: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:24:54.804 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: pgmap v712: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:24:54.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:24:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:55 smithi104 ceph-mon[32987]: pgmap v713: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:55 smithi183 ceph-mon[33560]: pgmap v713: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:56.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:55 smithi100 ceph-mon[29745]: pgmap v713: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:24:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:57 smithi104 ceph-mon[32987]: pgmap v714: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:58.305 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:57 smithi183 ceph-mon[33560]: pgmap v714: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:24:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:57 smithi100 ceph-mon[29745]: pgmap v714: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:24:59 smithi104 ceph-mon[32987]: pgmap v715: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:24:59 smithi183 ceph-mon[33560]: pgmap v715: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:00.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:24:59 smithi100 ceph-mon[29745]: pgmap v715: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:01 smithi104 ceph-mon[32987]: pgmap v716: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:01 smithi183 ceph-mon[33560]: pgmap v716: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:02.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:01 smithi100 ceph-mon[29745]: pgmap v716: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:04.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:03 smithi104 ceph-mon[32987]: pgmap v717: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:04.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:03 smithi183 ceph-mon[33560]: pgmap v717: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:04.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:03 smithi100 ceph-mon[29745]: pgmap v717: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:05 smithi104 ceph-mon[32987]: pgmap v718: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:05 smithi183 ceph-mon[33560]: pgmap v718: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:06.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:05 smithi100 ceph-mon[29745]: pgmap v718: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:08.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:07 smithi104 ceph-mon[32987]: pgmap v719: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:08.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:07 smithi183 ceph-mon[33560]: pgmap v719: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:08.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:07 smithi100 ceph-mon[29745]: pgmap v719: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:10.107 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:09 smithi183 ceph-mon[33560]: pgmap v720: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:09 smithi104 ceph-mon[32987]: pgmap v720: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:10.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:09 smithi100 ceph-mon[29745]: pgmap v720: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:11 smithi104 ceph-mon[32987]: pgmap v721: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:11 smithi183 ceph-mon[33560]: pgmap v721: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:12.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:11 smithi100 ceph-mon[29745]: pgmap v721: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:14.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:13 smithi104 ceph-mon[32987]: pgmap v722: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:14.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:13 smithi183 ceph-mon[33560]: pgmap v722: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:14.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:13 smithi100 ceph-mon[29745]: pgmap v722: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:15 smithi104 ceph-mon[32987]: pgmap v723: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:15 smithi183 ceph-mon[33560]: pgmap v723: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:16.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:15 smithi100 ceph-mon[29745]: pgmap v723: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:17.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:25:17.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 -- 172.21.15.100:0/1349676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c103010 msgr2=0x7f928c103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 --2- 172.21.15.100:0/1349676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c103010 0x7f928c103420 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f927c009900 tx=0x7f927c02a410 comp rx=0 tx=0).stop 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 -- 172.21.15.100:0/1349676724 shutdown_connections 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 --2- 172.21.15.100:0/1349676724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c1046d0 0x7f928c10ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 --2- 172.21.15.100:0/1349676724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103b70 0x7f928c104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 --2- 172.21.15.100:0/1349676724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c103010 0x7f928c103420 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 -- 172.21.15.100:0/1349676724 >> 172.21.15.100:0/1349676724 conn(0x7f928c0fd390 msgr2=0x7f928c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 -- 172.21.15.100:0/1349676724 shutdown_connections 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.094+0000 7f9292f5e640 1 -- 172.21.15.100:0/1349676724 wait complete. 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 Processor -- start 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 -- start start 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103010 0x7f928c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 0x7f928c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10f8a0 con 0x7f928c19f550 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10f720 con 0x7f928c103b70 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9292f5e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10fa20 con 0x7f928c103010 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47192/0 (socket says 172.21.15.100:47192) 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 -- 172.21.15.100:0/684365309 learned_addr learned my addr 172.21.15.100:0/684365309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f9290cfa640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103010 0x7f928c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f928bfff640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 0x7f928c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 -- 172.21.15.100:0/684365309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103010 msgr2=0x7f928c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103010 0x7f928c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 -- 172.21.15.100:0/684365309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 msgr2=0x7f928c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 0x7f928c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f92914fb640 1 -- 172.21.15.100:0/684365309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c1a1fe0 con 0x7f928c19f550 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.095+0000 7f928bfff640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 0x7f928c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f92914fb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f928400eaa0 tx=0x7f928400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f9289ffb640 1 -- 172.21.15.100:0/684365309 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928400cdb0 con 0x7f928c19f550 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f9289ffb640 1 -- 172.21.15.100:0/684365309 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9284005020 con 0x7f928c19f550 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c1a22d0 con 0x7f928c19f550 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f9289ffb640 1 -- 172.21.15.100:0/684365309 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92840116d0 con 0x7f928c19f550 2024-04-30T23:25:18.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.096+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c1a27d0 con 0x7f928c19f550 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.098+0000 7f9289ffb640 1 -- 172.21.15.100:0/684365309 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f92840051d0 con 0x7f928c19f550 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.098+0000 7f9299e14740 1 Processor -- start 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.098+0000 7f9299e14740 1 -- start start 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ef1390 0x55f9b32934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 0x55f9b3293a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f9b31aab10 con 0x55f9b2ed06b0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9b31f7d80 con 0x55f9b2ef1390 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9299e14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f9b31b18b0 con 0x55f9b2ec84d0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9289ffb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 0x7f92740a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47200/0 (socket says 172.21.15.100:47200) 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 -- 172.21.15.100:0/2748122666 learned_addr learned my addr 172.21.15.100:0/2748122666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9290cfa640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 0x55f9b3293a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ef1390 0x55f9b32934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f92914fb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 0x7f92740a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9289ffb640 1 -- 172.21.15.100:0/684365309 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f92840d0a10 con 0x7f928c19f550 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 -- 172.21.15.100:0/2748122666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 msgr2=0x55f9b3293a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 0x55f9b3293a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 -- 172.21.15.100:0/2748122666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ef1390 msgr2=0x55f9b32934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ef1390 0x55f9b32934f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 -- 172.21.15.100:0/2748122666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b3182a40 con 0x55f9b2ed06b0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f9290cfa640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 0x55f9b3293a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f928bfff640 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9280009460 tx=0x7f92800096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1939a1bf486e1b62 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.099+0000 7f92914fb640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 0x7f92740a60c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f928409c920 tx=0x7f9284091e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9272ffd640 1 -- 172.21.15.100:0/2748122666 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004030 con 0x55f9b2ed06b0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9272ffd640 1 -- 172.21.15.100:0/2748122666 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280010710 con 0x55f9b2ed06b0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9272ffd640 1 -- 172.21.15.100:0/2748122666 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280003830 con 0x55f9b2ed06b0 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 -- 172.21.15.100:0/2748122666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 msgr2=0x55f9b3294700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9280009460 tx=0x7f92800096b0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 -- 172.21.15.100:0/2748122666 shutdown_connections 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b3294700 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ec84d0 0x55f9b3293a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 --2- 172.21.15.100:0/2748122666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ef1390 0x55f9b32934f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.100+0000 7f9299e14740 1 -- 172.21.15.100:0/2748122666 >> 172.21.15.100:0/2748122666 conn(0x55f9b2ee54e0 msgr2=0x55f9b328ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- 172.21.15.100:0/2748122666 shutdown_connections 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- 172.21.15.100:0/2748122666 wait complete. 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- start start 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 Processor -- start 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ed06b0 0x55f9b329d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b32a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f9b317ed10 con 0x55f9b2ec84d0 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9b31f3d40 con 0x55f9b2ed06b0 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3295210 con 0x55f9b2ef1390 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.101+0000 7f9299e14740 10 client.0 _ll_register_callbacks cb 0x55f9b3204d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:25:18.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47212/0 (socket says 172.21.15.100:47212) 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 -- 172.21.15.100:0/2973660404 learned_addr learned my addr 172.21.15.100:0/2973660404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f9290cfa640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ed06b0 0x55f9b329d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b32a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 -- 172.21.15.100:0/2973660404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 msgr2=0x55f9b32a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b32a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 -- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ed06b0 msgr2=0x55f9b329d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ed06b0 0x55f9b329d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 -- 172.21.15.100:0/2973660404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b2fd37d0 con 0x55f9b2ec84d0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f928bfff640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9280009900 tx=0x7f92800093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c9d332716a3f2d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f926bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004050 con 0x55f9b2ec84d0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f92800041f0 con 0x55f9b2ec84d0 2024-04-30T23:25:18.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9280010710 con 0x55f9b2ec84d0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f9280032050 con 0x55f9b2ec84d0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f9299e14740 10 client.16788 fetch_fsmap learned FSMap version 51 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.102+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55f9b2f093f0 con 0x55f9b2ec84d0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280010710 con 0x55f9b2ec84d0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f9280004940 con 0x55f9b2ec84d0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 10 client.16788 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 20 client.16788 populate_metadata read hostname 'smithi100' 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2eaff60 0x55f9b32aa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 4 client.16788 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b3205990 con 0x55f9b2eaff60 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.103+0000 7f9290cfa640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2eaff60 0x55f9b32aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9290cfa640 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2eaff60 0x55f9b32aa830 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26502f561b675b75 server_cookie=9be27f53f6a335b9 in_seq=0 out_seq=0 2024-04-30T23:25:18.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f926bfff640 10 client.16788 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f926bfff640 1 -- 172.21.15.100:0/2973660404 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55f9b3205990 con 0x55f9b2eaff60 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f926bfff640 10 client.16788 handle_command_reply: tid=0 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 client.16788 shutdown 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 msgr2=0x55f9b329d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9280009900 tx=0x7f92800093b0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 shutdown_connections 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2eaff60 0x55f9b32aa830 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.104+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b32a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ed06b0 0x55f9b329d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f926bfff640 0 client.16788 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 1 --2- 172.21.15.100:0/2973660404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ec84d0 0x55f9b329d270 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 >> 172.21.15.100:0/2973660404 conn(0x55f9b2ee54e0 msgr2=0x55f9b3291c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 shutdown_connections 2024-04-30T23:25:18.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 1 -- 172.21.15.100:0/2973660404 wait complete. 2024-04-30T23:25:18.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.105+0000 7f9299e14740 20 client.16788 trim_cache size 0 max 16384 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.122+0000 7f9299e14740 1 Processor -- start 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.122+0000 7f9299e14740 1 -- start start 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b328eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ed06b0 0x55f9b329b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ac9a0 con 0x55f9b2ef1390 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ae4e0 con 0x55f9b2ec84d0 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9299e14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ad070 con 0x55f9b2ed06b0 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47216/0 (socket says 172.21.15.100:47216) 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 -- 172.21.15.100:0/802719552 learned_addr learned my addr 172.21.15.100:0/802719552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f9290cfa640 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ed06b0 0x55f9b329b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b328eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 -- 172.21.15.100:0/802719552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ed06b0 msgr2=0x55f9b329b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ed06b0 0x55f9b329b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 -- 172.21.15.100:0/802719552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 msgr2=0x55f9b328eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b328eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 -- 172.21.15.100:0/802719552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b2ec90f0 con 0x55f9b2ef1390 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f928bfff640 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9280003910 tx=0x7f9280024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8825e7db409c6d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f92727fc640 1 -- 172.21.15.100:0/802719552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280009a50 con 0x55f9b2ef1390 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f92727fc640 1 -- 172.21.15.100:0/802719552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280026030 con 0x55f9b2ef1390 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.123+0000 7f92727fc640 1 -- 172.21.15.100:0/802719552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280013400 con 0x55f9b2ef1390 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- 172.21.15.100:0/802719552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 msgr2=0x55f9b329bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9280003910 tx=0x7f9280024040 comp rx=0 tx=0).stop 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- 172.21.15.100:0/802719552 shutdown_connections 2024-04-30T23:25:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ef1390 0x55f9b329bdd0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ed06b0 0x55f9b329b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 --2- 172.21.15.100:0/802719552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b328eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- 172.21.15.100:0/802719552 >> 172.21.15.100:0/802719552 conn(0x55f9b2ee54e0 msgr2=0x55f9b32a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- 172.21.15.100:0/802719552 shutdown_connections 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- 172.21.15.100:0/802719552 wait complete. 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.124+0000 7f9299e14740 1 -- start start 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 Processor -- start 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b330b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b3312d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ade10 con 0x55f9b2ed06b0 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ad740 con 0x55f9b2ec84d0 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1aa980 con 0x55f9b2ef1390 2024-04-30T23:25:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9299e14740 10 client.0 _ll_register_callbacks cb 0x7f9280009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47220/0 (socket says 172.21.15.100:47220) 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 -- 172.21.15.100:0/4172960414 learned_addr learned my addr 172.21.15.100:0/4172960414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f928bfff640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b3312d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f928bfff640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b330b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 -- 172.21.15.100:0/4172960414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 msgr2=0x55f9b3312d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b3312d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 -- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 msgr2=0x55f9b330b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b330b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f9290cfa640 1 -- 172.21.15.100:0/4172960414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b31b84b0 con 0x55f9b2ed06b0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.125+0000 7f928bfff640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b330b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9290cfa640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f927c009850 tx=0x7f927c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34906f2d1aa5e9e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:18.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c035040 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f927c005240 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9280026030 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f927c054050 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 10 client.16794 fetch_fsmap learned FSMap version 51 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55f9b33144e0 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280026030 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f927c0047e0 con 0x55f9b2ed06b0 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 10 client.16794 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 20 client.16794 populate_metadata read hostname 'smithi100' 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2e853a0 0x55f9b3316f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 4 client.16794 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:25:18.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.126+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f9b31ff800 con 0x55f9b2e853a0 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f928bfff640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2e853a0 0x55f9b3316f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f926bfff640 10 client.16794 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f928bfff640 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2e853a0 0x55f9b3316f50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d8558a0e501a0a server_cookie=5de2cafdb1700e53 in_seq=0 out_seq=0 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f926bfff640 1 -- 172.21.15.100:0/4172960414 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55f9b31ff800 con 0x55f9b2e853a0 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f926bfff640 10 client.16794 handle_command_reply: tid=0 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 client.16794 shutdown 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 msgr2=0x55f9b330be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f927c009850 tx=0x7f927c004290 comp rx=0 tx=0).stop 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 shutdown_connections 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55f9b2e853a0 0x55f9b3316f50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9b2ef1390 0x55f9b3312d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f926bfff640 0 client.16794 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9b2ed06b0 0x55f9b330be30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 --2- 172.21.15.100:0/4172960414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9b2ec84d0 0x55f9b330b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.127+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 >> 172.21.15.100:0/4172960414 conn(0x55f9b2ee54e0 msgr2=0x55f9b329d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 shutdown_connections 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9299e14740 1 -- 172.21.15.100:0/4172960414 wait complete. 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9299e14740 20 client.16794 trim_cache size 0 max 16384 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.137 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:25:18.138 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.140 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:18.141 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 msgr2=0x7f92740a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 0x7f92740a60c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f928409c920 tx=0x7f9284091e70 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 msgr2=0x7f928c1a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f928400eaa0 tx=0x7f928400ef60 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 shutdown_connections 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f92740a3bb0 0x7f92740a60c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f928c19f550 0x7f928c1a1970 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c103b70 0x7f928c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 --2- 172.21.15.100:0/684365309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c103010 0x7f928c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 >> 172.21.15.100:0/684365309 conn(0x7f928c0fd390 msgr2=0x7f928c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:18.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 shutdown_connections 2024-04-30T23:25:18.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:18.128+0000 7f9292f5e640 1 -- 172.21.15.100:0/684365309 wait complete. 2024-04-30T23:25:18.144 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:25:18.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:17 smithi104 ceph-mon[32987]: pgmap v724: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:18.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:17 smithi183 ceph-mon[33560]: pgmap v724: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:18.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:17 smithi100 ceph-mon[29745]: pgmap v724: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:19 smithi104 ceph-mon[32987]: pgmap v725: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:19 smithi183 ceph-mon[33560]: pgmap v725: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:20.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:19 smithi100 ceph-mon[29745]: pgmap v725: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:22.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:21 smithi104 ceph-mon[32987]: pgmap v726: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:22.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:21 smithi183 ceph-mon[33560]: pgmap v726: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:21 smithi100 ceph-mon[29745]: pgmap v726: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:23 smithi104 ceph-mon[32987]: pgmap v727: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:23 smithi183 ceph-mon[33560]: pgmap v727: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:24.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:23 smithi100 ceph-mon[29745]: pgmap v727: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:25 smithi104 ceph-mon[32987]: pgmap v728: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:25 smithi183 ceph-mon[33560]: pgmap v728: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:26.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:25 smithi100 ceph-mon[29745]: pgmap v728: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:27 smithi104 ceph-mon[32987]: pgmap v729: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:27 smithi183 ceph-mon[33560]: pgmap v729: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:28.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:27 smithi100 ceph-mon[29745]: pgmap v729: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:29 smithi104 ceph-mon[32987]: pgmap v730: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:29 smithi183 ceph-mon[33560]: pgmap v730: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:30.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:29 smithi100 ceph-mon[29745]: pgmap v730: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:31 smithi104 ceph-mon[32987]: pgmap v731: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:31 smithi183 ceph-mon[33560]: pgmap v731: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:32.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:31 smithi100 ceph-mon[29745]: pgmap v731: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:33 smithi104 ceph-mon[32987]: pgmap v732: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:33 smithi183 ceph-mon[33560]: pgmap v732: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:34.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:33 smithi100 ceph-mon[29745]: pgmap v732: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:35 smithi104 ceph-mon[32987]: pgmap v733: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:35 smithi183 ceph-mon[33560]: pgmap v733: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:36.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:35 smithi100 ceph-mon[29745]: pgmap v733: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:37 smithi104 ceph-mon[32987]: pgmap v734: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:37 smithi183 ceph-mon[33560]: pgmap v734: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:38.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:37 smithi100 ceph-mon[29745]: pgmap v734: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:39 smithi104 ceph-mon[32987]: pgmap v735: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:39 smithi183 ceph-mon[33560]: pgmap v735: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:40.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:39 smithi100 ceph-mon[29745]: pgmap v735: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:41 smithi104 ceph-mon[32987]: pgmap v736: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:41 smithi183 ceph-mon[33560]: pgmap v736: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:42.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:41 smithi100 ceph-mon[29745]: pgmap v736: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:43 smithi104 ceph-mon[32987]: pgmap v737: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:44.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:43 smithi183 ceph-mon[33560]: pgmap v737: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:44.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:43 smithi100 ceph-mon[29745]: pgmap v737: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:45 smithi104 ceph-mon[32987]: pgmap v738: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:45 smithi183 ceph-mon[33560]: pgmap v738: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:46.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:45 smithi100 ceph-mon[29745]: pgmap v738: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:48.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:25:48.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:25:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 -- 172.21.15.100:0/173006257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4108970 msgr2=0x7f55a410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 --2- 172.21.15.100:0/173006257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4108970 0x7f55a410ad90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f559c009ca0 tx=0x7f559c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 -- 172.21.15.100:0/173006257 shutdown_connections 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 --2- 172.21.15.100:0/173006257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4108970 0x7f55a410ad90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 --2- 172.21.15.100:0/173006257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 --2- 172.21.15.100:0/173006257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4102a30 0x7f55a4103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 -- 172.21.15.100:0/173006257 >> 172.21.15.100:0/173006257 conn(0x7f55a40fdc00 msgr2=0x7f55a41000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 -- 172.21.15.100:0/173006257 shutdown_connections 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.264+0000 7f55a9819640 1 -- 172.21.15.100:0/173006257 wait complete. 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.265+0000 7f55a9819640 1 Processor -- start 2024-04-30T23:25:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.265+0000 7f55a9819640 1 -- start start 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.265+0000 7f55a9819640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.265+0000 7f55a9819640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a40fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.265+0000 7f55a9819640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 0x7f55a40fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a9819640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410e560 con 0x7f55a4102a30 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a9819640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410e3e0 con 0x7f55a4108970 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a9819640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410e6e0 con 0x7f55a4103c70 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60222/0 (socket says 172.21.15.100:60222) 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2257072067 learned_addr learned my addr 172.21.15.100:0/2257072067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 0x7f55a40fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a27fc640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a40fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2257072067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 msgr2=0x7f55a40fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a40fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2257072067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 msgr2=0x7f55a40fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 0x7f55a40fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2257072067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a40feda0 con 0x7f55a4102a30 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 0x7f55a40fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a27fc640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a40fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f559400c970 tx=0x7f559400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a8817640 1 -- 172.21.15.100:0/2257072067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594004220 con 0x7f55a4102a30 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a8817640 1 -- 172.21.15.100:0/2257072067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55940043c0 con 0x7f55a4102a30 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41a42b0 con 0x7f55a4102a30 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a8817640 1 -- 172.21.15.100:0/2257072067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559400f450 con 0x7f55a4102a30 2024-04-30T23:25:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.266+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41a4770 con 0x7f55a4102a30 2024-04-30T23:25:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 Processor -- start 2024-04-30T23:25:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 -- start start 2024-04-30T23:25:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a8817640 1 -- 172.21.15.100:0/2257072067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f559400f5f0 con 0x7f55a4102a30 2024-04-30T23:25:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026ae24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026ae2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610269f9b10 con 0x56102671f6b0 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561026a46d80 con 0x5610267174d0 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55b07ac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561026a008b0 con 0x561026740390 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60228/0 (socket says 172.21.15.100:60228) 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a27fc640 1 -- 172.21.15.100:0/1576284923 learned_addr learned my addr 172.21.15.100:0/1576284923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026ae2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.269+0000 7f55a37fe640 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026ae24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 -- 172.21.15.100:0/1576284923 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 msgr2=0x561026ae24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026ae24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 -- 172.21.15.100:0/1576284923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 msgr2=0x561026ae2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026ae2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 -- 172.21.15.100:0/1576284923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610269d1a40 con 0x56102671f6b0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a8817640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 0x7f558c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a27fc640 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f559800bb80 tx=0x7f559800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3e1fc1b4373bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 0x7f558c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f5589ffb640 1 -- 172.21.15.100:0/1576284923 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598017620 con 0x56102671f6b0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f55a8817640 1 -- 172.21.15.100:0/2257072067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f55940d0930 con 0x7f55a4102a30 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f5589ffb640 1 -- 172.21.15.100:0/1576284923 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5598017c70 con 0x56102671f6b0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.270+0000 7f5589ffb640 1 -- 172.21.15.100:0/1576284923 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559800fb60 con 0x56102671f6b0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- 172.21.15.100:0/1576284923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 msgr2=0x561026ae3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f559800bb80 tx=0x7f559800d710 comp rx=0 tx=0).stop 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 0x7f558c0a60c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x561026ae3540 tx=0x7f559c0098a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- 172.21.15.100:0/1576284923 shutdown_connections 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026ae3700 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026ae2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 --2- 172.21.15.100:0/1576284923 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026ae24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- 172.21.15.100:0/1576284923 >> 172.21.15.100:0/1576284923 conn(0x5610267344e0 msgr2=0x561026addd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- 172.21.15.100:0/1576284923 shutdown_connections 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- 172.21.15.100:0/1576284923 wait complete. 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.271+0000 7f55b07ac740 1 -- start start 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 Processor -- start 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 0x561026aec280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026af3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610269cdd10 con 0x56102671f6b0 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561026a42d40 con 0x561026740390 2024-04-30T23:25:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561026ae4210 con 0x5610267174d0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55b07ac740 10 client.0 _ll_register_callbacks cb 0x561026a53d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60230/0 (socket says 172.21.15.100:60230) 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 -- 172.21.15.100:0/770909743 learned_addr learned my addr 172.21.15.100:0/770909743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 0x561026aec280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a37fe640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026af3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 -- 172.21.15.100:0/770909743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 msgr2=0x561026aec280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 0x561026aec280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 -- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 msgr2=0x561026af3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026af3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 -- 172.21.15.100:0/770909743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610268227d0 con 0x56102671f6b0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 0x561026aec280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f55a27fc640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f559800b310 tx=0x7f559800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6564bbd5dba3ca server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.272+0000 7f5582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598026070 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f5598017830 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5598017c70 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5598032050 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 10 client.16806 fetch_fsmap learned FSMap version 51 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5610267583f0 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5598017c70 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f5598022a10 con 0x56102671f6b0 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 10 client.16806 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 10 client.16806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 20 client.16806 populate_metadata read hostname 'smithi100' 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266fef60 0x561026af98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 4 client.16806 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:25:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561026a54990 con 0x5610266fef60 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.273+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266fef60 0x561026af98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.274+0000 7f5582ffd640 10 client.16806 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.274+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266fef60 0x561026af98a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b79bb405c38ac4 server_cookie=1992e4460f462a1e in_seq=0 out_seq=0 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f5582ffd640 1 -- 172.21.15.100:0/770909743 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x561026a54990 con 0x5610266fef60 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f5582ffd640 10 client.16806 handle_command_reply: tid=0 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 client.16806 shutdown 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 msgr2=0x561026aec7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f559800b310 tx=0x7f559800be80 comp rx=0 tx=0).stop 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 shutdown_connections 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266fef60 0x561026af98a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026af3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026aec7c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 --2- 172.21.15.100:0/770909743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5610267174d0 0x561026aec280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f5582ffd640 0 client.16806 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 >> 172.21.15.100:0/770909743 conn(0x5610267344e0 msgr2=0x561026adcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 shutdown_connections 2024-04-30T23:25:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 1 -- 172.21.15.100:0/770909743 wait complete. 2024-04-30T23:25:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.275+0000 7f55b07ac740 20 client.16806 trim_cache size 0 max 16384 2024-04-30T23:25:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 Processor -- start 2024-04-30T23:25:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 -- start start 2024-04-30T23:25:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56102671f6b0 0x561026ae7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026adc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41aeb00 con 0x5610267174d0 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41b0640 con 0x561026740390 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55b07ac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41af1d0 con 0x56102671f6b0 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60232/0 (socket says 172.21.15.100:60232) 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2023697033 learned_addr learned my addr 172.21.15.100:0/2023697033 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a27fc640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56102671f6b0 0x561026ae7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2023697033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56102671f6b0 msgr2=0x561026ae7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026adc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56102671f6b0 0x561026ae7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2023697033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 msgr2=0x561026adc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026adc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a2ffd640 1 -- 172.21.15.100:0/2023697033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610267180f0 con 0x5610267174d0 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.293+0000 7f55a37fe640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026adc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.294+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5594099280 tx=0x7f5594087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb66dc2d2e6a6f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.294+0000 7f55897fa640 1 -- 172.21.15.100:0/2023697033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559401d040 con 0x5610267174d0 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.294+0000 7f55897fa640 1 -- 172.21.15.100:0/2023697033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55940a0c60 con 0x5610267174d0 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.294+0000 7f55897fa640 1 -- 172.21.15.100:0/2023697033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594098f20 con 0x5610267174d0 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- 172.21.15.100:0/2023697033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 msgr2=0x561026aeaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5594099280 tx=0x7f5594087040 comp rx=0 tx=0).stop 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- 172.21.15.100:0/2023697033 shutdown_connections 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561026740390 0x561026adc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56102671f6b0 0x561026ae7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- 172.21.15.100:0/2023697033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610267174d0 0x561026aeaed0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- 172.21.15.100:0/2023697033 >> 172.21.15.100:0/2023697033 conn(0x5610267344e0 msgr2=0x561026adc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- 172.21.15.100:0/2023697033 shutdown_connections 2024-04-30T23:25:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- 172.21.15.100:0/2023697033 wait complete. 2024-04-30T23:25:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- start start 2024-04-30T23:25:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 Processor -- start 2024-04-30T23:25:48.300 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:47 smithi104 ceph-mon[32987]: pgmap v739: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026af13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026af2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41aff70 con 0x56102671f6b0 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41af8a0 con 0x5610267174d0 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.295+0000 7f55b07ac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55a41acae0 con 0x561026740390 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55b07ac740 10 client.0 _ll_register_callbacks cb 0x7f559800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60242/0 (socket says 172.21.15.100:60242) 2024-04-30T23:25:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 -- 172.21.15.100:0/191221766 learned_addr learned my addr 172.21.15.100:0/191221766 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026af13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 -- 172.21.15.100:0/191221766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 msgr2=0x561026af2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026af2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 -- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 msgr2=0x561026af13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026af13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 -- 172.21.15.100:0/191221766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561026a074b0 con 0x56102671f6b0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55a27fc640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x561026ad9680 tx=0x7f559800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb83cc1fe5b9576 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f5582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598026040 con 0x56102671f6b0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f5598020610 con 0x56102671f6b0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55940a0c60 con 0x56102671f6b0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5598020810 con 0x56102671f6b0 2024-04-30T23:25:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55b07ac740 10 client.16812 fetch_fsmap learned FSMap version 51 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.296+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561026af3e00 con 0x56102671f6b0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55940a0c60 con 0x56102671f6b0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f55980229d0 con 0x56102671f6b0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 10 client.16812 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 20 client.16812 populate_metadata read hostname 'smithi100' 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266d43a0 0x561026b61e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 4 client.16812 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561026a4e800 con 0x5610266d43a0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266d43a0 0x561026b61e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f5582ffd640 10 client.16812 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.297+0000 7f55a2ffd640 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266d43a0 0x561026b61e00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=301b04e4bb510c31 server_cookie=509b3b803c530c47 in_seq=0 out_seq=0 2024-04-30T23:25:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f5582ffd640 1 -- 172.21.15.100:0/191221766 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x561026a4e800 con 0x5610266d43a0 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f5582ffd640 10 client.16812 handle_command_reply: tid=0 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 client.16812 shutdown 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 msgr2=0x561026af1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x561026ad9680 tx=0x7f559800b3b0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 shutdown_connections 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5610266d43a0 0x561026b61e00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561026740390 0x561026af2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56102671f6b0 0x561026af1930 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f5582ffd640 0 client.16812 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 --2- 172.21.15.100:0/191221766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5610267174d0 0x561026af13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 >> 172.21.15.100:0/191221766 conn(0x5610267344e0 msgr2=0x561026adcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 shutdown_connections 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 1 -- 172.21.15.100:0/191221766 wait complete. 2024-04-30T23:25:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.298+0000 7f55b07ac740 20 client.16812 trim_cache size 0 max 16384 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.308 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.310 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:25:48.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:25:48.312 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 msgr2=0x7f558c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 0x7f558c0a60c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x561026ae3540 tx=0x7f559c0098a0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 msgr2=0x7f55a40ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f559400c970 tx=0x7f559400ce30 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 shutdown_connections 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f558c0a3bb0 0x7f558c0a60c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55a4108970 0x7f55a40fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55a4103c70 0x7f55a40fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 --2- 172.21.15.100:0/2257072067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a4102a30 0x7f55a40ffa90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:25:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 >> 172.21.15.100:0/2257072067 conn(0x7f55a40fdc00 msgr2=0x7f55a4109e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:25:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 shutdown_connections 2024-04-30T23:25:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:25:48.299+0000 7f55a9819640 1 -- 172.21.15.100:0/2257072067 wait complete. 2024-04-30T23:25:48.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:47 smithi100 ceph-mon[29745]: pgmap v739: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:48.315 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:47 smithi183 ceph-mon[33560]: pgmap v739: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:48.315 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:25:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:49 smithi104 ceph-mon[32987]: pgmap v740: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:49 smithi183 ceph-mon[33560]: pgmap v740: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:50.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:49 smithi100 ceph-mon[29745]: pgmap v740: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:51 smithi104 ceph-mon[32987]: pgmap v741: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:51 smithi183 ceph-mon[33560]: pgmap v741: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:52.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:51 smithi100 ceph-mon[29745]: pgmap v741: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:25:54.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:53 smithi104 ceph-mon[32987]: pgmap v742: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:54.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:53 smithi183 ceph-mon[33560]: pgmap v742: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:54.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:53 smithi100 ceph-mon[29745]: pgmap v742: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:25:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:25:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:25:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:25:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:54 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:25:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:25:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:25:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:25:55.304 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:54 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:25:55.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:25:55.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:25:55.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:25:55.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:54 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:25:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:55 smithi104 ceph-mon[32987]: pgmap v743: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:55 smithi183 ceph-mon[33560]: pgmap v743: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:56.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:55 smithi100 ceph-mon[29745]: pgmap v743: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:25:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:57 smithi104 ceph-mon[32987]: pgmap v744: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:57 smithi183 ceph-mon[33560]: pgmap v744: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:25:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:57 smithi100 ceph-mon[29745]: pgmap v744: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:25:59 smithi104 ceph-mon[32987]: pgmap v745: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:25:59 smithi183 ceph-mon[33560]: pgmap v745: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:00.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:25:59 smithi100 ceph-mon[29745]: pgmap v745: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:01 smithi104 ceph-mon[32987]: pgmap v746: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:01 smithi183 ceph-mon[33560]: pgmap v746: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:02.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:01 smithi100 ceph-mon[29745]: pgmap v746: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:04.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:03 smithi104 ceph-mon[32987]: pgmap v747: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:04.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:03 smithi183 ceph-mon[33560]: pgmap v747: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:04.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:03 smithi100 ceph-mon[29745]: pgmap v747: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:05 smithi104 ceph-mon[32987]: pgmap v748: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:05 smithi183 ceph-mon[33560]: pgmap v748: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:06.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:05 smithi100 ceph-mon[29745]: pgmap v748: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:08.303 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:07 smithi104 ceph-mon[32987]: pgmap v749: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:08.304 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:07 smithi183 ceph-mon[33560]: pgmap v749: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:08.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:07 smithi100 ceph-mon[29745]: pgmap v749: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:09 smithi104 ceph-mon[32987]: pgmap v750: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:10.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:09 smithi183 ceph-mon[33560]: pgmap v750: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:10.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:09 smithi100 ceph-mon[29745]: pgmap v750: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:11 smithi104 ceph-mon[32987]: pgmap v751: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:11 smithi183 ceph-mon[33560]: pgmap v751: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:12.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:11 smithi100 ceph-mon[29745]: pgmap v751: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:14.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:13 smithi104 ceph-mon[32987]: pgmap v752: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:14.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:13 smithi183 ceph-mon[33560]: pgmap v752: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:14.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:13 smithi100 ceph-mon[29745]: pgmap v752: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:15 smithi104 ceph-mon[32987]: pgmap v753: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:26:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:15 smithi183 ceph-mon[33560]: pgmap v753: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:26:16.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:15 smithi100 ceph-mon[29745]: pgmap v753: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:26:18.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:17 smithi104 ceph-mon[32987]: pgmap v754: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:26:18.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:17 smithi183 ceph-mon[33560]: pgmap v754: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:26:18.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:26:18.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:26:18.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:17 smithi100 ceph-mon[29745]: pgmap v754: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:26:18.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 -- 172.21.15.100:0/1056839931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f81098d0 msgr2=0x7f17f810bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/1056839931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f81098d0 0x7f17f810bcf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009900 tx=0x7f17e802a410 comp rx=0 tx=0).stop 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 -- 172.21.15.100:0/1056839931 shutdown_connections 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/1056839931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f81098d0 0x7f17f810bcf0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/1056839931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8106f70 0x7f17f8109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/1056839931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f8104610 0x7f17f8106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 -- 172.21.15.100:0/1056839931 >> 172.21.15.100:0/1056839931 conn(0x7f17f80fdc10 msgr2=0x7f17f81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 -- 172.21.15.100:0/1056839931 shutdown_connections 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.435+0000 7f17fd1ce640 1 -- 172.21.15.100:0/1056839931 wait complete. 2024-04-30T23:26:18.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 Processor -- start 2024-04-30T23:26:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 -- start start 2024-04-30T23:26:18.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8104610 0x7f17f819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f81098d0 0x7f17f81a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810f650 con 0x7f17f8106f70 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810f4d0 con 0x7f17f81098d0 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.436+0000 7f17fd1ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810f7d0 con 0x7f17f8104610 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60154/0 (socket says 172.21.15.100:60154) 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 -- 172.21.15.100:0/2921013838 learned_addr learned my addr 172.21.15.100:0/2921013838 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8104610 0x7f17f819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f759e640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f81098d0 0x7f17f81a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 -- 172.21.15.100:0/2921013838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8104610 msgr2=0x7f17f819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8104610 0x7f17f819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 -- 172.21.15.100:0/2921013838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f81098d0 msgr2=0x7f17f81a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f81098d0 0x7f17f81a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 -- 172.21.15.100:0/2921013838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f81a20c0 con 0x7f17f8106f70 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17f659c640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d770 tx=0x7f17ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17dffff640 1 -- 172.21.15.100:0/2921013838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec017070 con 0x7f17f8106f70 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f81a23b0 con 0x7f17f8106f70 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17dffff640 1 -- 172.21.15.100:0/2921013838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17ec0054d0 con 0x7f17f8106f70 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17dffff640 1 -- 172.21.15.100:0/2921013838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec004c30 con 0x7f17f8106f70 2024-04-30T23:26:18.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.437+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f81a2900 con 0x7f17f8106f70 2024-04-30T23:26:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f17dffff640 1 -- 172.21.15.100:0/2921013838 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f17ec004e10 con 0x7f17f8106f70 2024-04-30T23:26:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 Processor -- start 2024-04-30T23:26:18.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 -- start start 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc1704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc170a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562fdc087b10 con 0x562fdbdad6b0 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562fdc0d4d80 con 0x562fdbda54d0 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f1804083740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562fdc08e8b0 con 0x562fdbdce390 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f17dffff640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 0x7f17e00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.440+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60162/0 (socket says 172.21.15.100:60162) 2024-04-30T23:26:18.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 -- 172.21.15.100:0/2947709188 learned_addr learned my addr 172.21.15.100:0/2947709188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f759e640 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc1704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f759e640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 0x7f17e00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc170a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17dffff640 1 -- 172.21.15.100:0/2921013838 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f17ec0d0220 con 0x7f17f8106f70 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 -- 172.21.15.100:0/2947709188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 msgr2=0x562fdc1704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc1704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 -- 172.21.15.100:0/2947709188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 msgr2=0x562fdc170a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc170a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 -- 172.21.15.100:0/2947709188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fdc05fa40 con 0x562fdbdad6b0 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f759e640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 0x7f17e00a60c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031440 tx=0x7f17e80056d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17f659c640 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d740 tx=0x7f17ec01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299e1a756f3e7474 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17dd7fa640 1 -- 172.21.15.100:0/2947709188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec020070 con 0x562fdbdad6b0 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17dd7fa640 1 -- 172.21.15.100:0/2947709188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17ec09c1a0 con 0x562fdbdad6b0 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.441+0000 7f17dd7fa640 1 -- 172.21.15.100:0/2947709188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec098810 con 0x562fdbdad6b0 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- 172.21.15.100:0/2947709188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 msgr2=0x562fdc171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d740 tx=0x7f17ec01e000 comp rx=0 tx=0).stop 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- 172.21.15.100:0/2947709188 shutdown_connections 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc171700 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc170a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 --2- 172.21.15.100:0/2947709188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc1704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- 172.21.15.100:0/2947709188 >> 172.21.15.100:0/2947709188 conn(0x562fdbdc24e0 msgr2=0x562fdc16bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- 172.21.15.100:0/2947709188 shutdown_connections 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- 172.21.15.100:0/2947709188 wait complete. 2024-04-30T23:26:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.442+0000 7f1804083740 1 -- start start 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 Processor -- start 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc17a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc181710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562fdc05bd10 con 0x562fdbdad6b0 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562fdc0d0d40 con 0x562fdbda54d0 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562fdc1721b0 con 0x562fdbdce390 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f1804083740 10 client.0 _ll_register_callbacks cb 0x562fdc0e1d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60164/0 (socket says 172.21.15.100:60164) 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 -- 172.21.15.100:0/1007564559 learned_addr learned my addr 172.21.15.100:0/1007564559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f759e640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc181710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc17a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 -- 172.21.15.100:0/1007564559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 msgr2=0x562fdc181710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc181710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 -- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 msgr2=0x562fdc17a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc17a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 -- 172.21.15.100:0/1007564559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fdbeb07d0 con 0x562fdbdad6b0 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc17a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:26:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17f659c640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f17ec09bea0 tx=0x7f17ec0984b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f165e92aedf60c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.443+0000 7f17daff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec020040 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f17ec09c400 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fdc0e2990 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f17ec0a0550 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 10 client.16824 fetch_fsmap learned FSMap version 51 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562fdbde63f0 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562fdc0e2990 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f17ec097ef0 con 0x562fdbdad6b0 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 10 client.16824 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:26:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 20 client.16824 populate_metadata read hostname 'smithi100' 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbd8cf60 0x562fdc1877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 4 client.16824 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.444+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fdc0dc800 con 0x562fdbd8cf60 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.445+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbd8cf60 0x562fdc1877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.445+0000 7f17daff5640 10 client.16824 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.445+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbd8cf60 0x562fdc1877d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9658ae4dd6d6b24f server_cookie=fd31ec963c833cdb in_seq=0 out_seq=0 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f17daff5640 1 -- 172.21.15.100:0/1007564559 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562fdc0dc800 con 0x562fdbd8cf60 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f17daff5640 10 client.16824 handle_command_reply: tid=0 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 client.16824 shutdown 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 msgr2=0x562fdc17a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f17ec09bea0 tx=0x7f17ec0984b0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 shutdown_connections 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbd8cf60 0x562fdc1877d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdce390 0x562fdc181710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f17daff5640 0 client.16824 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc17a820 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 --2- 172.21.15.100:0/1007564559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbda54d0 0x562fdc17a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 >> 172.21.15.100:0/1007564559 conn(0x562fdbdc24e0 msgr2=0x562fdc16aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 shutdown_connections 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 1 -- 172.21.15.100:0/1007564559 wait complete. 2024-04-30T23:26:18.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.446+0000 7f1804083740 20 client.16824 trim_cache size 0 max 16384 2024-04-30T23:26:18.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 Processor -- start 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 -- start start 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc16b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 0x562fdc181630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81ac8c0 con 0x562fdbdad6b0 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81ae400 con 0x562fdbd8cf60 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f1804083740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81acf90 con 0x562fdbda54d0 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60172/0 (socket says 172.21.15.100:60172) 2024-04-30T23:26:18.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 -- 172.21.15.100:0/1459082739 learned_addr learned my addr 172.21.15.100:0/1459082739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc16b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f659c640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 0x562fdc181630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 -- 172.21.15.100:0/1459082739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 msgr2=0x562fdc181630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 0x562fdc181630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 -- 172.21.15.100:0/1459082739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 msgr2=0x562fdc16b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc16b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 -- 172.21.15.100:0/1459082739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fdbda60f0 con 0x562fdbdad6b0 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f659c640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 0x562fdc181630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.464+0000 7f17f759e640 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098d0 tx=0x7f17e803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9565848fa23024c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f17dcff9640 1 -- 172.21.15.100:0/1459082739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8035040 con 0x562fdbdad6b0 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f17dcff9640 1 -- 172.21.15.100:0/1459082739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e8003aa0 con 0x562fdbdad6b0 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f17dcff9640 1 -- 172.21.15.100:0/1459082739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e803da40 con 0x562fdbdad6b0 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 -- 172.21.15.100:0/1459082739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 msgr2=0x562fdc16bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098d0 tx=0x7f17e803d000 comp rx=0 tx=0).stop 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 -- 172.21.15.100:0/1459082739 shutdown_connections 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbdad6b0 0x562fdc16bb30 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbda54d0 0x562fdc181630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 --2- 172.21.15.100:0/1459082739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc16b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 -- 172.21.15.100:0/1459082739 >> 172.21.15.100:0/1459082739 conn(0x562fdbdc24e0 msgr2=0x562fdc178900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 -- 172.21.15.100:0/1459082739 shutdown_connections 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.465+0000 7f1804083740 1 -- 172.21.15.100:0/1459082739 wait complete. 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 -- start start 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 Processor -- start 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc17e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdad6b0 0x562fdc17fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81add30 con 0x562fdbda54d0 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81ad660 con 0x562fdbd8cf60 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81aa8a0 con 0x562fdbdad6b0 2024-04-30T23:26:18.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f1804083740 10 client.0 _ll_register_callbacks cb 0x7f17ec0d0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60178/0 (socket says 172.21.15.100:60178) 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 -- 172.21.15.100:0/1765380427 learned_addr learned my addr 172.21.15.100:0/1765380427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f759e640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdad6b0 0x562fdc17fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc17e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 -- 172.21.15.100:0/1765380427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdad6b0 msgr2=0x562fdc17fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdad6b0 0x562fdc17fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 -- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 msgr2=0x562fdc17e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc17e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f659c640 1 -- 172.21.15.100:0/1765380427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fdc0954b0 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.466+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc17e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17f659c640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f17ec09c360 tx=0x7f17ec0a0400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b679c0930f1634 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec020040 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f17ec09c400 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e8003aa0 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f17ec09c8a0 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 10 client.16830 fetch_fsmap learned FSMap version 51 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562fdc181190 con 0x562fdbda54d0 2024-04-30T23:26:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e8003aa0 con 0x562fdbda54d0 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f17ec0a1770 con 0x562fdbda54d0 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 10 client.16830 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 20 client.16830 populate_metadata read hostname 'smithi100' 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbdce390 0x562fdc1ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 4 client.16830 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562fdc0574a0 con 0x562fdbdce390 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.467+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbdce390 0x562fdc1ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f17f6d9d640 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbdce390 0x562fdc1ef7f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242745a18bfc6d91 server_cookie=4d1f24f8baed2f09 in_seq=0 out_seq=0 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f17daff5640 10 client.16830 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f17daff5640 1 -- 172.21.15.100:0/1765380427 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x562fdc0574a0 con 0x562fdbdce390 2024-04-30T23:26:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f17daff5640 10 client.16830 handle_command_reply: tid=0 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 client.16830 shutdown 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 msgr2=0x562fdc17ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f17ec09c360 tx=0x7f17ec0a0400 comp rx=0 tx=0).stop 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 shutdown_connections 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562fdbdce390 0x562fdc1ef7f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fdbdad6b0 0x562fdc17fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fdbda54d0 0x562fdc17ece0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 --2- 172.21.15.100:0/1765380427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562fdbd8cf60 0x562fdc17e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f17daff5640 0 client.16830 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 >> 172.21.15.100:0/1765380427 conn(0x562fdbdc24e0 msgr2=0x562fdc16b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 shutdown_connections 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 1 -- 172.21.15.100:0/1765380427 wait complete. 2024-04-30T23:26:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.468+0000 7f1804083740 20 client.16830 trim_cache size 0 max 16384 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:26:18.482 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:26:18.483 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.484 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:26:18.485 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:18.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:18.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:18.487 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:26:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 msgr2=0x7f17e00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 0x7f17e00a60c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031440 tx=0x7f17e80056d0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 msgr2=0x7f17f819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d770 tx=0x7f17ec00dc30 comp rx=0 tx=0).stop 2024-04-30T23:26:18.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 shutdown_connections 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f17e00a3bb0 0x7f17e00a60c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17f81098d0 0x7f17f81a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17f8106f70 0x7f17f819aac0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 --2- 172.21.15.100:0/2921013838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f8104610 0x7f17f819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 >> 172.21.15.100:0/2921013838 conn(0x7f17f80fdc10 msgr2=0x7f17f8105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 shutdown_connections 2024-04-30T23:26:18.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:18.469+0000 7f17fd1ce640 1 -- 172.21.15.100:0/2921013838 wait complete. 2024-04-30T23:26:18.489 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:26:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:19 smithi104 ceph-mon[32987]: pgmap v755: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:19 smithi183 ceph-mon[33560]: pgmap v755: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:20.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:19 smithi100 ceph-mon[29745]: pgmap v755: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:26:22.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:21 smithi104 ceph-mon[32987]: pgmap v756: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:22.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:21 smithi183 ceph-mon[33560]: pgmap v756: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:21 smithi100 ceph-mon[29745]: pgmap v756: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:26:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:23 smithi104 ceph-mon[32987]: pgmap v757: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:23 smithi183 ceph-mon[33560]: pgmap v757: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:24.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:23 smithi100 ceph-mon[29745]: pgmap v757: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:25 smithi104 ceph-mon[32987]: pgmap v758: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:25 smithi183 ceph-mon[33560]: pgmap v758: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:25 smithi100 ceph-mon[29745]: pgmap v758: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:27 smithi104 ceph-mon[32987]: pgmap v759: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:27 smithi183 ceph-mon[33560]: pgmap v759: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:28.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:27 smithi100 ceph-mon[29745]: pgmap v759: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:29 smithi104 ceph-mon[32987]: pgmap v760: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:29 smithi183 ceph-mon[33560]: pgmap v760: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:30.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:29 smithi100 ceph-mon[29745]: pgmap v760: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:31 smithi104 ceph-mon[32987]: pgmap v761: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:31 smithi183 ceph-mon[33560]: pgmap v761: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:32.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:31 smithi100 ceph-mon[29745]: pgmap v761: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:33 smithi104 ceph-mon[32987]: pgmap v762: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:33 smithi183 ceph-mon[33560]: pgmap v762: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:34.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:33 smithi100 ceph-mon[29745]: pgmap v762: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:35 smithi104 ceph-mon[32987]: pgmap v763: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:35 smithi183 ceph-mon[33560]: pgmap v763: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:36.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:35 smithi100 ceph-mon[29745]: pgmap v763: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:37 smithi104 ceph-mon[32987]: pgmap v764: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:37 smithi183 ceph-mon[33560]: pgmap v764: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:38.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:37 smithi100 ceph-mon[29745]: pgmap v764: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:39 smithi104 ceph-mon[32987]: pgmap v765: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:39 smithi183 ceph-mon[33560]: pgmap v765: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:40.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:39 smithi100 ceph-mon[29745]: pgmap v765: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:41 smithi104 ceph-mon[32987]: pgmap v766: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:41 smithi183 ceph-mon[33560]: pgmap v766: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:42.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:41 smithi100 ceph-mon[29745]: pgmap v766: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:43 smithi104 ceph-mon[32987]: pgmap v767: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:44.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:43 smithi183 ceph-mon[33560]: pgmap v767: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:44.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:43 smithi100 ceph-mon[29745]: pgmap v767: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:46.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:45 smithi104 ceph-mon[32987]: pgmap v768: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:45 smithi183 ceph-mon[33560]: pgmap v768: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:46.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:45 smithi100 ceph-mon[29745]: pgmap v768: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:47 smithi104 ceph-mon[32987]: pgmap v769: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:47 smithi183 ceph-mon[33560]: pgmap v769: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:48.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:47 smithi100 ceph-mon[29745]: pgmap v769: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:26:48.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:26:48.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 -- 172.21.15.100:0/1816210726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 msgr2=0x7fe5b810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1816210726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b810bce0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009ca0 tx=0x7fe5b002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 -- 172.21.15.100:0/1816210726 shutdown_connections 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1816210726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b810bce0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1816210726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b8101780 0x7fe5b8101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1816210726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b81050d0 0x7fe5b81054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 -- 172.21.15.100:0/1816210726 >> 172.21.15.100:0/1816210726 conn(0x7fe5b80fd380 msgr2=0x7fe5b80ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 -- 172.21.15.100:0/1816210726 shutdown_connections 2024-04-30T23:26:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 -- 172.21.15.100:0/1816210726 wait complete. 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.612+0000 7fe5bd372640 1 Processor -- start 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 -- start start 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b8101780 0x7fe5b819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b81050d0 0x7fe5b81a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f660 con 0x7fe5b8102280 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f4e0 con 0x7fe5b81050d0 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5bd372640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f7e0 con 0x7fe5b8101780 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59402/0 (socket says 172.21.15.100:59402) 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 -- 172.21.15.100:0/1082477702 learned_addr learned my addr 172.21.15.100:0/1082477702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:48.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b8101780 0x7fe5b819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b81050d0 0x7fe5b81a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 -- 172.21.15.100:0/1082477702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b8101780 msgr2=0x7fe5b819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b8101780 0x7fe5b819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 -- 172.21.15.100:0/1082477702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b81050d0 msgr2=0x7fe5b81a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b81050d0 0x7fe5b81a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.613+0000 7fe5ae7fc640 1 -- 172.21.15.100:0/1082477702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81a1d20 con 0x7fe5b8102280 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000d950 tx=0x7fe5a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5b4ff9640 1 -- 172.21.15.100:0/1082477702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0017070 con 0x7fe5b8102280 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5b4ff9640 1 -- 172.21.15.100:0/1082477702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a0009c30 con 0x7fe5b8102280 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b81a1fb0 con 0x7fe5b8102280 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5b4ff9640 1 -- 172.21.15.100:0/1082477702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000f620 con 0x7fe5b8102280 2024-04-30T23:26:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.614+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b81a24a0 con 0x7fe5b8102280 2024-04-30T23:26:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.616+0000 7fe5b4ff9640 1 -- 172.21.15.100:0/1082477702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fe5a0010460 con 0x7fe5b8102280 2024-04-30T23:26:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.616+0000 7fe5c4227740 1 Processor -- start 2024-04-30T23:26:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.616+0000 7fe5c4227740 1 -- start start 2024-04-30T23:26:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 0x55a5ac0ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a5ac004b10 con 0x55a5abd224d0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5ac051d80 con 0x55a5abd2a6b0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5c4227740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a5ac00b8b0 con 0x55a5abd4b390 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59410/0 (socket says 172.21.15.100:59410) 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/2481257755 learned_addr learned my addr 172.21.15.100:0/2481257755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b4ff9640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 0x7fe5a40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 0x55a5ac0ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 0x7fe5a40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/2481257755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 msgr2=0x55a5ac0ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 0x55a5ac0ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/2481257755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 msgr2=0x55a5ac0ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/2481257755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5abfdca40 con 0x55a5abd224d0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 0x55a5ac0ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b4ff9640 1 -- 172.21.15.100:0/1082477702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe5a00d0390 con 0x7fe5b8102280 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.617+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800bc70 tx=0x7fe5a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0c068da2d7af31 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.618+0000 7fe5ad7fa640 1 -- 172.21.15.100:0/2481257755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a801c680 con 0x55a5abd224d0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.618+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 0x7fe5a40a60c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55a5ac0ee540 tx=0x7fe5b00095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.618+0000 7fe5ad7fa640 1 -- 172.21.15.100:0/2481257755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a800be20 con 0x55a5abd224d0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.618+0000 7fe5ad7fa640 1 -- 172.21.15.100:0/2481257755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011b20 con 0x55a5abd224d0 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- 172.21.15.100:0/2481257755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 msgr2=0x55a5ac0eda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800bc70 tx=0x7fe5a80107a0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- 172.21.15.100:0/2481257755 shutdown_connections 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0eda70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- 172.21.15.100:0/2481257755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd4b390 0x55a5ac0ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- 172.21.15.100:0/2481257755 >> 172.21.15.100:0/2481257755 conn(0x55a5abd3f4e0 msgr2=0x55a5ac0e8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- 172.21.15.100:0/2481257755 shutdown_connections 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- 172.21.15.100:0/2481257755 wait complete. 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- start start 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 Processor -- start 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd224d0 0x55a5ac0f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0f7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a5abfd8d10 con 0x55a5abd4b390 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5ac04dd40 con 0x55a5abd2a6b0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a5ac0ef210 con 0x55a5abd224d0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.619+0000 7fe5c4227740 10 client.0 _ll_register_callbacks cb 0x55a5ac05ed20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59426/0 (socket says 172.21.15.100:59426) 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 -- 172.21.15.100:0/175277583 learned_addr learned my addr 172.21.15.100:0/175277583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd224d0 0x55a5ac0f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 -- 172.21.15.100:0/175277583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd224d0 msgr2=0x55a5ac0f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd224d0 0x55a5ac0f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 -- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 msgr2=0x55a5ac0f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 -- 172.21.15.100:0/175277583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5abe2d7d0 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0035000 tx=0x7fe5b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8935297ddd9f263 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe59e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0004620 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe5b00047c0 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a800be20 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fe5b002f660 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5c4227740 10 client.16842 fetch_fsmap learned FSMap version 51 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.620+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55a5abd633f0 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a800be20 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fe5b00309e0 con 0x55a5abd4b390 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 10 client.16842 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 20 client.16842 populate_metadata read hostname 'smithi100' 2024-04-30T23:26:48.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abd09f60 0x55a5ac104c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 4 client.16842 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ac05f990 con 0x55a5abd09f60 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.621+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abd09f60 0x55a5ac104c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe59e7fc640 10 client.16842 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abd09f60 0x55a5ac104c90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=411a7235da17ad57 server_cookie=25962cbd364e4f7c in_seq=0 out_seq=0 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe59e7fc640 1 -- 172.21.15.100:0/175277583 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55a5ac05f990 con 0x55a5abd09f60 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe59e7fc640 10 client.16842 handle_command_reply: tid=0 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe5c4227740 1 client.16842 shutdown 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 msgr2=0x55a5ac0fe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.622+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0035000 tx=0x7fe5b0004a40 comp rx=0 tx=0).stop 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 shutdown_connections 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abd09f60 0x55a5ac104c90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe770 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe59e7fc640 0 client.16842 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 --2- 172.21.15.100:0/175277583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd224d0 0x55a5ac0f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 >> 172.21.15.100:0/175277583 conn(0x55a5abd3f4e0 msgr2=0x55a5ac0ebc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 shutdown_connections 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 1 -- 172.21.15.100:0/175277583 wait complete. 2024-04-30T23:26:48.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.623+0000 7fe5c4227740 20 client.16842 trim_cache size 0 max 16384 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.640+0000 7fe5c4227740 1 Processor -- start 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.640+0000 7fe5c4227740 1 -- start start 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.640+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.640+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac10a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5c4227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81ac910 con 0x55a5abd224d0 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5c4227740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81ae450 con 0x55a5abd4b390 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5c4227740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81acfe0 con 0x55a5abd2a6b0 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59442/0 (socket says 172.21.15.100:59442) 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/1762389058 learned_addr learned my addr 172.21.15.100:0/1762389058 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:48.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac10a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/1762389058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 msgr2=0x55a5ac0ec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ec750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/1762389058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 msgr2=0x55a5ac10a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac10a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/1762389058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5abd230f0 con 0x55a5abd224d0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x55a5ac0ed210 tx=0x7fe5a8005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831909afb533ed3f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5acff9640 1 -- 172.21.15.100:0/1762389058 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8031070 con 0x55a5abd224d0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5acff9640 1 -- 172.21.15.100:0/1762389058 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a80116f0 con 0x55a5abd224d0 2024-04-30T23:26:48.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.641+0000 7fe5acff9640 1 -- 172.21.15.100:0/1762389058 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80048a0 con 0x55a5abd224d0 2024-04-30T23:26:48.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- 172.21.15.100:0/1762389058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 msgr2=0x55a5ac0ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x55a5ac0ed210 tx=0x7fe5a8005f30 comp rx=0 tx=0).stop 2024-04-30T23:26:48.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- 172.21.15.100:0/1762389058 shutdown_connections 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 --2- 172.21.15.100:0/1762389058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0ec210 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- 172.21.15.100:0/1762389058 >> 172.21.15.100:0/1762389058 conn(0x55a5abd3f4e0 msgr2=0x55a5ac0ebb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- 172.21.15.100:0/1762389058 shutdown_connections 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- 172.21.15.100:0/1762389058 wait complete. 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.642+0000 7fe5c4227740 1 -- start start 2024-04-30T23:26:48.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 Processor -- start 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81add80 con 0x55a5abd224d0 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81ad6b0 con 0x55a5abd4b390 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81aa8f0 con 0x55a5abd2a6b0 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 10 client.0 _ll_register_callbacks cb 0x7fe5b0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59446/0 (socket says 172.21.15.100:59446) 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/3728622475 learned_addr learned my addr 172.21.15.100:0/3728622475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/3728622475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 msgr2=0x55a5ac0fdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 msgr2=0x55a5ac0fe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 -- 172.21.15.100:0/3728622475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ac0124b0 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b77fe640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5b6ffd640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8010e80 tx=0x7fe5a8011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4d521f3f634e12 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe59e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8031040 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fe5a8011b60 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.643+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a80116f0 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8045050 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 10 client.16848 fetch_fsmap learned FSMap version 51 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55a5ac16a030 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a80116f0 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fe5a8004b40 con 0x55a5abd224d0 2024-04-30T23:26:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 10 client.16848 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 20 client.16848 populate_metadata read hostname 'smithi100' 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abcdf3a0 0x55a5ac16c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 4 client.16848 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5ac059800 con 0x55a5abcdf3a0 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.644+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abcdf3a0 0x55a5ac16c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe59e7fc640 10 client.16848 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5ae7fc640 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abcdf3a0 0x55a5ac16c770 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f42cc4157d54336 server_cookie=9901d033a8133386 in_seq=0 out_seq=0 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe59e7fc640 1 -- 172.21.15.100:0/3728622475 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55a5ac059800 con 0x55a5abcdf3a0 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe59e7fc640 10 client.16848 handle_command_reply: tid=0 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 client.16848 shutdown 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 msgr2=0x55a5ac0fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8010e80 tx=0x7fe5a8011670 comp rx=0 tx=0).stop 2024-04-30T23:26:48.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 shutdown_connections 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55a5abcdf3a0 0x55a5ac16c770 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5abd4b390 0x55a5ac0fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a5abd2a6b0 0x55a5ac0fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 --2- 172.21.15.100:0/3728622475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5abd224d0 0x55a5ac0fd850 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe59e7fc640 0 client.16848 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 >> 172.21.15.100:0/3728622475 conn(0x55a5abd3f4e0 msgr2=0x55a5ac0ec530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 shutdown_connections 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 1 -- 172.21.15.100:0/3728622475 wait complete. 2024-04-30T23:26:48.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.645+0000 7fe5c4227740 20 client.16848 trim_cache size 0 max 16384 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:26:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.656 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:26:48.658 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:26:48.659 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:26:48.659 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:48.659 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:26:48.659 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 msgr2=0x7fe5a40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 0x7fe5a40a60c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55a5ac0ee540 tx=0x7fe5b00095c0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 msgr2=0x7fe5b819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000d950 tx=0x7fe5a000de10 comp rx=0 tx=0).stop 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 shutdown_connections 2024-04-30T23:26:48.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fe5a40a3bb0 0x7fe5a40a60c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5b81050d0 0x7fe5b81a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5b8102280 0x7fe5b819a720 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 --2- 172.21.15.100:0/1082477702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b8101780 0x7fe5b819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 >> 172.21.15.100:0/1082477702 conn(0x7fe5b80fd380 msgr2=0x7fe5b8107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 shutdown_connections 2024-04-30T23:26:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:26:48.646+0000 7fe5bd372640 1 -- 172.21.15.100:0/1082477702 wait complete. 2024-04-30T23:26:48.661 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:26:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:49 smithi104 ceph-mon[32987]: pgmap v770: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:49 smithi183 ceph-mon[33560]: pgmap v770: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:50.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:49 smithi100 ceph-mon[29745]: pgmap v770: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:51 smithi104 ceph-mon[32987]: pgmap v771: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:51 smithi183 ceph-mon[33560]: pgmap v771: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:52.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:51 smithi100 ceph-mon[29745]: pgmap v771: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:26:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:54 smithi104 ceph-mon[32987]: pgmap v772: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:54 smithi183 ceph-mon[33560]: pgmap v772: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:55.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:54 smithi100 ceph-mon[29745]: pgmap v772: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:26:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:26:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:26:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:26:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:55 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:26:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:26:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:26:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:26:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:55 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:26:56.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:26:56.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:26:56.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:26:56.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:55 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:26:58.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:57 smithi104 ceph-mon[32987]: pgmap v773: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:58.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:57 smithi183 ceph-mon[33560]: pgmap v773: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:26:58.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:57 smithi100 ceph-mon[29745]: pgmap v773: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:00.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:26:59 smithi104 ceph-mon[32987]: pgmap v774: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:00.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:26:59 smithi183 ceph-mon[33560]: pgmap v774: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:00.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:26:59 smithi100 ceph-mon[29745]: pgmap v774: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:02.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:01 smithi104 ceph-mon[32987]: pgmap v775: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:02.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:01 smithi183 ceph-mon[33560]: pgmap v775: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:02.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:01 smithi100 ceph-mon[29745]: pgmap v775: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:04.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:03 smithi104 ceph-mon[32987]: pgmap v776: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:04.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:03 smithi183 ceph-mon[33560]: pgmap v776: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:04.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:03 smithi100 ceph-mon[29745]: pgmap v776: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:06.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:05 smithi104 ceph-mon[32987]: pgmap v777: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:06.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:05 smithi183 ceph-mon[33560]: pgmap v777: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:06.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:05 smithi100 ceph-mon[29745]: pgmap v777: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:08.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:07 smithi104 ceph-mon[32987]: pgmap v778: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:08.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:07 smithi183 ceph-mon[33560]: pgmap v778: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:08.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:07 smithi100 ceph-mon[29745]: pgmap v778: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:10.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:09 smithi104 ceph-mon[32987]: pgmap v779: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:10.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:09 smithi183 ceph-mon[33560]: pgmap v779: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:10.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:09 smithi100 ceph-mon[29745]: pgmap v779: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:12.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:11 smithi104 ceph-mon[32987]: pgmap v780: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:12.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:11 smithi183 ceph-mon[33560]: pgmap v780: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:12.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:11 smithi100 ceph-mon[29745]: pgmap v780: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:14.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:13 smithi104 ceph-mon[32987]: pgmap v781: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:14.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:13 smithi183 ceph-mon[33560]: pgmap v781: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:13 smithi100 ceph-mon[29745]: pgmap v781: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:16.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:15 smithi104 ceph-mon[32987]: pgmap v782: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:16.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:15 smithi183 ceph-mon[33560]: pgmap v782: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:15 smithi100 ceph-mon[29745]: pgmap v782: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:18.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:17 smithi104 ceph-mon[32987]: pgmap v783: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:18.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:17 smithi183 ceph-mon[33560]: pgmap v783: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:18.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:17 smithi100 ceph-mon[29745]: pgmap v783: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:18.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:27:18.663 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:27:18.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 -- 172.21.15.100:0/315988231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 msgr2=0x7f484810be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 --2- 172.21.15.100:0/315988231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f484810be90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4840009ca0 tx=0x7f484002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 -- 172.21.15.100:0/315988231 shutdown_connections 2024-04-30T23:27:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 --2- 172.21.15.100:0/315988231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f484810be90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 --2- 172.21.15.100:0/315988231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 0x7f4848105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 --2- 172.21.15.100:0/315988231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f4848104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 -- 172.21.15.100:0/315988231 >> 172.21.15.100:0/315988231 conn(0x7f48480fed20 msgr2=0x7f48481011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 -- 172.21.15.100:0/315988231 shutdown_connections 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.784+0000 7f484e643640 1 -- 172.21.15.100:0/315988231 wait complete. 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 Processor -- start 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 -- start start 2024-04-30T23:27:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f484819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 0x7f484819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4848076a10 con 0x7f4848109a70 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4848076890 con 0x7f4848104d70 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.785+0000 7f484e643640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4848076b90 con 0x7f4848103b30 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45478/0 (socket says 172.21.15.100:45478) 2024-04-30T23:27:18.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 -- 172.21.15.100:0/1252805338 learned_addr learned my addr 172.21.15.100:0/1252805338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f48477fe640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 0x7f484819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f4847fff640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f484819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 -- 172.21.15.100:0/1252805338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 msgr2=0x7f484819c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f484819c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 -- 172.21.15.100:0/1252805338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 msgr2=0x7f484819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 0x7f484819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 -- 172.21.15.100:0/1252805338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481a3fa0 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f4847fff640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f484819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484cbe0640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f48400097b0 tx=0x7f4840003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f48457fa640 1 -- 172.21.15.100:0/1252805338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840004240 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48481a4230 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f48457fa640 1 -- 172.21.15.100:0/1252805338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484002f380 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f48457fa640 1 -- 172.21.15.100:0/1252805338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484002fc30 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.786+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a4780 con 0x7f4848109a70 2024-04-30T23:27:18.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.789+0000 7f48555d0740 1 Processor -- start 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.789+0000 7f48457fa640 1 -- 172.21.15.100:0/1252805338 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f48400043e0 con 0x7f4848109a70 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.789+0000 7f48555d0740 1 -- start start 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae47124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae4712a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eae4629b10 con 0x55eae434f6b0 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eae4676d80 con 0x55eae4370390 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48555d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55eae46308b0 con 0x55eae43474d0 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45490/0 (socket says 172.21.15.100:45490) 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 -- 172.21.15.100:0/1114350196 learned_addr learned my addr 172.21.15.100:0/1114350196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48457fa640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 0x7f48300a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f4847fff640 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae4712a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae47124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f484cbe0640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 0x7f48300a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 -- 172.21.15.100:0/1114350196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 msgr2=0x55eae4712a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae4712a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 -- 172.21.15.100:0/1114350196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 msgr2=0x55eae47124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae47124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 -- 172.21.15.100:0/1114350196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae4601a40 con 0x55eae434f6b0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48457fa640 1 -- 172.21.15.100:0/1252805338 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f48400f1eb0 con 0x7f4848109a70 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.790+0000 7f48477fe640 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f483c011710 tx=0x7f483c00a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace5a1f57c443001 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f482e7fc640 1 -- 172.21.15.100:0/1114350196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c004020 con 0x55eae434f6b0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f484cbe0640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 0x7f48300a60c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f48400ba770 tx=0x7f4840088040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f482e7fc640 1 -- 172.21.15.100:0/1114350196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f483c00fe80 con 0x55eae434f6b0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f482e7fc640 1 -- 172.21.15.100:0/1114350196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c0053a0 con 0x55eae434f6b0 2024-04-30T23:27:18.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 -- 172.21.15.100:0/1114350196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 msgr2=0x55eae4713700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f483c011710 tx=0x7f483c00a770 comp rx=0 tx=0).stop 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 -- 172.21.15.100:0/1114350196 shutdown_connections 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4713700 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae4712a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 --2- 172.21.15.100:0/1114350196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae47124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 -- 172.21.15.100:0/1114350196 >> 172.21.15.100:0/1114350196 conn(0x55eae43644e0 msgr2=0x55eae470dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 -- 172.21.15.100:0/1114350196 shutdown_connections 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.791+0000 7f48555d0740 1 -- 172.21.15.100:0/1114350196 wait complete. 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 -- start start 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 Processor -- start 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae471c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae434f6b0 0x55eae471c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eae45fdd10 con 0x55eae4370390 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eae4672d40 con 0x55eae434f6b0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55eae4714210 con 0x55eae43474d0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48555d0740 10 client.0 _ll_register_callbacks cb 0x55eae4683d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.792+0000 7f48477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45500/0 (socket says 172.21.15.100:45500) 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f4847fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae434f6b0 0x55eae471c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 -- 172.21.15.100:0/233328004 learned_addr learned my addr 172.21.15.100:0/233328004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae471c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 -- 172.21.15.100:0/233328004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 msgr2=0x55eae471c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae471c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 -- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae434f6b0 msgr2=0x55eae471c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae434f6b0 0x55eae471c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 -- 172.21.15.100:0/233328004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae44527d0 con 0x55eae4370390 2024-04-30T23:27:18.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48477fe640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f483c001eb0 tx=0x7f483c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1d7768329f6fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48277fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c0046c0 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f483c004860 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eae4684990 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f483c033050 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48555d0740 10 client.16860 fetch_fsmap learned FSMap version 51 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.793+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55eae43883f0 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55eae4684990 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f483c01ea70 con 0x55eae4370390 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 10 client.16860 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 10 client.16860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 20 client.16860 populate_metadata read hostname 'smithi100' 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae432ef60 0x55eae47299b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 4 client.16860 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:27:18.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eae467e800 con 0x55eae432ef60 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.794+0000 7f4847fff640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae432ef60 0x55eae47299b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48277fe640 10 client.16860 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f4847fff640 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae432ef60 0x55eae47299b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a517fa25fdf27785 server_cookie=45b83468ea122f77 in_seq=0 out_seq=0 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48277fe640 1 -- 172.21.15.100:0/233328004 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55eae467e800 con 0x55eae432ef60 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48277fe640 10 client.16860 handle_command_reply: tid=0 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48555d0740 1 client.16860 shutdown 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 msgr2=0x55eae4723750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.795+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f483c001eb0 tx=0x7f483c00a620 comp rx=0 tx=0).stop 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 shutdown_connections 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae432ef60 0x55eae47299b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae4370390 0x55eae4723750 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae434f6b0 0x55eae471c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 --2- 172.21.15.100:0/233328004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae471c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48277fe640 0 client.16860 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:18.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 >> 172.21.15.100:0/233328004 conn(0x55eae43644e0 msgr2=0x55eae4710c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 shutdown_connections 2024-04-30T23:27:18.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 1 -- 172.21.15.100:0/233328004 wait complete. 2024-04-30T23:27:18.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.796+0000 7f48555d0740 20 client.16860 trim_cache size 0 max 16384 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 Processor -- start 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 -- start start 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae470d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae470dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48481aeb20 con 0x55eae434f6b0 2024-04-30T23:27:18.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b0660 con 0x55eae4370390 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f48555d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48481af1f0 con 0x55eae43474d0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.813+0000 7f4847fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45502/0 (socket says 172.21.15.100:45502) 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 -- 172.21.15.100:0/2374928093 learned_addr learned my addr 172.21.15.100:0/2374928093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f48477fe640 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae470dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f48477fe640 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae470d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 -- 172.21.15.100:0/2374928093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 msgr2=0x55eae470d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae470d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 -- 172.21.15.100:0/2374928093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 msgr2=0x55eae470dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae470dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 -- 172.21.15.100:0/2374928093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eae43480f0 con 0x55eae434f6b0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f4847fff640 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4838005fd0 tx=0x7f48380139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee54ad283942959 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f482dffb640 1 -- 172.21.15.100:0/2374928093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838023070 con 0x55eae434f6b0 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f482dffb640 1 -- 172.21.15.100:0/2374928093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f483801d530 con 0x55eae434f6b0 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.814+0000 7f482dffb640 1 -- 172.21.15.100:0/2374928093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838003a10 con 0x55eae434f6b0 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- 172.21.15.100:0/2374928093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 msgr2=0x55eae4723670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4838005fd0 tx=0x7f48380139a0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- 172.21.15.100:0/2374928093 shutdown_connections 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae4370390 0x55eae470dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4723670 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 --2- 172.21.15.100:0/2374928093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae43474d0 0x55eae470d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- 172.21.15.100:0/2374928093 >> 172.21.15.100:0/2374928093 conn(0x55eae43644e0 msgr2=0x55eae471a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- 172.21.15.100:0/2374928093 shutdown_connections 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- 172.21.15.100:0/2374928093 wait complete. 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 -- start start 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.815+0000 7f48555d0740 1 Processor -- start 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae43474d0 0x55eae47205b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 0x55eae478dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48481aff90 con 0x55eae434f6b0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f48481af8c0 con 0x55eae43474d0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48481acb00 con 0x55eae4370390 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 10 client.0 _ll_register_callbacks cb 0x7f483c00acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45506/0 (socket says 172.21.15.100:45506) 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 -- 172.21.15.100:0/3413730834 learned_addr learned my addr 172.21.15.100:0/3413730834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48477fe640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae43474d0 0x55eae47205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48477fe640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 0x55eae478dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 -- 172.21.15.100:0/3413730834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 msgr2=0x55eae478dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 0x55eae478dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 -- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae43474d0 msgr2=0x55eae47205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae43474d0 0x55eae47205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 -- 172.21.15.100:0/3413730834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eae46374b0 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48477fe640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 0x55eae478dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f4847fff640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4838013380 tx=0x7f48380133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3999eeb96ba8ac81 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48277fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483802c020 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4838028480 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f483801d530 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.816+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4838023040 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 10 client.16866 fetch_fsmap learned FSMap version 51 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55eae478f060 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f483801d530 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f4838010910 con 0x55eae434f6b0 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 10 client.16866 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:27:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 20 client.16866 populate_metadata read hostname 'smithi100' 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae43043a0 0x55eae4791a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 4 client.16866 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eae45f94a0 con 0x55eae43043a0 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48477fe640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae43043a0 0x55eae4791a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48477fe640 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae43043a0 0x55eae4791a70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=797bac0ce6cc279d server_cookie=e987857cda7f4ed0 in_seq=0 out_seq=0 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.817+0000 7f48277fe640 10 client.16866 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48277fe640 1 -- 172.21.15.100:0/3413730834 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55eae45f94a0 con 0x55eae43043a0 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48277fe640 10 client.16866 handle_command_reply: tid=0 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 client.16866 shutdown 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 msgr2=0x55eae4720af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4838013380 tx=0x7f48380133b0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 shutdown_connections 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55eae43043a0 0x55eae4791a70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55eae4370390 0x55eae478dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eae434f6b0 0x55eae4720af0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 --2- 172.21.15.100:0/3413730834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eae43474d0 0x55eae47205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 >> 172.21.15.100:0/3413730834 conn(0x55eae43644e0 msgr2=0x55eae4710b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48277fe640 0 client.16866 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 shutdown_connections 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 1 -- 172.21.15.100:0/3413730834 wait complete. 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.818+0000 7f48555d0740 20 client.16866 trim_cache size 0 max 16384 2024-04-30T23:27:18.827 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:27:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:18.831 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 msgr2=0x7f48300a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 0x7f48300a60c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f48400ba770 tx=0x7f4840088040 comp rx=0 tx=0).stop 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 msgr2=0x7f48481a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f48400097b0 tx=0x7f4840003c20 comp rx=0 tx=0).stop 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 shutdown_connections 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f48300a3bb0 0x7f48300a60c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4848109a70 0x7f48481a3930 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4848104d70 0x7f484819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 --2- 172.21.15.100:0/1252805338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4848103b30 0x7f484819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 >> 172.21.15.100:0/1252805338 conn(0x7f48480fed20 msgr2=0x7f4848101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 shutdown_connections 2024-04-30T23:27:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:18.819+0000 7f484e643640 1 -- 172.21.15.100:0/1252805338 wait complete. 2024-04-30T23:27:18.834 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:27:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:19 smithi104 ceph-mon[32987]: pgmap v784: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:19 smithi183 ceph-mon[33560]: pgmap v784: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:20.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:19 smithi100 ceph-mon[29745]: pgmap v784: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:21 smithi104 ceph-mon[32987]: pgmap v785: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:22.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:21 smithi183 ceph-mon[33560]: pgmap v785: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:22.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:21 smithi100 ceph-mon[29745]: pgmap v785: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:24.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:23 smithi104 ceph-mon[32987]: pgmap v786: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:23 smithi183 ceph-mon[33560]: pgmap v786: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:23 smithi100 ceph-mon[29745]: pgmap v786: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:27:26.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:25 smithi104 ceph-mon[32987]: pgmap v787: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:26.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:25 smithi183 ceph-mon[33560]: pgmap v787: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:26.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:25 smithi100 ceph-mon[29745]: pgmap v787: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:28.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:27 smithi104 ceph-mon[32987]: pgmap v788: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:28.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:27 smithi183 ceph-mon[33560]: pgmap v788: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:28.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:27 smithi100 ceph-mon[29745]: pgmap v788: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:30.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:29 smithi104 ceph-mon[32987]: pgmap v789: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:30.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:29 smithi183 ceph-mon[33560]: pgmap v789: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:30.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:29 smithi100 ceph-mon[29745]: pgmap v789: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:27:32.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:31 smithi104 ceph-mon[32987]: pgmap v790: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:32.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:31 smithi183 ceph-mon[33560]: pgmap v790: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:32.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:31 smithi100 ceph-mon[29745]: pgmap v790: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:34.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:33 smithi104 ceph-mon[32987]: pgmap v791: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:34.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:33 smithi183 ceph-mon[33560]: pgmap v791: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:34.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:33 smithi100 ceph-mon[29745]: pgmap v791: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:36.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:35 smithi104 ceph-mon[32987]: pgmap v792: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:36.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:35 smithi183 ceph-mon[33560]: pgmap v792: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:36.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:35 smithi100 ceph-mon[29745]: pgmap v792: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:38.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:37 smithi104 ceph-mon[32987]: pgmap v793: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:38.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:37 smithi183 ceph-mon[33560]: pgmap v793: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:38.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:37 smithi100 ceph-mon[29745]: pgmap v793: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:40.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:39 smithi104 ceph-mon[32987]: pgmap v794: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:40.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:39 smithi183 ceph-mon[33560]: pgmap v794: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:40.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:39 smithi100 ceph-mon[29745]: pgmap v794: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:42.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:41 smithi104 ceph-mon[32987]: pgmap v795: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:42.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:41 smithi183 ceph-mon[33560]: pgmap v795: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:42.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:41 smithi100 ceph-mon[29745]: pgmap v795: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:44.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:43 smithi104 ceph-mon[32987]: pgmap v796: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:44.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:43 smithi183 ceph-mon[33560]: pgmap v796: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:44.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:43 smithi100 ceph-mon[29745]: pgmap v796: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:46.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:45 smithi104 ceph-mon[32987]: pgmap v797: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:46.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:45 smithi183 ceph-mon[33560]: pgmap v797: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:46.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:45 smithi100 ceph-mon[29745]: pgmap v797: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:48.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:47 smithi104 ceph-mon[32987]: pgmap v798: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:48.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:47 smithi183 ceph-mon[33560]: pgmap v798: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:48.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:47 smithi100 ceph-mon[29745]: pgmap v798: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:27:48.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:27:48.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:27:48.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 -- 172.21.15.100:0/592670768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608103c80 msgr2=0x7fc608104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/592670768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608103c80 0x7fc608104090 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc604009900 tx=0x7fc60402a410 comp rx=0 tx=0).stop 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 -- 172.21.15.100:0/592670768 shutdown_connections 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/592670768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608108980 0x7fc60810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/592670768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608103c80 0x7fc608104090 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/592670768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc608103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 -- 172.21.15.100:0/592670768 >> 172.21.15.100:0/592670768 conn(0x7fc6080fdc30 msgr2=0x7fc6081000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 -- 172.21.15.100:0/592670768 shutdown_connections 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.959+0000 7fc60fe4a640 1 -- 172.21.15.100:0/592670768 wait complete. 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 Processor -- start 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 -- start start 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc6081991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608103c80 0x7fc608199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc60810e570 con 0x7fc608108980 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc60810e3f0 con 0x7fc608102a40 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60fe4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc60810e6f0 con 0x7fc608103c80 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33842/0 (socket says 172.21.15.100:33842) 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 -- 172.21.15.100:0/2263801179 learned_addr learned my addr 172.21.15.100:0/2263801179 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc6081991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608103c80 0x7fc608199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 -- 172.21.15.100:0/2263801179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608103c80 msgr2=0x7fc608199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608103c80 0x7fc608199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 -- 172.21.15.100:0/2263801179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 msgr2=0x7fc6081991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc6081991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60e3e7640 1 -- 172.21.15.100:0/2263801179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6081a0d10 con 0x7fc608108980 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.960+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc6081991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:27:48.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc60e3e7640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc60000eb10 tx=0x7fc60000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc5faffd640 1 -- 172.21.15.100:0/2263801179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600004b20 con 0x7fc608108980 2024-04-30T23:27:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc5faffd640 1 -- 172.21.15.100:0/2263801179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc600004cc0 con 0x7fc608108980 2024-04-30T23:27:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6081a0fa0 con 0x7fc608108980 2024-04-30T23:27:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc5faffd640 1 -- 172.21.15.100:0/2263801179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600010670 con 0x7fc608108980 2024-04-30T23:27:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.961+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6081a1460 con 0x7fc608108980 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.963+0000 7fc5faffd640 1 -- 172.21.15.100:0/2263801179 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc600005020 con 0x7fc608108980 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.963+0000 7fc616de1740 1 Processor -- start 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 -- start start 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5ded700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 0x5564d5dedc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5dee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564d5d02b10 con 0x5564d5a286b0 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5564d5d4fd80 con 0x5564d5a204d0 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc616de1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5564d5d098b0 con 0x5564d5a49390 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5dee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5dee910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33844/0 (socket says 172.21.15.100:33844) 2024-04-30T23:27:48.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3832342654 learned_addr learned my addr 172.21.15.100:0/3832342654 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 0x5564d5dedc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc5faffd640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 0x7fc5f40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5ded700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60e3e7640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 0x7fc5f40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 -- 172.21.15.100:0/3832342654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 msgr2=0x5564d5ded700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5ded700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 -- 172.21.15.100:0/3832342654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 msgr2=0x5564d5dee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5dee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.964+0000 7fc60dbe6640 1 -- 172.21.15.100:0/3832342654 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d5cdaa40 con 0x5564d5a204d0 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc5faffd640 1 -- 172.21.15.100:0/2263801179 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc6000d0de0 con 0x7fc608108980 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 0x5564d5dedc80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc608102310 tx=0x7fc5fc0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf89d0258387940 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:48.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc60e3e7640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 0x7fc5f40a60c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6000ce5d0 tx=0x7fc6000673b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc5f3fff640 1 -- 172.21.15.100:0/3832342654 <== mon.2 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc005020 con 0x5564d5a204d0 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc5f3fff640 1 -- 172.21.15.100:0/3832342654 <== mon.2 v2:172.21.15.104:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc0047a0 con 0x5564d5a204d0 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.965+0000 7fc5f3fff640 1 -- 172.21.15.100:0/3832342654 <== mon.2 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012670 con 0x5564d5a204d0 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- 172.21.15.100:0/3832342654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 msgr2=0x5564d5dedc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 0x5564d5dedc80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc608102310 tx=0x7fc5fc0117b0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- 172.21.15.100:0/3832342654 shutdown_connections 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5dee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a204d0 0x5564d5dedc80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 --2- 172.21.15.100:0/3832342654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5ded700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- 172.21.15.100:0/3832342654 >> 172.21.15.100:0/3832342654 conn(0x5564d5a3d4e0 msgr2=0x5564d5de6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- 172.21.15.100:0/3832342654 shutdown_connections 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- 172.21.15.100:0/3832342654 wait complete. 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 -- start start 2024-04-30T23:27:48.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.966+0000 7fc616de1740 1 Processor -- start 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5df79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5dfe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564d5cd6d10 con 0x5564d5a204d0 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5564d5d4bd40 con 0x5564d5a286b0 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5564d5def420 con 0x5564d5a49390 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc616de1740 10 client.0 _ll_register_callbacks cb 0x5564d5d5cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60dbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5df79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33848/0 (socket says 172.21.15.100:33848) 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3228438683 learned_addr learned my addr 172.21.15.100:0/3228438683 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:48.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5dfe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3228438683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 msgr2=0x5564d5dfe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5dfe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 msgr2=0x5564d5df79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5df79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3228438683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d5b2b7d0 con 0x5564d5a204d0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5df79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.967+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc604006010 tx=0x7fc604005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc763eb0fc587ab server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604035040 con 0x5564d5a204d0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5fc0047a0 con 0x5564d5a204d0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc604004250 con 0x5564d5a204d0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc604051050 con 0x5564d5a204d0 2024-04-30T23:27:48.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 10 client.16878 fetch_fsmap learned FSMap version 51 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5564d5a613f0 con 0x5564d5a204d0 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc0047a0 con 0x5564d5a204d0 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fc60403a040 con 0x5564d5a204d0 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 10 client.16878 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 20 client.16878 populate_metadata read hostname 'smithi100' 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d5a07f60 0x5564d5e04e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 4 client.16878 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.968+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564d5d5d990 con 0x5564d5a07f60 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.969+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d5a07f60 0x5564d5e04e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.969+0000 7fc5f17fa640 10 client.16878 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.969+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d5a07f60 0x5564d5e04e50 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47869bd20ea6d0ab server_cookie=d25218d5ce741816 in_seq=0 out_seq=0 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3228438683 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x5564d5d5d990 con 0x5564d5a07f60 2024-04-30T23:27:48.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc5f17fa640 10 client.16878 handle_command_reply: tid=0 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 client.16878 shutdown 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 msgr2=0x5564d5df74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc604006010 tx=0x7fc604005e50 comp rx=0 tx=0).stop 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 shutdown_connections 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d5a07f60 0x5564d5e04e50 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5dfe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5df79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 --2- 172.21.15.100:0/3228438683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5df74a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc5f17fa640 0 client.16878 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 >> 172.21.15.100:0/3228438683 conn(0x5564d5a3d4e0 msgr2=0x5564d5de9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 shutdown_connections 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 1 -- 172.21.15.100:0/3228438683 wait complete. 2024-04-30T23:27:48.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.970+0000 7fc616de1740 20 client.16878 trim_cache size 0 max 16384 2024-04-30T23:27:48.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 Processor -- start 2024-04-30T23:27:48.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 -- start start 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a204d0 0x5564d5df29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a49390 0x5564d5df7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081aa760 con 0x5564d5a286b0 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081ac2a0 con 0x5564d5a49390 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc616de1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081aae30 con 0x5564d5a204d0 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.988+0000 7fc60dbe6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33852/0 (socket says 172.21.15.100:33852) 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 -- 172.21.15.100:0/4221709087 learned_addr learned my addr 172.21.15.100:0/4221709087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a204d0 0x5564d5df29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 -- 172.21.15.100:0/4221709087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a204d0 msgr2=0x5564d5df29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a204d0 0x5564d5df29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 -- 172.21.15.100:0/4221709087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a49390 msgr2=0x5564d5df7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a49390 0x5564d5df7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 -- 172.21.15.100:0/4221709087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d5a210f0 con 0x5564d5a286b0 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc608102310 tx=0x7fc5fc009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687d8c437312c970 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc5f37fe640 1 -- 172.21.15.100:0/4221709087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc009530 con 0x5564d5a286b0 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc5f37fe640 1 -- 172.21.15.100:0/4221709087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc02f070 con 0x5564d5a286b0 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.989+0000 7fc5f37fe640 1 -- 172.21.15.100:0/4221709087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc02a590 con 0x5564d5a286b0 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- 172.21.15.100:0/4221709087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 msgr2=0x5564d5de6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc608102310 tx=0x7fc5fc009de0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- 172.21.15.100:0/4221709087 shutdown_connections 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a49390 0x5564d5df7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a286b0 0x5564d5de6dd0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 --2- 172.21.15.100:0/4221709087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a204d0 0x5564d5df29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- 172.21.15.100:0/4221709087 >> 172.21.15.100:0/4221709087 conn(0x5564d5a3d4e0 msgr2=0x5564d5de66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- 172.21.15.100:0/4221709087 shutdown_connections 2024-04-30T23:27:48.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- 172.21.15.100:0/4221709087 wait complete. 2024-04-30T23:27:48.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 -- start start 2024-04-30T23:27:48.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.990+0000 7fc616de1740 1 Processor -- start 2024-04-30T23:27:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5dfb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5e690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081abbd0 con 0x5564d5a204d0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081ab500 con 0x5564d5a286b0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081a8740 con 0x5564d5a49390 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 10 client.0 _ll_register_callbacks cb 0x7fc604009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33856/0 (socket says 172.21.15.100:33856) 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3671059953 learned_addr learned my addr 172.21.15.100:0/3671059953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5e690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5dfb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3671059953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 msgr2=0x5564d5e690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5e690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 msgr2=0x5564d5dfb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5dfb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 -- 172.21.15.100:0/3671059953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d5d104b0 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5dfb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc60d3e5640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc604032bf0 tx=0x7fc604031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a7ab29e70f527f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc5f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604035070 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc604047070 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.991+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5fc02f070 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc604062050 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 10 client.16884 fetch_fsmap learned FSMap version 51 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5564d5e6a7c0 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc02f070 con 0x5564d5a204d0 2024-04-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fc6040035f0 con 0x5564d5a204d0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 10 client.16884 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 10 client.16884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 20 client.16884 populate_metadata read hostname 'smithi100' 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d59dd3a0 0x5564d5e6d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 4 client.16884 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5564d5d57800 con 0x5564d59dd3a0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.992+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d59dd3a0 0x5564d5e6d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc5f17fa640 10 client.16884 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc60dbe6640 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d59dd3a0 0x5564d5e6d180 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a90922fa89d079 server_cookie=f3c295a388d5b7ef in_seq=0 out_seq=0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc5f17fa640 1 -- 172.21.15.100:0/3671059953 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5564d5d57800 con 0x5564d59dd3a0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc5f17fa640 10 client.16884 handle_command_reply: tid=0 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 client.16884 shutdown 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 msgr2=0x5564d5dfb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc604032bf0 tx=0x7fc604031400 comp rx=0 tx=0).stop 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 shutdown_connections 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x5564d59dd3a0 0x5564d5e6d180 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5564d5a49390 0x5564d5e690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5564d5a286b0 0x5564d5dfb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc5f17fa640 0 client.16884 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 --2- 172.21.15.100:0/3671059953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564d5a204d0 0x5564d5dfb040 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 >> 172.21.15.100:0/3671059953 conn(0x5564d5a3d4e0 msgr2=0x5564d5de9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 shutdown_connections 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 1 -- 172.21.15.100:0/3671059953 wait complete. 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.993+0000 7fc616de1740 20 client.16884 trim_cache size 0 max 16384 2024-04-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:27:49.004 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.005 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 msgr2=0x7fc5f40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 0x7fc5f40a60c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6000ce5d0 tx=0x7fc6000673b0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 msgr2=0x7fc6081a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc60000eb10 tx=0x7fc60000c2d0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 shutdown_connections 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc5f40a3bb0 0x7fc5f40a60c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc608108980 0x7fc6081a06a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc608103c80 0x7fc608199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 --2- 172.21.15.100:0/2263801179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc608102a40 0x7fc6081991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 >> 172.21.15.100:0/2263801179 conn(0x7fc6080fdc30 msgr2=0x7fc608104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 shutdown_connections 2024-04-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:27:48.994+0000 7fc60fe4a640 1 -- 172.21.15.100:0/2263801179 wait complete. 2024-04-30T23:27:49.009 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:27:50.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:49 smithi104 ceph-mon[32987]: pgmap v799: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:50.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:49 smithi183 ceph-mon[33560]: pgmap v799: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:50.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:49 smithi100 ceph-mon[29745]: pgmap v799: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:27:52.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:51 smithi104 ceph-mon[32987]: pgmap v800: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:52.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:51 smithi183 ceph-mon[33560]: pgmap v800: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:52.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:51 smithi100 ceph-mon[29745]: pgmap v800: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:27:54.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:53 smithi104 ceph-mon[32987]: pgmap v801: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:54.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:53 smithi183 ceph-mon[33560]: pgmap v801: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:54.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:53 smithi100 ceph-mon[29745]: pgmap v801: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:27:56.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:55 smithi104 ceph-mon[32987]: pgmap v802: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:56.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:55 smithi183 ceph-mon[33560]: pgmap v802: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:56.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:55 smithi100 ceph-mon[29745]: pgmap v802: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:27:57.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:27:57.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:27:57.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:27:57.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:27:57.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:27:57.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:27:57.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:27:57.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:27:57.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:27:57.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:27:57.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:27:57.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:27:58.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:57 smithi104 ceph-mon[32987]: pgmap v803: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:58.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:57 smithi183 ceph-mon[33560]: pgmap v803: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:27:58.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:57 smithi100 ceph-mon[29745]: pgmap v803: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:00.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:27:59 smithi104 ceph-mon[32987]: pgmap v804: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:00.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:27:59 smithi183 ceph-mon[33560]: pgmap v804: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:00.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:27:59 smithi100 ceph-mon[29745]: pgmap v804: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:02.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:01 smithi104 ceph-mon[32987]: pgmap v805: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:02.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:01 smithi183 ceph-mon[33560]: pgmap v805: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:02.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:01 smithi100 ceph-mon[29745]: pgmap v805: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:04.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:03 smithi104 ceph-mon[32987]: pgmap v806: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:04.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:03 smithi183 ceph-mon[33560]: pgmap v806: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:04.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:03 smithi100 ceph-mon[29745]: pgmap v806: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:06.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:05 smithi104 ceph-mon[32987]: pgmap v807: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:06.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:05 smithi183 ceph-mon[33560]: pgmap v807: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:06.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:05 smithi100 ceph-mon[29745]: pgmap v807: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:08.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:07 smithi104 ceph-mon[32987]: pgmap v808: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:08.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:07 smithi183 ceph-mon[33560]: pgmap v808: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:08.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:07 smithi100 ceph-mon[29745]: pgmap v808: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:10.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:09 smithi104 ceph-mon[32987]: pgmap v809: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:10.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:09 smithi183 ceph-mon[33560]: pgmap v809: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:10.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:09 smithi100 ceph-mon[29745]: pgmap v809: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:12.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:11 smithi104 ceph-mon[32987]: pgmap v810: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:12.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:11 smithi183 ceph-mon[33560]: pgmap v810: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:12.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:11 smithi100 ceph-mon[29745]: pgmap v810: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:14.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:13 smithi104 ceph-mon[32987]: pgmap v811: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:14.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:13 smithi183 ceph-mon[33560]: pgmap v811: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:13 smithi100 ceph-mon[29745]: pgmap v811: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:16.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:15 smithi104 ceph-mon[32987]: pgmap v812: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:16.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:15 smithi183 ceph-mon[33560]: pgmap v812: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:15 smithi100 ceph-mon[29745]: pgmap v812: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:18.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:17 smithi104 ceph-mon[32987]: pgmap v813: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:18.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:17 smithi183 ceph-mon[33560]: pgmap v813: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:18.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:17 smithi100 ceph-mon[29745]: pgmap v813: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:19.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:28:19.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:28:19.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- 172.21.15.100:0/865715649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 msgr2=0x7fa4dc103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 --2- 172.21.15.100:0/865715649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc103810 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009900 tx=0x7fa4d002a410 comp rx=0 tx=0).stop 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- 172.21.15.100:0/865715649 shutdown_connections 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 --2- 172.21.15.100:0/865715649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc10a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 --2- 172.21.15.100:0/865715649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc103810 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 --2- 172.21.15.100:0/865715649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 0x7fa4dc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- 172.21.15.100:0/865715649 >> 172.21.15.100:0/865715649 conn(0x7fa4dc0fd390 msgr2=0x7fa4dc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- 172.21.15.100:0/865715649 shutdown_connections 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- 172.21.15.100:0/865715649 wait complete. 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 Processor -- start 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.131+0000 7fa4e238d640 1 -- start start 2024-04-30T23:28:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 0x7fa4dc0ff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc0fde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10dce0 con 0x7fa4dc103400 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10db60 con 0x7fa4dc1021c0 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e238d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10de60 con 0x7fa4dc108100 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51660/0 (socket says 172.21.15.100:51660) 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 -- 172.21.15.100:0/1197968315 learned_addr learned my addr 172.21.15.100:0/1197968315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 0x7fa4dc0ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e092a640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc0fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 -- 172.21.15.100:0/1197968315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 msgr2=0x7fa4dc0fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc0fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 -- 172.21.15.100:0/1197968315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 msgr2=0x7fa4dc0ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 0x7fa4dc0ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4db7fe640 1 -- 172.21.15.100:0/1197968315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0fe530 con 0x7fa4dc103400 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.132+0000 7fa4e092a640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc0fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006010 tx=0x7fa4d0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4d97fa640 1 -- 172.21.15.100:0/1197968315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d003f030 con 0x7fa4dc103400 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc1a4310 con 0x7fa4dc103400 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4d97fa640 1 -- 172.21.15.100:0/1197968315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d0003aa0 con 0x7fa4dc103400 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4d97fa640 1 -- 172.21.15.100:0/1197968315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0035070 con 0x7fa4dc103400 2024-04-30T23:28:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.133+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1a4710 con 0x7fa4dc103400 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.135+0000 7fa4d97fa640 1 -- 172.21.15.100:0/1197968315 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa4d0042030 con 0x7fa4dc103400 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.135+0000 7fa4e9249740 1 Processor -- start 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 -- start start 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f4cfe1b10 con 0x562f4ccff4d0 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562f4d02ed80 con 0x562f4cd28390 2024-04-30T23:28:19.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e9249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f4cfe88b0 con 0x562f4cd076b0 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51662/0 (socket says 172.21.15.100:51662) 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4d97fa640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 0x7fa4c40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 -- 172.21.15.100:0/3765178360 learned_addr learned my addr 172.21.15.100:0/3765178360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e092a640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 0x7fa4c40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4e092a640 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 -- 172.21.15.100:0/3765178360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 msgr2=0x562f4d0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 -- 172.21.15.100:0/3765178360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 msgr2=0x562f4d0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4d97fa640 1 -- 172.21.15.100:0/1197968315 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa4d00f0da0 con 0x7fa4dc103400 2024-04-30T23:28:19.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 -- 172.21.15.100:0/3765178360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4cfb9a40 con 0x562f4ccff4d0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.136+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009c60 tx=0x7fa4cc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb80f1cb2f09378 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e092a640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 0x7fa4c40a60c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x562f4d0cb540 tx=0x7fa4d40095d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4c27fc640 1 -- 172.21.15.100:0/3765178360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc004220 con 0x562f4ccff4d0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4c27fc640 1 -- 172.21.15.100:0/3765178360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4cc0043c0 con 0x562f4ccff4d0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4c27fc640 1 -- 172.21.15.100:0/3765178360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc004cd0 con 0x562f4ccff4d0 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e9249740 1 -- 172.21.15.100:0/3765178360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 msgr2=0x562f4d0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009c60 tx=0x7fa4cc011810 comp rx=0 tx=0).stop 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e9249740 1 -- 172.21.15.100:0/3765178360 shutdown_connections 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.137+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0caa70 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3765178360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- 172.21.15.100:0/3765178360 >> 172.21.15.100:0/3765178360 conn(0x562f4cd1c4e0 msgr2=0x562f4d0c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- 172.21.15.100:0/3765178360 shutdown_connections 2024-04-30T23:28:19.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- 172.21.15.100:0/3765178360 wait complete. 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- start start 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 Processor -- start 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f4cfb5d10 con 0x562f4ccff4d0 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562f4d02ad40 con 0x562f4cd28390 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f4d0cc210 con 0x562f4cd076b0 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.138+0000 7fa4e9249740 10 client.0 _ll_register_callbacks cb 0x562f4d03bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51670/0 (socket says 172.21.15.100:51670) 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 -- 172.21.15.100:0/1733331811 learned_addr learned my addr 172.21.15.100:0/1733331811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4e092a640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 -- 172.21.15.100:0/1733331811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 msgr2=0x562f4d0d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0d47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 -- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 msgr2=0x562f4d0db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 -- 172.21.15.100:0/1733331811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ce0a7d0 con 0x562f4ccff4d0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0d47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc01b040 tx=0x7fa4cc019b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6dad54756a3011 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc027030 con 0x562f4ccff4d0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa4cc019d20 con 0x562f4ccff4d0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4cc0043c0 con 0x562f4ccff4d0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa4cc034050 con 0x562f4ccff4d0 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.139+0000 7fa4e9249740 10 client.16896 fetch_fsmap learned FSMap version 51 2024-04-30T23:28:19.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562f4cd403f0 con 0x562f4ccff4d0 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4cc0043c0 con 0x562f4ccff4d0 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fa4cc0051b0 con 0x562f4ccff4d0 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 10 client.16896 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 20 client.16896 populate_metadata read hostname 'smithi100' 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cce6f60 0x562f4d0e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 4 client.16896 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f4d03c990 con 0x562f4cce6f60 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.140+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cce6f60 0x562f4d0e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4bb7fe640 10 client.16896 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cce6f60 0x562f4d0e1a00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465ef898f0ab7602 server_cookie=b07d21d88c80544e in_seq=0 out_seq=0 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/1733331811 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562f4d03c990 con 0x562f4cce6f60 2024-04-30T23:28:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4bb7fe640 10 client.16896 handle_command_reply: tid=0 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 client.16896 shutdown 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 msgr2=0x562f4d0d42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc01b040 tx=0x7fa4cc019b30 comp rx=0 tx=0).stop 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 shutdown_connections 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cce6f60 0x562f4d0e1a00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd28390 0x562f4d0db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4bb7fe640 0 client.16896 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.141+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cd076b0 0x562f4d0d47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.142+0000 7fa4e9249740 1 --2- 172.21.15.100:0/1733331811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0d42b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.142+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 >> 172.21.15.100:0/1733331811 conn(0x562f4cd1c4e0 msgr2=0x562f4d0c8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.142+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 shutdown_connections 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.142+0000 7fa4e9249740 1 -- 172.21.15.100:0/1733331811 wait complete. 2024-04-30T23:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.142+0000 7fa4e9249740 20 client.16896 trim_cache size 0 max 16384 2024-04-30T23:28:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 Processor -- start 2024-04-30T23:28:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 -- start start 2024-04-30T23:28:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4ccff4d0 0x562f4d0db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1aeac0 con 0x562f4cce6f60 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1b0600 con 0x562f4cd076b0 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4e9249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1af190 con 0x562f4ccff4d0 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51678/0 (socket says 172.21.15.100:51678) 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.159+0000 7fa4dbfff640 1 -- 172.21.15.100:0/2598233806 learned_addr learned my addr 172.21.15.100:0/2598233806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4e092a640 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4ccff4d0 0x562f4d0db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 -- 172.21.15.100:0/2598233806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4ccff4d0 msgr2=0x562f4d0db670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4ccff4d0 0x562f4d0db670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 -- 172.21.15.100:0/2598233806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 msgr2=0x562f4d0dbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0dbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 -- 172.21.15.100:0/2598233806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4cd000f0 con 0x562f4cce6f60 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02e610 tx=0x7fa4cc009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd19d0519f13a0fd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4c1ffb640 1 -- 172.21.15.100:0/2598233806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc027070 con 0x562f4cce6f60 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4c1ffb640 1 -- 172.21.15.100:0/2598233806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4cc02e690 con 0x562f4cce6f60 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.160+0000 7fa4c1ffb640 1 -- 172.21.15.100:0/2598233806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc01d040 con 0x562f4cce6f60 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- 172.21.15.100:0/2598233806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 msgr2=0x562f4d0d31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02e610 tx=0x7fa4cc009ab0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- 172.21.15.100:0/2598233806 shutdown_connections 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0dbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4ccff4d0 0x562f4d0db670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 --2- 172.21.15.100:0/2598233806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4cce6f60 0x562f4d0d31d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- 172.21.15.100:0/2598233806 >> 172.21.15.100:0/2598233806 conn(0x562f4cd1c4e0 msgr2=0x562f4d0d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- 172.21.15.100:0/2598233806 shutdown_connections 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- 172.21.15.100:0/2598233806 wait complete. 2024-04-30T23:28:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 -- start start 2024-04-30T23:28:19.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.161+0000 7fa4e9249740 1 Processor -- start 2024-04-30T23:28:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cce6f60 0x562f4d0dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1aff30 con 0x562f4ccff4d0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1af860 con 0x562f4cd076b0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1acaa0 con 0x562f4cce6f60 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 10 client.0 _ll_register_callbacks cb 0x7fa4d00bcb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51680/0 (socket says 172.21.15.100:51680) 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 -- 172.21.15.100:0/3359962014 learned_addr learned my addr 172.21.15.100:0/3359962014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cce6f60 0x562f4d0dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e092a640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 -- 172.21.15.100:0/3359962014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cce6f60 msgr2=0x562f4d0dbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cce6f60 0x562f4d0dbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 -- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 msgr2=0x562f4d0da900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0da900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 -- 172.21.15.100:0/3359962014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4cfef4b0 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4db7fe640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00bca20 tx=0x7fa4d0040fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f0c233d8f97488 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0049040 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fa4d00badc0 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4cc02e690 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa4d00c5990 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 10 client.16902 fetch_fsmap learned FSMap version 51 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.162+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562f4d146930 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4cc02e690 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d00b9390 con 0x562f4ccff4d0 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 10 client.16902 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:28:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 20 client.16902 populate_metadata read hostname 'smithi100' 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cd28390 0x562f4d1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 4 client.16902 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f4d036800 con 0x562f4cd28390 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cd28390 0x562f4d1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4bb7fe640 10 client.16902 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.163+0000 7fa4dbfff640 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cd28390 0x562f4d1492d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad7c94b4e61e5a77 server_cookie=d6cc7481b6bba066 in_seq=0 out_seq=0 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4bb7fe640 1 -- 172.21.15.100:0/3359962014 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x562f4d036800 con 0x562f4cd28390 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4bb7fe640 10 client.16902 handle_command_reply: tid=0 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 client.16902 shutdown 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 msgr2=0x562f4d0da3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00bca20 tx=0x7fa4d0040fb0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 shutdown_connections 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562f4cd28390 0x562f4d1492d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562f4cd076b0 0x562f4d0da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4bb7fe640 0 client.16902 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4ccff4d0 0x562f4d0da3c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 --2- 172.21.15.100:0/3359962014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f4cce6f60 0x562f4d0dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 >> 172.21.15.100:0/3359962014 conn(0x562f4cd1c4e0 msgr2=0x562f4d0c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 shutdown_connections 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 1 -- 172.21.15.100:0/3359962014 wait complete. 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.164+0000 7fa4e9249740 20 client.16902 trim_cache size 0 max 16384 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:28:19.173 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.174 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:28:19.175 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:28:19.176 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:19.177 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:19.178 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 msgr2=0x7fa4c40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 0x7fa4c40a60c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x562f4d0cb540 tx=0x7fa4d40095d0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 msgr2=0x7fa4dc0fd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006010 tx=0x7fa4d0031a50 comp rx=0 tx=0).stop 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 shutdown_connections 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fa4c40a3bb0 0x7fa4c40a60c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4dc108100 0x7fa4dc0fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4dc103400 0x7fa4dc0fd8c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 --2- 172.21.15.100:0/1197968315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4dc1021c0 0x7fa4dc0ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:19.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 >> 172.21.15.100:0/1197968315 conn(0x7fa4dc0fd390 msgr2=0x7fa4dc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:19.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 shutdown_connections 2024-04-30T23:28:19.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:19.165+0000 7fa4e238d640 1 -- 172.21.15.100:0/1197968315 wait complete. 2024-04-30T23:28:19.180 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:28:20.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:19 smithi104 ceph-mon[32987]: pgmap v814: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:20.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:19 smithi183 ceph-mon[33560]: pgmap v814: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:20.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:19 smithi100 ceph-mon[29745]: pgmap v814: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:22.048 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:21 smithi104 ceph-mon[32987]: pgmap v815: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:22.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:21 smithi183 ceph-mon[33560]: pgmap v815: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:22.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:21 smithi100 ceph-mon[29745]: pgmap v815: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:24.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:23 smithi183 ceph-mon[33560]: pgmap v816: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:24.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:23 smithi100 ceph-mon[29745]: pgmap v816: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:23 smithi104 ceph-mon[32987]: pgmap v816: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:26.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:25 smithi183 ceph-mon[33560]: pgmap v817: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:26.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:25 smithi100 ceph-mon[29745]: pgmap v817: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:25 smithi104 ceph-mon[32987]: pgmap v817: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:28.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:27 smithi100 ceph-mon[29745]: pgmap v818: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:27 smithi104 ceph-mon[32987]: pgmap v818: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:27 smithi183 ceph-mon[33560]: pgmap v818: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:30.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:29 smithi100 ceph-mon[29745]: pgmap v819: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:29 smithi104 ceph-mon[32987]: pgmap v819: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:29 smithi183 ceph-mon[33560]: pgmap v819: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:32.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:31 smithi100 ceph-mon[29745]: pgmap v820: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:31 smithi104 ceph-mon[32987]: pgmap v820: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:31 smithi183 ceph-mon[33560]: pgmap v820: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:34.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:33 smithi100 ceph-mon[29745]: pgmap v821: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:33 smithi104 ceph-mon[32987]: pgmap v821: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:33 smithi183 ceph-mon[33560]: pgmap v821: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:36.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:35 smithi100 ceph-mon[29745]: pgmap v822: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:35 smithi104 ceph-mon[32987]: pgmap v822: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:35 smithi183 ceph-mon[33560]: pgmap v822: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:38.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:37 smithi100 ceph-mon[29745]: pgmap v823: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:37 smithi104 ceph-mon[32987]: pgmap v823: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:37 smithi183 ceph-mon[33560]: pgmap v823: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:40.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:39 smithi100 ceph-mon[29745]: pgmap v824: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:39 smithi104 ceph-mon[32987]: pgmap v824: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:39 smithi183 ceph-mon[33560]: pgmap v824: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:42.105 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:41 smithi183 ceph-mon[33560]: pgmap v825: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:41 smithi104 ceph-mon[32987]: pgmap v825: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:42.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:41 smithi100 ceph-mon[29745]: pgmap v825: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:44.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:43 smithi104 ceph-mon[32987]: pgmap v826: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:44.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:43 smithi183 ceph-mon[33560]: pgmap v826: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:44.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:43 smithi100 ceph-mon[29745]: pgmap v826: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:46.100 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:45 smithi104 ceph-mon[32987]: pgmap v827: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:46.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:45 smithi183 ceph-mon[33560]: pgmap v827: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:46.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:45 smithi100 ceph-mon[29745]: pgmap v827: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:48.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:47 smithi104 ceph-mon[32987]: pgmap v828: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:48.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:47 smithi183 ceph-mon[33560]: pgmap v828: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:48.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:47 smithi100 ceph-mon[29745]: pgmap v828: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:28:49.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:28:49.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 -- 172.21.15.100:0/303649065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 msgr2=0x7f4a0c101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/303649065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c101c10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009900 tx=0x7f49fc02a410 comp rx=0 tx=0).stop 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 -- 172.21.15.100:0/303649065 shutdown_connections 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/303649065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c10bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/303649065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c101c10 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/303649065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 0x7f4a0c105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 -- 172.21.15.100:0/303649065 >> 172.21.15.100:0/303649065 conn(0x7f4a0c0fd3c0 msgr2=0x7f4a0c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 -- 172.21.15.100:0/303649065 shutdown_connections 2024-04-30T23:28:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.301+0000 7f4a11c7f640 1 -- 172.21.15.100:0/303649065 wait complete. 2024-04-30T23:28:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 Processor -- start 2024-04-30T23:28:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 -- start start 2024-04-30T23:28:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 0x7f4a0c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c10f6d0 con 0x7f4a0c1017a0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c10f550 con 0x7f4a0c1050f0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.302+0000 7f4a11c7f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c10f850 con 0x7f4a0c1022a0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35204/0 (socket says 172.21.15.100:35204) 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2324296597 learned_addr learned my addr 172.21.15.100:0/2324296597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 0x7f4a0c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0affd640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2324296597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 msgr2=0x7f4a0c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2324296597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 msgr2=0x7f4a0c1a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 0x7f4a0c1a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2324296597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c1a1d40 con 0x7f4a0c1017a0 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0affd640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:28:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c970 tx=0x7f4a0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a08ff9640 1 -- 172.21.15.100:0/2324296597 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007c70 con 0x7f4a0c1017a0 2024-04-30T23:28:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c1a1fd0 con 0x7f4a0c1017a0 2024-04-30T23:28:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a08ff9640 1 -- 172.21.15.100:0/2324296597 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a00007e10 con 0x7f4a0c1017a0 2024-04-30T23:28:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a08ff9640 1 -- 172.21.15.100:0/2324296597 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00018760 con 0x7f4a0c1017a0 2024-04-30T23:28:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.303+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c1a2560 con 0x7f4a0c1017a0 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a08ff9640 1 -- 172.21.15.100:0/2324296597 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4a0000fab0 con 0x7f4a0c1017a0 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 Processor -- start 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 -- start start 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce38700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56289cd4eb10 con 0x56289ca6c4d0 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56289cd9bd80 con 0x56289ca746b0 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56289cd558b0 con 0x56289ca95390 2024-04-30T23:28:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35218/0 (socket says 172.21.15.100:35218) 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2496041183 learned_addr learned my addr 172.21.15.100:0/2496041183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a0affd640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce38700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a08ff9640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 0x7f49f40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.306+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2496041183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 msgr2=0x56289ce374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2496041183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 msgr2=0x56289ce38700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce38700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/2496041183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289cd26a40 con 0x56289ca6c4d0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 0x7f49f40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a08ff9640 1 -- 172.21.15.100:0/2324296597 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4a000d08d0 con 0x7f4a0c1017a0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4a00056890 tx=0x7f4a00020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c846f71634f70c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f49f1ffb640 1 -- 172.21.15.100:0/2496041183 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0009c1b0 con 0x56289ca6c4d0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 0x7f49f40a60c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x56289ce38540 tx=0x7f4a0400c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f49f1ffb640 1 -- 172.21.15.100:0/2496041183 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0009cf50 con 0x56289ca6c4d0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.307+0000 7f49f1ffb640 1 -- 172.21.15.100:0/2496041183 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00054220 con 0x56289ca6c4d0 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- 172.21.15.100:0/2496041183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 msgr2=0x56289ce37a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4a00056890 tx=0x7f4a00020000 comp rx=0 tx=0).stop 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- 172.21.15.100:0/2496041183 shutdown_connections 2024-04-30T23:28:49.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce38700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce37a70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/2496041183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- 172.21.15.100:0/2496041183 >> 172.21.15.100:0/2496041183 conn(0x56289ca894e0 msgr2=0x56289ce32d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- 172.21.15.100:0/2496041183 shutdown_connections 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- 172.21.15.100:0/2496041183 wait complete. 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.308+0000 7f4a18c0b740 1 -- start start 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 Processor -- start 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce41730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce48690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56289cd22d10 con 0x56289ca6c4d0 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56289cd97d40 con 0x56289ca746b0 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56289ce391b0 con 0x56289ca95390 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a18c0b740 10 client.0 _ll_register_callbacks cb 0x56289cda8d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35224/0 (socket says 172.21.15.100:35224) 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/55772146 learned_addr learned my addr 172.21.15.100:0/55772146 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce48690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0affd640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce41730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/55772146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 msgr2=0x56289ce48690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce48690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 msgr2=0x56289ce41730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce41730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/55772146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289cb777d0 con 0x56289ca6c4d0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4a0009ca10 tx=0x7f4a000d6300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a362c66cc62ede8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.309+0000 7f49eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000d340 con 0x56289ca6c4d0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4a000b0fb0 con 0x56289ca6c4d0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a0009cf50 con 0x56289ca6c4d0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4a0009c1b0 con 0x56289ca6c4d0 2024-04-30T23:28:49.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f4a18c0b740 10 client.16914 fetch_fsmap learned FSMap version 51 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56289caad3f0 con 0x56289ca6c4d0 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.310+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0009cf50 con 0x56289ca6c4d0 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f4a0009cab0 con 0x56289ca6c4d0 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 10 client.16914 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 20 client.16914 populate_metadata read hostname 'smithi100' 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca53f60 0x56289ce4e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 4 client.16914 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56289cda9990 con 0x56289ca53f60 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a0affd640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca53f60 0x56289ce4e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f4a0affd640 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca53f60 0x56289ce4e750 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e67156dc9c545b3 server_cookie=d766b9a6d4b58cb6 in_seq=0 out_seq=0 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.311+0000 7f49eaffd640 10 client.16914 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:49.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f49eaffd640 1 -- 172.21.15.100:0/55772146 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x56289cda9990 con 0x56289ca53f60 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f49eaffd640 10 client.16914 handle_command_reply: tid=0 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 client.16914 shutdown 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 msgr2=0x56289ce411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4a0009ca10 tx=0x7f4a000d6300 comp rx=0 tx=0).stop 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 shutdown_connections 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca53f60 0x56289ce4e750 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca95390 0x56289ce48690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce41730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f49eaffd640 0 client.16914 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/55772146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce411f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 >> 172.21.15.100:0/55772146 conn(0x56289ca894e0 msgr2=0x56289ce35c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 shutdown_connections 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.312+0000 7f4a18c0b740 1 -- 172.21.15.100:0/55772146 wait complete. 2024-04-30T23:28:49.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.313+0000 7f4a18c0b740 20 client.16914 trim_cache size 0 max 16384 2024-04-30T23:28:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 Processor -- start 2024-04-30T23:28:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 -- start start 2024-04-30T23:28:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca53f60 0x56289ce40240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ac980 con 0x56289ca6c4d0 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ae4c0 con 0x56289ca746b0 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ad050 con 0x56289ca53f60 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35228/0 (socket says 172.21.15.100:35228) 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.330+0000 7f4a0affd640 1 -- 172.21.15.100:0/1748495151 learned_addr learned my addr 172.21.15.100:0/1748495151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 -- 172.21.15.100:0/1748495151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca53f60 msgr2=0x56289ce40240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca53f60 0x56289ce40240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 -- 172.21.15.100:0/1748495151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 msgr2=0x56289ce414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 -- 172.21.15.100:0/1748495151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289ca6d0f0 con 0x56289ca6c4d0 2024-04-30T23:28:49.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f4a0affd640 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c19b350 tx=0x7f49fc009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31ade71859b2637 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f49f17fa640 1 -- 172.21.15.100:0/1748495151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc035040 con 0x56289ca6c4d0 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f49f17fa640 1 -- 172.21.15.100:0/1748495151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49fc048070 con 0x56289ca6c4d0 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.331+0000 7f49f17fa640 1 -- 172.21.15.100:0/1748495151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc043310 con 0x56289ca6c4d0 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- 172.21.15.100:0/1748495151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 msgr2=0x56289ce48620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c19b350 tx=0x7f49fc009640 comp rx=0 tx=0).stop 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- 172.21.15.100:0/1748495151 shutdown_connections 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca6c4d0 0x56289ce48620 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/1748495151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca53f60 0x56289ce40240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- 172.21.15.100:0/1748495151 >> 172.21.15.100:0/1748495151 conn(0x56289ca894e0 msgr2=0x56289ce40dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- 172.21.15.100:0/1748495151 shutdown_connections 2024-04-30T23:28:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- 172.21.15.100:0/1748495151 wait complete. 2024-04-30T23:28:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 -- start start 2024-04-30T23:28:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.332+0000 7f4a18c0b740 1 Processor -- start 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca6c4d0 0x56289ce46280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1addf0 con 0x56289ca53f60 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ad720 con 0x56289ca746b0 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1aa960 con 0x56289ca6c4d0 2024-04-30T23:28:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a18c0b740 10 client.0 _ll_register_callbacks cb 0x7f49fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35238/0 (socket says 172.21.15.100:35238) 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/846487260 learned_addr learned my addr 172.21.15.100:0/846487260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0affd640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca6c4d0 0x56289ce46280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0bfff640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/846487260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca6c4d0 msgr2=0x56289ce46280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca6c4d0 0x56289ce46280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 msgr2=0x56289ce47140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce47140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 -- 172.21.15.100:0/846487260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289cd5c4b0 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f4a0b7fe640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4a00098cb0 tx=0x7f4a0000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65aca74abdb2d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f49eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.333+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00096020 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f4a000d6300 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49fc048070 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4a0009c390 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 10 client.16920 fetch_fsmap learned FSMap version 51 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56289ce48730 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49fc048070 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f4a000b2030 con 0x56289ca53f60 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 10 client.16920 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:28:49.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 20 client.16920 populate_metadata read hostname 'smithi100' 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca95390 0x56289ceb6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 4 client.16920 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56289cda3800 con 0x56289ca95390 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.334+0000 7f4a0affd640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca95390 0x56289ceb6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f49eaffd640 10 client.16920 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a0affd640 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca95390 0x56289ceb6b50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466652d7b5f9879a server_cookie=b78915c533c7250b in_seq=0 out_seq=0 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f49eaffd640 1 -- 172.21.15.100:0/846487260 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x56289cda3800 con 0x56289ca95390 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f49eaffd640 10 client.16920 handle_command_reply: tid=0 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 client.16920 shutdown 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 msgr2=0x56289ce45d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4a00098cb0 tx=0x7f4a0000cf80 comp rx=0 tx=0).stop 2024-04-30T23:28:49.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 shutdown_connections 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x56289ca95390 0x56289ceb6b50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56289ca746b0 0x56289ce47140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f49eaffd640 0 client.16920 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56289ca6c4d0 0x56289ce46280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 --2- 172.21.15.100:0/846487260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289ca53f60 0x56289ce45d40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 >> 172.21.15.100:0/846487260 conn(0x56289ca894e0 msgr2=0x56289ce3ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 shutdown_connections 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 1 -- 172.21.15.100:0/846487260 wait complete. 2024-04-30T23:28:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.335+0000 7f4a18c0b740 20 client.16920 trim_cache size 0 max 16384 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:28:49.347 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.349 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.350 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:28:49.351 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:28:49.352 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:28:49.352 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:28:49.352 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:49.352 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:28:49.352 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 msgr2=0x7f49f40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 0x7f49f40a60c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x56289ce38540 tx=0x7f4a0400c040 comp rx=0 tx=0).stop 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 msgr2=0x7f4a0c19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c970 tx=0x7f4a0000ce30 comp rx=0 tx=0).stop 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 shutdown_connections 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f49f40a3bb0 0x7f49f40a60c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a0c1050f0 0x7f4a0c1a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a0c1022a0 0x7f4a0c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 --2- 172.21.15.100:0/2324296597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a0c1017a0 0x7f4a0c19a2b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:28:49.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 >> 172.21.15.100:0/2324296597 conn(0x7f4a0c0fd3c0 msgr2=0x7f4a0c105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:28:49.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 shutdown_connections 2024-04-30T23:28:49.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:28:49.336+0000 7f4a11c7f640 1 -- 172.21.15.100:0/2324296597 wait complete. 2024-04-30T23:28:49.355 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:28:50.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:49 smithi104 ceph-mon[32987]: pgmap v829: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:50.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:49 smithi183 ceph-mon[33560]: pgmap v829: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:49 smithi100 ceph-mon[29745]: pgmap v829: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:28:52.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:51 smithi104 ceph-mon[32987]: pgmap v830: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:52.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:51 smithi183 ceph-mon[33560]: pgmap v830: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:52.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:51 smithi100 ceph-mon[29745]: pgmap v830: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:28:54.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:53 smithi104 ceph-mon[32987]: pgmap v831: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:54.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:53 smithi183 ceph-mon[33560]: pgmap v831: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:54.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:53 smithi100 ceph-mon[29745]: pgmap v831: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:28:56.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:55 smithi104 ceph-mon[32987]: pgmap v832: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:28:56.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:55 smithi183 ceph-mon[33560]: pgmap v832: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:28:56.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:55 smithi100 ceph-mon[29745]: pgmap v832: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:28:57.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:56 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:28:57.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:56 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:28:57.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:56 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:28:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:57 smithi104 ceph-mon[32987]: pgmap v833: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:28:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:28:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:28:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:57 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:28:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:57 smithi183 ceph-mon[33560]: pgmap v833: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:28:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:28:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:28:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:57 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:28:58.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:57 smithi100 ceph-mon[29745]: pgmap v833: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 op/s 2024-04-30T23:28:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:28:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:28:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:57 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:29:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:28:59 smithi104 ceph-mon[32987]: pgmap v834: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:29:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:28:59 smithi183 ceph-mon[33560]: pgmap v834: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:29:00.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:28:59 smithi100 ceph-mon[29745]: pgmap v834: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-04-30T23:29:02.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:01 smithi104 ceph-mon[32987]: pgmap v835: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:02.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:01 smithi183 ceph-mon[33560]: pgmap v835: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:02.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:01 smithi100 ceph-mon[29745]: pgmap v835: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:04.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:03 smithi104 ceph-mon[32987]: pgmap v836: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:29:04.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:03 smithi183 ceph-mon[33560]: pgmap v836: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:29:04.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:03 smithi100 ceph-mon[29745]: pgmap v836: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-04-30T23:29:06.127 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:05 smithi100 ceph-mon[29745]: pgmap v837: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:06.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:05 smithi104 ceph-mon[32987]: pgmap v837: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:06.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:05 smithi183 ceph-mon[33560]: pgmap v837: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-04-30T23:29:08.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:07 smithi104 ceph-mon[32987]: pgmap v838: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:08.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:07 smithi183 ceph-mon[33560]: pgmap v838: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:08.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:07 smithi100 ceph-mon[29745]: pgmap v838: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:10.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:09 smithi104 ceph-mon[32987]: pgmap v839: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:10.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:09 smithi183 ceph-mon[33560]: pgmap v839: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:10.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:09 smithi100 ceph-mon[29745]: pgmap v839: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:12.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:11 smithi104 ceph-mon[32987]: pgmap v840: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:12.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:11 smithi183 ceph-mon[33560]: pgmap v840: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:12.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:11 smithi100 ceph-mon[29745]: pgmap v840: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:14.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:13 smithi104 ceph-mon[32987]: pgmap v841: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:14.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:13 smithi183 ceph-mon[33560]: pgmap v841: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:14.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:13 smithi100 ceph-mon[29745]: pgmap v841: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:16.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:15 smithi104 ceph-mon[32987]: pgmap v842: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:16.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:15 smithi183 ceph-mon[33560]: pgmap v842: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:16.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:15 smithi100 ceph-mon[29745]: pgmap v842: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:18.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:17 smithi104 ceph-mon[32987]: pgmap v843: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:18.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:17 smithi183 ceph-mon[33560]: pgmap v843: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:18.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:17 smithi100 ceph-mon[29745]: pgmap v843: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:19.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:29:19.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 -- 172.21.15.100:0/1890922652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c103c60 msgr2=0x7f8c9c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 --2- 172.21.15.100:0/1890922652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c103c60 0x7f8c9c104070 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009900 tx=0x7f8c8402a410 comp rx=0 tx=0).stop 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 -- 172.21.15.100:0/1890922652 shutdown_connections 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 --2- 172.21.15.100:0/1890922652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c108960 0x7f8c9c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 --2- 172.21.15.100:0/1890922652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c103c60 0x7f8c9c104070 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 --2- 172.21.15.100:0/1890922652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 0x7f8c9c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 -- 172.21.15.100:0/1890922652 >> 172.21.15.100:0/1890922652 conn(0x7f8c9c0fdc10 msgr2=0x7f8c9c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 -- 172.21.15.100:0/1890922652 shutdown_connections 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.479+0000 7f8ca189d640 1 -- 172.21.15.100:0/1890922652 wait complete. 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 Processor -- start 2024-04-30T23:29:19.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 -- start start 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 0x7f8c9c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c103c60 0x7f8c9c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10e540 con 0x7f8c9c108960 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10e3c0 con 0x7f8c9c103c60 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8ca189d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10e6c0 con 0x7f8c9c102a20 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52466/0 (socket says 172.21.15.100:52466) 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 -- 172.21.15.100:0/2955510580 learned_addr learned my addr 172.21.15.100:0/2955510580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c103c60 0x7f8c9c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 0x7f8c9c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 -- 172.21.15.100:0/2955510580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 msgr2=0x7f8c9c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 0x7f8c9c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 -- 172.21.15.100:0/2955510580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c103c60 msgr2=0x7f8c9c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c103c60 0x7f8c9c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.480+0000 7f8c9b7fe640 1 -- 172.21.15.100:0/2955510580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c1a0cd0 con 0x7f8c9c108960 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8c9b7fe640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00d750 tx=0x7f8c8c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8ca089b640 1 -- 172.21.15.100:0/2955510580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c017070 con 0x7f8c9c108960 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8ca089b640 1 -- 172.21.15.100:0/2955510580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c8c0054d0 con 0x7f8c9c108960 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c1a0fc0 con 0x7f8c9c108960 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8ca089b640 1 -- 172.21.15.100:0/2955510580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004c60 con 0x7f8c9c108960 2024-04-30T23:29:19.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.481+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c1a13d0 con 0x7f8c9c108960 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.483+0000 7f8ca882f740 1 Processor -- start 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.483+0000 7f8ca089b640 1 -- 172.21.15.100:0/2955510580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8c8c010460 con 0x7f8c9c108960 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.483+0000 7f8ca882f740 1 -- start start 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5b3390 0x561e6e9554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e955a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561e6e86cb10 con 0x561e6e5926b0 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561e6e8b9d80 con 0x561e6e5b3390 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca882f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561e6e8738b0 con 0x561e6e58a4d0 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52482/0 (socket says 172.21.15.100:52482) 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/922837895 learned_addr learned my addr 172.21.15.100:0/922837895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9affd640 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e955a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca089b640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 0x7f8c880a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5b3390 0x561e6e9554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/922837895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 msgr2=0x561e6e955a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e955a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/922837895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5b3390 msgr2=0x561e6e9554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5b3390 0x561e6e9554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/922837895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6e844a40 con 0x561e6e5926b0 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9b7fe640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 0x7f8c880a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8ca089b640 1 -- 172.21.15.100:0/2955510580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c8c0d0170 con 0x7f8c9c108960 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.484+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8c840096c0 tx=0x7f8c84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c60672ac8aa9b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8c91ffb640 1 -- 172.21.15.100:0/922837895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84035040 con 0x561e6e5926b0 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8c91ffb640 1 -- 172.21.15.100:0/922837895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c840317a0 con 0x561e6e5926b0 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8c91ffb640 1 -- 172.21.15.100:0/922837895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84003cc0 con 0x561e6e5926b0 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 -- 172.21.15.100:0/922837895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 msgr2=0x561e6e956700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8c840096c0 tx=0x7f8c84000bc0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8c9b7fe640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 0x7f8c880a60c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c09bdf0 tx=0x7f8c8c0667f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 -- 172.21.15.100:0/922837895 shutdown_connections 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5926b0 0x561e6e956700 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e955a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.485+0000 7f8ca882f740 1 --2- 172.21.15.100:0/922837895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5b3390 0x561e6e9554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- 172.21.15.100:0/922837895 >> 172.21.15.100:0/922837895 conn(0x561e6e5a74e0 msgr2=0x561e6e950d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- 172.21.15.100:0/922837895 shutdown_connections 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- 172.21.15.100:0/922837895 wait complete. 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- start start 2024-04-30T23:29:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 Processor -- start 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e5b3390 0x561e6e966730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561e6e840d10 con 0x561e6e58a4d0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561e6e8b5d40 con 0x561e6e5926b0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.486+0000 7f8ca882f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561e6e9571b0 con 0x561e6e5b3390 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8ca882f740 10 client.0 _ll_register_callbacks cb 0x561e6e8c6d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52486/0 (socket says 172.21.15.100:52486) 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2640665991 learned_addr learned my addr 172.21.15.100:0/2640665991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e5b3390 0x561e6e966730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2640665991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e5b3390 msgr2=0x561e6e966730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e5b3390 0x561e6e966730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 msgr2=0x561e6e95f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2640665991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6e6957d0 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8c84001eb0 tx=0x7f8c84009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37a1a32fcb704be server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84035040 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c8403d690 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c840317a0 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8c8405b050 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8ca882f740 10 client.16932 fetch_fsmap learned FSMap version 51 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.487+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561e6e5cb3f0 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c840317a0 con 0x561e6e58a4d0 2024-04-30T23:29:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f8c840498c0 con 0x561e6e58a4d0 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 10 client.16932 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 20 client.16932 populate_metadata read hostname 'smithi100' 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e571f60 0x561e6e96c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 4 client.16932 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e6e8c7990 con 0x561e6e571f60 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.488+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e571f60 0x561e6e96c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.489+0000 7f8c7affd640 10 client.16932 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.489+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e571f60 0x561e6e96c7f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b2b2668af219558 server_cookie=c589b7fb12f7faab in_seq=0 out_seq=0 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.489+0000 7f8c7affd640 1 -- 172.21.15.100:0/2640665991 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x561e6e8c7990 con 0x561e6e571f60 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.489+0000 7f8c7affd640 10 client.16932 handle_command_reply: tid=0 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.489+0000 7f8ca882f740 1 client.16932 shutdown 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 msgr2=0x561e6e95f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8c84001eb0 tx=0x7f8c84009520 comp rx=0 tx=0).stop 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 shutdown_connections 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e571f60 0x561e6e96c7f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e5b3390 0x561e6e966730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8c7affd640 0 client.16932 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2640665991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e58a4d0 0x561e6e95f290 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 >> 172.21.15.100:0/2640665991 conn(0x561e6e5a74e0 msgr2=0x561e6e953c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 shutdown_connections 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 1 -- 172.21.15.100:0/2640665991 wait complete. 2024-04-30T23:29:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.490+0000 7f8ca882f740 20 client.16932 trim_cache size 0 max 16384 2024-04-30T23:29:19.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 Processor -- start 2024-04-30T23:29:19.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 -- start start 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e95a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1ab7a0 con 0x561e6e5b3390 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1ad2e0 con 0x561e6e5926b0 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8ca882f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1abe70 con 0x561e6e58a4d0 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.507+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52500/0 (socket says 172.21.15.100:52500) 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2969902220 learned_addr learned my addr 172.21.15.100:0/2969902220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e95a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2969902220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 msgr2=0x561e6e95a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e95a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2969902220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 msgr2=0x561e6e95d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/2969902220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6e58b0f0 con 0x561e6e5b3390 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9affd640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8c84049c90 tx=0x7f8c8404e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddcce37bf5ecf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c917fa640 1 -- 172.21.15.100:0/2969902220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84035070 con 0x561e6e5b3390 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c917fa640 1 -- 172.21.15.100:0/2969902220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c84050020 con 0x561e6e5b3390 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.508+0000 7f8c917fa640 1 -- 172.21.15.100:0/2969902220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8404c770 con 0x561e6e5b3390 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- 172.21.15.100:0/2969902220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 msgr2=0x561e6e95f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8c84049c90 tx=0x7f8c8404e040 comp rx=0 tx=0).stop 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- 172.21.15.100:0/2969902220 shutdown_connections 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e95f570 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e95d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 --2- 172.21.15.100:0/2969902220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e95a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- 172.21.15.100:0/2969902220 >> 172.21.15.100:0/2969902220 conn(0x561e6e5a74e0 msgr2=0x561e6e95ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- 172.21.15.100:0/2969902220 shutdown_connections 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- 172.21.15.100:0/2969902220 wait complete. 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 -- start start 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.509+0000 7f8ca882f740 1 Processor -- start 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e9cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e9cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1acc10 con 0x561e6e5b3390 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1ac540 con 0x561e6e5926b0 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1a9780 con 0x561e6e58a4d0 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 10 client.0 _ll_register_callbacks cb 0x7f8c940099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:29:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52504/0 (socket says 172.21.15.100:52504) 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/3358725607 learned_addr learned my addr 172.21.15.100:0/3358725607 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e9cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9affd640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e9cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/3358725607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 msgr2=0x561e6e9cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e9cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 msgr2=0x561e6e9cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e9cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 -- 172.21.15.100:0/3358725607 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6e87a4b0 con 0x561e6e5b3390 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c9a7fc640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8c840318f0 tx=0x7f8c84005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793261d7d0a6673 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:29:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84035030 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f8c84051070 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.510+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c84050020 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8c8403d690 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 10 client.16938 fetch_fsmap learned FSMap version 51 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561e6e9d40e0 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c84050020 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f8c8404c890 con 0x561e6e5b3390 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 10 client.16938 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 20 client.16938 populate_metadata read hostname 'smithi100' 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e5473a0 0x561e6e9d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 4 client.16938 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e6e8c1800 con 0x561e6e5473a0 2024-04-30T23:29:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.511+0000 7f8c9affd640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e5473a0 0x561e6e9d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8c9affd640 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e5473a0 0x561e6e9d69c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f2f946efd066c server_cookie=569fb7a345251f37 in_seq=0 out_seq=0 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8c7affd640 10 client.16938 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8c7affd640 1 -- 172.21.15.100:0/3358725607 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x561e6e8c1800 con 0x561e6e5473a0 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8c7affd640 10 client.16938 handle_command_reply: tid=0 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 client.16938 shutdown 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 msgr2=0x561e6e9d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8c840318f0 tx=0x7f8c84005950 comp rx=0 tx=0).stop 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 shutdown_connections 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x561e6e5473a0 0x561e6e9d69c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561e6e5b3390 0x561e6e9d2a60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8c7affd640 0 client.16938 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561e6e5926b0 0x561e6e9cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 --2- 172.21.15.100:0/3358725607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561e6e58a4d0 0x561e6e9cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 >> 172.21.15.100:0/3358725607 conn(0x561e6e5a74e0 msgr2=0x561e6e970f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 shutdown_connections 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 1 -- 172.21.15.100:0/3358725607 wait complete. 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.512+0000 7f8ca882f740 20 client.16938 trim_cache size 0 max 16384 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:29:19.522 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:29:19.523 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:29:19.524 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:19.525 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:19.526 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:29:19.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 msgr2=0x7f8c880a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 0x7f8c880a60c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c09bdf0 tx=0x7f8c8c0667f0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 msgr2=0x7f8c9c1a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00d750 tx=0x7f8c8c00dc10 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 shutdown_connections 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f8c880a3bb0 0x7f8c880a60c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c9c108960 0x7f8c9c1a0660 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c9c103c60 0x7f8c9c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 --2- 172.21.15.100:0/2955510580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c9c102a20 0x7f8c9c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 >> 172.21.15.100:0/2955510580 conn(0x7f8c9c0fdc10 msgr2=0x7f8c9c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 shutdown_connections 2024-04-30T23:29:19.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:19.513+0000 7f8ca189d640 1 -- 172.21.15.100:0/2955510580 wait complete. 2024-04-30T23:29:19.529 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:29:20.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:19 smithi104 ceph-mon[32987]: pgmap v844: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:20.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:19 smithi183 ceph-mon[33560]: pgmap v844: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:20.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:19 smithi100 ceph-mon[29745]: pgmap v844: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:22.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:21 smithi104 ceph-mon[32987]: pgmap v845: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:22.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:21 smithi183 ceph-mon[33560]: pgmap v845: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:22.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:21 smithi100 ceph-mon[29745]: pgmap v845: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:24.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:23 smithi104 ceph-mon[32987]: pgmap v846: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:24.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:23 smithi183 ceph-mon[33560]: pgmap v846: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:24.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:23 smithi100 ceph-mon[29745]: pgmap v846: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:26.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:25 smithi104 ceph-mon[32987]: pgmap v847: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:26.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:25 smithi183 ceph-mon[33560]: pgmap v847: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:25 smithi100 ceph-mon[29745]: pgmap v847: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:28.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:27 smithi104 ceph-mon[32987]: pgmap v848: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:28.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:27 smithi183 ceph-mon[33560]: pgmap v848: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:28.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:27 smithi100 ceph-mon[29745]: pgmap v848: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:30.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:29 smithi104 ceph-mon[32987]: pgmap v849: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:30.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:29 smithi183 ceph-mon[33560]: pgmap v849: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:30.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:29 smithi100 ceph-mon[29745]: pgmap v849: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:32.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:31 smithi104 ceph-mon[32987]: pgmap v850: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:32.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:31 smithi183 ceph-mon[33560]: pgmap v850: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:32.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:31 smithi100 ceph-mon[29745]: pgmap v850: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:34.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:33 smithi104 ceph-mon[32987]: pgmap v851: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:34.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:33 smithi183 ceph-mon[33560]: pgmap v851: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:34.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:33 smithi100 ceph-mon[29745]: pgmap v851: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:36.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:35 smithi104 ceph-mon[32987]: pgmap v852: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:36.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:35 smithi183 ceph-mon[33560]: pgmap v852: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:36.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:35 smithi100 ceph-mon[29745]: pgmap v852: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:38.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:37 smithi104 ceph-mon[32987]: pgmap v853: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:38.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:37 smithi183 ceph-mon[33560]: pgmap v853: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:38.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:37 smithi100 ceph-mon[29745]: pgmap v853: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:40.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:39 smithi104 ceph-mon[32987]: pgmap v854: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:40.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:39 smithi183 ceph-mon[33560]: pgmap v854: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:40.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:39 smithi100 ceph-mon[29745]: pgmap v854: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:42.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:41 smithi104 ceph-mon[32987]: pgmap v855: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:42.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:41 smithi183 ceph-mon[33560]: pgmap v855: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:42.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:41 smithi100 ceph-mon[29745]: pgmap v855: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:43.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:42 smithi104 ceph-mon[32987]: pgmap v856: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:43.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:42 smithi183 ceph-mon[33560]: pgmap v856: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:42 smithi100 ceph-mon[29745]: pgmap v856: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:45.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:44 smithi104 ceph-mon[32987]: pgmap v857: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:45.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:44 smithi183 ceph-mon[33560]: pgmap v857: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:45.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:44 smithi100 ceph-mon[29745]: pgmap v857: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:47.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:46 smithi104 ceph-mon[32987]: pgmap v858: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:47.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:46 smithi183 ceph-mon[33560]: pgmap v858: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:47.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:46 smithi100 ceph-mon[29745]: pgmap v858: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:49.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:48 smithi104 ceph-mon[32987]: pgmap v859: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:49.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:48 smithi183 ceph-mon[33560]: pgmap v859: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:49.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:48 smithi100 ceph-mon[29745]: pgmap v859: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:49.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:29:49.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:29:49.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- 172.21.15.100:0/3412742353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 msgr2=0x7f0a3810bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/3412742353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a3810bcd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009ca0 tx=0x7f0a3002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- 172.21.15.100:0/3412742353 shutdown_connections 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/3412742353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a3810bcd0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/3412742353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38106c50 0x7f0a38109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/3412742353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38101e70 0x7f0a38102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- 172.21.15.100:0/3412742353 >> 172.21.15.100:0/3412742353 conn(0x7f0a380fd380 msgr2=0x7f0a380ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- 172.21.15.100:0/3412742353 shutdown_connections 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- 172.21.15.100:0/3412742353 wait complete. 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 Processor -- start 2024-04-30T23:29:49.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.651+0000 7f0a3e39d640 1 -- start start 2024-04-30T23:29:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38101e70 0x7f0a3819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 0x7f0a3819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810f650 con 0x7f0a381097c0 2024-04-30T23:29:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810f4d0 con 0x7f0a38106c50 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3e39d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810f7d0 con 0x7f0a38101e70 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45958/0 (socket says 172.21.15.100:45958) 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 -- 172.21.15.100:0/2496145330 learned_addr learned my addr 172.21.15.100:0/2496145330 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a37fff640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38101e70 0x7f0a3819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a377fe640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 0x7f0a3819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 -- 172.21.15.100:0/2496145330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38101e70 msgr2=0x7f0a3819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38101e70 0x7f0a3819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 -- 172.21.15.100:0/2496145330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 msgr2=0x7f0a3819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 0x7f0a3819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a3c93a640 1 -- 172.21.15.100:0/2496145330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a381a1c50 con 0x7f0a381097c0 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.652+0000 7f0a377fe640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 0x7f0a3819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a3c93a640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0a300097b0 tx=0x7f0a30003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a357fa640 1 -- 172.21.15.100:0/2496145330 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30004240 con 0x7f0a381097c0 2024-04-30T23:29:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a381a1ee0 con 0x7f0a381097c0 2024-04-30T23:29:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a357fa640 1 -- 172.21.15.100:0/2496145330 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a3002f380 con 0x7f0a381097c0 2024-04-30T23:29:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a357fa640 1 -- 172.21.15.100:0/2496145330 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3002fc20 con 0x7f0a381097c0 2024-04-30T23:29:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.653+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a381a23a0 con 0x7f0a381097c0 2024-04-30T23:29:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 Processor -- start 2024-04-30T23:29:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a357fa640 1 -- 172.21.15.100:0/2496145330 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0a300305c0 con 0x7f0a381097c0 2024-04-30T23:29:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 -- start start 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e424390 0x55610e7c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55610e6ddb10 con 0x55610e4036b0 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55610e72ad80 con 0x55610e3fb4d0 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a45256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55610e6e48b0 con 0x55610e424390 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45960/0 (socket says 172.21.15.100:45960) 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a377fe640 1 -- 172.21.15.100:0/932490212 learned_addr learned my addr 172.21.15.100:0/932490212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a37fff640 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a377fe640 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e424390 0x55610e7c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.656+0000 7f0a357fa640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 0x7f0a200a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 -- 172.21.15.100:0/932490212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e424390 msgr2=0x55610e7c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e424390 0x55610e7c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 -- 172.21.15.100:0/932490212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 msgr2=0x55610e7c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a3c93a640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 0x7f0a200a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 -- 172.21.15.100:0/932490212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610e6b5a40 con 0x55610e4036b0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a357fa640 1 -- 172.21.15.100:0/2496145330 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0a300f2070 con 0x7f0a381097c0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a377fe640 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005fd0 tx=0x7f0a2c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310e3a80760d6043 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a1e7fc640 1 -- 172.21.15.100:0/932490212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c010490 con 0x55610e4036b0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a1e7fc640 1 -- 172.21.15.100:0/932490212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a2c010ae0 con 0x55610e4036b0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.657+0000 7f0a1e7fc640 1 -- 172.21.15.100:0/932490212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00e9c0 con 0x55610e4036b0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- 172.21.15.100:0/932490212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 msgr2=0x55610e7c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a3c93a640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 0x7f0a200a60c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0a30090a70 tx=0x7f0a300e9100 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005fd0 tx=0x7f0a2c00b460 comp rx=0 tx=0).stop 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- 172.21.15.100:0/932490212 shutdown_connections 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e4036b0 0x55610e7c7700 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 --2- 172.21.15.100:0/932490212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e424390 0x55610e7c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- 172.21.15.100:0/932490212 >> 172.21.15.100:0/932490212 conn(0x55610e4184e0 msgr2=0x55610e7c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- 172.21.15.100:0/932490212 shutdown_connections 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- 172.21.15.100:0/932490212 wait complete. 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.658+0000 7f0a45256740 1 -- start start 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 Processor -- start 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e7d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55610e6b1d10 con 0x55610e424390 2024-04-30T23:29:49.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55610e726d40 con 0x55610e3fb4d0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55610e7c8210 con 0x55610e4036b0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a45256740 10 client.0 _ll_register_callbacks cb 0x55610e737d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45964/0 (socket says 172.21.15.100:45964) 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 -- 172.21.15.100:0/1081258724 learned_addr learned my addr 172.21.15.100:0/1081258724 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a37fff640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e7d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 -- 172.21.15.100:0/1081258724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 msgr2=0x55610e7d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e7d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 -- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 msgr2=0x55610e7d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 -- 172.21.15.100:0/1081258724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610e5067d0 con 0x55610e424390 2024-04-30T23:29:49.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a377fe640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c004650 tx=0x7f0a2c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb658ceb02a072e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.659+0000 7f0a177fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00e780 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0a2c019040 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2c010ae0 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0a2c00e920 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 10 client.16950 fetch_fsmap learned FSMap version 51 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55610e43c3f0 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a2c010ae0 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f0a2c00f040 con 0x55610e424390 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 10 client.16950 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 20 client.16950 populate_metadata read hostname 'smithi100' 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e3e2f60 0x55610e7dd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 4 client.16950 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:29:49.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.660+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610e738990 con 0x55610e3e2f60 2024-04-30T23:29:49.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.661+0000 7f0a37fff640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e3e2f60 0x55610e7dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.661+0000 7f0a37fff640 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e3e2f60 0x55610e7dd920 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214757602056072f server_cookie=958874538cfabf90 in_seq=0 out_seq=0 2024-04-30T23:29:49.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.661+0000 7f0a177fe640 10 client.16950 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a177fe640 1 -- 172.21.15.100:0/1081258724 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x55610e738990 con 0x55610e3e2f60 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a177fe640 10 client.16950 handle_command_reply: tid=0 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 client.16950 shutdown 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 msgr2=0x55610e7d7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c004650 tx=0x7f0a2c005850 comp rx=0 tx=0).stop 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 shutdown_connections 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e3e2f60 0x55610e7dd920 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e424390 0x55610e7d7750 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e7d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a177fe640 0 client.16950 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 --2- 172.21.15.100:0/1081258724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 >> 172.21.15.100:0/1081258724 conn(0x55610e4184e0 msgr2=0x55610e7c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 shutdown_connections 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 1 -- 172.21.15.100:0/1081258724 wait complete. 2024-04-30T23:29:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.662+0000 7f0a45256740 20 client.16950 trim_cache size 0 max 16384 2024-04-30T23:29:49.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 Processor -- start 2024-04-30T23:29:49.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 -- start start 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e3e2f60 0x55610e7c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 0x55610e7d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381ac7d0 con 0x55610e3fb4d0 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381ae310 con 0x55610e4036b0 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a45256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381acea0 con 0x55610e3e2f60 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45974/0 (socket says 172.21.15.100:45974) 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 -- 172.21.15.100:0/27916993 learned_addr learned my addr 172.21.15.100:0/27916993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a377fe640 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 0x55610e7d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 -- 172.21.15.100:0/27916993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e3e2f60 msgr2=0x55610e7c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e3e2f60 0x55610e7c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 -- 172.21.15.100:0/27916993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 msgr2=0x55610e7d7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 0x55610e7d7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 -- 172.21.15.100:0/27916993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610e3fc0f0 con 0x55610e3fb4d0 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a377fe640 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 0x55610e7d7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.680+0000 7f0a37fff640 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x55610e7c2a90 tx=0x7f0a2800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d379629e3eb52f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a1dffb640 1 -- 172.21.15.100:0/27916993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a280203b0 con 0x55610e3fb4d0 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a1dffb640 1 -- 172.21.15.100:0/27916993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a28024070 con 0x55610e3fb4d0 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a1dffb640 1 -- 172.21.15.100:0/27916993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2801edc0 con 0x55610e3fb4d0 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 -- 172.21.15.100:0/27916993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 msgr2=0x55610e7c1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x55610e7c2a90 tx=0x7f0a2800a2d0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 -- 172.21.15.100:0/27916993 shutdown_connections 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e4036b0 0x55610e7d7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3fb4d0 0x55610e7c1c70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 --2- 172.21.15.100:0/27916993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e3e2f60 0x55610e7c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 -- 172.21.15.100:0/27916993 >> 172.21.15.100:0/27916993 conn(0x55610e4184e0 msgr2=0x55610e7ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 -- 172.21.15.100:0/27916993 shutdown_connections 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.681+0000 7f0a45256740 1 -- 172.21.15.100:0/27916993 wait complete. 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 -- start start 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 Processor -- start 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e841a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381adc40 con 0x55610e3e2f60 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381ad570 con 0x55610e3fb4d0 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a381aa7b0 con 0x55610e4036b0 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a45256740 10 client.0 _ll_register_callbacks cb 0x7f0a2800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45988/0 (socket says 172.21.15.100:45988) 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a377fe640 1 -- 172.21.15.100:0/4250451772 learned_addr learned my addr 172.21.15.100:0/4250451772 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.682+0000 7f0a37fff640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 -- 172.21.15.100:0/4250451772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 msgr2=0x55610e841a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e841a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 -- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 msgr2=0x55610e7d5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 -- 172.21.15.100:0/4250451772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610e6eb4b0 con 0x55610e3e2f60 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a377fe640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391689a688f4bb7c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c039020 con 0x55610e3e2f60 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0a2c019040 con 0x55610e3e2f60 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a28024070 con 0x55610e3e2f60 2024-04-30T23:29:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0a2c044050 con 0x55610e3e2f60 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a45256740 10 client.16956 fetch_fsmap learned FSMap version 51 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55610e842dc0 con 0x55610e3e2f60 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a28024070 con 0x55610e3e2f60 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.683+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f0a2c00e510 con 0x55610e3e2f60 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 10 client.16956 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 20 client.16956 populate_metadata read hostname 'smithi100' 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e424390 0x55610e8457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 4 client.16956 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55610e732800 con 0x55610e424390 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a37fff640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e424390 0x55610e8457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a37fff640 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e424390 0x55610e8457e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bdcc54346c350b7 server_cookie=eac6d7931dce4c73 in_seq=0 out_seq=0 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a177fe640 10 client.16956 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a177fe640 1 -- 172.21.15.100:0/4250451772 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55610e732800 con 0x55610e424390 2024-04-30T23:29:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a177fe640 10 client.16956 handle_command_reply: tid=0 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.684+0000 7f0a45256740 1 client.16956 shutdown 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 msgr2=0x55610e7d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c013e40 comp rx=0 tx=0).stop 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 shutdown_connections 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x55610e424390 0x55610e8457e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55610e4036b0 0x55610e841a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55610e3fb4d0 0x55610e7d5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 --2- 172.21.15.100:0/4250451772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55610e3e2f60 0x55610e7d4cd0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a177fe640 0 client.16956 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 >> 172.21.15.100:0/4250451772 conn(0x55610e4184e0 msgr2=0x55610e7c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 shutdown_connections 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 1 -- 172.21.15.100:0/4250451772 wait complete. 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a45256740 20 client.16956 trim_cache size 0 max 16384 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:29:49.694 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.695 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.696 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:29:49.697 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:29:49.698 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:29:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 msgr2=0x7f0a200a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 0x7f0a200a60c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0a30090a70 tx=0x7f0a300e9100 comp rx=0 tx=0).stop 2024-04-30T23:29:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 msgr2=0x7f0a381a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0a300097b0 tx=0x7f0a30003c20 comp rx=0 tx=0).stop 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 shutdown_connections 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f0a200a3bb0 0x7f0a200a60c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a381097c0 0x7f0a381a1690 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a38106c50 0x7f0a3819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 --2- 172.21.15.100:0/2496145330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a38101e70 0x7f0a3819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 >> 172.21.15.100:0/2496145330 conn(0x7f0a380fd380 msgr2=0x7f0a38107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 shutdown_connections 2024-04-30T23:29:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:29:49.685+0000 7f0a3e39d640 1 -- 172.21.15.100:0/2496145330 wait complete. 2024-04-30T23:29:49.700 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:29:51.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:51 smithi104 ceph-mon[32987]: pgmap v860: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:51.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:51 smithi183 ceph-mon[33560]: pgmap v860: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:51.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:51 smithi100 ceph-mon[29745]: pgmap v860: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:53.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:53 smithi104 ceph-mon[32987]: pgmap v861: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:53.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:53 smithi183 ceph-mon[33560]: pgmap v861: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:53.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:53 smithi100 ceph-mon[29745]: pgmap v861: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:29:55.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:55 smithi104 ceph-mon[32987]: pgmap v862: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:55.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:55 smithi183 ceph-mon[33560]: pgmap v862: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:55.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:55 smithi100 ceph-mon[29745]: pgmap v862: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:29:57.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:57 smithi104 ceph-mon[32987]: pgmap v863: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:57.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:57 smithi183 ceph-mon[33560]: pgmap v863: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:57.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:57 smithi100 ceph-mon[29745]: pgmap v863: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:29:58.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:29:58.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:29:58.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:29:58.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:29:58.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:29:58.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:29:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:59 smithi104 ceph-mon[32987]: pgmap v864: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:59 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:29:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:59 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:29:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:59 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:29:59.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:29:59 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:29:59.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:59 smithi183 ceph-mon[33560]: pgmap v864: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:59.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:59 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:29:59.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:59 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:29:59.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:59 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:29:59.304 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:29:59 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:29:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:59 smithi100 ceph-mon[29745]: pgmap v864: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:29:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:59 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-04-30T23:29:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:59 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi100 to 184726528: error parsing value: Value '184726528' is below minimum 939524096 2024-04-30T23:29:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:59 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi104 to 176.2M 2024-04-30T23:29:59.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:29:59 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi104 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-30T23:30:00.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:00 smithi104 ceph-mon[32987]: overall HEALTH_OK 2024-04-30T23:30:00.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:00 smithi183 ceph-mon[33560]: overall HEALTH_OK 2024-04-30T23:30:00.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:00 smithi100 ceph-mon[29745]: overall HEALTH_OK 2024-04-30T23:30:01.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:01 smithi104 ceph-mon[32987]: pgmap v865: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:01.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:01 smithi183 ceph-mon[33560]: pgmap v865: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:01.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:01 smithi100 ceph-mon[29745]: pgmap v865: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:03.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:03 smithi104 ceph-mon[32987]: pgmap v866: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:03.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:03 smithi183 ceph-mon[33560]: pgmap v866: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:03.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:03 smithi100 ceph-mon[29745]: pgmap v866: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:05.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:05 smithi104 ceph-mon[32987]: pgmap v867: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:05.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:05 smithi183 ceph-mon[33560]: pgmap v867: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:05.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:05 smithi100 ceph-mon[29745]: pgmap v867: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:07.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:07 smithi104 ceph-mon[32987]: pgmap v868: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:07.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:07 smithi183 ceph-mon[33560]: pgmap v868: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:07.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:07 smithi100 ceph-mon[29745]: pgmap v868: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:09.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:09 smithi104 ceph-mon[32987]: pgmap v869: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:09.302 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:09 smithi183 ceph-mon[33560]: pgmap v869: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:09 smithi100 ceph-mon[29745]: pgmap v869: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:11.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:11 smithi104 ceph-mon[32987]: pgmap v870: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:11.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:11 smithi183 ceph-mon[33560]: pgmap v870: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:11.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:11 smithi100 ceph-mon[29745]: pgmap v870: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:13.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:13 smithi183 ceph-mon[33560]: pgmap v871: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:13.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:13 smithi100 ceph-mon[29745]: pgmap v871: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:13.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:13 smithi104 ceph-mon[32987]: pgmap v871: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:15.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:15 smithi183 ceph-mon[33560]: pgmap v872: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:15.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:15 smithi100 ceph-mon[29745]: pgmap v872: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:15.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:15 smithi104 ceph-mon[32987]: pgmap v872: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:17.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:17 smithi100 ceph-mon[29745]: pgmap v873: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:17.350 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:17 smithi104 ceph-mon[32987]: pgmap v873: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:17.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:17 smithi183 ceph-mon[33560]: pgmap v873: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:19 smithi100 ceph-mon[29745]: pgmap v874: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:19.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:19 smithi104 ceph-mon[32987]: pgmap v874: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:19.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:19 smithi183 ceph-mon[33560]: pgmap v874: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:19.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:30:19.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:30:19.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- 172.21.15.100:0/747935042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 msgr2=0x7fbaac10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 --2- 172.21.15.100:0/747935042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac10be90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009ca0 tx=0x7fbaa402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- 172.21.15.100:0/747935042 shutdown_connections 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 --2- 172.21.15.100:0/747935042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac10be90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 --2- 172.21.15.100:0/747935042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 0x7fbaac105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 --2- 172.21.15.100:0/747935042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 0x7fbaac104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- 172.21.15.100:0/747935042 >> 172.21.15.100:0/747935042 conn(0x7fbaac0fed20 msgr2=0x7fbaac1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- 172.21.15.100:0/747935042 shutdown_connections 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- 172.21.15.100:0/747935042 wait complete. 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 Processor -- start 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.824+0000 7fbab258d640 1 -- start start 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 0x7fbaac19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 0x7fbaac19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac10f690 con 0x7fbaac109a70 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac10f510 con 0x7fbaac104d70 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab258d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac10f810 con 0x7fbaac103b30 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42170/0 (socket says 172.21.15.100:42170) 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 -- 172.21.15.100:0/3784773250 learned_addr learned my addr 172.21.15.100:0/3784773250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbaabfff640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 0x7fbaac19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 0x7fbaac19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 -- 172.21.15.100:0/3784773250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 msgr2=0x7fbaac19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 0x7fbaac19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 -- 172.21.15.100:0/3784773250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 msgr2=0x7fbaac19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 0x7fbaac19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.825+0000 7fbab0b2a640 1 -- 172.21.15.100:0/3784773250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac1a1d10 con 0x7fbaac109a70 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbab0b2a640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4003ba0 tx=0x7fbaa4003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbaa97fa640 1 -- 172.21.15.100:0/3784773250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40317c0 con 0x7fbaac109a70 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac1a1fa0 con 0x7fbaac109a70 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbaa97fa640 1 -- 172.21.15.100:0/3784773250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40044f0 con 0x7fbaac109a70 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbaa97fa640 1 -- 172.21.15.100:0/3784773250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa402fd00 con 0x7fbaac109a70 2024-04-30T23:30:19.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.826+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1a2460 con 0x7fbaac109a70 2024-04-30T23:30:19.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.828+0000 7fbab9447740 1 Processor -- start 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.828+0000 7fbaa97fa640 1 -- 172.21.15.100:0/3784773250 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbaa40305c0 con 0x7fbaac109a70 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.828+0000 7fbab9447740 1 -- start start 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 0x560c77ea84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77ae56b0 0x560c77ea9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c77dbfb10 con 0x560c77add4d0 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c77e0cd80 con 0x560c77ae56b0 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab9447740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560c77dc68b0 con 0x560c77b06390 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42184/0 (socket says 172.21.15.100:42184) 2024-04-30T23:30:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 -- 172.21.15.100:0/121625524 learned_addr learned my addr 172.21.15.100:0/121625524 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 0x560c77ea84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaa97fa640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 0x7fba940a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 -- 172.21.15.100:0/121625524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 msgr2=0x560c77ea84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 0x560c77ea84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 -- 172.21.15.100:0/121625524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77ae56b0 msgr2=0x560c77ea9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77ae56b0 0x560c77ea9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 -- 172.21.15.100:0/121625524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c77d97a40 con 0x560c77add4d0 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 0x560c77ea84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbab0b2a640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 0x7fba940a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaabfff640 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cb90 tx=0x7fba9c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3bcf9282834fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fbaa97fa640 1 -- 172.21.15.100:0/3784773250 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbaa40f2010 con 0x7fbaac109a70 2024-04-30T23:30:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fba927fc640 1 -- 172.21.15.100:0/121625524 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c005220 con 0x560c77add4d0 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fba927fc640 1 -- 172.21.15.100:0/121625524 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c004c50 con 0x560c77add4d0 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.829+0000 7fba927fc640 1 -- 172.21.15.100:0/121625524 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c010700 con 0x560c77add4d0 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 -- 172.21.15.100:0/121625524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 msgr2=0x560c77ea8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab0b2a640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 0x7fba940a60c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40efb20 tx=0x7fbaa4090ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cb90 tx=0x7fba9c00e720 comp rx=0 tx=0).stop 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 -- 172.21.15.100:0/121625524 shutdown_connections 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77ae56b0 0x560c77ea9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77add4d0 0x560c77ea8a70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 --2- 172.21.15.100:0/121625524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77b06390 0x560c77ea84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 -- 172.21.15.100:0/121625524 >> 172.21.15.100:0/121625524 conn(0x560c77afa4e0 msgr2=0x560c77ea3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 -- 172.21.15.100:0/121625524 shutdown_connections 2024-04-30T23:30:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.830+0000 7fbab9447740 1 -- 172.21.15.100:0/121625524 wait complete. 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 -- start start 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 Processor -- start 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c77d93d10 con 0x560c77b06390 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c77e08d40 con 0x560c77add4d0 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560c77eaa210 con 0x560c77ae56b0 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbab9447740 10 client.0 _ll_register_callbacks cb 0x560c77e19d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42198/0 (socket says 172.21.15.100:42198) 2024-04-30T23:30:19.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbaab7fe640 1 -- 172.21.15.100:0/1536584291 learned_addr learned my addr 172.21.15.100:0/1536584291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:19.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.831+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaabfff640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 -- 172.21.15.100:0/1536584291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 msgr2=0x560c77eb27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 -- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 msgr2=0x560c77eb2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 -- 172.21.15.100:0/1536584291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c77be87d0 con 0x560c77b06390 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaabfff640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0013fd0 tx=0x7fbaa000c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898edc225df3a21e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fba8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011e80 con 0x560c77b06390 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbaa0004030 con 0x560c77b06390 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba9c004c50 con 0x560c77b06390 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbaa0028050 con 0x560c77b06390 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbab9447740 10 client.16968 fetch_fsmap learned FSMap version 51 2024-04-30T23:30:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560c77b1e3f0 con 0x560c77b06390 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.832+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c004c50 con 0x560c77b06390 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fbaa000f430 con 0x560c77b06390 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 10 client.16968 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 20 client.16968 populate_metadata read hostname 'smithi100' 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77ac4f60 0x560c77ebfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 4 client.16968 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c77e1a990 con 0x560c77ac4f60 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.833+0000 7fbaabfff640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77ac4f60 0x560c77ebfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.834+0000 7fbaabfff640 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77ac4f60 0x560c77ebfc40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95659da8af0f72a4 server_cookie=dad0bd4311336f4e in_seq=0 out_seq=0 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.834+0000 7fba8b7fe640 10 client.16968 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.834+0000 7fba8b7fe640 1 -- 172.21.15.100:0/1536584291 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x560c77e1a990 con 0x560c77ac4f60 2024-04-30T23:30:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.834+0000 7fba8b7fe640 10 client.16968 handle_command_reply: tid=0 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.834+0000 7fbab9447740 1 client.16968 shutdown 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 msgr2=0x560c77eb9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0013fd0 tx=0x7fbaa000c690 comp rx=0 tx=0).stop 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 shutdown_connections 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77ac4f60 0x560c77ebfc40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77eb9730 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fba8b7fe640 0 client.16968 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 --2- 172.21.15.100:0/1536584291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 >> 172.21.15.100:0/1536584291 conn(0x560c77afa4e0 msgr2=0x560c77ea6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 shutdown_connections 2024-04-30T23:30:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 1 -- 172.21.15.100:0/1536584291 wait complete. 2024-04-30T23:30:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.835+0000 7fbab9447740 20 client.16968 trim_cache size 0 max 16384 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.852+0000 7fbab9447740 1 Processor -- start 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.852+0000 7fbab9447740 1 -- start start 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77add4d0 0x560c77ea7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77b06390 0x560c77ec5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1ac8f0 con 0x560c77ae56b0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1ae430 con 0x560c77b06390 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbab9447740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1acfc0 con 0x560c77add4d0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42206/0 (socket says 172.21.15.100:42206) 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 -- 172.21.15.100:0/983574382 learned_addr learned my addr 172.21.15.100:0/983574382 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77b06390 0x560c77ec5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77add4d0 0x560c77ea7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 -- 172.21.15.100:0/983574382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77add4d0 msgr2=0x560c77ea7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77add4d0 0x560c77ea7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 -- 172.21.15.100:0/983574382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77b06390 msgr2=0x560c77ec5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77b06390 0x560c77ec5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 -- 172.21.15.100:0/983574382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c77ade0f0 con 0x560c77ae56b0 2024-04-30T23:30:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fbaabfff640 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00d010 tx=0x7fba9c004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70694e5c618bb7ca server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fba91ffb640 1 -- 172.21.15.100:0/983574382 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c02b070 con 0x560c77ae56b0 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fba91ffb640 1 -- 172.21.15.100:0/983574382 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c0278e0 con 0x560c77ae56b0 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.853+0000 7fba91ffb640 1 -- 172.21.15.100:0/983574382 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c003a90 con 0x560c77ae56b0 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- 172.21.15.100:0/983574382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 msgr2=0x560c77ea7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00d010 tx=0x7fba9c004810 comp rx=0 tx=0).stop 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- 172.21.15.100:0/983574382 shutdown_connections 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77b06390 0x560c77ec5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77ae56b0 0x560c77ea7750 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 --2- 172.21.15.100:0/983574382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77add4d0 0x560c77ea7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- 172.21.15.100:0/983574382 >> 172.21.15.100:0/983574382 conn(0x560c77afa4e0 msgr2=0x560c77ea6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- 172.21.15.100:0/983574382 shutdown_connections 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- 172.21.15.100:0/983574382 wait complete. 2024-04-30T23:30:19.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.854+0000 7fbab9447740 1 -- start start 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 Processor -- start 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1add60 con 0x560c77b06390 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1ad690 con 0x560c77add4d0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1aa8d0 con 0x560c77ae56b0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbab9447740 10 client.0 _ll_register_callbacks cb 0x7fbaa000cb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42210/0 (socket says 172.21.15.100:42210) 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 -- 172.21.15.100:0/505552396 learned_addr learned my addr 172.21.15.100:0/505552396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaabfff640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 -- 172.21.15.100:0/505552396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 msgr2=0x560c77eb9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 -- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 msgr2=0x560c77eb9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 -- 172.21.15.100:0/505552396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c77dcd4b0 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fbaab7fe640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0005fd0 tx=0x7fbaa000c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dbe3f0653447f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.855+0000 7fba8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000f9f0 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbaa000fb90 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba9c0278e0 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbaa0004030 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 10 client.16974 fetch_fsmap learned FSMap version 51 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560c77f25a60 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c0278e0 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fbaa0003b30 con 0x560c77b06390 2024-04-30T23:30:19.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 10 client.16974 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 20 client.16974 populate_metadata read hostname 'smithi100' 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77a9a3a0 0x560c77f28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 4 client.16974 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c77e14800 con 0x560c77a9a3a0 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.856+0000 7fbaabfff640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77a9a3a0 0x560c77f28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fba8b7fe640 10 client.16974 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbaabfff640 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77a9a3a0 0x560c77f28420 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c48ba27447decc server_cookie=adeb5de437178f7e in_seq=0 out_seq=0 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fba8b7fe640 1 -- 172.21.15.100:0/505552396 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x560c77e14800 con 0x560c77a9a3a0 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fba8b7fe640 10 client.16974 handle_command_reply: tid=0 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 client.16974 shutdown 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 msgr2=0x560c77f243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0005fd0 tx=0x7fbaa000c690 comp rx=0 tx=0).stop 2024-04-30T23:30:19.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 shutdown_connections 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x560c77a9a3a0 0x560c77f28420 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c77b06390 0x560c77f243e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560c77ae56b0 0x560c77eb9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 --2- 172.21.15.100:0/505552396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c77add4d0 0x560c77eb9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fba8b7fe640 0 client.16974 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 >> 172.21.15.100:0/505552396 conn(0x560c77afa4e0 msgr2=0x560c77ea7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 shutdown_connections 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 1 -- 172.21.15.100:0/505552396 wait complete. 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.857+0000 7fbab9447740 20 client.16974 trim_cache size 0 max 16384 2024-04-30T23:30:19.867 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.868 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.869 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:30:19.870 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:19.871 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:19.872 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 msgr2=0x7fba940a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 0x7fba940a60c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40efb20 tx=0x7fbaa4090ad0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 msgr2=0x7fbaac1a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4003ba0 tx=0x7fbaa4003bd0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 shutdown_connections 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fba940a3bb0 0x7fba940a60c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaac109a70 0x7fbaac1a16a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaac104d70 0x7fbaac19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 --2- 172.21.15.100:0/3784773250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac103b30 0x7fbaac19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 >> 172.21.15.100:0/3784773250 conn(0x7fbaac0fed20 msgr2=0x7fbaac105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 shutdown_connections 2024-04-30T23:30:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:19.858+0000 7fbab258d640 1 -- 172.21.15.100:0/3784773250 wait complete. 2024-04-30T23:30:19.875 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:30:21.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:21 smithi100 ceph-mon[29745]: pgmap v875: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:21.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:21 smithi104 ceph-mon[32987]: pgmap v875: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:21.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:21 smithi183 ceph-mon[33560]: pgmap v875: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:23.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:23 smithi100 ceph-mon[29745]: pgmap v876: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:23.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:23 smithi104 ceph-mon[32987]: pgmap v876: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:23.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:23 smithi183 ceph-mon[33560]: pgmap v876: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:25.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:25 smithi100 ceph-mon[29745]: pgmap v877: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:25.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:25 smithi104 ceph-mon[32987]: pgmap v877: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:25.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:25 smithi183 ceph-mon[33560]: pgmap v877: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:27.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:27 smithi100 ceph-mon[29745]: pgmap v878: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:27.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:27 smithi104 ceph-mon[32987]: pgmap v878: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:27.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:27 smithi183 ceph-mon[33560]: pgmap v878: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:29.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:29 smithi100 ceph-mon[29745]: pgmap v879: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:29.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:29 smithi104 ceph-mon[32987]: pgmap v879: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:29.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:29 smithi183 ceph-mon[33560]: pgmap v879: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:31.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:31 smithi104 ceph-mon[32987]: pgmap v880: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:31.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:31 smithi183 ceph-mon[33560]: pgmap v880: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:31.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:31 smithi100 ceph-mon[29745]: pgmap v880: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:33 smithi104 ceph-mon[32987]: pgmap v881: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:33 smithi183 ceph-mon[33560]: pgmap v881: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:33.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:33 smithi100 ceph-mon[29745]: pgmap v881: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:35.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:35 smithi104 ceph-mon[32987]: pgmap v882: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:35.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:35 smithi183 ceph-mon[33560]: pgmap v882: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:35.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:35 smithi100 ceph-mon[29745]: pgmap v882: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:37.377 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:37 smithi100 ceph-mon[29745]: pgmap v883: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:37.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:37 smithi104 ceph-mon[32987]: pgmap v883: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:37.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:37 smithi183 ceph-mon[33560]: pgmap v883: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:39.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:39 smithi104 ceph-mon[32987]: pgmap v884: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:39.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:39 smithi183 ceph-mon[33560]: pgmap v884: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:39.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:39 smithi100 ceph-mon[29745]: pgmap v884: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:41.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:41 smithi104 ceph-mon[32987]: pgmap v885: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:41.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:41 smithi183 ceph-mon[33560]: pgmap v885: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:41.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:41 smithi100 ceph-mon[29745]: pgmap v885: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:43.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:43 smithi104 ceph-mon[32987]: pgmap v886: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:43.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:43 smithi183 ceph-mon[33560]: pgmap v886: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:43.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:43 smithi100 ceph-mon[29745]: pgmap v886: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:45.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:45 smithi104 ceph-mon[32987]: pgmap v887: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:45.552 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:45 smithi183 ceph-mon[33560]: pgmap v887: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:45.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:45 smithi100 ceph-mon[29745]: pgmap v887: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:47.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:47 smithi104 ceph-mon[32987]: pgmap v888: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:47.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:47 smithi183 ceph-mon[33560]: pgmap v888: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:47.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:47 smithi100 ceph-mon[29745]: pgmap v888: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:49.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:49 smithi104 ceph-mon[32987]: pgmap v889: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:49.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:49 smithi183 ceph-mon[33560]: pgmap v889: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:49.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:49 smithi100 ceph-mon[29745]: pgmap v889: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:49.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-30T23:30:49.876 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-30T23:30:50.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 -- 172.21.15.100:0/2097967799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09401098d0 msgr2=0x7f094010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 --2- 172.21.15.100:0/2097967799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09401098d0 0x7f094010bcf0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ca0 tx=0x7f093802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 -- 172.21.15.100:0/2097967799 shutdown_connections 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 --2- 172.21.15.100:0/2097967799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09401098d0 0x7f094010bcf0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 --2- 172.21.15.100:0/2097967799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0940106f70 0x7f0940109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 --2- 172.21.15.100:0/2097967799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 0x7f0940106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 -- 172.21.15.100:0/2097967799 >> 172.21.15.100:0/2097967799 conn(0x7f09400fdc10 msgr2=0x7f09401000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 -- 172.21.15.100:0/2097967799 shutdown_connections 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.997+0000 7f094853f640 1 -- 172.21.15.100:0/2097967799 wait complete. 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 Processor -- start 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 -- start start 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 0x7f094019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 0x7f09401a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f094010f650 con 0x7f0940106f70 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f094010f4d0 con 0x7f09401098d0 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f094853f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f094010f7d0 con 0x7f0940104610 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56838/0 (socket says 172.21.15.100:56838) 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 -- 172.21.15.100:0/873040507 learned_addr learned my addr 172.21.15.100:0/873040507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f09462db640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 0x7f094019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0946adc640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 0x7f09401a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 -- 172.21.15.100:0/873040507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 msgr2=0x7f094019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 0x7f094019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 -- 172.21.15.100:0/873040507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 msgr2=0x7f09401a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 0x7f09401a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 -- 172.21.15.100:0/873040507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09401a20c0 con 0x7f0940106f70 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0946adc640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 0x7f09401a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f0945ada640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f093000d950 tx=0x7f093000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.998+0000 7f09377fe640 1 -- 172.21.15.100:0/873040507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930017030 con 0x7f0940106f70 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.999+0000 7f09377fe640 1 -- 172.21.15.100:0/873040507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0930004020 con 0x7f0940106f70 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.999+0000 7f09377fe640 1 -- 172.21.15.100:0/873040507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300047a0 con 0x7f0940106f70 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.999+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09401a23b0 con 0x7f0940106f70 2024-04-30T23:30:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:49.999+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401a2900 con 0x7f0940106f70 2024-04-30T23:30:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.001+0000 7f09377fe640 1 -- 172.21.15.100:0/873040507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0930009a30 con 0x7f0940106f70 2024-04-30T23:30:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.001+0000 7f094f3f3740 1 Processor -- start 2024-04-30T23:30:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 -- start start 2024-04-30T23:30:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1e2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c1f0f8b10 con 0x562c1ee164d0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562c1f145d80 con 0x562c1ee3f390 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f094f3f3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562c1f0ff8b0 con 0x562c1ee1e6b0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56854/0 (socket says 172.21.15.100:56854) 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 -- 172.21.15.100:0/2031862014 learned_addr learned my addr 172.21.15.100:0/2031862014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09377fe640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 0x7f092c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f0945ada640 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f0946adc640 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f0946adc640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 0x7f092c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 -- 172.21.15.100:0/2031862014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 msgr2=0x562c1f1e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1e2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 -- 172.21.15.100:0/2031862014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 msgr2=0x562c1f1e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.002+0000 7f09462db640 1 -- 172.21.15.100:0/2031862014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1f0d0a40 con 0x562c1ee164d0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f09377fe640 1 -- 172.21.15.100:0/873040507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f09300d0240 con 0x7f0940106f70 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f09462db640 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f093c00bc90 tx=0x7f093c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0a626f0b5ff18f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f0946adc640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 0x7f092c0a60c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0938005cc0 tx=0x7f0938005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f0934bfe640 1 -- 172.21.15.100:0/2031862014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c015070 con 0x562c1ee164d0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f0934bfe640 1 -- 172.21.15.100:0/2031862014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093c01a910 con 0x562c1ee164d0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.003+0000 7f0934bfe640 1 -- 172.21.15.100:0/2031862014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c011830 con 0x562c1ee164d0 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- 172.21.15.100:0/2031862014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 msgr2=0x562c1f1e1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f093c00bc90 tx=0x7f093c00f730 comp rx=0 tx=0).stop 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- 172.21.15.100:0/2031862014 shutdown_connections 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1e1a70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2031862014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- 172.21.15.100:0/2031862014 >> 172.21.15.100:0/2031862014 conn(0x562c1ee334e0 msgr2=0x562c1f1dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- 172.21.15.100:0/2031862014 shutdown_connections 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- 172.21.15.100:0/2031862014 wait complete. 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 -- start start 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.004+0000 7f094f3f3740 1 Processor -- start 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c1f0ccd10 con 0x562c1ee164d0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562c1f141d40 con 0x562c1ee3f390 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562c1f1e3210 con 0x562c1ee1e6b0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f094f3f3740 10 client.0 _ll_register_callbacks cb 0x562c1f152d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56860/0 (socket says 172.21.15.100:56860) 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 -- 172.21.15.100:0/21469992 learned_addr learned my addr 172.21.15.100:0/21469992 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f0945ada640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f0946adc640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 -- 172.21.15.100:0/21469992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 msgr2=0x562c1f1eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 -- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 msgr2=0x562c1f1f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 -- 172.21.15.100:0/21469992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1ef217d0 con 0x562c1ee164d0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f09462db640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f093c01a690 tx=0x7f093c01a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19371f7c7f39d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f0929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c028060 con 0x562c1ee164d0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.005+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f093c01acd0 con 0x562c1ee164d0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093c01a910 con 0x562c1ee164d0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f093c02f050 con 0x562c1ee164d0 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 10 client.16986 fetch_fsmap learned FSMap version 51 2024-04-30T23:30:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562c1ee573f0 con 0x562c1ee164d0 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093c01a910 con 0x562c1ee164d0 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f093c004a80 con 0x562c1ee164d0 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 10 client.16986 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 20 client.16986 populate_metadata read hostname 'smithi100' 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edfdf60 0x562c1f1f8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 4 client.16986 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c1f153990 con 0x562c1edfdf60 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.006+0000 7f0945ada640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edfdf60 0x562c1f1f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.007+0000 7f0929ffb640 10 client.16986 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.007+0000 7f0945ada640 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edfdf60 0x562c1f1f8960 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99d677f1378a2e2 server_cookie=b3dc916cdc2f9631 in_seq=0 out_seq=0 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.007+0000 7f0929ffb640 1 -- 172.21.15.100:0/21469992 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23519 (crc 0 0 0) 0x562c1f153990 con 0x562c1edfdf60 2024-04-30T23:30:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.007+0000 7f0929ffb640 10 client.16986 handle_command_reply: tid=0 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.007+0000 7f094f3f3740 1 client.16986 shutdown 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 msgr2=0x562c1f1eb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f093c01a690 tx=0x7f093c01a6c0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 shutdown_connections 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edfdf60 0x562c1f1f8960 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f0929ffb640 0 client.16986 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee1e6b0 0x562c1f1eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 --2- 172.21.15.100:0/21469992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee164d0 0x562c1f1eb2f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 >> 172.21.15.100:0/21469992 conn(0x562c1ee334e0 msgr2=0x562c1f1dfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 shutdown_connections 2024-04-30T23:30:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 1 -- 172.21.15.100:0/21469992 wait complete. 2024-04-30T23:30:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.008+0000 7f094f3f3740 20 client.16986 trim_cache size 0 max 16384 2024-04-30T23:30:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 Processor -- start 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 -- start start 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1ea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09401ac9a0 con 0x562c1ee1e6b0 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f09401ae4e0 con 0x562c1ee3f390 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.025+0000 7f094f3f3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09401ad070 con 0x562c1ee164d0 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56872/0 (socket says 172.21.15.100:56872) 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 -- 172.21.15.100:0/2141962468 learned_addr learned my addr 172.21.15.100:0/2141962468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f09462db640 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0946adc640 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 -- 172.21.15.100:0/2141962468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 msgr2=0x562c1f1ea020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1ea020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 -- 172.21.15.100:0/2141962468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 msgr2=0x562c1f1f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 -- 172.21.15.100:0/2141962468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1ee170f0 con 0x562c1ee1e6b0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f0945ada640 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f09300cdd50 tx=0x7f09300cd8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b353f0414a37bc92 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f092bfff640 1 -- 172.21.15.100:0/2141962468 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300b5070 con 0x562c1ee1e6b0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f092bfff640 1 -- 172.21.15.100:0/2141962468 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093009c8c0 con 0x562c1ee1e6b0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.026+0000 7f092bfff640 1 -- 172.21.15.100:0/2141962468 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093009a4c0 con 0x562c1ee1e6b0 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- 172.21.15.100:0/2141962468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 msgr2=0x562c1f1f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f09300cdd50 tx=0x7f09300cd8b0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- 172.21.15.100:0/2141962468 shutdown_connections 2024-04-30T23:30:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee3f390 0x562c1f1f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f26b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 --2- 172.21.15.100:0/2141962468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- 172.21.15.100:0/2141962468 >> 172.21.15.100:0/2141962468 conn(0x562c1ee334e0 msgr2=0x562c1f1e9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- 172.21.15.100:0/2141962468 shutdown_connections 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- 172.21.15.100:0/2141962468 wait complete. 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 -- start start 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.027+0000 7f094f3f3740 1 Processor -- start 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09401ade10 con 0x562c1ee3f390 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f09401ad740 con 0x562c1ee1e6b0 2024-04-30T23:30:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09401aa980 con 0x562c1ee164d0 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 10 client.0 _ll_register_callbacks cb 0x7f093009bf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56886/0 (socket says 172.21.15.100:56886) 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 -- 172.21.15.100:0/540302399 learned_addr learned my addr 172.21.15.100:0/540302399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f09462db640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 -- 172.21.15.100:0/540302399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 msgr2=0x562c1f1f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 -- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee1e6b0 msgr2=0x562c1f1f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T23:30:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 -- 172.21.15.100:0/540302399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1f1064b0 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0946adc640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ca0 tx=0x7f09380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd216a5ac52f32e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938003c40 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f0938044070 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.028+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093009c8c0 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0938003de0 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 10 client.16992 fetch_fsmap learned FSMap version 51 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562c1f25dc40 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093009c8c0 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f093802fa30 con 0x562c1ee3f390 2024-04-30T23:30:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 10 client.16992 fetch_fsmap finished waiting for FSMap version 51 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 20 client.16992 populate_metadata read hostname 'smithi100' 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edd33a0 0x562c1f2606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 4 client.16992 mds_command: new command op to 24545 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 --> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c1f14d800 con 0x562c1edd33a0 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.029+0000 7f09462db640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edd33a0 0x562c1f2606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f0929ffb640 10 client.16992 ms_handle_connect on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f09462db640 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edd33a0 0x562c1f2606b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3332538c0d4d8248 server_cookie=75dba1797521a80 in_seq=0 out_seq=0 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f0929ffb640 1 -- 172.21.15.100:0/540302399 <== mds.0 v2:172.21.15.104:6838/1200691747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x562c1f14d800 con 0x562c1edd33a0 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f0929ffb640 10 client.16992 handle_command_reply: tid=0 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 client.16992 shutdown 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 msgr2=0x562c1f1f2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ca0 tx=0x7f09380095c0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 shutdown_connections 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:6838/1200691747,v1:172.21.15.104:6839/1200691747] conn(0x562c1edd33a0 0x562c1f2606b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c1ee3f390 0x562c1f1f2260 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562c1ee1e6b0 0x562c1f1f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f0929ffb640 0 client.16992 ms_handle_reset on v2:172.21.15.104:6838/1200691747 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 --2- 172.21.15.100:0/540302399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c1ee164d0 0x562c1f1f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 >> 172.21.15.100:0/540302399 conn(0x562c1ee334e0 msgr2=0x562c1f1eb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 shutdown_connections 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 1 -- 172.21.15.100:0/540302399 wait complete. 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.030+0000 7f094f3f3740 20 client.16992 trim_cache size 0 max 16384 2024-04-30T23:30:50.040 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3", 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_stats": { 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3": { 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:16:14.760978+0000", 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "c14be86f-5996-4cf9-8d37-56709dfaa780": { 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:09.200803+0000", 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "d5625cc7-aaf4-4537-be59-f57f7bae4dab": { 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:36.531214+0000", 2024-04-30T23:30:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "bba78046-48dc-428e-b8a2-3c1236d5a61b": { 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:15:41.963390+0000", 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "fb7fb6d3-25b8-41a5-a60a-0d3e78232348": { 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:13:30.902039+0000", 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "54920341-8007-47f5-bc55-b82e8703fc8a": { 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "start_time": "2024-04-30T23:14:03.684627+0000", 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-04-30T23:30:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_passed": 0, 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_failed": 0, 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_skipped": 0 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:50.045 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 msgr2=0x7f092c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 0x7f092c0a60c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0938005cc0 tx=0x7f0938005fd0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 msgr2=0x7f094019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f093000d950 tx=0x7f093000de10 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 shutdown_connections 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f092c0a3bb0 0x7f092c0a60c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09401098d0 0x7f09401a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0940106f70 0x7f094019aac0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 --2- 172.21.15.100:0/873040507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0940104610 0x7f094019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 >> 172.21.15.100:0/873040507 conn(0x7f09400fdc10 msgr2=0x7f0940105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 shutdown_connections 2024-04-30T23:30:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.031+0000 7f094853f640 1 -- 172.21.15.100:0/873040507 wait complete. 2024-04-30T23:30:50.048 INFO:tasks.cephfs.filesystem:scrub status for tag:35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3 - {'path': '/', 'tag': '35d0f1a0-2a6e-4af6-ac54-13ecdb2123b3', 'options': 'recursive,force'} 2024-04-30T23:30:50.048 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/cephfs/filesystem.py", line 1802, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2024-04-30T23:30:50.050 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_8505bf412a33fc9b7838e91f3a227044bc06f5ed/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2024-04-30T23:30:50.051 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-30T23:30:50.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:30:50.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 -- 172.21.15.100:0/1576282595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 msgr2=0x7f6938103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 --2- 172.21.15.100:0/1576282595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938103400 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6928009900 tx=0x7f692802a410 comp rx=0 tx=0).stop 2024-04-30T23:30:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 -- 172.21.15.100:0/1576282595 shutdown_connections 2024-04-30T23:30:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 --2- 172.21.15.100:0/1576282595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 0x7f693810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 --2- 172.21.15.100:0/1576282595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 0x7f6938103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 --2- 172.21.15.100:0/1576282595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938103400 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 -- 172.21.15.100:0/1576282595 >> 172.21.15.100:0/1576282595 conn(0x7f69380fd3d0 msgr2=0x7f69380ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 -- 172.21.15.100:0/1576282595 shutdown_connections 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.167+0000 7f693c88b640 1 -- 172.21.15.100:0/1576282595 wait complete. 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 Processor -- start 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 -- start start 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 0x7f6938199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 0x7f69381a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f693810e570 con 0x7f6938102ff0 2024-04-30T23:30:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f693810e3f0 con 0x7f69381039d0 2024-04-30T23:30:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693c88b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f693810e6f0 con 0x7f69381044d0 2024-04-30T23:30:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56912/0 (socket says 172.21.15.100:56912) 2024-04-30T23:30:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.168+0000 7f693659c640 1 -- 172.21.15.100:0/1190108448 learned_addr learned my addr 172.21.15.100:0/1190108448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 0x7f6938199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f6936d9d640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 0x7f69381a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 -- 172.21.15.100:0/1190108448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 msgr2=0x7f69381a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 0x7f69381a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 -- 172.21.15.100:0/1190108448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 msgr2=0x7f6938199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 0x7f6938199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 -- 172.21.15.100:0/1190108448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69381a0be0 con 0x7f6938102ff0 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693659c640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6928006010 tx=0x7f6928031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692803f030 con 0x7f6938102ff0 2024-04-30T23:30:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6928003aa0 con 0x7f6938102ff0 2024-04-30T23:30:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69381a0e70 con 0x7f6938102ff0 2024-04-30T23:30:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928035070 con 0x7f6938102ff0 2024-04-30T23:30:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.169+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69381a1270 con 0x7f6938102ff0 2024-04-30T23:30:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.170+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6938107990 con 0x7f6938102ff0 2024-04-30T23:30:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.172+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6928042030 con 0x7f6938102ff0 2024-04-30T23:30:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.172+0000 7f69277fe640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 0x7f69200a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.172+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f69280f1160 con 0x7f6938102ff0 2024-04-30T23:30:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.172+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 0x7f69200a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.173+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 0x7f69200a60c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f692c005e10 tx=0x7f692c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.178+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f69280bd7e0 con 0x7f6938102ff0 2024-04-30T23:30:50.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.358+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f693802dd60 con 0x7f6938102ff0 2024-04-30T23:30:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.360+0000 7f69277fe640 1 -- 172.21.15.100:0/1190108448 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7f69280bd0e0 con 0x7f6938102ff0 2024-04-30T23:30:50.363 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:30:50.363 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 msgr2=0x7f69200a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 0x7f69200a60c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f692c005e10 tx=0x7f692c005da0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 msgr2=0x7f6938199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6928006010 tx=0x7f6928031a50 comp rx=0 tx=0).stop 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 shutdown_connections 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f69200a3bb0 0x7f69200a60c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69381044d0 0x7f69381a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69381039d0 0x7f6938199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 --2- 172.21.15.100:0/1190108448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6938102ff0 0x7f6938199150 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 >> 172.21.15.100:0/1190108448 conn(0x7f69380fd3d0 msgr2=0x7f6938104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 shutdown_connections 2024-04-30T23:30:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.362+0000 7f693c88b640 1 -- 172.21.15.100:0/1190108448 wait complete. 2024-04-30T23:30:50.376 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:30:50.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.484+0000 7fbfd5f38640 1 -- 172.21.15.100:0/1434474664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd01098d0 msgr2=0x7fbfd010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.484+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/1434474664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd01098d0 0x7fbfd010bcf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009ca0 tx=0x7fbfc802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 -- 172.21.15.100:0/1434474664 shutdown_connections 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/1434474664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd01098d0 0x7fbfd010bcf0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/1434474664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd0106f70 0x7fbfd0109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/1434474664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0104610 0x7fbfd0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 -- 172.21.15.100:0/1434474664 >> 172.21.15.100:0/1434474664 conn(0x7fbfd00fdc10 msgr2=0x7fbfd01000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 -- 172.21.15.100:0/1434474664 shutdown_connections 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 -- 172.21.15.100:0/1434474664 wait complete. 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 Processor -- start 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.485+0000 7fbfd5f38640 1 -- start start 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0106f70 0x7fbfd019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd01098d0 0x7fbfd01a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd010f630 con 0x7fbfd0104610 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd010f4b0 con 0x7fbfd0106f70 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd010f7b0 con 0x7fbfd01098d0 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56928/0 (socket says 172.21.15.100:56928) 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 -- 172.21.15.100:0/4116139279 learned_addr learned my addr 172.21.15.100:0/4116139279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcffff640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd01098d0 0x7fbfd01a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfceffd640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0106f70 0x7fbfd019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 -- 172.21.15.100:0/4116139279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd01098d0 msgr2=0x7fbfd01a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd01098d0 0x7fbfd01a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 -- 172.21.15.100:0/4116139279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0106f70 msgr2=0x7fbfd019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0106f70 0x7fbfd019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 -- 172.21.15.100:0/4116139279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd01a2090 con 0x7fbfd0104610 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfcf7fe640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000d770 tx=0x7fbfc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0017070 con 0x7fbfd0104610 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd01a2380 con 0x7fbfd0104610 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfc0009c30 con 0x7fbfd0104610 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000f620 con 0x7fbfd0104610 2024-04-30T23:30:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.486+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd01a28d0 con 0x7fbfd0104610 2024-04-30T23:30:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.487+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd006c2e0 con 0x7fbfd0104610 2024-04-30T23:30:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.489+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbfc001a070 con 0x7fbfd0104610 2024-04-30T23:30:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.490+0000 7fbfccff9640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 0x7fbfb80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.490+0000 7fbfceffd640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 0x7fbfb80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.490+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbfc00d0290 con 0x7fbfd0104610 2024-04-30T23:30:50.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.491+0000 7fbfceffd640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 0x7fbfb80a60c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbfd019b5f0 tx=0x7fbfc400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.494+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbfc0009de0 con 0x7fbfd0104610 2024-04-30T23:30:50.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.670+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbfd01a2b30 con 0x7fbfd0104610 2024-04-30T23:30:50.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.671+0000 7fbfccff9640 1 -- 172.21.15.100:0/4116139279 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7fbfc009c910 con 0x7fbfd0104610 2024-04-30T23:30:50.674 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:30:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 msgr2=0x7fbfb80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 0x7fbfb80a60c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbfd019b5f0 tx=0x7fbfc400b5b0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 msgr2=0x7fbfd019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000d770 tx=0x7fbfc000dc30 comp rx=0 tx=0).stop 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 shutdown_connections 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbfb80a3bb0 0x7fbfb80a60c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd01098d0 0x7fbfd01a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfd0106f70 0x7fbfd019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 --2- 172.21.15.100:0/4116139279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd0104610 0x7fbfd019a550 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 >> 172.21.15.100:0/4116139279 conn(0x7fbfd00fdc10 msgr2=0x7fbfd0105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 shutdown_connections 2024-04-30T23:30:50.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.673+0000 7fbfd5f38640 1 -- 172.21.15.100:0/4116139279 wait complete. 2024-04-30T23:30:50.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:30:50.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 -- 172.21.15.100:0/3502444712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e8101790 msgr2=0x7f22e8101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/3502444712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e8101790 0x7f22e8101c00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009900 tx=0x7f22dc02a410 comp rx=0 tx=0).stop 2024-04-30T23:30:50.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 -- 172.21.15.100:0/3502444712 shutdown_connections 2024-04-30T23:30:50.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/3502444712 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 0x7f22e810bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/3502444712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e8101790 0x7f22e8101c00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/3502444712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e81050e0 0x7f22e81054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 -- 172.21.15.100:0/3502444712 >> 172.21.15.100:0/3502444712 conn(0x7f22e80fd390 msgr2=0x7f22e80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 -- 172.21.15.100:0/3502444712 shutdown_connections 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.796+0000 7f22ee1a8640 1 -- 172.21.15.100:0/3502444712 wait complete. 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 Processor -- start 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 -- start start 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e8101790 0x7f22e819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 0x7f22e819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810f650 con 0x7f22e81050e0 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810f4d0 con 0x7f22e8102290 2024-04-30T23:30:50.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22ee1a8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810f7d0 con 0x7f22e8101790 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56944/0 (socket says 172.21.15.100:56944) 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22e7fff640 1 -- 172.21.15.100:0/2463942300 learned_addr learned my addr 172.21.15.100:0/2463942300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22e6ffd640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 0x7f22e819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.797+0000 7f22e77fe640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e8101790 0x7f22e819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 -- 172.21.15.100:0/2463942300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e8101790 msgr2=0x7f22e819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e8101790 0x7f22e819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 -- 172.21.15.100:0/2463942300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 msgr2=0x7f22e819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 0x7f22e819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 -- 172.21.15.100:0/2463942300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81a1da0 con 0x7f22e81050e0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e7fff640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22e000cad0 tx=0x7f22e000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e000ae20 con 0x7f22e81050e0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81a2090 con 0x7f22e81050e0 2024-04-30T23:30:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e0005020 con 0x7f22e81050e0 2024-04-30T23:30:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e000f6b0 con 0x7f22e81050e0 2024-04-30T23:30:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.798+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81a25e0 con 0x7f22e81050e0 2024-04-30T23:30:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.799+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e8108a70 con 0x7f22e81050e0 2024-04-30T23:30:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.800+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f22e00051d0 con 0x7f22e81050e0 2024-04-30T23:30:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.801+0000 7f22e4ff9640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 0x7f22d00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.801+0000 7f22e77fe640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 0x7f22d00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.801+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f22e00d0bb0 con 0x7f22e81050e0 2024-04-30T23:30:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.801+0000 7f22e77fe640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 0x7f22d00a60c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005fd0 tx=0x7f22d800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:50.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.805+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f22e0014030 con 0x7f22e81050e0 2024-04-30T23:30:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.981+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22e802db90 con 0x7f22e81050e0 2024-04-30T23:30:50.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.981+0000 7f22e4ff9640 1 -- 172.21.15.100:0/2463942300 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f22e009d230 con 0x7f22e81050e0 2024-04-30T23:30:50.985 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.983+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 msgr2=0x7f22d00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.983+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 0x7f22d00a60c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005fd0 tx=0x7f22d800b5b0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.983+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 msgr2=0x7f22e81a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.983+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22e000cad0 tx=0x7f22e000cf90 comp rx=0 tx=0).stop 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 shutdown_connections 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f22d00a3bb0 0x7f22d00a60c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e81050e0 0x7f22e81a1730 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e8102290 0x7f22e819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 --2- 172.21.15.100:0/2463942300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22e8101790 0x7f22e819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:50.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 >> 172.21.15.100:0/2463942300 conn(0x7f22e80fd390 msgr2=0x7f22e8105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:50.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 shutdown_connections 2024-04-30T23:30:50.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:50.984+0000 7f22ee1a8640 1 -- 172.21.15.100:0/2463942300 wait complete. 2024-04-30T23:30:50.998 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:30:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 -- 172.21.15.100:0/798611559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388104620 msgr2=0x7f3388106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 --2- 172.21.15.100:0/798611559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388104620 0x7f3388106a40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3378009ca0 tx=0x7f337802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 -- 172.21.15.100:0/798611559 shutdown_connections 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 --2- 172.21.15.100:0/798611559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 0x7f338810bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 --2- 172.21.15.100:0/798611559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388106f80 0x7f33881093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 --2- 172.21.15.100:0/798611559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388104620 0x7f3388106a40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 -- 172.21.15.100:0/798611559 >> 172.21.15.100:0/798611559 conn(0x7f33880fdc00 msgr2=0x7f33881000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 -- 172.21.15.100:0/798611559 shutdown_connections 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.105+0000 7f338d127640 1 -- 172.21.15.100:0/798611559 wait complete. 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.106+0000 7f338d127640 1 Processor -- start 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.106+0000 7f338d127640 1 -- start start 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 0x7f338819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 0x7f33881a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f338810f610 con 0x7f3388106f80 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f338810f490 con 0x7f3388104620 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f338810f790 con 0x7f33881098e0 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56954/0 (socket says 172.21.15.100:56954) 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 -- 172.21.15.100:0/1269737219 learned_addr learned my addr 172.21.15.100:0/1269737219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f3386d9d640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 0x7f338819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338759e640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 0x7f33881a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 -- 172.21.15.100:0/1269737219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 msgr2=0x7f33881a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 0x7f33881a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 -- 172.21.15.100:0/1269737219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 msgr2=0x7f338819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 0x7f338819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 -- 172.21.15.100:0/1269737219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33881a1d20 con 0x7f3388106f80 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f3386d9d640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 0x7f338819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338659c640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f337c00d950 tx=0x7f337c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c017070 con 0x7f3388106f80 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c009c30 con 0x7f3388106f80 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33881a1fb0 con 0x7f3388106f80 2024-04-30T23:30:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.107+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c00f620 con 0x7f3388106f80 2024-04-30T23:30:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.108+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33881a24a0 con 0x7f3388106f80 2024-04-30T23:30:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.109+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33880ff720 con 0x7f3388106f80 2024-04-30T23:30:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.111+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f337c005030 con 0x7f3388106f80 2024-04-30T23:30:51.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.111+0000 7f336ffff640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 0x7f33700a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.111+0000 7f3386d9d640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 0x7f33700a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.111+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f337c0d05c0 con 0x7f3388106f80 2024-04-30T23:30:51.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.112+0000 7f3386d9d640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 0x7f33700a60c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3378031b50 tx=0x7f3378004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.115+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f337c09cc40 con 0x7f3388106f80 2024-04-30T23:30:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.296+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f33880637e0 con 0x7f3388106f80 2024-04-30T23:30:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.296+0000 7f336ffff640 1 -- 172.21.15.100:0/1269737219 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f337c009de0 con 0x7f3388106f80 2024-04-30T23:30:51.300 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:30:51.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 msgr2=0x7f33700a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 0x7f33700a60c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3378031b50 tx=0x7f3378004a40 comp rx=0 tx=0).stop 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 msgr2=0x7f338819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f337c00d950 tx=0x7f337c00de10 comp rx=0 tx=0).stop 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 shutdown_connections 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f33700a3bb0 0x7f33700a60c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33881098e0 0x7f33881a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3388106f80 0x7f338819a7d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 --2- 172.21.15.100:0/1269737219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3388104620 0x7f338819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.298+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 >> 172.21.15.100:0/1269737219 conn(0x7f33880fdc00 msgr2=0x7f3388106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.299+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 shutdown_connections 2024-04-30T23:30:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.299+0000 7f338d127640 1 -- 172.21.15.100:0/1269737219 wait complete. 2024-04-30T23:30:51.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:51 smithi100 ceph-mon[29745]: pgmap v890: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:51.312 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1190108448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:30:51.312 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4116139279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.312 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:51 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2463942300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:30:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 -- 172.21.15.100:0/548820000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c103970 msgr2=0x7fbf5c103e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 --2- 172.21.15.100:0/548820000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c103970 0x7fbf5c103e20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009900 tx=0x7fbf5002a410 comp rx=0 tx=0).stop 2024-04-30T23:30:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 -- 172.21.15.100:0/548820000 shutdown_connections 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 --2- 172.21.15.100:0/548820000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 --2- 172.21.15.100:0/548820000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c103970 0x7fbf5c103e20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 --2- 172.21.15.100:0/548820000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c102f90 0x7fbf5c1033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 -- 172.21.15.100:0/548820000 >> 172.21.15.100:0/548820000 conn(0x7fbf5c0fd390 msgr2=0x7fbf5c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 -- 172.21.15.100:0/548820000 shutdown_connections 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.421+0000 7fbf64631640 1 -- 172.21.15.100:0/548820000 wait complete. 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 Processor -- start 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 -- start start 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c102f90 0x7fbf5c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c103970 0x7fbf5c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c10f680 con 0x7fbf5c1044b0 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c10f500 con 0x7fbf5c103970 2024-04-30T23:30:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf64631640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c10f800 con 0x7fbf5c102f90 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56972/0 (socket says 172.21.15.100:56972) 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 -- 172.21.15.100:0/1511354913 learned_addr learned my addr 172.21.15.100:0/1511354913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf61bcc640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c103970 0x7fbf5c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf623cd640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c102f90 0x7fbf5c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 -- 172.21.15.100:0/1511354913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c102f90 msgr2=0x7fbf5c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c102f90 0x7fbf5c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 -- 172.21.15.100:0/1511354913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c103970 msgr2=0x7fbf5c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c103970 0x7fbf5c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 -- 172.21.15.100:0/1511354913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c1a1d90 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.422+0000 7fbf62bce640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d750 tx=0x7fbf4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.423+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c017070 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.423+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf4c0054d0 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.423+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c004c60 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.423+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c1a2080 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.423+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c1a2620 con 0x7fbf5c1044b0 2024-04-30T23:30:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.424+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c107930 con 0x7fbf5c1044b0 2024-04-30T23:30:51.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.425+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbf4c009bd0 con 0x7fbf5c1044b0 2024-04-30T23:30:51.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.426+0000 7fbf5b7fe640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 0x7fbf440a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.426+0000 7fbf623cd640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 0x7fbf440a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.426+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fbf4c0d0470 con 0x7fbf5c1044b0 2024-04-30T23:30:51.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.426+0000 7fbf623cd640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 0x7fbf440a6140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c06b540 tx=0x7fbf54009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.429+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf4c09cb70 con 0x7fbf5c1044b0 2024-04-30T23:30:51.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:51 smithi104 ceph-mon[32987]: pgmap v890: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:51.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1190108448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:30:51.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4116139279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:51 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2463942300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:51 smithi183 ceph-mon[33560]: pgmap v890: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:51.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1190108448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:30:51.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4116139279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:51 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2463942300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:30:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.606+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbf5c0637e0 con 0x7fbf5c1044b0 2024-04-30T23:30:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.607+0000 7fbf5b7fe640 1 -- 172.21.15.100:0/1511354913 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fbf4c09c470 con 0x7fbf5c1044b0 2024-04-30T23:30:51.610 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 msgr2=0x7fbf440a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 0x7fbf440a6140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c06b540 tx=0x7fbf54009870 comp rx=0 tx=0).stop 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 msgr2=0x7fbf5c1a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d750 tx=0x7fbf4c00dc10 comp rx=0 tx=0).stop 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 shutdown_connections 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fbf440a3c30 0x7fbf440a6140 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf5c1044b0 0x7fbf5c1a1720 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c103970 0x7fbf5c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 --2- 172.21.15.100:0/1511354913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf5c102f90 0x7fbf5c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 >> 172.21.15.100:0/1511354913 conn(0x7fbf5c0fd390 msgr2=0x7fbf5c104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 shutdown_connections 2024-04-30T23:30:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.609+0000 7fbf64631640 1 -- 172.21.15.100:0/1511354913 wait complete. 2024-04-30T23:30:51.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 -- 172.21.15.100:0/2384516266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d81050e0 msgr2=0x7fc8d81054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 --2- 172.21.15.100:0/2384516266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d81050e0 0x7fc8d81054f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009900 tx=0x7fc8d402a410 comp rx=0 tx=0).stop 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 -- 172.21.15.100:0/2384516266 shutdown_connections 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 --2- 172.21.15.100:0/2384516266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8102290 0x7fc8d810bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 --2- 172.21.15.100:0/2384516266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d8101790 0x7fc8d8101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 --2- 172.21.15.100:0/2384516266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d81050e0 0x7fc8d81054f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 -- 172.21.15.100:0/2384516266 >> 172.21.15.100:0/2384516266 conn(0x7fc8d80fd3b0 msgr2=0x7fc8d80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 -- 172.21.15.100:0/2384516266 shutdown_connections 2024-04-30T23:30:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.726+0000 7fc8e044a640 1 -- 172.21.15.100:0/2384516266 wait complete. 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 Processor -- start 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 -- start start 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 0x7fc8d819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d81050e0 0x7fc8d81a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810f630 con 0x7fc8d8102290 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810f4b0 con 0x7fc8d81050e0 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8e044a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810f7b0 con 0x7fc8d8101790 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8dd9e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8dd9e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56984/0 (socket says 172.21.15.100:56984) 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.727+0000 7fc8dd9e5640 1 -- 172.21.15.100:0/1590773522 learned_addr learned my addr 172.21.15.100:0/1590773522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8de9e7640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d81050e0 0x7fc8d81a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8de1e6640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 0x7fc8d819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 -- 172.21.15.100:0/1590773522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 msgr2=0x7fc8d819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 0x7fc8d819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 -- 172.21.15.100:0/1590773522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d81050e0 msgr2=0x7fc8d81a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d81050e0 0x7fc8d81a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 -- 172.21.15.100:0/1590773522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d81a1da0 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8de1e6640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 0x7fc8d819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8dd9e5640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c890 tx=0x7fc8c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8004220 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d81a2090 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c80043c0 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8004a00 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.728+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d81a2630 con 0x7fc8d8102290 2024-04-30T23:30:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.729+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d8108a70 con 0x7fc8d8102290 2024-04-30T23:30:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.730+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc8c80079b0 con 0x7fc8d8102290 2024-04-30T23:30:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.731+0000 7fc8cf7fe640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 0x7fc8c40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:30:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.731+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc8c80d0950 con 0x7fc8d8102290 2024-04-30T23:30:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.731+0000 7fc8de1e6640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 0x7fc8c40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:30:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.732+0000 7fc8de1e6640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 0x7fc8c40a60c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4005f70 tx=0x7fc8d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:30:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.735+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc8c8014030 con 0x7fc8d8102290 2024-04-30T23:30:51.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.963+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc8d802dd60 con 0x7fc8d8102290 2024-04-30T23:30:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.971+0000 7fc8cf7fe640 1 -- 172.21.15.100:0/1590773522 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+745537 (secure 0 0 0) 0x7fc8c809cfd0 con 0x7fc8d8102290 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 18, 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "active_gid": 14152, 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "active_name": "x", 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addrs": { 2024-04-30T23:30:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6800", 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3346272580 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6801", 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3346272580 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addr": "172.21.15.100:6801/3346272580", 2024-04-30T23:30:51.986 INFO:teuthology.orchestra.run.smithi100.stdout: "active_change": "2024-04-30T23:03:55.489741+0000", 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "active_mgr_features": 4540701547738038271, 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "available": true, 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "standbys": [ 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24109, 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "z", 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:51.987 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:51.989 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.991 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.994 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.996 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.996 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-04-30T23:30:51.996 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-04-30T23:30:51.996 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.998 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:51.999 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.001 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.002 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-04-30T23:30:52.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-04-30T23:30:52.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.006 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-04-30T23:30:52.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-04-30T23:30:52.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-30T23:30:52.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-04-30T23:30:52.011 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-30T23:30:52.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.013 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.014 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.017 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-30T23:30:52.018 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-04-30T23:30:52.019 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.020 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.021 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.023 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.024 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-04-30T23:30:52.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-04-30T23:30:52.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.027 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.028 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.029 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.030 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-30T23:30:52.031 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.034 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.035 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.037 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.038 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.039 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-04-30T23:30:52.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.042 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.043 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-04-30T23:30:52.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.045 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-04-30T23:30:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.047 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.050 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.051 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-04-30T23:30:52.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-30T23:30:52.054 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-30T23:30:52.055 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-04-30T23:30:52.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-30T23:30:52.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.058 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.060 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-30T23:30:52.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-30T23:30:52.062 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.063 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.066 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.067 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.068 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.069 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.070 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.071 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-04-30T23:30:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.074 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.075 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.079 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.080 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-04-30T23:30:52.082 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-04-30T23:30:52.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.085 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.086 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.088 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-04-30T23:30:52.090 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.091 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.094 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.095 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.097 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.099 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.100 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.101 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.102 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.104 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.105 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.106 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.108 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-30T23:30:52.109 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-30T23:30:52.110 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-30T23:30:52.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.112 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.113 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-30T23:30:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-04-30T23:30:52.115 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.116 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.117 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-30T23:30:52.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-30T23:30:52.119 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-30T23:30:52.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-30T23:30:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "[]", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "MULTICLUSTER_CONFIG": { 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "{}", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.123 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.124 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.125 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.126 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.128 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.130 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.131 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.132 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.133 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.134 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.135 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.137 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.138 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.139 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.140 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.141 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "UNSAFE_TLS_v1_2": { 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.142 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.146 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.148 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.151 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.152 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.153 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.154 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.155 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-04-30T23:30:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.158 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:52.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-04-30T23:30:52.160 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:52.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.162 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.165 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.166 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.168 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.169 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.171 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.172 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.173 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.174 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.175 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.176 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.177 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.178 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.179 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.180 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.181 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.185 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.186 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-30T23:30:52.187 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.189 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.190 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.191 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.192 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.194 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-04-30T23:30:52.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.196 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.197 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-04-30T23:30:52.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-04-30T23:30:52.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.201 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.201 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.202 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.206 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.207 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.208 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.211 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.213 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.214 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-04-30T23:30:52.215 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.216 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.217 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.218 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.221 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.222 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-30T23:30:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.242 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.244 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.245 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.263 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.266 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.269 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.271 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.274 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.275 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.277 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.278 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.279 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.280 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.281 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-04-30T23:30:52.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.285 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.286 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.287 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.288 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.289 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.290 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.294 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.295 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-04-30T23:30:52.298 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:52.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.301 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.302 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.303 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.304 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.305 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-04-30T23:30:52.307 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.311 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.316 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.319 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.321 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.325 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.326 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.327 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-04-30T23:30:52.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.329 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.330 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.331 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.332 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.333 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.334 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.336 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.338 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.341 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.342 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.346 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.350 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.351 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.352 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.354 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.355 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.360 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.361 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.362 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.363 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.365 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.366 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.370 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.371 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-04-30T23:30:52.372 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.373 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.379 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:52.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-04-30T23:30:52.382 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.387 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.392 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.394 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-04-30T23:30:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-04-30T23:30:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-04-30T23:30:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-04-30T23:30:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-04-30T23:30:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.415 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.416 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.417 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.419 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24113, 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "y", 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-04-30T23:30:52.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.426 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.427 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.431 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.432 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.434 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.435 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.439 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.440 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-04-30T23:30:52.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-04-30T23:30:52.442 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.443 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.444 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.447 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-04-30T23:30:52.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.451 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.454 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.455 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.456 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.458 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.460 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.461 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.463 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.464 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.466 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.468 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.471 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-04-30T23:30:52.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-04-30T23:30:52.474 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.478 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.479 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.486 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-04-30T23:30:52.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-04-30T23:30:52.488 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-04-30T23:30:52.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-04-30T23:30:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.491 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.492 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.493 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.494 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.495 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.496 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.497 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.499 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.503 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-30T23:30:52.504 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-30T23:30:52.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-30T23:30:52.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-30T23:30:52.510 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.513 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.518 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.520 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.521 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.522 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.523 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-04-30T23:30:52.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.525 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.531 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.532 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.535 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.536 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.537 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.538 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.539 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.540 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "[]", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "MULTICLUSTER_CONFIG": { 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "{}", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.558 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.559 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.561 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.562 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.564 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.567 INFO:teuthology.orchestra.run.smithi100.stdout: "UNSAFE_TLS_v1_2": { 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.568 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.569 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.570 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-04-30T23:30:52.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-04-30T23:30:52.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-04-30T23:30:52.573 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-04-30T23:30:52.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:52.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.576 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.577 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.578 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.579 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.580 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-04-30T23:30:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.583 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:52.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-04-30T23:30:52.586 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:52.587 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.588 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.591 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.592 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.593 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.594 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.596 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.597 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.598 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.599 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.600 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.601 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.603 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.604 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.605 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.606 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.608 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.609 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.610 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-04-30T23:30:52.612 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.617 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.618 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.619 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.620 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-04-30T23:30:52.621 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-04-30T23:30:52.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:52.623 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.625 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-04-30T23:30:52.627 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.628 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.629 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.630 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.631 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.633 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.634 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.636 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.637 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.638 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.641 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.642 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.644 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-04-30T23:30:52.646 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.647 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.650 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.651 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.652 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.653 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.654 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.655 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.656 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-04-30T23:30:52.657 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.658 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.660 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.662 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.663 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.665 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.666 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.667 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.668 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-04-30T23:30:52.669 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.670 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.671 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.672 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.674 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.675 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.676 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.677 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.678 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.679 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.682 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.683 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.684 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.685 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.686 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.687 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.688 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.689 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.690 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.691 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.692 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.693 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.695 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.696 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-04-30T23:30:52.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-30T23:30:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.702 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.703 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.704 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.705 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.706 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.707 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.709 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.710 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.711 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.713 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.714 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.716 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-04-30T23:30:52.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.722 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.723 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.724 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.725 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.726 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.727 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.728 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.729 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.730 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.731 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.732 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.737 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.738 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.740 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:52.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:52.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.743 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.744 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.745 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.747 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.748 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.749 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.750 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.752 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.753 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.754 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.755 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.756 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.757 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.758 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.759 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.760 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.761 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.762 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.764 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.765 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.767 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.768 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.770 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.773 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.774 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.775 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.778 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.782 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.783 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.784 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.785 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.786 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.788 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.791 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.792 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.793 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.794 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.795 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.797 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.799 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.801 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.802 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.803 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.804 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.805 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.806 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.808 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-04-30T23:30:52.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.811 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.812 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-04-30T23:30:52.813 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-04-30T23:30:52.813 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.813 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.813 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.814 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.815 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.816 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.817 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.819 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-30T23:30:52.821 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.822 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.823 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.825 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.833 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.837 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.839 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.840 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.841 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.842 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.843 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.845 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-04-30T23:30:52.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "modules": [ 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard", 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "iostat", 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "nfs", 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "restful" 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.848 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.850 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.851 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.852 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.853 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.854 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.855 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.856 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.857 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-04-30T23:30:52.858 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.860 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.861 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.863 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.864 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.865 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.866 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.868 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-04-30T23:30:52.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.870 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.871 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.873 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.876 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.877 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.878 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-30T23:30:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-04-30T23:30:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-04-30T23:30:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-04-30T23:30:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.895 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.898 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-04-30T23:30:52.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-04-30T23:30:52.901 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-04-30T23:30:52.902 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-04-30T23:30:52.903 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-04-30T23:30:52.904 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-04-30T23:30:52.905 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-04-30T23:30:52.906 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.907 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.910 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-04-30T23:30:52.911 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.913 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.914 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.915 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.916 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.918 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.919 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.921 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.924 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-04-30T23:30:52.925 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-04-30T23:30:52.926 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-04-30T23:30:52.927 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.929 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.933 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.934 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-04-30T23:30:52.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-04-30T23:30:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.939 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.940 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.941 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.942 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:52.943 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:52.946 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.947 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.948 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-04-30T23:30:52.949 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-04-30T23:30:52.951 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-30T23:30:52.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.953 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.955 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.956 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.957 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.958 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.959 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.960 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.961 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.962 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.963 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.964 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.967 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.968 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.969 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.971 INFO:teuthology.orchestra.run.smithi100.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "[]", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "MULTICLUSTER_CONFIG": { 2024-04-30T23:30:52.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "{}", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-04-30T23:30:52.973 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-30T23:30:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-30T23:30:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.980 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.981 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-30T23:30:52.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.984 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.986 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.989 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.990 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "UNSAFE_TLS_v1_2": { 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.991 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.992 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.993 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.994 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.998 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.000 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.001 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.002 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.003 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.007 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.008 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.010 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:53.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-04-30T23:30:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.030 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.032 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-04-30T23:30:53.034 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-04-30T23:30:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:53.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-30T23:30:53.038 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-30T23:30:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.042 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.043 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.044 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.045 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-04-30T23:30:53.047 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.051 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-04-30T23:30:53.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.053 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.054 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.056 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.057 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.059 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.060 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.061 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.062 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.063 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.064 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.066 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.067 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.069 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.071 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.072 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.074 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.075 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.076 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-04-30T23:30:53.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.080 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.082 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.083 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.084 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.085 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.088 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.090 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.091 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.093 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.094 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.096 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.097 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.098 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.099 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.100 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.101 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.102 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.103 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.104 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.106 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.108 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.109 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.110 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.111 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.112 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.114 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.119 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.120 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:53.121 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-04-30T23:30:53.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-04-30T23:30:53.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:53.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.126 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.127 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.128 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.130 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-04-30T23:30:53.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.132 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.133 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.134 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.136 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-04-30T23:30:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-04-30T23:30:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.150 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.151 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-04-30T23:30:53.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-04-30T23:30:53.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-04-30T23:30:53.154 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.159 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.163 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.165 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.167 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.168 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.169 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.170 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.171 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.173 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.174 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.177 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.179 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.180 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.182 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.185 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.187 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.188 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.189 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.192 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.193 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.194 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.195 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.196 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.197 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.198 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.201 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.203 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.204 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.205 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.206 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.207 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.211 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.215 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.216 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.218 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.219 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.221 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.225 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.228 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.230 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.232 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.233 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.237 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.238 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-04-30T23:30:53.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.242 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.244 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.245 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.246 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.250 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-30T23:30:53.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.253 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.254 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-04-30T23:30:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.257 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.258 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-04-30T23:30:53.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-04-30T23:30:53.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.263 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-04-30T23:30:53.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "services": { 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard": "https://172.21.15.100:8443/" 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "always_on_modules": { 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus": [ 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-04-30T23:30:53.266 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific": [ 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-04-30T23:30:53.267 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy": [ 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-04-30T23:30:53.268 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "reef": [ 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "squid": [ 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-04-30T23:30:53.269 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "last_failure_osd_epoch": 3, 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "active_clients": [ 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-04-30T23:30:53.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 176264207 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "libcephsqlite", 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3696440809 2024-04-30T23:30:53.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 474760944 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-04-30T23:30:53.272 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1701025406 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-30T23:30:53.273 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:30:53.274 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:52 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1269737219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.275 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:52 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1511354913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.275 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:52 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1590773522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-30T23:30:53.275 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:52 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1269737219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.275 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:52 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1511354913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.275 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:52 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1590773522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 msgr2=0x7fc8c40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 0x7fc8c40a60c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4005f70 tx=0x7fc8d4000bc0 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 msgr2=0x7fc8d819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c890 tx=0x7fc8c800cd50 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 shutdown_connections 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc8c40a3bb0 0x7fc8c40a60c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d81050e0 0x7fc8d81a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8d8102290 0x7fc8d819a7a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 --2- 172.21.15.100:0/1590773522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d8101790 0x7fc8d819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 >> 172.21.15.100:0/1590773522 conn(0x7fc8d80fd3b0 msgr2=0x7fc8d8105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 shutdown_connections 2024-04-30T23:30:53.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:30:51.976+0000 7fc8e044a640 1 -- 172.21.15.100:0/1590773522 wait complete. 2024-04-30T23:30:53.282 DEBUG:tasks.check_counter:Getting stats from a 2024-04-30T23:30:53.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-30T23:30:53.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:52 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1269737219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:52 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1511354913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:30:53.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:52 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1590773522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-30T23:30:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:30:53.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:53 smithi104 ceph-mon[32987]: pgmap v891: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:53.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:53 smithi183 ceph-mon[33560]: pgmap v891: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:53.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:53 smithi100 ceph-mon[29745]: pgmap v891: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:30:55.316 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:55 smithi100 ceph-mon[29745]: pgmap v892: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 8018, 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 11882, 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 5834860, 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 9675219, 2024-04-30T23:30:55.466 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 9, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.038753886, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.278508755, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.342263424, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.435834119, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 11881, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.486224977, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000040924 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12778, 2024-04-30T23:30:55.467 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002929041, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000229 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 709776, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 210048 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 13224, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 22109, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 4352265, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 11940532, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 22, 2024-04-30T23:30:55.468 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.764833194, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 1.207591745, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.510656302, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.111296279, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 22108, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.929022469, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000222951 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 21322, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003333081, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000156 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.469 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3180416, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 10351024 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 5559, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 5561, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1489763, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 14525040, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 13, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.592274720, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.178447649, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.103637795, 2024-04-30T23:30:55.470 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.272618760, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5559, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.298831760, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000053756 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 172, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000040182, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000233 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:30:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2561, 2024-04-30T23:30:55.472 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 12.088587864, 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004720260 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4858, 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.828551456, 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000170554 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 4723, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 4723, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4723, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 9.508466258, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002013225 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-04-30T23:30:55.474 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 16, 2024-04-30T23:30:55.475 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 1, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 2, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 13, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 13, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 258, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 11998, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 11170, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 15, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-04-30T23:30:55.476 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 1000, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 1, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 17, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 209, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 17, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 2805, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 5488, 2024-04-30T23:30:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 11640, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 1374906479, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 5488, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 663, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 663, 2024-04-30T23:30:55.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 4825, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 4102, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 3221, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 4262, 2024-04-30T23:30:55.479 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 117, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 23, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 3760 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 9, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 1, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-04-30T23:30:55.480 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 2752, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 2752, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 19, 2024-04-30T23:30:55.481 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_succeeded": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_write_failed": 0 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 9290, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-04-30T23:30:55.482 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 9290, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 13, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 13, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 22310960, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1532, 2024-04-30T23:30:55.483 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 20.001871741, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.013056052 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 22, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 2798, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 2776, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 401, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 382, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 16, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 5612, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 5596, 2024-04-30T23:30:55.484 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 2788, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 2788, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 144960, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223632 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 7081, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 6, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 4723, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 13, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 361, 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-04-30T23:30:55.485 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.486 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1616, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.644398269, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000398761 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.487 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.488 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.489 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.489 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-04-30T23:30:55.489 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.489 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 355, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.275896062, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000777172 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 337, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.456572018, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.013224249 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.493 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.494 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2415, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.131599909, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001710807 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 1, 2024-04-30T23:30:55.498 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 4095, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 4095, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 2220, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:30:55.499 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:30:55.500 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:30:55.501 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 304567, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 107, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8704, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 167, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:30:55.502 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 86453, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 423, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-04-30T23:30:55.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 12408, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 18590235, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 33, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 12408, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12408, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 30.345230254, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002445618 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-04-30T23:30:55.504 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12408, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 12475 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 12408, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 5545, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 6863, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 57, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 1589, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 27, 2024-04-30T23:30:55.505 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 5191, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-04-30T23:30:55.506 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 5488, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-04-30T23:30:55.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-04-30T23:30:55.508 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-04-30T23:30:55.509 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 93, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 4, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 66, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 27 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-04-30T23:30:55.510 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 11, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 9, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 5175, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 2752, 2024-04-30T23:30:55.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 26797, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 8847853, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 26797, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 26797, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 8847853, 2024-04-30T23:30:55.512 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:30:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 12408, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 18887515, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 12408, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 18887515, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:30:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 12408, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 12408, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 12408, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 12408, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2752, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 297280, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2752, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 57, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 297280, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x5568c450e8f0": { 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 9290, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 18116656, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 9290, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1532, 2024-04-30T23:30:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 18116656, 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:55.518 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:30:55.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:55 smithi104 ceph-mon[32987]: pgmap v892: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:55.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:55 smithi183 ceph-mon[33560]: pgmap v892: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:30:56.284 INFO:tasks.check_counter:Daemon mds.a mds.exported=17 2024-04-30T23:30:56.284 INFO:tasks.check_counter:Daemon mds.a mds.imported=17 2024-04-30T23:30:56.284 DEBUG:tasks.check_counter:Getting stats from d 2024-04-30T23:30:56.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-30T23:30:56.535 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:30:57.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:57 smithi104 ceph-mon[32987]: pgmap v893: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:57.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:57 smithi183 ceph-mon[33560]: pgmap v893: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:57.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:57 smithi100 ceph-mon[29745]: pgmap v893: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:30:58.260 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:58 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.001246400, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-04-30T23:30:58.261 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000278558, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:30:58.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 333, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 328, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 514912, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 201968, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.051451526, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.023544768, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.017966019, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.006946293, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 328, 2024-04-30T23:30:58.263 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.017148688, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000052282 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 514912, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 201968 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 250, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-04-30T23:30:58.264 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 201248, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.020436158, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.015740146, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001863604, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 248, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.015991223, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000064480 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:58.265 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 201248 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:30:58.266 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:30:58.267 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:30:58.268 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148704, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 29, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-04-30T23:30:58.269 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:30:58.270 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 331, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 465459, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 331, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 331, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 465459, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:30:58.271 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:30:58.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:58 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:30:58.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:58 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-30T23:30:58.984 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-30T23:30:58.984 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-30T23:30:58.984 DEBUG:tasks.check_counter:Getting stats from g 2024-04-30T23:30:58.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-30T23:30:59.232 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: pgmap v894: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:30:59.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:30:59 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: pgmap v894: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:30:59.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:30:59 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: pgmap v894: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: Unable to set osd_memory_target on smithi183 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-30T23:30:59.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:30:59 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' 2024-04-30T23:31:00.950 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:31:00.950 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2016, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2018, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 4808893, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 641089, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 7, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.208756685, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.085231351, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.048430938, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.056732190, 2024-04-30T23:31:00.951 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2016, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.077813113, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000038597 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:31:00.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2507, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2478, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 15179925, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 883433, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.230561134, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.074230957, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.078529589, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.063145582, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2478, 2024-04-30T23:31:00.953 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.067195688, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000027116 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 694720, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 201584 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:00.954 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 5, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 250, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1668, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 604325, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 8, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.018314827, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.013445509, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002406347, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000070667, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 248, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014690597, 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000059236 2024-04-30T23:31:00.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 603360 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-04-30T23:31:00.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 6534, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.185403196, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000028375 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.957 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:00.958 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 2762, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 2762, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 2762, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 1, 2024-04-30T23:31:00.959 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:00.960 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:00.961 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-04-30T23:31:00.962 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-04-30T23:31:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_started": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "uninline_write_failed": 0 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-04-30T23:31:00.964 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 9290, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 13, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-04-30T23:31:00.965 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 22310960, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 22309822, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 9290 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 13, 2024-04-30T23:31:00.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 2799, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 2786, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 11, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 400, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 389, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 2762, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 5600, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 2838, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 128620, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215440 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.967 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.968 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-04-30T23:31:00.969 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.970 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.972 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-04-30T23:31:00.972 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.972 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.972 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.973 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.974 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-04-30T23:31:00.975 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.975 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.975 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.975 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.978 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.979 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 1, 2024-04-30T23:31:00.980 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 2227, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:00.981 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:00.982 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:00.983 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 198247, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 56, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 167, 2024-04-30T23:31:00.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 1988040, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 11176, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-04-30T23:31:00.985 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 4163, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 21, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 3, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 4163, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4163, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.700931293, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000648794 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4163, 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4164 2024-04-30T23:31:00.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 4163, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 4163, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 2941, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 1220, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-04-30T23:31:00.987 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 1, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:00.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-04-30T23:31:00.989 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 93, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 4, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 6, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 9, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 3, 2024-04-30T23:31:00.990 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 2, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 0, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-04-30T23:31:00.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:31:00.992 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 4524, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 19561962, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 4524, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 4524, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 19561962, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.993 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 4163, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 18119450, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 4163, 2024-04-30T23:31:00.994 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 18119450, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:31:00.995 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 4163, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 4163, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 4163, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 4163, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.996 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-04-30T23:31:00.997 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x5613e4fb2750": { 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-04-30T23:31:00.998 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:00.999 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:31:01.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:01 smithi100 ceph-mon[29745]: pgmap v895: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:01.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:01 smithi104 ceph-mon[32987]: pgmap v895: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:01.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:01 smithi183 ceph-mon[33560]: pgmap v895: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:01.771 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-30T23:31:01.771 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-30T23:31:01.771 DEBUG:tasks.check_counter:Getting stats from j 2024-04-30T23:31:01.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-30T23:31:02.009 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.a/config 2024-04-30T23:31:03.472 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:03 smithi100 ceph-mon[29745]: pgmap v896: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:03.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:03 smithi104 ceph-mon[32987]: pgmap v896: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:03.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:03 smithi183 ceph-mon[33560]: pgmap v896: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 331, 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 328, 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 512512, 2024-04-30T23:31:03.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 202800, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.051409037, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.022265318, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.019252586, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.006854109, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 327, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.015957021, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000048798 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:03.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 512512, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 202800 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 252, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 201600, 2024-04-30T23:31:03.763 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.020713032, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.015888219, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002196684, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 250, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014566455, 2024-04-30T23:31:03.764 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000058265 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 201600 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2944, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-04-30T23:31:03.765 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000704193, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000033312, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000651437, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000741236, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000247078 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:03.766 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-04-30T23:31:03.767 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:03.768 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:03.769 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148784, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 31, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:03.770 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:03.771 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 333, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 465719, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 333, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-04-30T23:31:03.772 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 333, 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 465719, 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-30T23:31:03.773 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-30T23:31:04.526 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-30T23:31:04.527 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-30T23:31:04.527 DEBUG:tasks.check_counter:Getting stats from b 2024-04-30T23:31:04.527 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-30T23:31:04.777 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:31:05.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:05 smithi104 ceph-mon[32987]: pgmap v897: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:05.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:05 smithi183 ceph-mon[33560]: pgmap v897: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:05.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:05 smithi100 ceph-mon[29745]: pgmap v897: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:06.617 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-30T23:31:06.617 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:06.617 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 32261, 2024-04-30T23:31:06.617 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 18742, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 9935753, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 36000451, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 10, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 5, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 1.834927619, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.704833981, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.998309528, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.322703774, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 18741, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.837445968, 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000044685 2024-04-30T23:31:06.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 37053, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.005209463, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000140 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 8045, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 7943, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 2547156, 2024-04-30T23:31:06.619 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 23655040, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 13, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 7, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.693181893, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.241038221, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.209151957, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.217195106, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 7938, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.647464943, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000081565 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 4421, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000850159, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000192 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 538432 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 47395, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 83416, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 17684231, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 64146893, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 116, 2024-04-30T23:31:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 3.610312394, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 1.640407970, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 2.578754949, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.254261856, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 83418, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 2.561958838, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000030712 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 105308, 2024-04-30T23:31:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.016251711, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000154 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 14890016, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 37406864 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "cct": { 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "total_workers": 1, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "unhealthy_workers": 0 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-MDSRank": { 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3892, 2024-04-30T23:31:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 39.623694436, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.010180805 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 4928, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.849577236, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000172397 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": { 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "request": 16827, 2024-04-30T23:31:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: "reply": 16773, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "reply_latency": { 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 16773, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 77.615000528, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.004627377 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_reply": 0, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "forward": 54, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_commit": 86, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_split": 8, 2024-04-30T23:31:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_merge": 2, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes": 90, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_top": 24, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_bottom": 51, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pin_tail": 15, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pinned": 29, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_expired": 10317, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_with_caps": 2, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": 2, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "subtrees": 5, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse": 24971, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_hit": 24773, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_forward": 5, 2024-04-30T23:31:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_discover": 15, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_lock": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "load_cent": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "q": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "exported": 51, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "exported_inodes": 9761, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "imported": 47, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "imported_inodes": 345, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_backtrace_fetch": 7403, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rfiles": 4, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rbytes": 234, 2024-04-30T23:31:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rsnaps": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_fetch": 7403, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_inodes": 929, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_base_inodes": 6, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dirfrag_rstats": 923, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_file_inodes": 6474, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_inode_file_caps": 65, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_revoke": 9931, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_grant": 14217, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_trunc": 14, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps": 20603, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps_dirty": 11921, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_cap_release": 39, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "process_request_cap_release": 4660 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_cache": { 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update": 0, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_try_discover": 0, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_send_discover": 15, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_handle_discover": 44, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays": 6, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_created": 2614, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_enqueued": 2608, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_migrated": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_started": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_completed": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_enqueue_scrub": 6, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_exportdir": 51, 2024-04-30T23:31:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_flush": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragmentdir": 10, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_started": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_write_failed": 0 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_log": { 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "evlrg": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "evadd": 33112, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "evex": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "evtrm": 0, 2024-04-30T23:31:06.631 INFO:teuthology.orchestra.run.smithi104.stdout: "ev": 33112, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "evexg": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "evexd": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segadd": 40, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segex": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segtrm": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "seg": 40, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segmjr": 4, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segexg": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "segexd": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "expos": 4194304, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "wrpos": 73379568, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "rdpos": 0, 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "jlat": { 2024-04-30T23:31:06.632 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 4231, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 134.264740942, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.031733571 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "replayed": 0 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_mem": { 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "ino": 48, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "ino+": 12262, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "ino-": 12214, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "dir": 55, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "dir+": 1487, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "dir-": 1432, 2024-04-30T23:31:06.633 INFO:teuthology.orchestra.run.smithi104.stdout: "dn": 90, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "dn+": 15832, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "dn-": 15742, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "cap": 2, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "cap+": 12206, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "cap-": 12204, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "rss": 183868, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "heap": 231824 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_server": { 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_client_request": 18185, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_server_request": 752, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_request": 16827, 2024-04-30T23:31:06.634 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_session": 93, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_peer_request": 1567, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "req_create_latency": { 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 10741, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 40.635119413, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.003783178 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getattr_latency": { 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 53, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.020368081, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.019252227 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.635 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "req_link_latency": { 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 14, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.937754517, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.066982465 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookup_latency": { 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1468, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.324391382, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000902173 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:06.636 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupino_latency": { 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000144192, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000144192 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupname_latency": { 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.637 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.638 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lssnap_latency": { 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mkdir_latency": { 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1371, 2024-04-30T23:31:06.639 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 10.637519166, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.007758949 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mknod_latency": { 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 44, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 3.044392749, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.069190744 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mksnap_latency": { 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.640 INFO:teuthology.orchestra.run.smithi104.stdout: "req_open_latency": { 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 43, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.010293034, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000239372 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "req_readdir_latency": { 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 315, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 2.095615890, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.006652748 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rename_latency": { 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 28, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.643970649, 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.022998951 2024-04-30T23:31:06.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmdir_latency": { 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 335, 2024-04-30T23:31:06.642 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 7.037605833, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.021007778 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.643 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setattr_latency": { 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 16, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.324194807, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.082762175 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setlayout_latency": { 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setxattr_latency": { 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 8, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.022680536, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.002835067 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "req_symlink_latency": { 2024-04-30T23:31:06.645 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 45, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 3.970318315, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.088229295 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "req_unlink_latency": { 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 2291, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 4.910631964, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.002143444 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.646 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_sessions": { 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "session_count": 1, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "session_add": 3, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "session_remove": 2, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_open": 1, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_stale": 0, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "total_load": 6930, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "average_load": 6930, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "avg_session_uptime": 1060, 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:06.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "mempool": { 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:06.648 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:06.649 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_items": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_bytes": 306677, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_items": 136, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_bytes": 1232, 2024-04-30T23:31:06.650 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_items": 14, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_bytes": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_items": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_items": 167, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_items": 0, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_bytes": 254493, 2024-04-30T23:31:06.651 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_items": 2843, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_items": 0, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_items": 0 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "objecter": { 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_active": 0, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_laggy": 0, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send": 17537, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send_bytes": 71912290, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_resend": 37, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_reply": 17537, 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "op_latency": { 2024-04-30T23:31:06.652 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 17537, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 61.462227774, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.003504717 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op_inflight": 0, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "oplen_avg": { 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 17537, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 17776 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op": 17537, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op_r": 7499, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op_w": 10038, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op_rmw": 0, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "op_pg": 0, 2024-04-30T23:31:06.653 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_stat": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_create": 11, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_read": 90, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_write": 4315, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writefull": 74, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writesame": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_append": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_zero": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_truncate": 8, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_delete": 5432, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_mapext": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:06.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_getxattr": 7409, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_setxattr": 22, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_call": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_watch": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_notify": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_other": 15, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_active": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_send": 0, 2024-04-30T23:31:06.655 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_resend": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_ping": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_active": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_send": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_resend": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_active": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_send": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_resend": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_active": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_send": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_resend": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "command_active": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "command_send": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "command_resend": 0, 2024-04-30T23:31:06.656 INFO:teuthology.orchestra.run.smithi104.stdout: "map_epoch": 93, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "map_full": 0, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "map_inc": 9, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_sessions": 12, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_open": 12, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_close": 0, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_laggy": 0, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_wr": 329, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_rd": 0, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_del": 71 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "oft": { 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_objs": 1, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:06.657 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_updates": 0, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_removes": 0 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "osd-slow-ops": { 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_ops_count": 0 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "purge_queue": { 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops_high_water": 10, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing": 0, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_high_water": 8, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed_ops": 4900, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed": 2608, 2024-04-30T23:31:06.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 87697, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 20444428, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 87697, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 87697, 2024-04-30T23:31:06.659 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 20444428, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 17537, 2024-04-30T23:31:06.660 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 72193962, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 17537, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 72193962, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 1024, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:06.661 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 17537, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 17537, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 17537, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 17537, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:06.662 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 2608, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 281672, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 2608, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 84, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 281672, 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:06.663 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle-0x55f681b2c8f0": { 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 33112, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 69185264, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 33112, 2024-04-30T23:31:06.664 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 4231, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 69185264, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:06.665 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-30T23:31:07.354 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:07 smithi100 ceph-mon[29745]: pgmap v898: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:07.403 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:07 smithi104 ceph-mon[32987]: pgmap v898: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:07.431 INFO:tasks.check_counter:Daemon mds.b mds.exported=51 2024-04-30T23:31:07.431 INFO:tasks.check_counter:Daemon mds.b mds.imported=47 2024-04-30T23:31:07.431 DEBUG:tasks.check_counter:Getting stats from e 2024-04-30T23:31:07.431 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-30T23:31:07.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:07 smithi183 ceph-mon[33560]: pgmap v898: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:07.677 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:31:09.426 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:09 smithi104 ceph-mon[32987]: pgmap v899: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 1584, 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 1554, 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 9505444, 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 591342, 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:09.469 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 2, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.199831231, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.079373097, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.059047947, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.046263161, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1553, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.084832362, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000054624 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 710992, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 204336 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 953, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 1200, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 16431960, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 819142, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 5, 2024-04-30T23:31:09.471 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.102817623, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.039819615, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.030180049, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.023543140, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1199, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.043134011, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000035974 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.472 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 517616 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 1386, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 1388, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 21319449, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 440755, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.132902539, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.035475479, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.043160712, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.044743360, 2024-04-30T23:31:09.473 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1386, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.037955516, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000027384 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:31:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "cct": { 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "total_workers": 1, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "unhealthy_workers": 0 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-MDSRank": { 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 5892, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.159269391, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000027031 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:09.475 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": { 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "request": 0, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "reply": 0, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "reply_latency": { 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_reply": 0, 2024-04-30T23:31:09.476 INFO:teuthology.orchestra.run.smithi104.stdout: "forward": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_commit": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_split": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_merge": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes": 4416, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_top": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_bottom": 4416, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pinned": 4416, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_expired": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": 0, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "subtrees": 1, 2024-04-30T23:31:09.477 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_hit": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_forward": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_discover": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_lock": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "load_cent": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "q": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "exported": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "exported_inodes": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "imported": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "imported_inodes": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:09.478 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_backtrace_fetch": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rfiles": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rbytes": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rsnaps": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_fetch": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_inodes": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dirfrag_rstats": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_file_inodes": 0, 2024-04-30T23:31:09.479 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_revoke": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_grant": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps_dirty": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_cap_release": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "process_request_cap_release": 0 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_cache": { 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:09.480 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_try_discover": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_send_discover": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_created": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_enqueued": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_migrated": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_started": 0, 2024-04-30T23:31:09.481 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_completed": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_exportdir": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_flush": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_started": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_write_failed": 0 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.482 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_log": { 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evlrg": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evadd": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evex": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evtrm": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "ev": 19746, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evexg": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "evexd": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "segadd": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "segex": 0, 2024-04-30T23:31:09.483 INFO:teuthology.orchestra.run.smithi104.stdout: "segtrm": 0, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "seg": 24, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "segmjr": 3, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "segexg": 0, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "segexd": 0, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "expos": 4194304, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "wrpos": 49735552, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "rdpos": 49734414, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "jlat": { 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "replayed": 19746 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.484 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_mem": { 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "ino": 27, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "ino+": 4796, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "ino-": 4769, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dir": 25, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dir+": 766, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dir-": 741, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dn": 4416, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dn+": 9693, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "dn-": 5277, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cap": 0, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cap+": 0, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cap-": 0, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "rss": 143684, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "heap": 215440 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.485 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_server": { 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_client_request": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_server_request": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_request": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_session": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_peer_request": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "req_create_latency": { 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getattr_latency": { 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.486 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "req_link_latency": { 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookup_latency": { 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.487 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupino_latency": { 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupname_latency": { 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.489 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lssnap_latency": { 2024-04-30T23:31:09.490 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mkdir_latency": { 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mknod_latency": { 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.491 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mksnap_latency": { 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "req_open_latency": { 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "req_readdir_latency": { 2024-04-30T23:31:09.492 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rename_latency": { 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.493 INFO:teuthology.orchestra.run.smithi104.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmdir_latency": { 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.494 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setattr_latency": { 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setlayout_latency": { 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.496 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setxattr_latency": { 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "req_symlink_latency": { 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "req_unlink_latency": { 2024-04-30T23:31:09.497 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.498 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_sessions": { 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "session_count": 1, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "session_add": 2, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "session_remove": 1, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_open": 1, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_stale": 0, 2024-04-30T23:31:09.499 INFO:teuthology.orchestra.run.smithi104.stdout: "total_load": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "average_load": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "avg_session_uptime": 2229, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "mempool": { 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:09.500 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:09.501 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:09.502 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_items": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_bytes": 215749, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_items": 81, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_bytes": 0, 2024-04-30T23:31:09.503 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_items": 167, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_bytes": 3205518, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_items": 19432, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_items": 0, 2024-04-30T23:31:09.504 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_items": 0 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "objecter": { 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_active": 0, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_laggy": 0, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send": 3551, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send_bytes": 21, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_resend": 3, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_reply": 3551, 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "op_latency": { 2024-04-30T23:31:09.505 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3551, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.813977140, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000510835 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "op_inflight": 0, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "oplen_avg": { 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3551, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 3552 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "op": 3551, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "op_r": 3551, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "op_w": 0, 2024-04-30T23:31:09.506 INFO:teuthology.orchestra.run.smithi104.stdout: "op_rmw": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "op_pg": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_stat": 2290, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_create": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_read": 1259, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_write": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writefull": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writesame": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_append": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_zero": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_truncate": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_delete": 0, 2024-04-30T23:31:09.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_mapext": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_getxattr": 1, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_setxattr": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_call": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_watch": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_notify": 0, 2024-04-30T23:31:09.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_other": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_active": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_send": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_resend": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_ping": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_active": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_send": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_resend": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_active": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_send": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_resend": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_active": 0, 2024-04-30T23:31:09.509 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_send": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_resend": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "command_active": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "command_send": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "command_resend": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "map_epoch": 93, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "map_full": 0, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "map_inc": 4, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_sessions": 8, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_open": 9, 2024-04-30T23:31:09.510 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_close": 1, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_laggy": 0, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_wr": 0, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_rd": 2, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_del": 0 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "oft": { 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_objs": 0, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_updates": 0, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_removes": 0 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "osd-slow-ops": { 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_ops_count": 0 2024-04-30T23:31:09.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "purge_queue": { 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops_high_water": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_high_water": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed_ops": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:09.512 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 3919, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 46882427, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 3919, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3919, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 46882427, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.513 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:09.514 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 3551, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 45542445, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3551, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 45542445, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 1024, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 3551, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 3551, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3551, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 3551, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.516 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 0, 2024-04-30T23:31:09.517 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle-0x55729fe188f0": { 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:09.518 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:09.519 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-30T23:31:09.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:09 smithi183 ceph-mon[33560]: pgmap v899: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:09.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:09 smithi100 ceph-mon[29745]: pgmap v899: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:10.367 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-30T23:31:10.367 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-30T23:31:10.367 DEBUG:tasks.check_counter:Getting stats from h 2024-04-30T23:31:10.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-30T23:31:10.606 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:31:11.297 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:11 smithi104 ceph-mon[32987]: pgmap v900: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:11.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:11 smithi183 ceph-mon[33560]: pgmap v900: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:11.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:11 smithi100 ceph-mon[29745]: pgmap v900: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:12.435 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-30T23:31:12.435 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:12.435 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 15505, 2024-04-30T23:31:12.435 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 25144, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 6965608, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 17007009, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 10, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 1.436799774, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.647242583, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.558499511, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.210190732, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 25149, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.854482263, 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000033976 2024-04-30T23:31:12.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 24195, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.004932574, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000203 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 6689, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 6764, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 2401405, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 15416174, 2024-04-30T23:31:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 17, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 7, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.550605550, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.180930723, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.152394871, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.175258070, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 6763, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.418123800, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000061825 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 500, 2024-04-30T23:31:12.438 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000091225, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000182 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 726672, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 395008 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 16665, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 29439, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 6642814, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 20540667, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 19, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 9, 2024-04-30T23:31:12.439 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 1.318194342, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.642519861, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.738416729, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.098112488, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 29431, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.999451849, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000033959 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 29148, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.005032280, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000172 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 4698448, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 14681264 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "cct": { 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "total_workers": 1, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "unhealthy_workers": 0 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-MDSRank": { 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 4879, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 17.451845624, 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.003576930 2024-04-30T23:31:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 6499, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.069986470, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000164638 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": { 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "request": 6558, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "reply": 6556, 2024-04-30T23:31:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "reply_latency": { 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 6556, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 12.070999092, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.001841214 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_reply": 0, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "forward": 2, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_commit": 11, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_split": 0, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_merge": 0, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes": 293, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_top": 177, 2024-04-30T23:31:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_bottom": 76, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pin_tail": 40, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pinned": 40, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_expired": 226, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "subtrees": 2, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse": 16580, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_hit": 15923, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_forward": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_discover": 9, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_lock": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "load_cent": 0, 2024-04-30T23:31:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "q": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "exported": 11, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "exported_inodes": 135, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "imported": 13, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "imported_inodes": 3752, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_backtrace_fetch": 7915, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_peer_discover": 1, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rfiles": 11640, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rbytes": 1374906479, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rsnaps": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_fetch": 7915, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_inodes": 926, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dirfrag_rstats": 926, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_file_inodes": 6989, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_inode_file_caps": 2, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_revoke": 6521, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_grant": 4589, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps": 6711, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps_dirty": 722, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_cap_release": 28, 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "process_request_cap_release": 4753 2024-04-30T23:31:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_cache": { 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_try_discover": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_send_discover": 12, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays": 30, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_created": 3717, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_enqueued": 3687, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_migrated": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_started": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_completed": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_exportdir": 11, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_flush": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_started": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_write_failed": 0 2024-04-30T23:31:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_log": { 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evlrg": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evadd": 12815, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evex": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evtrm": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "ev": 12815, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evexg": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "evexd": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "segadd": 19, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "segex": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "segtrm": 0, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "seg": 19, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "segmjr": 3, 2024-04-30T23:31:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "segexg": 0, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "segexd": 0, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "expos": 4194304, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "wrpos": 30031701, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "rdpos": 0, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "jlat": { 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1973, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 14.572508886, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.007385964 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "replayed": 0 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_mem": { 2024-04-30T23:31:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "ino": 46, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "ino+": 3761, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "ino-": 3715, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dir": 44, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dir+": 512, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dir-": 468, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dn": 293, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dn+": 7524, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "dn-": 7231, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cap": 0, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cap+": 3857, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cap-": 3857, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "rss": 148000, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "heap": 223632 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_server": { 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_client_request": 9384, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_server_request": 11, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_request": 6558, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_session": 18, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_peer_request": 223, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "req_create_latency": { 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getattr_latency": { 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "req_link_latency": { 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookup_latency": { 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 2368, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.913727153, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000385864 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupino_latency": { 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupname_latency": { 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lssnap_latency": { 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mkdir_latency": { 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mknod_latency": { 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mksnap_latency": { 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "req_open_latency": { 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "req_readdir_latency": { 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 471, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.294839899, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000625987 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rename_latency": { 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmdir_latency": { 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 448, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 5.756469861, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.012849263 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setattr_latency": { 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setlayout_latency": { 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setxattr_latency": { 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "req_symlink_latency": { 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "req_unlink_latency": { 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3269, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 5.105962179, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.001561933 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_sessions": { 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "session_count": 1, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "session_add": 2, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "session_remove": 1, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_open": 1, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_stale": 0, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "total_load": 5204, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "average_load": 5204, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "avg_session_uptime": 1056, 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "mempool": { 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_bytes": 273117, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_items": 126, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_bytes": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_items": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_items": 167, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_items": 0, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_bytes": 399948, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_items": 12558, 2024-04-30T23:31:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_items": 0, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_items": 0 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "objecter": { 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_active": 0, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_laggy": 0, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send": 17141, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send_bytes": 26474365, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_resend": 33, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_reply": 17141, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "op_latency": { 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 17141, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 33.170582498, 2024-04-30T23:31:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.001935160 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op_inflight": 0, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "oplen_avg": { 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 17141, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 17228 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op": 17141, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op_r": 7991, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op_w": 9150, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op_rmw": 0, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "op_pg": 0, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_stat": 0, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_create": 10, 2024-04-30T23:31:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_read": 76, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_write": 2049, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writefull": 41, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writesame": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_append": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_zero": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_truncate": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_delete": 6990, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_mapext": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_getxattr": 7915, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_setxattr": 20, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_call": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_watch": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_notify": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_other": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_active": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_send": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_resend": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_ping": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_active": 0, 2024-04-30T23:31:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_send": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_resend": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_active": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_send": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_resend": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_active": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_send": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_resend": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "command_active": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "command_send": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "command_resend": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "map_epoch": 93, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "map_full": 0, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "map_inc": 4, 2024-04-30T23:31:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_sessions": 12, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_open": 12, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_close": 0, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_laggy": 0, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_wr": 90, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_rd": 0, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_del": 37 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "oft": { 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_objs": 1, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_updates": 0, 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_removes": 0 2024-04-30T23:31:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "osd-slow-ops": { 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_ops_count": 0 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "purge_queue": { 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops_high_water": 17, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing": 0, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_high_water": 9, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed_ops": 6972, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed": 3687, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 38855, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 11901851, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 38855, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 38855, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 11901851, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 17141, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 26872920, 2024-04-30T23:31:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 17141, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 26872920, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 1024, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 17141, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 17141, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 17141, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 17141, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 3687, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 398555, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 3687, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 76, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 398555, 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle-0x562754cda8f0": { 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 12815, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 25837397, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 12815, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 1973, 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 25837397, 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:12.481 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-30T23:31:13.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:13 smithi104 ceph-mon[32987]: pgmap v901: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:13.366 INFO:tasks.check_counter:Daemon mds.h mds.exported=11 2024-04-30T23:31:13.366 INFO:tasks.check_counter:Daemon mds.h mds.imported=13 2024-04-30T23:31:13.366 DEBUG:tasks.check_counter:Getting stats from k 2024-04-30T23:31:13.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-30T23:31:13.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:13 smithi183 ceph-mon[33560]: pgmap v901: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:13.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:13 smithi100 ceph-mon[29745]: pgmap v901: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:13.604 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.b/config 2024-04-30T23:31:15.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:15 smithi104 ceph-mon[32987]: pgmap v902: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:15.344 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-30T23:31:15.344 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:15.344 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 1145, 2024-04-30T23:31:15.344 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 1145, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 9362354, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 363350, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 8, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.115918132, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.046098753, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.030443247, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.028220897, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 1144, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.050102104, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000043795 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:15.345 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 664, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 634, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 13368708, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 300075, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 4, 2024-04-30T23:31:15.346 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.090497311, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.028899625, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.041249890, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.017192405, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 633, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.029759681, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000047013 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 712080, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 206896 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_messages": 2118, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages": 2370, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_bytes": 4822274, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_bytes": 1280760, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_total_time": 0.245586878, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_send_time": 0.080460861, 2024-04-30T23:31:15.348 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_recv_time": 0.060581068, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_running_fast_dispatch_time": 0.081206365, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 2368, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.107117263, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000045235 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "msgr_send_encrypted_bytes": 607872 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.349 INFO:teuthology.orchestra.run.smithi104.stdout: "cct": { 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "total_workers": 1, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "unhealthy_workers": 0 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-MDSRank": { 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 5828, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.180524050, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000030975 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: "queue_len": 0, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "complete_latency": { 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": { 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "request": 0, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "reply": 0, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "reply_latency": { 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_reply": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "forward": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_commit": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_split": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_merge": 0, 2024-04-30T23:31:15.352 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes": 4114, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_top": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_bottom": 4114, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_pinned": 4114, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_expired": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "subtrees": 1, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_hit": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_forward": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_discover": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:15.353 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "traverse_lock": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "load_cent": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "q": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "exported": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "exported_inodes": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "imported": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "imported_inodes": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_backtrace_fetch": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rfiles": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rbytes": 0, 2024-04-30T23:31:15.354 INFO:teuthology.orchestra.run.smithi104.stdout: "root_rsnaps": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_fetch": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_inodes": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_dirfrag_rstats": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "scrub_file_inodes": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_revoke": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_grant": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:15.355 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_caps_dirty": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_cap_release": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "process_request_cap_release": 0 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_cache": { 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_try_discover": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_send_discover": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:15.356 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_created": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_enqueued": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "strays_migrated": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_started": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_completed": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_exportdir": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_flush": 0, 2024-04-30T23:31:15.357 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_started": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "uninline_write_failed": 0 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_log": { 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "evlrg": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "evadd": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "evex": 0, 2024-04-30T23:31:15.358 INFO:teuthology.orchestra.run.smithi104.stdout: "evtrm": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "ev": 12815, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "evexg": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "evexd": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segadd": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segex": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segtrm": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "seg": 19, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segmjr": 3, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segexg": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "segexd": 0, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "expos": 4194304, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "wrpos": 30031701, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "rdpos": 30030563, 2024-04-30T23:31:15.359 INFO:teuthology.orchestra.run.smithi104.stdout: "jlat": { 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "replayed": 12815 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_mem": { 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "ino": 43, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "ino+": 3768, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "ino-": 3725, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "dir": 41, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "dir+": 514, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "dir-": 473, 2024-04-30T23:31:15.360 INFO:teuthology.orchestra.run.smithi104.stdout: "dn": 4114, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "dn+": 7517, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "dn-": 3403, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "cap": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "cap+": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "cap-": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "rss": 128316, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "heap": 215440 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_server": { 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_client_request": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "dispatch_server_request": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_request": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_client_session": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "handle_peer_request": 0, 2024-04-30T23:31:15.361 INFO:teuthology.orchestra.run.smithi104.stdout: "req_create_latency": { 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getattr_latency": { 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "req_link_latency": { 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookup_latency": { 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.363 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupino_latency": { 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupname_latency": { 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.364 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.365 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.365 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:15.365 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.365 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "req_lssnap_latency": { 2024-04-30T23:31:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mkdir_latency": { 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mknod_latency": { 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "req_mksnap_latency": { 2024-04-30T23:31:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "req_open_latency": { 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "req_readdir_latency": { 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rename_latency": { 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmdir_latency": { 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setattr_latency": { 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setlayout_latency": { 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "req_setxattr_latency": { 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "req_symlink_latency": { 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "req_unlink_latency": { 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_sessions": { 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "session_count": 1, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "session_add": 2, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "session_remove": 1, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_open": 1, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "sessions_stale": 0, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "total_load": 0, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "average_load": 0, 2024-04-30T23:31:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "avg_session_uptime": 2230, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "mempool": { 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_bytes": 209045, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_anon_items": 95, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_items": 167, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "pgmap_items": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_bytes": 3062047, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_co_items": 28405, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_1_items": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "unittest_2_items": 0 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "objecter": { 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_active": 0, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_laggy": 0, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send": 3550, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_send_bytes": 21, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_resend": 3, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_reply": 3550, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "op_latency": { 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3550, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 1.762977788, 2024-04-30T23:31:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000496613 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op_inflight": 0, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "oplen_avg": { 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 3550, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 3551 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op": 3550, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op_r": 3550, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op_w": 0, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op_rmw": 0, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "op_pg": 0, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_stat": 2293, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_create": 0, 2024-04-30T23:31:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_read": 1255, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_write": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writefull": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_writesame": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_append": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_zero": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_truncate": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_delete": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_mapext": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_getxattr": 1, 2024-04-30T23:31:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_setxattr": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_call": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_watch": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_notify": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "osdop_other": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_active": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_send": 0, 2024-04-30T23:31:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_resend": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "linger_ping": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_active": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_send": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolop_resend": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_active": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_send": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "poolstat_resend": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_active": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_send": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "statfs_resend": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "command_active": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "command_send": 0, 2024-04-30T23:31:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "command_resend": 0, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "map_epoch": 93, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "map_full": 0, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "map_inc": 4, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_sessions": 7, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_open": 8, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_session_close": 1, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_laggy": 0, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_wr": 0, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_rd": 2, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_del": 0 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "oft": { 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_objs": 0, 2024-04-30T23:31:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_updates": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "omap_total_removes": 0 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "osd-slow-ops": { 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "slow_ops_count": 0 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "purge_queue": { 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_ops_high_water": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executing_high_water": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed_ops": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_executed": 0, 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 3923, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 27178299, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 3923, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3923, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 27178299, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 104857600, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 3550, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 25837402, 2024-04-30T23:31:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3550, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 25837402, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 1024, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 3550, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 3550, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 3550, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 3550, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "throttle-write_buf_throttle-0x55bb4ecf08f0": { 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "val": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "max": 3758096384, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "get_started": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "get": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "get_sum": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "take": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "take_sum": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "put": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "put_sum": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "wait": { 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "avgcount": 0, 2024-04-30T23:31:15.437 INFO:teuthology.orchestra.run.smithi104.stdout: "sum": 0.000000000, 2024-04-30T23:31:15.438 INFO:teuthology.orchestra.run.smithi104.stdout: "avgtime": 0.000000000 2024-04-30T23:31:15.438 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.438 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-30T23:31:15.438 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-30T23:31:15.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:15 smithi183 ceph-mon[33560]: pgmap v902: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:15.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:15 smithi100 ceph-mon[29745]: pgmap v902: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:16.186 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-30T23:31:16.186 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-30T23:31:16.186 DEBUG:tasks.check_counter:Getting stats from c 2024-04-30T23:31:16.186 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-30T23:31:16.436 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:31:17.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:17 smithi104 ceph-mon[32987]: pgmap v903: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:17.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:17 smithi183 ceph-mon[33560]: pgmap v903: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:17.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:17 smithi100 ceph-mon[29745]: pgmap v903: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:18.258 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-04-30T23:31:18.258 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 4141, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 4492, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 2630024, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 5943548, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 20, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.356874232, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.127473298, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.167200678, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.064769379, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 4493, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.216934850, 2024-04-30T23:31:18.259 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000048282 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 4512, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.001091160, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000241 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 2873, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2847, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 1431522, 2024-04-30T23:31:18.260 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 5370764, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 11, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 7, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.271794103, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.105747204, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.075155003, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.074572532, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2846, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.179107946, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000062933 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:18.261 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 186, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000040760, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000219 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 720880, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 214992 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 5874, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 9931, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 2137306, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 5722672, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 15, 2024-04-30T23:31:18.262 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.471914378, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.226050303, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.280186891, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.025886422, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 9927, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.398838237, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000040177 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 10424, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.001789610, 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000171 2024-04-30T23:31:18.263 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 1571824, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 5088240 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1194, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 5.247754502, 2024-04-30T23:31:18.264 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.004395104 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2189, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.493716804, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000225544 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 1977, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 1975, 2024-04-30T23:31:18.265 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1975, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3.730094496, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001888655 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 2, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 11, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 21, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 4, 2024-04-30T23:31:18.266 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 7, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 10, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 14, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 60, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 2, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 2, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 4, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 5111, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 4940, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 18, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-04-30T23:31:18.267 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 1000, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 1, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 18, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 1, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 20, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 1281, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 2495, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 11640, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 1374906479, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 2495, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:18.268 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 172, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 172, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 2323, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 2, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 1884, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 1443, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 2412, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 540, 2024-04-30T23:31:18.269 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 23, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 1519 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 21, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 1, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 1248, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 1248, 2024-04-30T23:31:18.270 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 18, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:18.271 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 4305, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 4305, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 6, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-04-30T23:31:18.272 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 6, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 2, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 12574501, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 0, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 237, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.692130290, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002920380 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 0 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.273 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 26, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 1304, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 1278, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 25, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 143, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 118, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 21, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 2609, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 2588, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 2, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 1346, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 1344, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 137960, 2024-04-30T23:31:18.274 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 223632 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 2390, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 46, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 1977, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 18, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 231, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-04-30T23:31:18.275 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000981998, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000981998 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.276 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 624, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.268315164, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000429992 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000182867, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000182867 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.277 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.278 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.280 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 101, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.071356461, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000706499 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.281 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-04-30T23:31:18.282 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 86, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.546118919, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.017978126 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.283 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.285 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1162, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.843139087, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001586178 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 1770, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 1770, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 1071, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:18.287 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:18.288 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:18.289 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 288439, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 101, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 167, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 106397, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 432, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-04-30T23:31:18.291 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 5291, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 8600224, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 33, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 5291, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 5291, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 11.058692731, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002090095 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 5291, 2024-04-30T23:31:18.292 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 5348 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 5291, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 2525, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 2766, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 10, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 30, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 267, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 25, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-04-30T23:31:18.293 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 2423, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 2495, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 20, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:18.294 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-04-30T23:31:18.295 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 93, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 4, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 12, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 12, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 60, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 0, 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 18 2024-04-30T23:31:18.296 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 1, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 10, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-04-30T23:31:18.297 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 7, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 2410, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 1248, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 12884, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 4823752, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 12884, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:18.298 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 12884, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 4823752, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:18.299 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 5291, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 8735568, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 5291, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 8735568, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:18.300 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 5291, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 5291, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 5291, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 5291, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 1248, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 135344, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 1248, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 30, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 135344, 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:18.302 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x558e0e81c8f0": { 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 4305, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 8380197, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 4305, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:18.303 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 237, 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 8380197, 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:18.304 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-04-30T23:31:19.088 INFO:tasks.check_counter:Daemon mds.c mds.exported=18 2024-04-30T23:31:19.088 INFO:tasks.check_counter:Daemon mds.c mds.imported=20 2024-04-30T23:31:19.088 DEBUG:tasks.check_counter:Getting stats from f 2024-04-30T23:31:19.088 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-30T23:31:19.332 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:31:19.449 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:19 smithi183 ceph-mon[33560]: pgmap v904: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:19.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:19 smithi104 ceph-mon[32987]: pgmap v904: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:19.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:19 smithi100 ceph-mon[29745]: pgmap v904: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 2389, 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2391, 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 32153284, 2024-04-30T23:31:21.031 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 759712, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 7, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.266465156, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.081618437, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.080948794, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.079286594, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2389, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.099168935, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000041510 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.032 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 138, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 389, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 21007168, 2024-04-30T23:31:21.033 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 654258, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 7, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.035640557, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.013203558, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.015866640, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.003334832, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 387, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.026032721, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000067268 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.034 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 610944 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1622, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1590, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 17807861, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 603411, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:21.035 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.188514466, 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.066224513, 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.060284866, 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.049701389, 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1590, 2024-04-30T23:31:21.036 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.065858117, 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000041420 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.037 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 714912, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 206864 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 6159, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.185350403, 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000030094 2024-04-30T23:31:21.038 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 0, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 0, 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-04-30T23:31:21.039 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 3047, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 23, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 3024, 2024-04-30T23:31:21.040 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 3014, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 2, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-04-30T23:31:21.041 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 4, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 234, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:21.042 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 0, 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 0 2024-04-30T23:31:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-04-30T23:31:21.044 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-04-30T23:31:21.045 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 33112, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-04-30T23:31:21.046 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 40, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 4, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 73379568, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 73375267, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 33112 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.047 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 29, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 12214, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 12185, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 36, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 1449, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 1413, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 3047, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 15212, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 12165, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 0, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 0, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 136080, 2024-04-30T23:31:21.048 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 215440 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-04-30T23:31:21.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.050 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.052 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.053 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.053 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-04-30T23:31:21.053 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.053 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.053 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-04-30T23:31:21.054 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.055 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.057 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.058 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-04-30T23:31:21.059 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.060 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 3, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 2, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 0, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 0, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 2242, 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:21.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:21.062 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:21.063 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 215437, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 72, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:21.064 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 167, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 2258711, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 14865, 2024-04-30T23:31:21.065 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 3772, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 26, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 4, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 3772, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3772, 2024-04-30T23:31:21.066 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.994944455, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000528882 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3772, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3773 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 3772, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 3772, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 0, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 2438, 2024-04-30T23:31:21.067 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 1331, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 2, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:21.068 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-04-30T23:31:21.069 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 93, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-04-30T23:31:21.070 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 4, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 8, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 8, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 2, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 0 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-04-30T23:31:21.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:21.072 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 4145, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 70573302, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 4145, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 4145, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 70573302, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 3772, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 69195973, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3772, 2024-04-30T23:31:21.074 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 69195973, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:21.075 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 3772, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 3772, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3772, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 3772, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:21.076 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x55dbc41e0750": { 2024-04-30T23:31:21.077 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:21.078 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:21.079 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:21.079 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.079 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:21.079 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-04-30T23:31:21.303 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:21 smithi183 ceph-mon[33560]: pgmap v905: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:21.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:21 smithi104 ceph-mon[32987]: pgmap v905: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:21.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:21 smithi100 ceph-mon[29745]: pgmap v905: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:21.824 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-30T23:31:21.825 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-30T23:31:21.825 DEBUG:tasks.check_counter:Getting stats from i 2024-04-30T23:31:21.825 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-30T23:31:22.061 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:31:23.459 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:23 smithi183 ceph-mon[33560]: pgmap v906: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:23.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:23 smithi104 ceph-mon[32987]: pgmap v906: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:23.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:23 smithi100 ceph-mon[29745]: pgmap v906: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-30T23:31:23.751 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-04-30T23:31:23.751 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 7642, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 9255, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 4844838, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 29007011, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 10, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.736524322, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.313733290, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.262349198, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.152863962, 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:23.752 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 9253, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.370689823, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000040061 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 7155, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.001552901, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000217 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 26848, 2024-04-30T23:31:23.753 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 44673, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 10103265, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 34729443, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 22, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 2.050155947, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.966492053, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 1.264124253, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.161535090, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 44671, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.548168347, 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000034657 2024-04-30T23:31:23.754 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 46960, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.007760741, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000165 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 8871808, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 25199584 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 6906, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 6874, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 2897176, 2024-04-30T23:31:23.755 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 15504402, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 14, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 6, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.593248552, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.217251770, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.159262929, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.178579579, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 6874, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.367205502, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000053419 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 208, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000044852, 2024-04-30T23:31:23.756 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000215 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 733344, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 224064 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 5421, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 18.854715465, 2024-04-30T23:31:23.757 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003478088 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 7953, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.864262168, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000234409 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 11518, 2024-04-30T23:31:23.758 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 11517, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 11517, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 58.363824807, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.005067623 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 1, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 11, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 83, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 12, 2024-04-30T23:31:23.759 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 71, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 63, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 629, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 3, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 19780, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 19401, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 8, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 6, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 1000, 2024-04-30T23:31:23.760 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 1, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 9, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 603, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 9, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 2526, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 4505, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 16, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 11640, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 1374906479, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 4497, 2024-04-30T23:31:23.761 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 409, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 409, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 4088, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 6336, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 7572, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 212, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:23.762 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 10313, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 3387, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 37, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 6988 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 7, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 18, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 14, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 4261, 2024-04-30T23:31:23.763 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 4139, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 110, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 10, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:23.764 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 1, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 19746, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 19746, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 24, 2024-04-30T23:31:23.765 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 24, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 3, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 49735552, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 0, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3173, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 28.638077679, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.009025552 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.766 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 0 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 36, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 4791, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 4755, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 35, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 762, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 727, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 83, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 9703, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 9620, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 4883, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 4883, 2024-04-30T23:31:23.767 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 192276, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 223632 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 14068, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 8, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 11518, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 231, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 115, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 925, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 8.788951003, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.009501568 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.768 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 34, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.165833617, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.004877459 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 237, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.474316566, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.006220745 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.769 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2886, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3.342170818, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001158063 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:23.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.773 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.773 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.773 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.773 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-04-30T23:31:23.773 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 476, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 4.961806314, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.010423962 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 440, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 4.344335628, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.009873490 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.774 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000576998, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000288499 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 726, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.970075457, 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002713602 2024-04-30T23:31:23.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 527, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 6.028168376, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.011438649 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 840, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 13.658172392, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.016259729 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.777 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 215, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 2.752355924, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.012801655 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 452, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3.090237923, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.006836809 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3757, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 7.786823791, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002072617 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:23.780 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 7364, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 7364, 2024-04-30T23:31:23.781 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 2245, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:23.782 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:23.783 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 314141, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 129, 2024-04-30T23:31:23.784 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 167, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 193411, 2024-04-30T23:31:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2836, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 15960, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 46346955, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 33, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 15960, 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-04-30T23:31:23.786 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 15960, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 44.575762918, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002792967 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 15960, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 16074 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 15960, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 4588, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 11372, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-04-30T23:31:23.787 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 10, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 83, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 3256, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 46, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 7729, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 4505, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 20, 2024-04-30T23:31:23.788 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 261, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-04-30T23:31:23.789 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 93, 2024-04-30T23:31:23.790 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 4, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 12, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 12, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 120, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 44 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 1, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-04-30T23:31:23.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 18, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 9, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 7707, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 4139, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:23.792 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 41392, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 13092332, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 41392, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 41392, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 13092332, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 15960, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 46785282, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 15960, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 46785282, 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:23.794 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 15960, 2024-04-30T23:31:23.795 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 15960, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 15960, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 15960, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:23.796 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 4139, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 438327, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 4139, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 83, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 438327, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x55dee5baa750": { 2024-04-30T23:31:23.797 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 19746, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 45541248, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 19746, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3173, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 45541248, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:23.798 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.799 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:23.799 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-04-30T23:31:24.639 INFO:tasks.check_counter:Daemon mds.i mds.exported=9 2024-04-30T23:31:24.639 INFO:tasks.check_counter:Daemon mds.i mds.imported=9 2024-04-30T23:31:24.639 DEBUG:tasks.check_counter:Getting stats from l 2024-04-30T23:31:24.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed shell --fsid a34a4a58-0745-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-30T23:31:24.875 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/mon.c/config 2024-04-30T23:31:25.258 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:25 smithi183 ceph-mon[33560]: pgmap v907: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:25.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:25 smithi104 ceph-mon[32987]: pgmap v907: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:25.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:25 smithi100 ceph-mon[29745]: pgmap v907: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1552, 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1552, 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 4691095, 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 492713, 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:26.588 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.196686329, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.060805630, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.053312718, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.064484954, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1551, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.082748802, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000053351 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.589 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1125, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1380, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 4477369, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 882236, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 6, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.128302692, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.054489675, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.028744412, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.031663971, 2024-04-30T23:31:26.590 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1378, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.064149427, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000046552 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 524736 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1250, 2024-04-30T23:31:26.591 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1220, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 929064, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 487402, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 5, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 3, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.143924744, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.049739896, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.044078618, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.040373930, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1219, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.051613956, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000042341 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-04-30T23:31:26.592 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 713792, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 209152 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 5924, 2024-04-30T23:31:26.593 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.190291570, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000032122 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 0, 2024-04-30T23:31:26.594 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 1253, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 0, 2024-04-30T23:31:26.595 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 1253, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 1253, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 1, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-04-30T23:31:26.596 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-04-30T23:31:26.597 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 0, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 0 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.598 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-04-30T23:31:26.599 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-04-30T23:31:26.600 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 4305, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 6, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 2, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-04-30T23:31:26.601 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 12574501, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 12573363, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 4305 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 8, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 1310, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 1302, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 6, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 148, 2024-04-30T23:31:26.602 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 142, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 1253, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 2595, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 1342, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 122236, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 215440 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 0, 2024-04-30T23:31:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 0, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.604 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.605 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-04-30T23:31:26.607 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.610 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.611 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.612 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 0, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 0, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 2247, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-04-30T23:31:26.615 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-04-30T23:31:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-04-30T23:31:26.617 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 199071, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 59, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-04-30T23:31:26.618 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8704, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 167, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 908184, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 5085, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-04-30T23:31:26.619 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 3547, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 21, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 3, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 3547, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3547, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 1.874947807, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000528601 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3547, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 3548 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.620 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 3547, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 3547, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 2307, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 1238, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 0, 2024-04-30T23:31:26.621 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 1, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-04-30T23:31:26.622 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-04-30T23:31:26.623 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 93, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 4, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 6, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 8, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 2, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 2, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 0 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-04-30T23:31:26.624 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "osd-slow-ops": { 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 0, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.625 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 3923, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 9722339, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 3923, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3923, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 9722339, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.626 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 3547, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 8380202, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3547, 2024-04-30T23:31:26.627 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 8380202, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 3547, 2024-04-30T23:31:26.628 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 3547, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3547, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 3547, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:26.629 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x5647156bcc30": { 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-04-30T23:31:26.630 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-04-30T23:31:26.631 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-04-30T23:31:27.290 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:27 smithi183 ceph-mon[33560]: pgmap v908: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:27.322 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-30T23:31:27.323 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-30T23:31:27.323 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-30T23:31:27.334 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-30T23:31:27.334 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:31:27.334 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:31:27.356 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:31:27.356 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:31:27.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:31:27.500 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:27 smithi104 ceph-mon[32987]: pgmap v908: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:27.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:27 smithi100 ceph-mon[29745]: pgmap v908: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2024-04-30T23:31:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 -- 172.21.15.100:0/2766921462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8109a80 msgr2=0x7fcbd810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/2766921462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8109a80 0x7fcbd810bea0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ca0 tx=0x7fcbd002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 -- 172.21.15.100:0/2766921462 shutdown_connections 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/2766921462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8109a80 0x7fcbd810bea0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/2766921462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8104d80 0x7fcbd8105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/2766921462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 0x7fcbd8104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 -- 172.21.15.100:0/2766921462 >> 172.21.15.100:0/2766921462 conn(0x7fcbd80fed70 msgr2=0x7fcbd81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.573+0000 7fcbdcf06640 1 -- 172.21.15.100:0/2766921462 shutdown_connections 2024-04-30T23:31:27.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.574+0000 7fcbdcf06640 1 -- 172.21.15.100:0/2766921462 wait complete. 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.574+0000 7fcbdcf06640 1 Processor -- start 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.574+0000 7fcbdcf06640 1 -- start start 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 0x7fcbd819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 0x7fcbd81a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd810f670 con 0x7fcbd8104d80 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd810f4f0 con 0x7fcbd8109a80 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd810f7f0 con 0x7fcbd8103b40 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53268/0 (socket says 172.21.15.100:53268) 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 -- 172.21.15.100:0/535962391 learned_addr learned my addr 172.21.15.100:0/535962391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd659c640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 0x7fcbd819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd6d9d640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 0x7fcbd81a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 -- 172.21.15.100:0/535962391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 msgr2=0x7fcbd819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 0x7fcbd819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 -- 172.21.15.100:0/535962391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 msgr2=0x7fcbd81a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 0x7fcbd81a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 -- 172.21.15.100:0/535962391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd81a1d00 con 0x7fcbd8104d80 2024-04-30T23:31:27.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd6d9d640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 0x7fcbd81a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbd5d9b640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800e9f0 tx=0x7fcbc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800cd80 con 0x7fcbd8104d80 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd81a1ff0 con 0x7fcbd8104d80 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc80108e0 con 0x7fcbd8104d80 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.575+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8018980 con 0x7fcbd8104d80 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.576+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd81a2460 con 0x7fcbd8104d80 2024-04-30T23:31:27.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.576+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd8108890 con 0x7fcbd8104d80 2024-04-30T23:31:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.578+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fcbc8010430 con 0x7fcbd8104d80 2024-04-30T23:31:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.578+0000 7fcbc77fe640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 0x7fcbc00a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.578+0000 7fcbd659c640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 0x7fcbc00a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.579+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fcbc80d0fe0 con 0x7fcbd8104d80 2024-04-30T23:31:27.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.579+0000 7fcbd659c640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 0x7fcbc00a60c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8104740 tx=0x7fcbcc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.582+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcbc809d660 con 0x7fcbd8104d80 2024-04-30T23:31:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.762+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbd802de00 con 0x7fcbd8104d80 2024-04-30T23:31:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.763+0000 7fcbc77fe640 1 -- 172.21.15.100:0/535962391 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7fcbc80a5e20 con 0x7fcbd8104d80 2024-04-30T23:31:27.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:31:27.767 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:31:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 msgr2=0x7fcbc00a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 0x7fcbc00a60c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8104740 tx=0x7fcbcc005f90 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 msgr2=0x7fcbd819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800e9f0 tx=0x7fcbc800eeb0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 shutdown_connections 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fcbc00a3bb0 0x7fcbc00a60c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbd8109a80 0x7fcbd81a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8104d80 0x7fcbd819a750 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 --2- 172.21.15.100:0/535962391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbd8103b40 0x7fcbd819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.765+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 >> 172.21.15.100:0/535962391 conn(0x7fcbd80fed70 msgr2=0x7fcbd8105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.766+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 shutdown_connections 2024-04-30T23:31:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.766+0000 7fcbdcf06640 1 -- 172.21.15.100:0/535962391 wait complete. 2024-04-30T23:31:27.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T23:06:21.574769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T23:10:57.902304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T23:10:59.202948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-30T23:11:02.909730+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-30T23:31:27.780 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T23:31:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 -- 172.21.15.100:0/1045661960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 msgr2=0x7fc024103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/1045661960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc024103720 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc018009900 tx=0x7fc01802a410 comp rx=0 tx=0).stop 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 -- 172.21.15.100:0/1045661960 shutdown_connections 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/1045661960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 0x7fc02410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/1045661960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 0x7fc024104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/1045661960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc024103720 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 -- 172.21.15.100:0/1045661960 >> 172.21.15.100:0/1045661960 conn(0x7fc0240fdc10 msgr2=0x7fc0241000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 -- 172.21.15.100:0/1045661960 shutdown_connections 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.888+0000 7fc02b1d7640 1 -- 172.21.15.100:0/1045661960 wait complete. 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 Processor -- start 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 -- start start 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 0x7fc02419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 0x7fc0241a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc02410e520 con 0x7fc024102a20 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc02410e3a0 con 0x7fc024108960 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc02b1d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc02410e6a0 con 0x7fc024103c60 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc028f73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc028f73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53290/0 (socket says 172.21.15.100:53290) 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.889+0000 7fc028f73640 1 -- 172.21.15.100:0/2942097185 learned_addr learned my addr 172.21.15.100:0/2942097185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc023fff640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 0x7fc02419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc029774640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 0x7fc0241a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 -- 172.21.15.100:0/2942097185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 msgr2=0x7fc02419f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 0x7fc02419f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 -- 172.21.15.100:0/2942097185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 msgr2=0x7fc0241a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 0x7fc0241a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 -- 172.21.15.100:0/2942097185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0241a20d0 con 0x7fc024102a20 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc028f73640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc018006010 tx=0x7fc018031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01803f030 con 0x7fc024102a20 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc018003aa0 con 0x7fc024102a20 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018035070 con 0x7fc024102a20 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0241a2360 con 0x7fc024102a20 2024-04-30T23:31:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.890+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0241a2850 con 0x7fc024102a20 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.891+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc024107770 con 0x7fc024102a20 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.892+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc018042030 con 0x7fc024102a20 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.893+0000 7fc021ffb640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.893+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fc0180f0db0 con 0x7fc024102a20 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.893+0000 7fc023fff640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.893+0000 7fc023fff640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc010005fd0 tx=0x7fc010005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:27.898+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc0180bd430 con 0x7fc024102a20 2024-04-30T23:31:28.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.077+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc02406c2e0 con 0x7fc024102a20 2024-04-30T23:31:28.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.078+0000 7fc021ffb640 1 -- 172.21.15.100:0/2942097185 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7fc0180bcd30 con 0x7fc024102a20 2024-04-30T23:31:28.082 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 msgr2=0x7fc0140a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc010005fd0 tx=0x7fc010005850 comp rx=0 tx=0).stop 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 msgr2=0x7fc02406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc018006010 tx=0x7fc018031a50 comp rx=0 tx=0).stop 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 shutdown_connections 2024-04-30T23:31:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fc0140a3bb0 0x7fc0140a60c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc024108960 0x7fc0241a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc024103c60 0x7fc02419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 --2- 172.21.15.100:0/2942097185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc024102a20 0x7fc02406a940 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 >> 172.21.15.100:0/2942097185 conn(0x7fc0240fdc10 msgr2=0x7fc024104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 shutdown_connections 2024-04-30T23:31:28.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.080+0000 7fc02b1d7640 1 -- 172.21.15.100:0/2942097185 wait complete. 2024-04-30T23:31:28.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 -- 172.21.15.100:0/1250129420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c108960 msgr2=0x7faa3c10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 --2- 172.21.15.100:0/1250129420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c108960 0x7faa3c10ad80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faa34009ca0 tx=0x7faa3402a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 -- 172.21.15.100:0/1250129420 shutdown_connections 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 --2- 172.21.15.100:0/1250129420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c108960 0x7faa3c10ad80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 --2- 172.21.15.100:0/1250129420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c103c60 0x7faa3c104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 --2- 172.21.15.100:0/1250129420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 0x7faa3c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 -- 172.21.15.100:0/1250129420 >> 172.21.15.100:0/1250129420 conn(0x7faa3c0fdc10 msgr2=0x7faa3c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 -- 172.21.15.100:0/1250129420 shutdown_connections 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 -- 172.21.15.100:0/1250129420 wait complete. 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.202+0000 7faa40f38640 1 Processor -- start 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 -- start start 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 0x7faa3c199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c108960 0x7faa3c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10e570 con 0x7faa3c103c60 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10e3f0 con 0x7faa3c102a20 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa40f38640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10e6f0 con 0x7faa3c108960 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53308/0 (socket says 172.21.15.100:53308) 2024-04-30T23:31:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 -- 172.21.15.100:0/366700288 learned_addr learned my addr 172.21.15.100:0/366700288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa3ad9d640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c108960 0x7faa3c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa3a59c640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 0x7faa3c199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 -- 172.21.15.100:0/366700288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c108960 msgr2=0x7faa3c1a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c108960 0x7faa3c1a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 -- 172.21.15.100:0/366700288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 msgr2=0x7faa3c199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 0x7faa3c199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 -- 172.21.15.100:0/366700288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c1a0fa0 con 0x7faa3c103c60 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.203+0000 7faa39d9b640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7faa3000d770 tx=0x7faa3000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.204+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30017070 con 0x7faa3c103c60 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.204+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c1a1290 con 0x7faa3c103c60 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.204+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa300054d0 con 0x7faa3c103c60 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.204+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30004c30 con 0x7faa3c103c60 2024-04-30T23:31:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.204+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1a17e0 con 0x7faa3c103c60 2024-04-30T23:31:28.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.205+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c107770 con 0x7faa3c103c60 2024-04-30T23:31:28.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.206+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7faa30004dd0 con 0x7faa3c103c60 2024-04-30T23:31:28.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.206+0000 7faa2b7fe640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 0x7faa240a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.206+0000 7faa3a59c640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 0x7faa240a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.206+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7faa300d0710 con 0x7faa3c103c60 2024-04-30T23:31:28.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.207+0000 7faa3a59c640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 0x7faa240a60c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0058c0 tx=0x7faa2c00a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.210+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faa3009cd90 con 0x7faa3c103c60 2024-04-30T23:31:28.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.390+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faa3c06c2e0 con 0x7faa3c103c60 2024-04-30T23:31:28.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.390+0000 7faa2b7fe640 1 -- 172.21.15.100:0/366700288 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7faa3009c690 con 0x7faa3c103c60 2024-04-30T23:31:28.393 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:31:28.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 msgr2=0x7faa240a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 0x7faa240a60c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0058c0 tx=0x7faa2c00a4c0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 msgr2=0x7faa3c1999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7faa3000d770 tx=0x7faa3000dc30 comp rx=0 tx=0).stop 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 shutdown_connections 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7faa240a3bb0 0x7faa240a60c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa3c108960 0x7faa3c1a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa3c103c60 0x7faa3c1999a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 --2- 172.21.15.100:0/366700288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa3c102a20 0x7faa3c199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 >> 172.21.15.100:0/366700288 conn(0x7faa3c0fdc10 msgr2=0x7faa3c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 shutdown_connections 2024-04-30T23:31:28.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.392+0000 7faa40f38640 1 -- 172.21.15.100:0/366700288 wait complete. 2024-04-30T23:31:28.405 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:28 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/535962391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:28.405 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:28 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2942097185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:31:28.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- 172.21.15.100:0/167446636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550109a80 msgr2=0x7f255010bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 --2- 172.21.15.100:0/167446636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550109a80 0x7f255010bea0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2548009ca0 tx=0x7f254802a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- 172.21.15.100:0/167446636 shutdown_connections 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 --2- 172.21.15.100:0/167446636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550109a80 0x7f255010bea0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 --2- 172.21.15.100:0/167446636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550104d80 0x7f2550105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 --2- 172.21.15.100:0/167446636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 0x7f2550104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- 172.21.15.100:0/167446636 >> 172.21.15.100:0/167446636 conn(0x7f25500fed50 msgr2=0x7f25501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- 172.21.15.100:0/167446636 shutdown_connections 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- 172.21.15.100:0/167446636 wait complete. 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 Processor -- start 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.514+0000 7f25565a5640 1 -- start start 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 0x7f255019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550109a80 0x7f25501a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f255010f670 con 0x7f2550104d80 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f255010f4f0 con 0x7f2550109a80 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f25565a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f255010f7f0 con 0x7f2550103b40 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53314/0 (socket says 172.21.15.100:53314) 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 -- 172.21.15.100:0/3794131035 learned_addr learned my addr 172.21.15.100:0/3794131035 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254ffff640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 0x7f255019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f2554b42640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550109a80 0x7f25501a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 -- 172.21.15.100:0/3794131035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 msgr2=0x7f255019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 0x7f255019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 -- 172.21.15.100:0/3794131035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550109a80 msgr2=0x7f25501a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550109a80 0x7f25501a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 -- 172.21.15.100:0/3794131035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25501a1da0 con 0x7f2550104d80 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.515+0000 7f254f7fe640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f254000d950 tx=0x7f254000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.516+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540017030 con 0x7f2550104d80 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.516+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2540004020 con 0x7f2550104d80 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.516+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25501a2090 con 0x7f2550104d80 2024-04-30T23:31:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.516+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25400047a0 con 0x7f2550104d80 2024-04-30T23:31:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.516+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25501a25e0 con 0x7f2550104d80 2024-04-30T23:31:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.517+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550108890 con 0x7f2550104d80 2024-04-30T23:31:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.518+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2540009a30 con 0x7f2550104d80 2024-04-30T23:31:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.519+0000 7f254d7fa640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 0x7f253c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.519+0000 7f254ffff640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 0x7f253c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.519+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f25400d07f0 con 0x7f2550104d80 2024-04-30T23:31:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.519+0000 7f254ffff640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 0x7f253c0a60c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2550104740 tx=0x7f2538005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.522+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f254009ce70 con 0x7f2550104d80 2024-04-30T23:31:28.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:28 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/535962391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:28.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:28 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2942097185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:31:28.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:28 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/535962391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:28.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:28 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2942097185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-30T23:31:28.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.700+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25500637e0 con 0x7f2550104d80 2024-04-30T23:31:28.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.700+0000 7f254d7fa640 1 -- 172.21.15.100:0/3794131035 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f254009c770 con 0x7f2550104d80 2024-04-30T23:31:28.703 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-04-30T23:31:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 msgr2=0x7f253c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 0x7f253c0a60c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2550104740 tx=0x7f2538005f90 comp rx=0 tx=0).stop 2024-04-30T23:31:28.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 msgr2=0x7f255019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f254000d950 tx=0x7f254000de10 comp rx=0 tx=0).stop 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 shutdown_connections 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f253c0a3bb0 0x7f253c0a60c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2550109a80 0x7f25501a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2550104d80 0x7f255019a7f0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 --2- 172.21.15.100:0/3794131035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2550103b40 0x7f255019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 >> 172.21.15.100:0/3794131035 conn(0x7f25500fed50 msgr2=0x7f2550105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 shutdown_connections 2024-04-30T23:31:28.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.702+0000 7f25565a5640 1 -- 172.21.15.100:0/3794131035 wait complete. 2024-04-30T23:31:28.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-30T23:31:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 -- 172.21.15.100:0/1140975142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614108970 msgr2=0x7fb61410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 --2- 172.21.15.100:0/1140975142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614108970 0x7fb61410ad90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009ca0 tx=0x7fb60c02a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 -- 172.21.15.100:0/1140975142 shutdown_connections 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 --2- 172.21.15.100:0/1140975142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614108970 0x7fb61410ad90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 --2- 172.21.15.100:0/1140975142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 0x7fb614104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 --2- 172.21.15.100:0/1140975142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614102a30 0x7fb614103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 -- 172.21.15.100:0/1140975142 >> 172.21.15.100:0/1140975142 conn(0x7fb6140fdc00 msgr2=0x7fb6141000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 -- 172.21.15.100:0/1140975142 shutdown_connections 2024-04-30T23:31:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.824+0000 7fb618beb640 1 -- 172.21.15.100:0/1140975142 wait complete. 2024-04-30T23:31:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 Processor -- start 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 -- start start 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 0x7fb61419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 0x7fb6141a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e560 con 0x7fb614102a30 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e3e0 con 0x7fb614108970 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb618beb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e6e0 con 0x7fb614103c70 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.825+0000 7fb61259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53338/0 (socket says 172.21.15.100:53338) 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 -- 172.21.15.100:0/2644369632 learned_addr learned my addr 172.21.15.100:0/2644369632 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb60bfff640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 0x7fb61419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb612d9d640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 0x7fb6141a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 -- 172.21.15.100:0/2644369632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 msgr2=0x7fb61419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 0x7fb61419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 -- 172.21.15.100:0/2644369632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 msgr2=0x7fb6141a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 0x7fb6141a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 -- 172.21.15.100:0/2644369632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6141a1d20 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb612d9d640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 0x7fb6141a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb61259c640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb60400d740 tx=0x7fb60400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604017070 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb60400de50 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6141a1fb0 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604003c20 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.826+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6141a2470 con 0x7fb614102a30 2024-04-30T23:31:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.828+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb614107780 con 0x7fb614102a30 2024-04-30T23:31:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.828+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fb604004020 con 0x7fb614102a30 2024-04-30T23:31:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.829+0000 7fb60b7fe640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 0x7fb6000a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.829+0000 7fb60bfff640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 0x7fb6000a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.829+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fb6040d0190 con 0x7fb614102a30 2024-04-30T23:31:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.830+0000 7fb60bfff640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 0x7fb6000a60c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb614075240 tx=0x7fb5fc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:28.834+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb60409c810 con 0x7fb614102a30 2024-04-30T23:31:29.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.013+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb61402db90 con 0x7fb614102a30 2024-04-30T23:31:29.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.013+0000 7fb60b7fe640 1 -- 172.21.15.100:0/2644369632 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fb60409c110 con 0x7fb614102a30 2024-04-30T23:31:29.016 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-04-30T23:31:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 msgr2=0x7fb6000a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 0x7fb6000a60c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb614075240 tx=0x7fb5fc00b390 comp rx=0 tx=0).stop 2024-04-30T23:31:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 msgr2=0x7fb614075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb60400d740 tx=0x7fb60400dc00 comp rx=0 tx=0).stop 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 shutdown_connections 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fb6000a3bb0 0x7fb6000a60c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb614108970 0x7fb6141a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb614103c70 0x7fb61419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 --2- 172.21.15.100:0/2644369632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb614102a30 0x7fb614075830 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 >> 172.21.15.100:0/2644369632 conn(0x7fb6140fdc00 msgr2=0x7fb614104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 shutdown_connections 2024-04-30T23:31:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.015+0000 7fb618beb640 1 -- 172.21.15.100:0/2644369632 wait complete. 2024-04-30T23:31:29.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T23:31:29.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 -- 172.21.15.100:0/3711079467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6481044c0 msgr2=0x7ff64810ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/3711079467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6481044c0 0x7ff64810ac00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff640009ca0 tx=0x7ff64002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 -- 172.21.15.100:0/3711079467 shutdown_connections 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/3711079467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6481044c0 0x7ff64810ac00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/3711079467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648103980 0x7ff648103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/3711079467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff648102fa0 0x7ff6481033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 -- 172.21.15.100:0/3711079467 >> 172.21.15.100:0/3711079467 conn(0x7ff6480fd3c0 msgr2=0x7ff6480ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 -- 172.21.15.100:0/3711079467 shutdown_connections 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.135+0000 7ff64f1f8640 1 -- 172.21.15.100:0/3711079467 wait complete. 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 Processor -- start 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 -- start start 2024-04-30T23:31:29.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 0x7ff64819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6481044c0 0x7ff6481a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810e570 con 0x7ff648103980 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810e3f0 con 0x7ff648102fa0 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64f1f8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810e6f0 con 0x7ff6481044c0 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff647fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff647fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53354/0 (socket says 172.21.15.100:53354) 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff647fff640 1 -- 172.21.15.100:0/985924453 learned_addr learned my addr 172.21.15.100:0/985924453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.136+0000 7ff64cf94640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 0x7ff64819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 -- 172.21.15.100:0/985924453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6481044c0 msgr2=0x7ff6481a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6481044c0 0x7ff6481a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 -- 172.21.15.100:0/985924453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 msgr2=0x7ff64819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 0x7ff64819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 -- 172.21.15.100:0/985924453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6481a1d10 con 0x7ff648103980 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff64cf94640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 0x7ff64819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff647fff640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff63400d950 tx=0x7ff63400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634017070 con 0x7ff648103980 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff634009c30 con 0x7ff648103980 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6481a1fa0 con 0x7ff648103980 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63400f620 con 0x7ff648103980 2024-04-30T23:31:29.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.137+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6481a2490 con 0x7ff648103980 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.138+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6481a26f0 con 0x7ff648103980 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.139+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff634010460 con 0x7ff648103980 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.140+0000 7ff645ffb640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 0x7ff6380a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.140+0000 7ff64cf94640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 0x7ff6380a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.140+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff6340d0440 con 0x7ff648103980 2024-04-30T23:31:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.140+0000 7ff64cf94640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 0x7ff6380a60c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff64806b520 tx=0x7ff63c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.145+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff63409cac0 con 0x7ff648103980 2024-04-30T23:31:29.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:29 smithi100 ceph-mon[29745]: pgmap v909: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:29.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/366700288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/3794131035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:29 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2644369632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.336+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff6481a28c0 con 0x7ff648103980 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.337+0000 7ff645ffb640 1 -- 172.21.15.100:0/985924453 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v93) ==== 81+0+597 (secure 0 0 0) 0x7ff634009de0 con 0x7ff648103980 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/57412019 2024-05-01T23:03:55.489561+0000 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:31:29.340 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4139962241 2024-05-01T23:03:28.524392+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3231236282 2024-05-01T23:03:55.489561+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3389524928 2024-05-01T23:03:28.524392+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2011872270 2024-05-01T23:03:28.524392+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/820034739 2024-05-01T23:03:28.524392+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1429245117 2024-05-01T23:03:55.489561+0000 2024-04-30T23:31:29.341 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/642565197 2024-05-01T23:03:55.489561+0000 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:listed 10 entries 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 msgr2=0x7ff6380a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 0x7ff6380a60c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff64806b520 tx=0x7ff63c005e50 comp rx=0 tx=0).stop 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 msgr2=0x7ff64819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff63400d950 tx=0x7ff63400de10 comp rx=0 tx=0).stop 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 shutdown_connections 2024-04-30T23:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff6380a3bb0 0x7ff6380a60c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6481044c0 0x7ff6481a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff648103980 0x7ff64819a710 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 --2- 172.21.15.100:0/985924453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff648102fa0 0x7ff64819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 >> 172.21.15.100:0/985924453 conn(0x7ff6480fd3c0 msgr2=0x7ff6480fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 shutdown_connections 2024-04-30T23:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.339+0000 7ff64f1f8640 1 -- 172.21.15.100:0/985924453 wait complete. 2024-04-30T23:31:29.353 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T23:31:29.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T23:31:29.416 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:31:29.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.416 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T23:31:29.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.443 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-30T23:31:29.499 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T23:31:29.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T23:31:29.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:29 smithi104 ceph-mon[32987]: pgmap v909: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:29.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/366700288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/3794131035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:29 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2644369632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:29 smithi183 ceph-mon[33560]: pgmap v909: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-30T23:31:29.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/366700288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/3794131035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:29 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2644369632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-30T23:31:29.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-04-30T23:31:29.662 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-30T23:31:29.662 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-30T23:31:29.662 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T23:31:29.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056066,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497624k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=280 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/42a618425dd860284e4d5dfef4da8b1bcf615a48004962fcfe151dd0dce5e2d2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/42a618425dd860284e4d5dfef4da8b1bcf615a48004962fcfe151dd0dce5e2d2/diff,workdir=/var/lib/containers/storage/overlay/42a618425dd860284e4d5dfef4da8b1bcf615a48004962fcfe151dd0dce5e2d2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/59fd862ff73c44084383fb61cb108e544a1c0d69d0a976727558396b90ae2ff8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/59fd862ff73c44084383fb61cb108e544a1c0d69d0a976727558396b90ae2ff8/diff,workdir=/var/lib/containers/storage/overlay/59fd862ff73c44084383fb61cb108e544a1c0d69d0a976727558396b90ae2ff8/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/39e765aa11b39b80766b731931e4561b63a0759dac0ed0c295ef81194dc3f9ef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/39e765aa11b39b80766b731931e4561b63a0759dac0ed0c295ef81194dc3f9ef/diff,workdir=/var/lib/containers/storage/overlay/39e765aa11b39b80766b731931e4561b63a0759dac0ed0c295ef81194dc3f9ef/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/93dc1416bb7eb18dc502bcbdab8fe6d553a17907837a09cef63847ef0312aa16/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/93dc1416bb7eb18dc502bcbdab8fe6d553a17907837a09cef63847ef0312aa16/diff,workdir=/var/lib/containers/storage/overlay/93dc1416bb7eb18dc502bcbdab8fe6d553a17907837a09cef63847ef0312aa16/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/23d462ef64a83fefba695b701cd5397d6e24a45a421493c0ad284c284ce4cd50/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/23d462ef64a83fefba695b701cd5397d6e24a45a421493c0ad284c284ce4cd50/diff,workdir=/var/lib/containers/storage/overlay/23d462ef64a83fefba695b701cd5397d6e24a45a421493c0ad284c284ce4cd50/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e2e06aac8e21f090422d3bceb6ef1672099c081ebdcb26a5afa44adab4fa086b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/e2e06aac8e21f090422d3bceb6ef1672099c081ebdcb26a5afa44adab4fa086b/diff,workdir=/var/lib/containers/storage/overlay/e2e06aac8e21f090422d3bceb6ef1672099c081ebdcb26a5afa44adab4fa086b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f2394a26343d6d9b3e36dfd1ee31c3fee4176ab0cd66d9d702577580f38c0e39/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/f2394a26343d6d9b3e36dfd1ee31c3fee4176ab0cd66d9d702577580f38c0e39/diff,workdir=/var/lib/containers/storage/overlay/f2394a26343d6d9b3e36dfd1ee31c3fee4176ab0cd66d9d702577580f38c0e39/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6116a2b2d161c7b4ba66cd318f918da6bf472b33fb1e5ce6558680c3705c6fb3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/6116a2b2d161c7b4ba66cd318f918da6bf472b33fb1e5ce6558680c3705c6fb3/diff,workdir=/var/lib/containers/storage/overlay/6116a2b2d161c7b4ba66cd318f918da6bf472b33fb1e5ce6558680c3705c6fb3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e7362e58a5286d9a5424b0223ee1908f95d79594f6856afca99730bd8ce252f4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/e7362e58a5286d9a5424b0223ee1908f95d79594f6856afca99730bd8ce252f4/diff,workdir=/var/lib/containers/storage/overlay/e7362e58a5286d9a5424b0223ee1908f95d79594f6856afca99730bd8ce252f4/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c6c4d2e808bb416f23aeab43729866c7bbfd390053106a09995aebef07ba7324/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/N4DEVM6EHIPTTCF3PYS3KFDIFU:/var/lib/containers/storage/overlay/l/CXDRT6WV5DXRXGTEIJB7DWNOUS,upperdir=/var/lib/containers/storage/overlay/c6c4d2e808bb416f23aeab43729866c7bbfd390053106a09995aebef07ba7324/diff,workdir=/var/lib/containers/storage/overlay/c6c4d2e808bb416f23aeab43729866c7bbfd390053106a09995aebef07ba7324/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497624k,nr_inodes=819200,mode=755,inode64 0 0 2024-04-30T23:31:29.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.679 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-30T23:31:29.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T23:31:29.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-04-30T23:31:29.800 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-04-30T23:31:29.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:31:29.801 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-30T23:31:29.812 INFO:tasks.cephadm:Teardown begin 2024-04-30T23:31:29.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T23:31:29.812 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 -- 172.21.15.100:0/843387428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8108940 msgr2=0x7f7ad810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 --2- 172.21.15.100:0/843387428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8108940 0x7f7ad810ad60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009ca0 tx=0x7f7ad002a8c0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 -- 172.21.15.100:0/843387428 shutdown_connections 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 --2- 172.21.15.100:0/843387428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8108940 0x7f7ad810ad60 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 --2- 172.21.15.100:0/843387428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8103c40 0x7f7ad8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 --2- 172.21.15.100:0/843387428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad8102a00 0x7f7ad8103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 -- 172.21.15.100:0/843387428 >> 172.21.15.100:0/843387428 conn(0x7f7ad80fdc10 msgr2=0x7f7ad81000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 -- 172.21.15.100:0/843387428 shutdown_connections 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 -- 172.21.15.100:0/843387428 wait complete. 2024-04-30T23:31:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.947+0000 7f7ae017e640 1 Processor -- start 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 -- start start 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad8103c40 0x7f7ad819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 0x7f7ad81a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad810f630 con 0x7f7ad8102a00 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad810f4b0 con 0x7f7ad8103c40 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad810f7b0 con 0x7f7ad8108940 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53360/0 (socket says 172.21.15.100:53360) 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 -- 172.21.15.100:0/2767697629 learned_addr learned my addr 172.21.15.100:0/2767697629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ade71b640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 0x7f7ad81a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 -- 172.21.15.100:0/2767697629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 msgr2=0x7f7ad81a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 0x7f7ad81a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 -- 172.21.15.100:0/2767697629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad8103c40 msgr2=0x7f7ad819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad8103c40 0x7f7ad819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 -- 172.21.15.100:0/2767697629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad81a1c70 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ade71b640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 0x7f7ad81a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7addf1a640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00c970 tx=0x7f7acc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc004220 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7acc0043c0 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad81a1f60 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.948+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00f450 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.949+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad81a2420 con 0x7f7ad8102a00 2024-04-30T23:31:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.949+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad8107750 con 0x7f7ad8102a00 2024-04-30T23:31:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.951+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7acc0079b0 con 0x7f7ad8102a00 2024-04-30T23:31:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.951+0000 7f7acaffd640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 0x7f7ac40a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.951+0000 7f7add719640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 0x7f7ac40a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.951+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f7acc0d0930 con 0x7f7ad8102a00 2024-04-30T23:31:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.952+0000 7f7add719640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 0x7f7ac40a60c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7ad819b280 tx=0x7f7ad4005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:29.956+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7acc014030 con 0x7f7ad8102a00 2024-04-30T23:31:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.175+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ad802db90 con 0x7f7ad8102a00 2024-04-30T23:31:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.175+0000 7f7acaffd640 1 -- 172.21.15.100:0/2767697629 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11956 (secure 0 0 0) 0x7f7acc09cfb0 con 0x7f7ad8102a00 2024-04-30T23:31:30.179 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:31:30.179 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:19:46.101971+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:31:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 51 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 msgr2=0x7f7ac40a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 0x7f7ac40a60c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7ad819b280 tx=0x7f7ad4005c70 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 msgr2=0x7f7ad819a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00c970 tx=0x7f7acc00ce30 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 shutdown_connections 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7ac40a3bb0 0x7f7ac40a60c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad8108940 0x7f7ad81a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad8103c40 0x7f7ad819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 --2- 172.21.15.100:0/2767697629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad8102a00 0x7f7ad819a1e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.177+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 >> 172.21.15.100:0/2767697629 conn(0x7f7ad80fdc10 msgr2=0x7f7ad8104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.178+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 shutdown_connections 2024-04-30T23:31:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.178+0000 7f7ae017e640 1 -- 172.21.15.100:0/2767697629 wait complete. 2024-04-30T23:31:30.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T23:31:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 -- 172.21.15.100:0/3797007145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764104410 msgr2=0x7ff764102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 --2- 172.21.15.100:0/3797007145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764104410 0x7ff764102e10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff758009900 tx=0x7ff75802a410 comp rx=0 tx=0).stop 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 -- 172.21.15.100:0/3797007145 shutdown_connections 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 --2- 172.21.15.100:0/3797007145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff764108a60 0x7ff76410ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 --2- 172.21.15.100:0/3797007145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764104410 0x7ff764102e10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 --2- 172.21.15.100:0/3797007145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 -- 172.21.15.100:0/3797007145 >> 172.21.15.100:0/3797007145 conn(0x7ff7640fd3b0 msgr2=0x7ff7640ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 -- 172.21.15.100:0/3797007145 shutdown_connections 2024-04-30T23:31:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.297+0000 7ff768bb5640 1 -- 172.21.15.100:0/3797007145 wait complete. 2024-04-30T23:31:30.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 Processor -- start 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 -- start start 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff76419e210 0x7ff7641a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410e5c0 con 0x7ff764108a60 2024-04-30T23:31:30.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410e440 con 0x7ff764103f30 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff768bb5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410e740 con 0x7ff76419e210 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.298+0000 7ff761d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53382/0 (socket says 172.21.15.100:53382) 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 -- 172.21.15.100:0/2377918064 learned_addr learned my addr 172.21.15.100:0/2377918064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff76259c640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff762d9d640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff76419e210 0x7ff7641a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 -- 172.21.15.100:0/2377918064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff76419e210 msgr2=0x7ff7641a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff76419e210 0x7ff7641a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 -- 172.21.15.100:0/2377918064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 msgr2=0x7ff764198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 -- 172.21.15.100:0/2377918064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7641a0c20 con 0x7ff764108a60 2024-04-30T23:31:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff76259c640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff761d9b640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff758006010 tx=0x7ff7580043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75803f030 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff758003cb0 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7641a0eb0 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758035070 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.299+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7641a1340 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.300+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff764107160 con 0x7ff764108a60 2024-04-30T23:31:30.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.301+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff758042030 con 0x7ff764108a60 2024-04-30T23:31:30.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.302+0000 7ff7537fe640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 0x7ff74c0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.302+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7ff7580f0f90 con 0x7ff764108a60 2024-04-30T23:31:30.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.302+0000 7ff76259c640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 0x7ff74c0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.302+0000 7ff76259c640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 0x7ff74c0a60c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff754005fd0 tx=0x7ff754005f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.307+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7580bd610 con 0x7ff764108a60 2024-04-30T23:31:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.524+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff76402db90 con 0x7ff764108a60 2024-04-30T23:31:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.525+0000 7ff7537fe640 1 -- 172.21.15.100:0/2377918064 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11956 (secure 0 0 0) 0x7ff7580bcf10 con 0x7ff764108a60 2024-04-30T23:31:30.528 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:31:30.528 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2182837858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2182837858},{"type":"v1","addr":"172.21.15.100:6835","nonce":2182837858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1947176646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1947176646},{"type":"v1","addr":"172.21.15.100:6837","nonce":1947176646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-30T23:11:00.289657+0000","modified":"2024-04-30T23:19:46.101971+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24545,"mds_1":24511,"mds_2":24503,"mds_3":24496,"mds_4":14664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6839/1668286182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1668286182},{"type":"v1","addr":"172.21.15.100:6839","nonce":1668286182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6841/2201593414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":2201593414},{"type":"v1","addr":"172.21.15.100:6841","nonce":2201593414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6833/2331654352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2331654352},{"type":"v1","addr":"172.21.15.183:6833","nonce":2331654352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6833/176831078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":176831078},{"type":"v1","addr":"172.21.15.104:6833","nonce":176831078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.104:6835/4094200769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4094200769},{"type":"v1","addr":"172.21.15.104:6835","nonce":4094200769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2697644609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2697644609},{"type":"v1","addr":"172.21.15.183:6835","nonce":2697644609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.183:6837/1464515486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1464515486},{"type":"v1","addr":"172.21.15.183:6837","nonce":1464515486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.104:6837/4190150609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":4190150609},{"type":"v1","addr":"172.21.15.104:6837","nonce":4190150609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.183:6839/587252257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":587252257},{"type":"v1","addr":"172.21.15.183:6839","nonce":587252257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24545":{"gid":24545,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6839/1200691747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6838","nonce":1200691747},{"type":"v1","addr":"172.21.15.104:6839","nonce":1200691747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24545,"qdb_cluster":[14664,24511,24545,24496,24503]},"id":1}]} 2024-04-30T23:31:30.529 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 51 2024-04-30T23:31:30.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 msgr2=0x7ff74c0a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 0x7ff74c0a60c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff754005fd0 tx=0x7ff754005f40 comp rx=0 tx=0).stop 2024-04-30T23:31:30.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 msgr2=0x7ff7641992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff758006010 tx=0x7ff7580043b0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 shutdown_connections 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7ff74c0a3bb0 0x7ff74c0a60c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff76419e210 0x7ff7641a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff764108a60 0x7ff7641992d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 --2- 172.21.15.100:0/2377918064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff764103f30 0x7ff764198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 >> 172.21.15.100:0/2377918064 conn(0x7ff7640fd3b0 msgr2=0x7ff7640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 shutdown_connections 2024-04-30T23:31:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.527+0000 7ff768bb5640 1 -- 172.21.15.100:0/2377918064 wait complete. 2024-04-30T23:31:30.540 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/985924453' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:31:30.540 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:30 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2767697629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:30.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T23:31:30.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/985924453' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:31:30.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:30 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2767697629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:30.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/985924453' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-30T23:31:30.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:30 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2767697629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 -- 172.21.15.100:0/312618362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c101790 msgr2=0x7f1e4c101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 --2- 172.21.15.100:0/312618362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c101790 0x7f1e4c101c00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009900 tx=0x7f1e4002a410 comp rx=0 tx=0).stop 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 -- 172.21.15.100:0/312618362 shutdown_connections 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 --2- 172.21.15.100:0/312618362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 0x7f1e4c10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 --2- 172.21.15.100:0/312618362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c101790 0x7f1e4c101c00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 --2- 172.21.15.100:0/312618362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 -- 172.21.15.100:0/312618362 >> 172.21.15.100:0/312618362 conn(0x7f1e4c0fd3b0 msgr2=0x7f1e4c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 -- 172.21.15.100:0/312618362 shutdown_connections 2024-04-30T23:31:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.645+0000 7f1e51194640 1 -- 172.21.15.100:0/312618362 wait complete. 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 Processor -- start 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 -- start start 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c101790 0x7f1e4c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 0x7f1e4c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10f6c0 con 0x7f1e4c1050e0 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10f540 con 0x7f1e4c102290 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e51194640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10f840 con 0x7f1e4c101790 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e4b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e4b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53408/0 (socket says 172.21.15.100:53408) 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e4b59e640 1 -- 172.21.15.100:0/735825902 learned_addr learned my addr 172.21.15.100:0/735825902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e4a59c640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 0x7f1e4c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.646+0000 7f1e4ad9d640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c101790 0x7f1e4c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 -- 172.21.15.100:0/735825902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c101790 msgr2=0x7f1e4c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c101790 0x7f1e4c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 -- 172.21.15.100:0/735825902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 msgr2=0x7f1e4c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 0x7f1e4c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 -- 172.21.15.100:0/735825902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c1a1d20 con 0x7f1e4c1050e0 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e4b59e640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cce0 tx=0x7f1e4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400f450 con 0x7f1e4c1050e0 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4400faa0 con 0x7f1e4c1050e0 2024-04-30T23:31:30.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1a1fb0 con 0x7f1e4c1050e0 2024-04-30T23:31:30.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44018a80 con 0x7f1e4c1050e0 2024-04-30T23:31:30.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.647+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1a24a0 con 0x7f1e4c1050e0 2024-04-30T23:31:30.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.648+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c108a70 con 0x7f1e4c1050e0 2024-04-30T23:31:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.650+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1e4400fc50 con 0x7f1e4c1050e0 2024-04-30T23:31:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.650+0000 7f1e33fff640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 0x7f1e340a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.651+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7f1e440d0ff0 con 0x7f1e4c1050e0 2024-04-30T23:31:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.651+0000 7f1e4ad9d640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 0x7f1e340a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.651+0000 7f1e4ad9d640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 0x7f1e340a60c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c06b360 tx=0x7f1e3c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.654+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1e44014030 con 0x7f1e4c1050e0 2024-04-30T23:31:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.833+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e4c02dd60 con 0x7f1e4c1050e0 2024-04-30T23:31:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.835+0000 7f1e33fff640 1 -- 172.21.15.100:0/735825902 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24635 (secure 0 0 0) 0x7f1e4409d670 con 0x7f1e4c1050e0 2024-04-30T23:31:30.838 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-30T23:31:30.838 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":93,"fsid":"a34a4a58-0745-11ef-bc93-c7b262605968","created":"2024-04-30T23:03:01.857638+0000","modified":"2024-04-30T23:12:57.673252+0000","last_up_change":"2024-04-30T23:10:09.640980+0000","last_in_change":"2024-04-30T23:09:49.806727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T23:06:21.574769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T23:10:57.902304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T23:10:59.202948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-30T23:11:02.909730+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ef7c5b0b-6410-4a8c-bfea-6469f5de392e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6803","nonce":815126249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6805","nonce":815126249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6809","nonce":815126249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":815126249},{"type":"v1","addr":"172.21.15.100:6807","nonce":815126249}]},"public_addr":"172.21.15.100:6803/815126249","cluster_addr":"172.21.15.100:6805/815126249","heartbeat_back_addr":"172.21.15.100:6809/815126249","heartbeat_front_addr":"172.21.15.100:6807/815126249","state":["exists","up"]},{"osd":1,"uuid":"37aaab18-a336-45c6-a43f-26d4dd5183b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6801","nonce":742044421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6803","nonce":742044421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6807","nonce":742044421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":742044421},{"type":"v1","addr":"172.21.15.104:6805","nonce":742044421}]},"public_addr":"172.21.15.104:6801/742044421","cluster_addr":"172.21.15.104:6803/742044421","heartbeat_back_addr":"172.21.15.104:6807/742044421","heartbeat_front_addr":"172.21.15.104:6805/742044421","state":["exists","up"]},{"osd":2,"uuid":"fe687b16-00c0-432c-9361-0371a0152831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6801","nonce":3395265285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6803","nonce":3395265285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6807","nonce":3395265285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3395265285},{"type":"v1","addr":"172.21.15.183:6805","nonce":3395265285}]},"public_addr":"172.21.15.183:6801/3395265285","cluster_addr":"172.21.15.183:6803/3395265285","heartbeat_back_addr":"172.21.15.183:6807/3395265285","heartbeat_front_addr":"172.21.15.183:6805/3395265285","state":["exists","up"]},{"osd":3,"uuid":"7d12a3f3-d9a4-43a4-879a-4aa2964857ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6811","nonce":2399310688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6813","nonce":2399310688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6817","nonce":2399310688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2399310688},{"type":"v1","addr":"172.21.15.100:6815","nonce":2399310688}]},"public_addr":"172.21.15.100:6811/2399310688","cluster_addr":"172.21.15.100:6813/2399310688","heartbeat_back_addr":"172.21.15.100:6817/2399310688","heartbeat_front_addr":"172.21.15.100:6815/2399310688","state":["exists","up"]},{"osd":4,"uuid":"2aed289f-1846-4fd1-8f0c-b1f293bd50e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6809","nonce":369610864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6811","nonce":369610864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6815","nonce":369610864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":369610864},{"type":"v1","addr":"172.21.15.104:6813","nonce":369610864}]},"public_addr":"172.21.15.104:6809/369610864","cluster_addr":"172.21.15.104:6811/369610864","heartbeat_back_addr":"172.21.15.104:6815/369610864","heartbeat_front_addr":"172.21.15.104:6813/369610864","state":["exists","up"]},{"osd":5,"uuid":"ff24999e-56a0-4b18-92e5-f7165c4f5752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6809","nonce":4049435736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6811","nonce":4049435736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6815","nonce":4049435736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":4049435736},{"type":"v1","addr":"172.21.15.183:6813","nonce":4049435736}]},"public_addr":"172.21.15.183:6809/4049435736","cluster_addr":"172.21.15.183:6811/4049435736","heartbeat_back_addr":"172.21.15.183:6815/4049435736","heartbeat_front_addr":"172.21.15.183:6813/4049435736","state":["exists","up"]},{"osd":6,"uuid":"bc4bc468-d384-49f6-a3c3-85963a7d828d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6819","nonce":652878635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6821","nonce":652878635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6825","nonce":652878635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":652878635},{"type":"v1","addr":"172.21.15.100:6823","nonce":652878635}]},"public_addr":"172.21.15.100:6819/652878635","cluster_addr":"172.21.15.100:6821/652878635","heartbeat_back_addr":"172.21.15.100:6825/652878635","heartbeat_front_addr":"172.21.15.100:6823/652878635","state":["exists","up"]},{"osd":7,"uuid":"21ba1dd0-804d-435d-b437-8d0975de2d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6817","nonce":1321206568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6819","nonce":1321206568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6823","nonce":1321206568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1321206568},{"type":"v1","addr":"172.21.15.104:6821","nonce":1321206568}]},"public_addr":"172.21.15.104:6817/1321206568","cluster_addr":"172.21.15.104:6819/1321206568","heartbeat_back_addr":"172.21.15.104:6823/1321206568","heartbeat_front_addr":"172.21.15.104:6821/1321206568","state":["exists","up"]},{"osd":8,"uuid":"3275bb80-7285-4045-909d-0dc4220da519","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6817","nonce":2582979705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6819","nonce":2582979705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6823","nonce":2582979705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2582979705},{"type":"v1","addr":"172.21.15.183:6821","nonce":2582979705}]},"public_addr":"172.21.15.183:6817/2582979705","cluster_addr":"172.21.15.183:6819/2582979705","heartbeat_back_addr":"172.21.15.183:6823/2582979705","heartbeat_front_addr":"172.21.15.183:6821/2582979705","state":["exists","up"]},{"osd":9,"uuid":"f0f73884-91f7-49e8-8a4d-bf23f66567a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6827","nonce":3455336884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6829","nonce":3455336884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6833","nonce":3455336884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3455336884},{"type":"v1","addr":"172.21.15.100:6831","nonce":3455336884}]},"public_addr":"172.21.15.100:6827/3455336884","cluster_addr":"172.21.15.100:6829/3455336884","heartbeat_back_addr":"172.21.15.100:6833/3455336884","heartbeat_front_addr":"172.21.15.100:6831/3455336884","state":["exists","up"]},{"osd":10,"uuid":"7a9e09c9-e0f3-4359-ba40-3fce08a144d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6825","nonce":452844074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6827","nonce":452844074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6831","nonce":452844074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":452844074},{"type":"v1","addr":"172.21.15.104:6829","nonce":452844074}]},"public_addr":"172.21.15.104:6825/452844074","cluster_addr":"172.21.15.104:6827/452844074","heartbeat_back_addr":"172.21.15.104:6831/452844074","heartbeat_front_addr":"172.21.15.104:6829/452844074","state":["exists","up"]},{"osd":11,"uuid":"1c5e3fbe-3128-4f57-93fe-c9fb639c9407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6825","nonce":964206536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6827","nonce":964206536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6831","nonce":964206536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":964206536},{"type":"v1","addr":"172.21.15.183:6829","nonce":964206536}]},"public_addr":"172.21.15.183:6825/964206536","cluster_addr":"172.21.15.183:6827/964206536","heartbeat_back_addr":"172.21.15.183:6831/964206536","heartbeat_front_addr":"172.21.15.183:6829/964206536","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:29.431549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:05:53.382583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:17.318364+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:06:41.980997+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:06.296972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:31.645421+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:07:58.044882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:23.708965+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:08:49.410899+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:15.965062+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:09:41.981093+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T23:10:08.179477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.3","mappings":[{"from":5,"to":10}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/57412019":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6801/642565197":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/4139962241":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/3231236282":"2024-05-01T23:03:55.489561+0000","172.21.15.100:0/3389524928":"2024-05-01T23:03:28.524392+0000","172.21.15.100:6801/2011872270":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/820034739":"2024-05-01T23:03:28.524392+0000","172.21.15.100:0/1429245117":"2024-05-01T23:03:55.489561+0000","172.21.15.100:6800/642565197":"2024-05-01T23:03:55.489561+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 msgr2=0x7f1e340a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 0x7f1e340a60c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c06b360 tx=0x7f1e3c009110 comp rx=0 tx=0).stop 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 msgr2=0x7f1e4c1a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cce0 tx=0x7f1e4400a620 comp rx=0 tx=0).stop 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 shutdown_connections 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f1e340a3bb0 0x7f1e340a60c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c1050e0 0x7f1e4c1a1760 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c102290 0x7f1e4c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 --2- 172.21.15.100:0/735825902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4c101790 0x7f1e4c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 >> 172.21.15.100:0/735825902 conn(0x7f1e4c0fd3b0 msgr2=0x7f1e4c105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 shutdown_connections 2024-04-30T23:31:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.837+0000 7f1e51194640 1 -- 172.21.15.100:0/735825902 wait complete. 2024-04-30T23:31:30.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2672029835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd224103410 msgr2=0x7fd224103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2672029835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd224103410 0x7fd224103820 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd220009900 tx=0x7fd22002a410 comp rx=0 tx=0).stop 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2672029835 shutdown_connections 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2672029835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 0x7fd22410a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2672029835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd224103410 0x7fd224103820 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2672029835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2241021d0 0x7fd224102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2672029835 >> 172.21.15.100:0/2672029835 conn(0x7fd2240fd3c0 msgr2=0x7fd2240ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2672029835 shutdown_connections 2024-04-30T23:31:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2672029835 wait complete. 2024-04-30T23:31:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.957+0000 7fd22b2e7640 1 Processor -- start 2024-04-30T23:31:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- start start 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 0x7fd22419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 0x7fd2241a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410d460 con 0x7fd2241021d0 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410d2e0 con 0x7fd224108110 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410d5e0 con 0x7fd224103410 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53420/0 (socket says 172.21.15.100:53420) 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 -- 172.21.15.100:0/2411839984 learned_addr learned my addr 172.21.15.100:0/2411839984 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd228882640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 0x7fd22419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 -- 172.21.15.100:0/2411839984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 msgr2=0x7fd22419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229884640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 0x7fd2241a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 0x7fd22419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 -- 172.21.15.100:0/2411839984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 msgr2=0x7fd2241a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 0x7fd2241a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 -- 172.21.15.100:0/2411839984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a1d90 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd228882640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 0x7fd22419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd229083640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd214005d00 tx=0x7fd21400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017070 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd214009c30 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a2080 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400f620 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.958+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2241a2580 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.960+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd224106f20 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.961+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd21401a070 con 0x7fd2241021d0 2024-04-30T23:31:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.961+0000 7fd21a7fc640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 0x7fd2100a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:30.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.961+0000 7fd228882640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 0x7fd2100a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:30.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.961+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9100+0+0 (secure 0 0 0) 0x7fd2140d0260 con 0x7fd2241021d0 2024-04-30T23:31:30.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.962+0000 7fd228882640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 0x7fd2100a60c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd220006010 tx=0x7fd220000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:30.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:30.967+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd214009de0 con 0x7fd2241021d0 2024-04-30T23:31:31.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.183+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd2240637e0 con 0x7fd2241021d0 2024-04-30T23:31:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.186+0000 7fd21a7fc640 1 -- 172.21.15.100:0/2411839984 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) ==== 161+0+0 (secure 0 0 0) 0x7fd21409c8e0 con 0x7fd2241021d0 2024-04-30T23:31:31.189 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T23:31:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 msgr2=0x7fd2100a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 0x7fd2100a60c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd220006010 tx=0x7fd220000bc0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 msgr2=0x7fd22419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd214005d00 tx=0x7fd21400dde0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 shutdown_connections 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7fd2100a3bb0 0x7fd2100a60c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224108110 0x7fd2241a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd224103410 0x7fd22419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 --2- 172.21.15.100:0/2411839984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2241021d0 0x7fd22419a250 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.190+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 >> 172.21.15.100:0/2411839984 conn(0x7fd2240fd3c0 msgr2=0x7fd2241040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.191+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 shutdown_connections 2024-04-30T23:31:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.191+0000 7fd22b2e7640 1 -- 172.21.15.100:0/2411839984 wait complete. 2024-04-30T23:31:31.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T23:31:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- 172.21.15.100:0/3697295802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c103b40 msgr2=0x7f3d7c104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 --2- 172.21.15.100:0/3697295802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c103b40 0x7f3d7c104840 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009900 tx=0x7f3d7802a410 comp rx=0 tx=0).stop 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- 172.21.15.100:0/3697295802 shutdown_connections 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 --2- 172.21.15.100:0/3697295802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c109a80 0x7f3d7c10bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 --2- 172.21.15.100:0/3697295802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c104d80 0x7f3d7c105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 --2- 172.21.15.100:0/3697295802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c103b40 0x7f3d7c104840 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- 172.21.15.100:0/3697295802 >> 172.21.15.100:0/3697295802 conn(0x7f3d7c0fed30 msgr2=0x7f3d7c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- 172.21.15.100:0/3697295802 shutdown_connections 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- 172.21.15.100:0/3697295802 wait complete. 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 Processor -- start 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 -- start start 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.327+0000 7f3d8353f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 0x7f3d7c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 0x7f3d7c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c10f640 con 0x7f3d7c109a80 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c10f4c0 con 0x7f3d7c104d80 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c10f7c0 con 0x7f3d7c103b40 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53470/0 (socket says 172.21.15.100:53470) 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 -- 172.21.15.100:0/1354780057 learned_addr learned my addr 172.21.15.100:0/1354780057 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d80ada640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 0x7f3d7c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d812db640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 0x7f3d7c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 -- 172.21.15.100:0/1354780057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 msgr2=0x7f3d7c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 0x7f3d7c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 -- 172.21.15.100:0/1354780057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 msgr2=0x7f3d7c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 0x7f3d7c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 -- 172.21.15.100:0/1354780057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c1a1de0 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d812db640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 0x7f3d7c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d80ada640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 0x7f3d7c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d81adc640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400eaa0 tx=0x7f3d7400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400cdb0 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d74005020 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d740116d0 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c1a20d0 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.328+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c1a25d0 con 0x7f3d7c109a80 2024-04-30T23:31:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.329+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c108890 con 0x7f3d7c109a80 2024-04-30T23:31:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.331+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3d740051d0 con 0x7f3d7c109a80 2024-04-30T23:31:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.331+0000 7f3d727fc640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 0x7f3d680a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.331+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9530+0+0 (secure 0 0 0) 0x7f3d740d1010 con 0x7f3d7c109a80 2024-04-30T23:31:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.331+0000 7f3d812db640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 0x7f3d680a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.332+0000 7f3d812db640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 0x7f3d680a6140 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005f70 tx=0x7f3d78000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.335+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d74016030 con 0x7f3d7c109a80 2024-04-30T23:31:31.548 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.548 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.548 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mds[62637]: -- 172.21.15.104:0/1705890781 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2b865da40 con 0x55e2b86a5600 2024-04-30T23:31:31.548 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: starting mds.e at 2024-04-30T23:31:31.548 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mds[63253]: -- 172.21.15.104:0/3413822840 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558649af9a40 con 0x558649b41180 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: starting mds.b at 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.549 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mds[62310]: -- 172.21.15.104:0/1989959424 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9fd841a40 con 0x55a9fd889600 2024-04-30T23:31:31.550 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: starting mds.k at 2024-04-30T23:31:31.550 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.550 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.550 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mds[62946]: -- 172.21.15.104:0/4194438703 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c262539a40 con 0x55c262581600 2024-04-30T23:31:31.550 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: starting mds.h at 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: pgmap v910: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 13 op/s 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2377918064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/735825902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: osdmap e94: 12 total, 12 up, 12 in 2024-04-30T23:31:31.551 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:31 smithi104 ceph-mon[32987]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: pgmap v910: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 13 op/s 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2377918064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/735825902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-30T23:31:31.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: osdmap e94: 12 total, 12 up, 12 in 2024-04-30T23:31:31.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mon[33560]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-30T23:31:31.554 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.554 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.554 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mds[64575]: -- 172.21.15.183:0/1871165369 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570420dda40 con 0x557042125180 2024-04-30T23:31:31.554 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: starting mds.i at 2024-04-30T23:31:31.555 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.555 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.555 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mds[63947]: -- 172.21.15.183:0/2283470433 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf0c441a40 con 0x55cf0c489600 2024-04-30T23:31:31.555 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: starting mds.f at 2024-04-30T23:31:31.555 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mds[64268]: -- 172.21.15.183:0/3714610309 <== mon.2 v2:172.21.15.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557daea1ba40 con 0x557daea63a80 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: starting mds.c at 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l[63634]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l[63634]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-mds[63638]: -- 172.21.15.183:0/95442564 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f782367a40 con 0x55f7823af180 2024-04-30T23:31:31.556 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:31:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l[63634]: starting mds.l at 2024-04-30T23:31:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:31.552+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3d7c0637e0 con 0x7f3d7c109a80 2024-04-30T23:31:31.574 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.575 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.575 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mds[69245]: -- 172.21.15.100:0/3883869153 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56427ca55a40 con 0x56427ca9d600 2024-04-30T23:31:31.575 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: starting mds.a at 2024-04-30T23:31:31.575 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: ignoring --setuser ceph since I am not root 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: ignoring --setgroup ceph since I am not root 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mds[68889]: -- 172.21.15.100:0/3592514849 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fece40fa40 con 0x55fece457a80 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: starting mds.g at 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a[29741]: 2024-04-30T23:31:31.184+0000 7f6e78813700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: pgmap v910: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 13 op/s 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2377918064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/735825902' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2411839984' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: osdmap e94: 12 total, 12 up, 12 in 2024-04-30T23:31:31.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:31 smithi100 ceph-mon[29745]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-30T23:31:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.258+0000 7f3d727fc640 1 -- 172.21.15.100:0/1354780057 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7f3d7409d480 con 0x7f3d7c109a80 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 msgr2=0x7f3d680a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 0x7f3d680a6140 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005f70 tx=0x7f3d78000bc0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 msgr2=0x7f3d7c1a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400eaa0 tx=0x7f3d7400ef60 comp rx=0 tx=0).stop 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 shutdown_connections 2024-04-30T23:31:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f3d680a3c30 0x7f3d680a6140 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d7c109a80 0x7f3d7c1a1770 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7c104d80 0x7f3d7c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 --2- 172.21.15.100:0/1354780057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7c103b40 0x7f3d7c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 >> 172.21.15.100:0/1354780057 conn(0x7f3d7c0fed30 msgr2=0x7f3d7c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 shutdown_connections 2024-04-30T23:31:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.261+0000 7f3d8353f640 1 -- 172.21.15.100:0/1354780057 wait complete. 2024-04-30T23:31:32.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T23:31:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 -- 172.21.15.100:0/4294238647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e84104240 msgr2=0x7f7e84102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/4294238647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e84104240 0x7f7e84102c40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009900 tx=0x7f7e7402a410 comp rx=0 tx=0).stop 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 -- 172.21.15.100:0/4294238647 shutdown_connections 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/4294238647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84108890 0x7f7e8410acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/4294238647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e84104240 0x7f7e84102c40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/4294238647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84103d60 0x7f7e84102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 -- 172.21.15.100:0/4294238647 >> 172.21.15.100:0/4294238647 conn(0x7f7e840fd1e0 msgr2=0x7f7e840ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 -- 172.21.15.100:0/4294238647 shutdown_connections 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.395+0000 7f7e8b19d640 1 -- 172.21.15.100:0/4294238647 wait complete. 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 Processor -- start 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 -- start start 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84103d60 0x7f7e84199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:32.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84108890 0x7f7e8419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410e3f0 con 0x7f7e8419f1b0 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410e270 con 0x7f7e84108890 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8b19d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8410e570 con 0x7f7e84103d60 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53484/0 (socket says 172.21.15.100:53484) 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 -- 172.21.15.100:0/2490138945 learned_addr learned my addr 172.21.15.100:0/2490138945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a19b640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84103d60 0x7f7e84199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8999a640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84108890 0x7f7e8419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 -- 172.21.15.100:0/2490138945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84103d60 msgr2=0x7f7e84199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84103d60 0x7f7e84199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 -- 172.21.15.100:0/2490138945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84108890 msgr2=0x7f7e8419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84108890 0x7f7e8419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 -- 172.21.15.100:0/2490138945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e841a1c40 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.396+0000 7f7e8a99c640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b970 tx=0x7f7e7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.397+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c019070 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.397+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e7c014440 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.397+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841a1f30 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.397+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0075d0 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.397+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a2420 con 0x7f7e8419f1b0 2024-04-30T23:31:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.398+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e84107f90 con 0x7f7e8419f1b0 2024-04-30T23:31:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.399+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f7e7c01c070 con 0x7f7e8419f1b0 2024-04-30T23:31:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.399+0000 7f7e7b7fe640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 0x7f7e700a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.400+0000 7f7e8a19b640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 0x7f7e700a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.400+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9530+0+0 (secure 0 0 0) 0x7f7e7c0cfed0 con 0x7f7e8419f1b0 2024-04-30T23:31:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.400+0000 7f7e8a19b640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 0x7f7e700a60e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:32.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.405+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7e7c09c3a0 con 0x7f7e8419f1b0 2024-04-30T23:31:32.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:32 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:31:32.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:32 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:31:32.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:32 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-30T23:31:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:32.583+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e8402db90 con 0x7f7e8419f1b0 2024-04-30T23:31:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.259+0000 7f7e7b7fe640 1 -- 172.21.15.100:0/2490138945 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f7e7c09bca0 con 0x7f7e8419f1b0 2024-04-30T23:31:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-04-30T23:31:33.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.263+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 msgr2=0x7f7e700a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:33.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.263+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 0x7f7e700a60e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005850 comp rx=0 tx=0).stop 2024-04-30T23:31:33.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.263+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 msgr2=0x7f7e841a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:33.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.263+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b970 tx=0x7f7e7c00be30 comp rx=0 tx=0).stop 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 shutdown_connections 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f7e700a3bd0 0x7f7e700a60e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e8419f1b0 0x7f7e841a15d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e84108890 0x7f7e8419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 --2- 172.21.15.100:0/2490138945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84103d60 0x7f7e84199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 >> 172.21.15.100:0/2490138945 conn(0x7f7e840fd1e0 msgr2=0x7f7e84101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 shutdown_connections 2024-04-30T23:31:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.264+0000 7f7e8b19d640 1 -- 172.21.15.100:0/2490138945 wait complete. 2024-04-30T23:31:33.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 -- 172.21.15.100:0/288588389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528103c50 msgr2=0x7f2528104060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 --2- 172.21.15.100:0/288588389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528103c50 0x7f2528104060 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2510009900 tx=0x7f251002a410 comp rx=0 tx=0).stop 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 -- 172.21.15.100:0/288588389 shutdown_connections 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 --2- 172.21.15.100:0/288588389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528108950 0x7f252810ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 --2- 172.21.15.100:0/288588389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528103c50 0x7f2528104060 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 --2- 172.21.15.100:0/288588389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f2528103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 -- 172.21.15.100:0/288588389 >> 172.21.15.100:0/288588389 conn(0x7f25280fdbe0 msgr2=0x7f25281000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 -- 172.21.15.100:0/288588389 shutdown_connections 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 -- 172.21.15.100:0/288588389 wait complete. 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.395+0000 7f252d58d640 1 Processor -- start 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 -- start start 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f252806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528103c50 0x7f252819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f252810e510 con 0x7f2528108950 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f252810e390 con 0x7f2528103c50 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f252d58d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f252810e690 con 0x7f2528102a10 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53496/0 (socket says 172.21.15.100:53496) 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 -- 172.21.15.100:0/2305572964 learned_addr learned my addr 172.21.15.100:0/2305572964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:33.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f2526ffd640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f252806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25267fc640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528103c50 0x7f252819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 -- 172.21.15.100:0/2305572964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 msgr2=0x7f252806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f252806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 -- 172.21.15.100:0/2305572964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528103c50 msgr2=0x7f252819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528103c50 0x7f252819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 -- 172.21.15.100:0/2305572964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25281a1ce0 con 0x7f2528108950 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f2526ffd640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f252806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.396+0000 7f25277fe640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f251800cce0 tx=0x7f251800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.397+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800f450 con 0x7f2528108950 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.397+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25281a1fd0 con 0x7f2528108950 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.397+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f251800faa0 con 0x7f2528108950 2024-04-30T23:31:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.397+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518018b70 con 0x7f2528108950 2024-04-30T23:31:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.397+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25281a2430 con 0x7f2528108950 2024-04-30T23:31:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.398+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2528107760 con 0x7f2528108950 2024-04-30T23:31:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.399+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2518018d10 con 0x7f2528108950 2024-04-30T23:31:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.399+0000 7f251ffff640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 0x7f25140a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.399+0000 7f2526ffd640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 0x7f25140a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.400+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9026+0+0 (secure 0 0 0) 0x7f25180d0c10 con 0x7f2528108950 2024-04-30T23:31:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.400+0000 7f2526ffd640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 0x7f25140a60c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2528103610 tx=0x7f252000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:33.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.404+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2518014030 con 0x7f2528108950 2024-04-30T23:31:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: pgmap v912: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-30T23:31:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-30T23:31:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-30T23:31:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: Cluster is now healthy 2024-04-30T23:31:33.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6838/2878213328,v1:172.21.15.100:6839/2878213328] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.100:6840/1295977720,v1:172.21.15.100:6841/1295977720] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6832/3038483619,v1:172.21.15.104:6833/3038483619] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6834/4070304693,v1:172.21.15.104:6836/4070304693] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6835/1386686272,v1:172.21.15.104:6838/1386686272] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.104:6837/3307915994,v1:172.21.15.104:6839/3307915994] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6832/3270644689,v1:172.21.15.183:6834/3270644689] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6833/726956819,v1:172.21.15.183:6835/726956819] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6836/3220089224,v1:172.21.15.183:6837/3220089224] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: mds.? [v2:172.21.15.183:6838/4258419429,v1:172.21.15.183:6839/4258419429] up:boot 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: fsmap 12 up:standby 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:31:33.549 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:31:33.550 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:33 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: pgmap v912: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: Cluster is now healthy 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6838/2878213328,v1:172.21.15.100:6839/2878213328] up:boot 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.100:6840/1295977720,v1:172.21.15.100:6841/1295977720] up:boot 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6832/3038483619,v1:172.21.15.104:6833/3038483619] up:boot 2024-04-30T23:31:33.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6834/4070304693,v1:172.21.15.104:6836/4070304693] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6835/1386686272,v1:172.21.15.104:6838/1386686272] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.104:6837/3307915994,v1:172.21.15.104:6839/3307915994] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6832/3270644689,v1:172.21.15.183:6834/3270644689] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6833/726956819,v1:172.21.15.183:6835/726956819] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6836/3220089224,v1:172.21.15.183:6837/3220089224] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: mds.? [v2:172.21.15.183:6838/4258419429,v1:172.21.15.183:6839/4258419429] up:boot 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: fsmap 12 up:standby 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:31:33.554 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:31:33.555 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:31:33.555 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:31:33.555 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:31:33.555 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:31:33.555 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:33 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:33.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: pgmap v912: 129 pgs: 129 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: Cluster is now healthy 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/1354780057' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6838/2878213328,v1:172.21.15.100:6839/2878213328] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.100:6840/1295977720,v1:172.21.15.100:6841/1295977720] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6832/3038483619,v1:172.21.15.104:6833/3038483619] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6834/4070304693,v1:172.21.15.104:6836/4070304693] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6835/1386686272,v1:172.21.15.104:6838/1386686272] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.104:6837/3307915994,v1:172.21.15.104:6839/3307915994] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6832/3270644689,v1:172.21.15.183:6834/3270644689] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6833/726956819,v1:172.21.15.183:6835/726956819] up:boot 2024-04-30T23:31:33.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6836/3220089224,v1:172.21.15.183:6837/3220089224] up:boot 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: mds.? [v2:172.21.15.183:6838/4258419429,v1:172.21.15.183:6839/4258419429] up:boot 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: fsmap 12 up:standby 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='mgr.14152 172.21.15.100:0/1024064292' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-30T23:31:33.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:33 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:33.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:33.581+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25280637e0 con 0x7f2528108950 2024-04-30T23:31:34.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.272+0000 7f251ffff640 1 -- 172.21.15.100:0/2305572964 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7f251809d2d0 con 0x7f2528108950 2024-04-30T23:31:34.274 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-04-30T23:31:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 msgr2=0x7f25140a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 0x7f25140a60c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2528103610 tx=0x7f252000a560 comp rx=0 tx=0).stop 2024-04-30T23:31:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 msgr2=0x7f25281a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f251800cce0 tx=0x7f251800a620 comp rx=0 tx=0).stop 2024-04-30T23:31:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 shutdown_connections 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f25140a3bb0 0x7f25140a60c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2528108950 0x7f25281a1550 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2528103c50 0x7f252819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 --2- 172.21.15.100:0/2305572964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2528102a10 0x7f252806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.275+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 >> 172.21.15.100:0/2305572964 conn(0x7f25280fdbe0 msgr2=0x7f2528104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.276+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 shutdown_connections 2024-04-30T23:31:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.276+0000 7f252d58d640 1 -- 172.21.15.100:0/2305572964 wait complete. 2024-04-30T23:31:34.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 -- 172.21.15.100:0/3665220314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0103b30 msgr2=0x7f03c0104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 --2- 172.21.15.100:0/3665220314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0103b30 0x7f03c0104830 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009900 tx=0x7f03bc02a410 comp rx=0 tx=0).stop 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 -- 172.21.15.100:0/3665220314 shutdown_connections 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 --2- 172.21.15.100:0/3665220314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0109a70 0x7f03c010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 --2- 172.21.15.100:0/3665220314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0104d70 0x7f03c0105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 --2- 172.21.15.100:0/3665220314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0103b30 0x7f03c0104830 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 -- 172.21.15.100:0/3665220314 >> 172.21.15.100:0/3665220314 conn(0x7f03c00fed20 msgr2=0x7f03c01011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 -- 172.21.15.100:0/3665220314 shutdown_connections 2024-04-30T23:31:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.410+0000 7f03c6e92640 1 -- 172.21.15.100:0/3665220314 wait complete. 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 Processor -- start 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 -- start start 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 0x7f03c019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0104d70 0x7f03c019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010f630 con 0x7f03c0109a70 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010f4b0 con 0x7f03c0104d70 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c6e92640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010f7b0 con 0x7f03c0103b30 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c542f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c542f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51768/0 (socket says 172.21.15.100:51768) 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.411+0000 7f03c542f640 1 -- 172.21.15.100:0/4169706777 learned_addr learned my addr 172.21.15.100:0/4169706777 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-30T23:31:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03b7fff640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0104d70 0x7f03c019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c4c2e640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 0x7f03c019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 -- 172.21.15.100:0/4169706777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 msgr2=0x7f03c019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 0x7f03c019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 -- 172.21.15.100:0/4169706777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0104d70 msgr2=0x7f03c019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0104d70 0x7f03c019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 -- 172.21.15.100:0/4169706777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01a1de0 con 0x7f03c0109a70 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c4c2e640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 0x7f03c019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c542f640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f03b800cad0 tx=0x7f03b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b800ae20 con 0x7f03c0109a70 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b8005020 con 0x7f03c0109a70 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01a20d0 con 0x7f03c0109a70 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b800f6b0 con 0x7f03c0109a70 2024-04-30T23:31:34.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.412+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01a25d0 con 0x7f03c0109a70 2024-04-30T23:31:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.413+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c0108880 con 0x7f03c0109a70 2024-04-30T23:31:34.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.415+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f03b80051d0 con 0x7f03c0109a70 2024-04-30T23:31:34.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.415+0000 7f03b5ffb640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 0x7f03a80a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T23:31:34.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.415+0000 7f03c4c2e640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 0x7f03a80a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T23:31:34.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.415+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8496+0+0 (secure 0 0 0) 0x7f03b80d05c0 con 0x7f03c0109a70 2024-04-30T23:31:34.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.416+0000 7f03c4c2e640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 0x7f03a80a60c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009230 tx=0x7f03bc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T23:31:34.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.420+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f03b8014030 con 0x7f03c0109a70 2024-04-30T23:31:34.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:34 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:34.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:34 smithi104 ceph-mon[32987]: osdmap e95: 12 total, 12 up, 12 in 2024-04-30T23:31:34.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:34 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:34.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:34 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:34.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:34 smithi183 ceph-mon[33560]: osdmap e95: 12 total, 12 up, 12 in 2024-04-30T23:31:34.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:34 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:34.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:34 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2490138945' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:34.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:34 smithi100 ceph-mon[29745]: osdmap e95: 12 total, 12 up, 12 in 2024-04-30T23:31:34.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:34 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:34.598+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f03c002db90 con 0x7f03c0109a70 2024-04-30T23:31:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.280+0000 7f03b5ffb640 1 -- 172.21.15.100:0/4169706777 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v97) ==== 178+0+0 (secure 0 0 0) 0x7f03b809cea0 con 0x7f03c0109a70 2024-04-30T23:31:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' removed 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 msgr2=0x7f03a80a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 0x7f03a80a60c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009230 tx=0x7f03bc000bc0 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 msgr2=0x7f03c01a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f03b800cad0 tx=0x7f03b800cf90 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 shutdown_connections 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:6800/3346272580,v1:172.21.15.100:6801/3346272580] conn(0x7f03a80a3bb0 0x7f03a80a60c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03c0109a70 0x7f03c01a1770 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03c0104d70 0x7f03c019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 --2- 172.21.15.100:0/4169706777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03c0103b30 0x7f03c019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 >> 172.21.15.100:0/4169706777 conn(0x7f03c00fed20 msgr2=0x7f03c0105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 shutdown_connections 2024-04-30T23:31:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-30T23:31:35.283+0000 7f03c6e92640 1 -- 172.21.15.100:0/4169706777 wait complete. 2024-04-30T23:31:35.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:31:35.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:31:35.360 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:31:35.389 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-30T23:31:35.390 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-30T23:31:35.405 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-30T23:31:35.423 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-30T23:31:35.445 INFO:tasks.cephadm:Stopping all daemons... 2024-04-30T23:31:35.445 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-30T23:31:35.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a 2024-04-30T23:31:35.547 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:35 smithi104 ceph-mon[32987]: pgmap v914: 97 pgs: 97 active+clean; 577 KiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:31:35.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:35 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:35.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:35 smithi104 ceph-mon[32987]: osdmap e96: 12 total, 12 up, 12 in 2024-04-30T23:31:35.548 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:35 smithi104 ceph-mon[32987]: from='client.? 172.21.15.100:0/4169706777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:35.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:35 smithi183 ceph-mon[33560]: pgmap v914: 97 pgs: 97 active+clean; 577 KiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:31:35.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:35 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:35.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:35 smithi183 ceph-mon[33560]: osdmap e96: 12 total, 12 up, 12 in 2024-04-30T23:31:35.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:35 smithi183 ceph-mon[33560]: from='client.? 172.21.15.100:0/4169706777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:35.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-mon[29745]: pgmap v914: 97 pgs: 97 active+clean; 577 KiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-30T23:31:35.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/2305572964' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-30T23:31:35.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-mon[29745]: osdmap e96: 12 total, 12 up, 12 in 2024-04-30T23:31:35.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-mon[29745]: from='client.? 172.21.15.100:0/4169706777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-30T23:31:35.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 systemd[1]: Stopping Ceph mon.a for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:36.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a[29741]: 2024-04-30T23:31:35.748+0000 7f6e7e01e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:36.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a[29741]: 2024-04-30T23:31:35.748+0000 7f6e7e01e700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-30T23:31:36.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:35 smithi100 podman[92606]: 2024-04-30 23:31:35.819686786 +0000 UTC m=+0.183249188 container died 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-30T23:31:36.477 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:36 smithi100 podman[92606]: 2024-04-30 23:31:36.216130539 +0000 UTC m=+0.579692938 container cleanup 18fd9f70226e10ccce31301d108c88f7d338d704146a95e12d40adc07496ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-30T23:31:36.477 INFO:journalctl@ceph.mon.a.smithi100.stdout:Apr 30 23:31:36 smithi100 bash[92606]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-a 2024-04-30T23:31:36.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.a.service' 2024-04-30T23:31:36.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:36.681 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-30T23:31:36.681 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-30T23:31:36.681 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.b 2024-04-30T23:31:36.992 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:36 smithi104 systemd[1]: Stopping Ceph mon.b for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:37.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b[32983]: 2024-04-30T23:31:36.989+0000 7fb1946ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:37.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b[32983]: 2024-04-30T23:31:36.989+0000 7fb1946ff700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-30T23:31:37.298 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:37 smithi104 podman[68680]: 2024-04-30 23:31:37.061226908 +0000 UTC m=+0.190127744 container died 52f900d59fc6d0d94bc8e34b5b79da346afe6088ab881be43c4d6d16f24c358e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-30T23:31:37.727 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:37 smithi104 podman[68680]: 2024-04-30 23:31:37.448931326 +0000 UTC m=+0.577832168 container cleanup 52f900d59fc6d0d94bc8e34b5b79da346afe6088ab881be43c4d6d16f24c358e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-30T23:31:37.727 INFO:journalctl@ceph.mon.b.smithi104.stdout:Apr 30 23:31:37 smithi104 bash[68680]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-b 2024-04-30T23:31:37.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.b.service' 2024-04-30T23:31:37.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:37.914 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-30T23:31:37.914 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-30T23:31:37.914 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.c 2024-04-30T23:31:38.227 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:37 smithi183 systemd[1]: Stopping Ceph mon.c for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:38.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c[33542]: 2024-04-30T23:31:38.224+0000 7f6ea8bd5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:38.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c[33542]: 2024-04-30T23:31:38.224+0000 7f6ea8bd5700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-30T23:31:38.553 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:38 smithi183 podman[70019]: 2024-04-30 23:31:38.45015344 +0000 UTC m=+0.344167462 container died 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:31:39.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:38 smithi183 podman[70019]: 2024-04-30 23:31:38.834014889 +0000 UTC m=+0.728028905 container cleanup 151cf72647b44e4d3bc871db38b783c32a5093c490b608342ad7beac9011e5c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-30T23:31:39.053 INFO:journalctl@ceph.mon.c.smithi183.stdout:Apr 30 23:31:38 smithi183 bash[70019]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mon-c 2024-04-30T23:31:39.234 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mon.c.service' 2024-04-30T23:31:39.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:39.278 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-30T23:31:39.278 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-30T23:31:39.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x 2024-04-30T23:31:39.574 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:39 smithi100 systemd[1]: Stopping Ceph mgr.x for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:39.950 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:31:39.595+0000 7f3cf9365700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:39.950 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x[29980]: 2024-04-30T23:31:39.595+0000 7f3cf9365700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-30T23:31:39.950 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:39 smithi100 podman[92730]: 2024-04-30 23:31:39.626799477 +0000 UTC m=+0.154824380 container died 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-30T23:31:40.283 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:40 smithi100 podman[92730]: 2024-04-30 23:31:40.047080171 +0000 UTC m=+0.575105072 container cleanup 840d9cf80640912836e20c8e2623bdb98749575008bd10578fad6d44077d7409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8505bf412a33fc9b7838e91f3a227044bc06f5ed, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:31:40.283 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Apr 30 23:31:40 smithi100 bash[92730]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-x 2024-04-30T23:31:40.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-30T23:31:40.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:40.448 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-30T23:31:40.448 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-30T23:31:40.448 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.y 2024-04-30T23:31:40.776 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:31:40 smithi104 systemd[1]: Stopping Ceph mgr.y for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:41.048 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:31:40 smithi104 podman[68804]: 2024-04-30 23:31:40.774524772 +0000 UTC m=+0.130620894 container died abfbd9a97fb5bcdb621dd23e34002ce3f4af4396ddffdacc87b116dca3bb1aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-30T23:31:41.548 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:31:41 smithi104 podman[68804]: 2024-04-30 23:31:41.188107869 +0000 UTC m=+0.544204036 container cleanup abfbd9a97fb5bcdb621dd23e34002ce3f4af4396ddffdacc87b116dca3bb1aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-30T23:31:41.548 INFO:journalctl@ceph.mgr.y.smithi104.stdout:Apr 30 23:31:41 smithi104 bash[68804]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-y 2024-04-30T23:31:41.773 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-30T23:31:41.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:41.807 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-30T23:31:41.807 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-30T23:31:41.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.z 2024-04-30T23:31:42.145 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:31:41 smithi183 systemd[1]: Stopping Ceph mgr.z for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:42.416 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:31:42 smithi183 podman[70141]: 2024-04-30 23:31:42.143669236 +0000 UTC m=+0.145635291 container died 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-30T23:31:42.701 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:31:42 smithi183 podman[70141]: 2024-04-30 23:31:42.489932378 +0000 UTC m=+0.491898432 container cleanup 0b63d055606be5363ed44804d45e2818fabbfda143a52b7c205630cf1c68b734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-30T23:31:42.701 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Apr 30 23:31:42 smithi183 bash[70141]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mgr-z 2024-04-30T23:31:42.909 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-30T23:31:42.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:42.941 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-30T23:31:42.942 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-30T23:31:42.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.0 2024-04-30T23:31:43.254 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:42 smithi100 systemd[1]: Stopping Ceph osd.0 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:43.574 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0[42010]: 2024-04-30T23:31:43.252+0000 7f1fb5043700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:43.574 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0[42010]: 2024-04-30T23:31:43.252+0000 7f1fb5043700 -1 osd.0 97 *** Got signal Terminated *** 2024-04-30T23:31:43.574 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0[42010]: 2024-04-30T23:31:43.252+0000 7f1fb5043700 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:31:49.075 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:48 smithi100 podman[92863]: 2024-04-30 23:31:48.778782914 +0000 UTC m=+5.646025755 container died a46f9e3241bded1f253fffe91f349dc4bc432883603451e914dd614b655881fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-30T23:31:49.447 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:49 smithi100 podman[92863]: 2024-04-30 23:31:49.169032671 +0000 UTC m=+6.036275518 container cleanup a46f9e3241bded1f253fffe91f349dc4bc432883603451e914dd614b655881fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:31:49.447 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:49 smithi100 bash[92863]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0 2024-04-30T23:31:49.747 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:49 smithi100 podman[92880]: 2024-04-30 23:31:49.446012557 +0000 UTC m=+0.670442073 container remove a46f9e3241bded1f253fffe91f349dc4bc432883603451e914dd614b655881fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-30T23:31:50.034 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:49 smithi100 podman[92973]: 2024-04-30 23:31:49.64895532 +0000 UTC m=+0.018009905 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:31:50.034 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:49 smithi100 podman[92973]: 2024-04-30 23:31:49.763760025 +0000 UTC m=+0.132814577 container create 75c0ade3944fe0bdd43e423bafbd6e1c1c7c534b3e3b5dd444661eef7ed38ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:31:50.035 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:50 smithi100 podman[92973]: 2024-04-30 23:31:50.033048347 +0000 UTC m=+0.402102903 container init 75c0ade3944fe0bdd43e423bafbd6e1c1c7c534b3e3b5dd444661eef7ed38ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-30T23:31:50.324 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:50 smithi100 podman[92973]: 2024-04-30 23:31:50.036588388 +0000 UTC m=+0.405642951 container start 75c0ade3944fe0bdd43e423bafbd6e1c1c7c534b3e3b5dd444661eef7ed38ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-30T23:31:50.325 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:50 smithi100 podman[92973]: 2024-04-30 23:31:50.133336117 +0000 UTC m=+0.502390692 container attach 75c0ade3944fe0bdd43e423bafbd6e1c1c7c534b3e3b5dd444661eef7ed38ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:31:50.696 INFO:journalctl@ceph.osd.0.smithi100.stdout:Apr 30 23:31:50 smithi100 podman[92973]: 2024-04-30 23:31:50.335142627 +0000 UTC m=+0.704197191 container died 75c0ade3944fe0bdd43e423bafbd6e1c1c7c534b3e3b5dd444661eef7ed38ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-30T23:31:51.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.0.service' 2024-04-30T23:31:51.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:51.084 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-30T23:31:51.084 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-30T23:31:51.084 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.1 2024-04-30T23:31:51.385 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:51 smithi104 systemd[1]: Stopping Ceph osd.1 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:51.797 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:31:51.383+0000 7f8f4fa3d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:51.798 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:31:51.383+0000 7f8f4fa3d700 -1 osd.1 97 *** Got signal Terminated *** 2024-04-30T23:31:51.798 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1[37593]: 2024-04-30T23:31:51.383+0000 7f8f4fa3d700 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:31:57.048 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:56 smithi104 podman[68940]: 2024-04-30 23:31:56.794780579 +0000 UTC m=+5.525116994 container died 81446970f4a8157d3d61fe96ba7cd8cff43905dcdf0071c089c9347e1d13c7c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:31:57.462 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:57 smithi104 podman[68940]: 2024-04-30 23:31:57.209147332 +0000 UTC m=+5.939483747 container cleanup 81446970f4a8157d3d61fe96ba7cd8cff43905dcdf0071c089c9347e1d13c7c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:31:57.462 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:57 smithi104 bash[68940]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1 2024-04-30T23:31:57.797 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:57 smithi104 podman[68958]: 2024-04-30 23:31:57.460699587 +0000 UTC m=+0.655976625 container remove 81446970f4a8157d3d61fe96ba7cd8cff43905dcdf0071c089c9347e1d13c7c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:31:58.274 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:57 smithi104 podman[69048]: 2024-04-30 23:31:57.785224127 +0000 UTC m=+0.017821639 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:31:58.274 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:57 smithi104 podman[69048]: 2024-04-30 23:31:57.903741262 +0000 UTC m=+0.136338758 container create 58612b02f4a6dc813a9cd5eaf6e02559ab165aa1ecc5a502dffd437dd93dab98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-30T23:31:58.275 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:58 smithi104 podman[69048]: 2024-04-30 23:31:58.106067954 +0000 UTC m=+0.338665448 container init 58612b02f4a6dc813a9cd5eaf6e02559ab165aa1ecc5a502dffd437dd93dab98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:31:58.275 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:58 smithi104 podman[69048]: 2024-04-30 23:31:58.109400429 +0000 UTC m=+0.341997924 container start 58612b02f4a6dc813a9cd5eaf6e02559ab165aa1ecc5a502dffd437dd93dab98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-30T23:31:58.275 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:58 smithi104 podman[69048]: 2024-04-30 23:31:58.273116436 +0000 UTC m=+0.505713930 container attach 58612b02f4a6dc813a9cd5eaf6e02559ab165aa1ecc5a502dffd437dd93dab98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-30T23:31:58.547 INFO:journalctl@ceph.osd.1.smithi104.stdout:Apr 30 23:31:58 smithi104 podman[69048]: 2024-04-30 23:31:58.402157506 +0000 UTC m=+0.634755006 container died 58612b02f4a6dc813a9cd5eaf6e02559ab165aa1ecc5a502dffd437dd93dab98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-04-30T23:31:59.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.1.service' 2024-04-30T23:31:59.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:31:59.107 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-30T23:31:59.107 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-30T23:31:59.107 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.2 2024-04-30T23:31:59.432 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:31:59 smithi183 systemd[1]: Stopping Ceph osd.2 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:31:59.803 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:31:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:31:59.429+0000 7fa74fe80700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:31:59.803 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:31:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:31:59.429+0000 7fa74fe80700 -1 osd.2 97 *** Got signal Terminated *** 2024-04-30T23:31:59.803 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:31:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2[38735]: 2024-04-30T23:31:59.429+0000 7fa74fe80700 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:05.047 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:04 smithi183 podman[70283]: 2024-04-30 23:32:04.776618151 +0000 UTC m=+5.478557064 container died e22b9d0fffec6dd105267f630b28245b7a72a6ec5a2e943bde6c0d849ab1e41d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-30T23:32:05.303 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:05 smithi183 podman[70283]: 2024-04-30 23:32:05.135475008 +0000 UTC m=+5.837413910 container cleanup e22b9d0fffec6dd105267f630b28245b7a72a6ec5a2e943bde6c0d849ab1e41d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:32:05.303 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:05 smithi183 bash[70283]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2 2024-04-30T23:32:05.798 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:05 smithi183 podman[70300]: 2024-04-30 23:32:05.437154241 +0000 UTC m=+0.656484609 container remove e22b9d0fffec6dd105267f630b28245b7a72a6ec5a2e943bde6c0d849ab1e41d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-30T23:32:06.053 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:05 smithi183 podman[70389]: 2024-04-30 23:32:05.70044078 +0000 UTC m=+0.017988349 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:06.053 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:05 smithi183 podman[70389]: 2024-04-30 23:32:05.818215323 +0000 UTC m=+0.135762893 container create 1214d56fb5af135b959a74ec7494dde1ffedc81f65ae7785e46141cfddd9b0db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-30T23:32:06.329 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:06 smithi183 podman[70389]: 2024-04-30 23:32:06.099477658 +0000 UTC m=+0.417025228 container init 1214d56fb5af135b959a74ec7494dde1ffedc81f65ae7785e46141cfddd9b0db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-30T23:32:06.329 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:06 smithi183 podman[70389]: 2024-04-30 23:32:06.103884243 +0000 UTC m=+0.421431812 container start 1214d56fb5af135b959a74ec7494dde1ffedc81f65ae7785e46141cfddd9b0db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:32:06.329 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:06 smithi183 podman[70389]: 2024-04-30 23:32:06.19949669 +0000 UTC m=+0.517044268 container attach 1214d56fb5af135b959a74ec7494dde1ffedc81f65ae7785e46141cfddd9b0db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-30T23:32:06.762 INFO:journalctl@ceph.osd.2.smithi183.stdout:Apr 30 23:32:06 smithi183 podman[70389]: 2024-04-30 23:32:06.411317471 +0000 UTC m=+0.728865038 container died 1214d56fb5af135b959a74ec7494dde1ffedc81f65ae7785e46141cfddd9b0db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:32:07.105 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.2.service' 2024-04-30T23:32:07.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:07.142 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-30T23:32:07.142 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-30T23:32:07.142 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.3 2024-04-30T23:32:07.449 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:07 smithi100 systemd[1]: Stopping Ceph osd.3 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:07.824 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:07 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:32:07.446+0000 7ff88bdbd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:07.824 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:07 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:32:07.446+0000 7ff88bdbd700 -1 osd.3 97 *** Got signal Terminated *** 2024-04-30T23:32:07.824 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:07 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:32:07.446+0000 7ff88bdbd700 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:10.306 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:09.941+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:11.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:10.983+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:11.428 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:11 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:32:11.132+0000 7ff888373700 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.701662+0000 front 2024-04-30T23:31:46.701631+0000 (oldest deadline 2024-04-30T23:32:10.801782+0000) 2024-04-30T23:32:12.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:11.941+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:12.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:12.170+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:12.574 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:12 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3[48536]: 2024-04-30T23:32:12.140+0000 7ff888373700 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.701662+0000 front 2024-04-30T23:31:46.701631+0000 (oldest deadline 2024-04-30T23:32:10.801782+0000) 2024-04-30T23:32:12.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:12 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:12.242+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:13.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:12 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:12.715+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:13.074 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:12 smithi100 podman[93081]: 2024-04-30 23:32:12.881047944 +0000 UTC m=+5.552176252 container died d24b8a5f5cf31a9e6b407c76d914445ddfb84fcd4426148b4da1712bb72abe91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-30T23:32:13.226 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:13.199+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:13.227 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:12.966+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:13.517 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:13 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:13.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:13.517 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:13 smithi100 podman[93081]: 2024-04-30 23:32:13.256250622 +0000 UTC m=+5.927378925 container cleanup d24b8a5f5cf31a9e6b407c76d914445ddfb84fcd4426148b4da1712bb72abe91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-30T23:32:13.517 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:13 smithi100 bash[93081]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3 2024-04-30T23:32:13.824 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:13 smithi100 podman[93110]: 2024-04-30 23:32:13.515995984 +0000 UTC m=+0.639181348 container remove d24b8a5f5cf31a9e6b407c76d914445ddfb84fcd4426148b4da1712bb72abe91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-30T23:32:14.047 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:13 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:13.728+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:14.163 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:13 smithi100 podman[93204]: 2024-04-30 23:32:13.774112694 +0000 UTC m=+0.017889282 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:14.163 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:13 smithi100 podman[93204]: 2024-04-30 23:32:13.925870678 +0000 UTC m=+0.169647288 container create 08063782166b78823e86209b69c54d51a0cd8bdad33ffb482fb1326b5e8ea205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-30T23:32:14.163 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:14 smithi100 podman[93204]: 2024-04-30 23:32:14.161805427 +0000 UTC m=+0.405581991 container init 08063782166b78823e86209b69c54d51a0cd8bdad33ffb482fb1326b5e8ea205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-30T23:32:14.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:13.993+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:14.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:14.161+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:14.452 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:14 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:14.268+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:14.453 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:14 smithi100 podman[93204]: 2024-04-30 23:32:14.165075687 +0000 UTC m=+0.408852252 container start 08063782166b78823e86209b69c54d51a0cd8bdad33ffb482fb1326b5e8ea205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:32:14.453 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:14 smithi100 podman[93204]: 2024-04-30 23:32:14.261935121 +0000 UTC m=+0.505711697 container attach 08063782166b78823e86209b69c54d51a0cd8bdad33ffb482fb1326b5e8ea205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-30T23:32:14.757 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 30 23:32:14 smithi100 podman[93204]: 2024-04-30 23:32:14.451471818 +0000 UTC m=+0.695248399 container died 08063782166b78823e86209b69c54d51a0cd8bdad33ffb482fb1326b5e8ea205 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-30T23:32:15.047 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:14 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:14.740+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:15.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.3.service' 2024-04-30T23:32:15.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:15.157 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-30T23:32:15.158 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-30T23:32:15.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.4 2024-04-30T23:32:15.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:15.149+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:14.982+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:15.497 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:15 smithi104 systemd[1]: Stopping Ceph osd.4 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:15.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:15 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:15.307+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:15.797 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:15 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:15.704+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:15.798 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:15 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:15.494+0000 7fe95c03e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:15.798 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:15 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:15.494+0000 7fe95c03e700 -1 osd.4 97 *** Got signal Terminated *** 2024-04-30T23:32:15.798 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:15 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:15.494+0000 7fe95c03e700 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:16.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:16.106+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:15.968+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:16.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:16 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:16.272+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:17.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:16 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:16.711+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:17.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:17 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:17.112+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:17.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:16.994+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:17.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:17 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:17.233+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:18.048 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:17 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:17.559+0000 7fe9545ec700 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.322936+0000 front 2024-04-30T23:31:56.322685+0000 (oldest deadline 2024-04-30T23:32:16.822839+0000) 2024-04-30T23:32:18.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:17 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:17.740+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:18.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:18 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:18.016+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:18.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:18 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:18.081+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:18.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:18 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:18.081+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:18.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:18 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:18.225+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:19.047 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:18 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:18.548+0000 7fe9545ec700 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.322936+0000 front 2024-04-30T23:31:56.322685+0000 (oldest deadline 2024-04-30T23:32:16.822839+0000) 2024-04-30T23:32:19.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:18 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:18.755+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:19.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:18 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:18.755+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:19.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:19 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:19.010+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:19.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:19 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:19.062+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:19.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:19 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:19.062+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:19.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:19 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:19.254+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:19.798 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:19 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:19.553+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:19.798 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:19 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4[44535]: 2024-04-30T23:32:19.537+0000 7fe9545ec700 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.322936+0000 front 2024-04-30T23:31:56.322685+0000 (oldest deadline 2024-04-30T23:32:16.822839+0000) 2024-04-30T23:32:19.798 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:19 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:19.764+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:19.798 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:19 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:19.764+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:19.802 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:19 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:19.448+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:20.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:19 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:19.978+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:20.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:20 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:20.093+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:20.304 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:20 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:20.093+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:20.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:20 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:20.338+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:20.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:20 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:20.242+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:20.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:20 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:20.242+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:20.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:20 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:20.410+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:20.914 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:20 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:20.546+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:20.914 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:20 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:20.787+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:20.914 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:20 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:20.787+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:21.256 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:20 smithi104 podman[69155]: 2024-04-30 23:32:20.912265282 +0000 UTC m=+5.560531450 container died 138f32ec1508ffe9300c7610d17f91ac214959f71a5ba25cd7e368baa9e6d665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-30T23:32:21.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:20 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:20.995+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:21.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:21 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:21.115+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:21.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:21 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:21.115+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:21.548 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:21 smithi104 podman[69155]: 2024-04-30 23:32:21.353812986 +0000 UTC m=+6.002079158 container cleanup 138f32ec1508ffe9300c7610d17f91ac214959f71a5ba25cd7e368baa9e6d665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-30T23:32:21.548 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:21 smithi104 bash[69155]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4 2024-04-30T23:32:21.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:21.357+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:21.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:21.210+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:21.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:21 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:21.210+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:21.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:21 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:21.409+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:21.815 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:21 smithi104 podman[69173]: 2024-04-30 23:32:21.571805414 +0000 UTC m=+0.653372912 container remove 138f32ec1508ffe9300c7610d17f91ac214959f71a5ba25cd7e368baa9e6d665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-30T23:32:21.816 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:21 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:21.558+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:22.146 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:21 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:21.813+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:22.146 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:21 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:21.813+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:22.146 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:21.926434769 +0000 UTC m=+0.019797655 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:22.147 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:22.048162349 +0000 UTC m=+0.141525198 container create d9aed0f29174eea2e4e01b3ac491c868e00479456b6273af1ef937997f129af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:32:22.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:22 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:22.045+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:22.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:22 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:22.160+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:22.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:22 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:22.160+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:22.524 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:22.285177767 +0000 UTC m=+0.378540625 container init d9aed0f29174eea2e4e01b3ac491c868e00479456b6273af1ef937997f129af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:32:22.524 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:22.288552551 +0000 UTC m=+0.381915401 container start d9aed0f29174eea2e4e01b3ac491c868e00479456b6273af1ef937997f129af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:32:22.524 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:22.385070198 +0000 UTC m=+0.478433049 container attach d9aed0f29174eea2e4e01b3ac491c868e00479456b6273af1ef937997f129af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:32:22.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:22.391+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:22.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:22.247+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:22.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:22 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:22.247+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:22.781 INFO:journalctl@ceph.osd.4.smithi104.stdout:Apr 30 23:32:22 smithi104 podman[69274]: 2024-04-30 23:32:22.586119965 +0000 UTC m=+0.679482826 container died d9aed0f29174eea2e4e01b3ac491c868e00479456b6273af1ef937997f129af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-30T23:32:22.781 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:22 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:22.521+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:22.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:22 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:22.413+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:23.031 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:22 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:22.778+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:23.031 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:22 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:22.778+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:23.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.4.service' 2024-04-30T23:32:23.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:23.409 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-30T23:32:23.409 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-30T23:32:23.410 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.5 2024-04-30T23:32:23.420 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:23.091+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:23.420 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:23.207+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:23.420 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:23.208+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:23.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:23 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:23.432+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:23.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:23 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:23.248+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:23.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:23 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:23.248+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:23.724 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 systemd[1]: Stopping Ceph osd.5 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:23.724 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:23.418+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:23.797 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:23 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:23.553+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:24.053 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:23.721+0000 7fdd122bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:24.053 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:23.722+0000 7fdd122bc700 -1 osd.5 97 *** Got signal Terminated *** 2024-04-30T23:32:24.053 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:23 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:23.722+0000 7fdd122bc700 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:24.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:23 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:23.807+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:24.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:23 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:23.807+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:24.411 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:24 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:24.072+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:24.411 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:24 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:24.200+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:24.411 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:24 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:24.200+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:24.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:24.440+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:24.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:24.216+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:24.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:24.216+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:24.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:24 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:24.409+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:24.828 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:24 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:24.563+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:25.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:24 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:24.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:25.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:24 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:24.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:25.425 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:25 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:25.079+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:25.425 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:25 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:25.174+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:25.425 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:25 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:25.174+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:25.434 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:25.202+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:25.434 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:25.202+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:25.797 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:25.539+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:25.802 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:25 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:25.423+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:25.824 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:25 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:25.433+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:26.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:25.830+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:26.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:25 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:25.830+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:26.399 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:26 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:26.152+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:26.399 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:26 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:26.152+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:26.399 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:26 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:26.065+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:26.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:26.405+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:26.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:26.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:26.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:26.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:26.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:26 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:26.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:26.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:26 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:26.397+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:26.812 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:26 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:26.556+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:27.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:26 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:26.811+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:27.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:26 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:26.811+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:27.302 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:27 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:27.040+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:27.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:27 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:27.137+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:27.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:27 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:27.137+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:27.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:27.386+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:27.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:27.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:27.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:27.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:27.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:27 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:27.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:27.797 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:27 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:27.521+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:27.802 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:27 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:27.429+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:28.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:27 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:27.817+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:28.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:27 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:27.817+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:28.302 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:28 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:28.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:28.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:28 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:28.113+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.335210+0000 front 2024-04-30T23:31:46.335086+0000 (oldest deadline 2024-04-30T23:32:11.634954+0000) 2024-04-30T23:32:28.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:28 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5[45679]: 2024-04-30T23:32:28.113+0000 7fdd0a86a700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:51.635580+0000 front 2024-04-30T23:31:51.635610+0000 (oldest deadline 2024-04-30T23:32:17.535631+0000) 2024-04-30T23:32:28.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:28.366+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:28.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:28.366+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:28.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:28.218+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:28.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:28.218+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:28.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:28.218+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:28.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:28 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:28.472+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:28.834 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:28 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:28.570+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:28.834 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:28 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:28.570+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:29.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:28 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:28.832+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:29.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:28 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:28.832+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:29.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:28 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:28.832+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:29.303 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:29 smithi183 podman[70506]: 2024-04-30 23:32:29.097873248 +0000 UTC m=+5.497011343 container died d8b23a34ccce5ea841f7dc8755ca72dcac0b9c4fc6577b5f2fc23543064ba920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-30T23:32:29.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:29 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:29.033+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:29.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:29 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:29.033+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:29.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:29 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:29.375+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:29.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:29 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:29.375+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:29.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:29 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:29.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:29.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:29 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:29.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:29.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:29 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:29.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:29.749 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:29 smithi183 podman[70506]: 2024-04-30 23:32:29.472155882 +0000 UTC m=+5.871293968 container cleanup d8b23a34ccce5ea841f7dc8755ca72dcac0b9c4fc6577b5f2fc23543064ba920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:32:29.750 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:29 smithi183 bash[70506]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5 2024-04-30T23:32:29.750 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:29 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:29.469+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:29.750 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:29 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:29.469+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:29.878 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:29.577+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:29.878 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:29.577+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:30.053 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:29 smithi183 podman[70525]: 2024-04-30 23:32:29.748402547 +0000 UTC m=+0.649644417 container remove d8b23a34ccce5ea841f7dc8755ca72dcac0b9c4fc6577b5f2fc23543064ba920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-30T23:32:30.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:29.876+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:30.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:29.876+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:30.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:29 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:29.876+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:30.362 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:30 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:30.075+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:30.362 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:30 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:30.075+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:30.362 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:29.994701333 +0000 UTC m=+0.017067708 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:30.362 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:30.107834194 +0000 UTC m=+0.130200544 container create 68117cf76f14e6f12156f8a8e756667e17f5c3613ba6ef3d323127208702b2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-30T23:32:30.362 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:30.360506211 +0000 UTC m=+0.382872560 container init 68117cf76f14e6f12156f8a8e756667e17f5c3613ba6ef3d323127208702b2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-30T23:32:30.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:30.387+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:30.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:30.387+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:30.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:30.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:30.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:30.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:30.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:30 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:30.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:30.658 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:30 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:30.495+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:30.658 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:30 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:30.495+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:30.658 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:30.363994415 +0000 UTC m=+0.386360766 container start 68117cf76f14e6f12156f8a8e756667e17f5c3613ba6ef3d323127208702b2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, ceph=True) 2024-04-30T23:32:30.658 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:30.435622357 +0000 UTC m=+0.457988721 container attach 68117cf76f14e6f12156f8a8e756667e17f5c3613ba6ef3d323127208702b2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-30T23:32:30.940 INFO:journalctl@ceph.osd.5.smithi183.stdout:Apr 30 23:32:30 smithi183 podman[70617]: 2024-04-30 23:32:30.657152414 +0000 UTC m=+0.679518775 container died 68117cf76f14e6f12156f8a8e756667e17f5c3613ba6ef3d323127208702b2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424) 2024-04-30T23:32:31.047 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:30 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:30.604+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:31.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:30 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:30.604+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:31.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:30 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:30.826+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:31.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:30 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:30.826+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:31.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:30 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:30.826+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:31.240 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:31.088+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:31.240 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:31.088+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:31.256 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.5.service' 2024-04-30T23:32:31.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:31.337 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-30T23:32:31.337 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-30T23:32:31.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.6 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:31.353+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:31.353+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 systemd[1]: Stopping Ceph osd.6 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:31.258+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:31.258+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:31.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:31.258+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:31.797 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:31.575+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:31.798 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:31.575+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:31.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:31.535+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:31.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:31 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:31.535+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:32.074 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:31.609+0000 7fabcb1b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:32.074 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:31.609+0000 7fabcb1b4700 -1 osd.6 97 *** Got signal Terminated *** 2024-04-30T23:32:32.074 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:31 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:31.609+0000 7fabcb1b4700 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:32.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:31.818+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:32.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:31.818+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:32.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:31 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:31.818+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:32.536 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:32 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:32.110+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:32.536 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:32 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:32.110+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:32.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:32.323+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:32.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:32.323+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:32.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:32.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:32.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:32.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:32.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:32.241+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:32.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:32 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:32.533+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:32.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:32 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:32.533+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:32.845 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:32 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:32.553+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:32.845 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:32 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:32.553+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:33.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:32 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:32.843+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:33.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:32 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:32.843+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:33.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:32 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:32.843+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:33.522 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:33.151+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:33.522 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:33.151+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:33.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:33.291+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:33.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:33.291+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:33.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:33.246+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:33.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:33.246+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:33.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:33 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:33.246+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:33.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:33.520+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:33.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:33 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:33.520+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:33.597+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:33.597+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:33.597+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:33.844+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:33.844+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:34.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:33.844+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:34.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:33 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:33.844+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:34.478 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:34.114+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:34.478 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:34.114+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:34.478 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:34.114+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:34.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:34 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:34.265+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:34.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:34 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:34.265+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:34.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:34 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:34.235+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:34.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:34 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:34.235+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:34.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:34 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:34.235+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:34.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:34.476+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:34.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:34.476+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:34.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:34 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:34.476+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:34.596+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:34.596+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:34.596+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:34.845+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:34.845+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:34.845+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:35.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:34 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:34.845+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:35.482 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:35.092+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:35.483 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:35.092+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:35.483 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:35.092+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:35.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:35.313+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:35.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:35.313+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:35.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:35.252+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:35.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:35.252+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:35.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:35 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:35.252+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:35.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:35.481+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:35.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:35.481+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:35.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:35 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:35.481+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:36.047 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:35.552+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:35.552+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:35.552+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:35.797+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:35.797+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:35.797+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:36.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:35 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:35.797+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:36.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:36.132+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:36.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:36.132+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:36.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:36.132+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:36.574 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:36.360+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:56.352523+0000 front 2024-04-30T23:31:56.352321+0000 (oldest deadline 2024-04-30T23:32:19.852507+0000) 2024-04-30T23:32:36.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:36.360+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.153794+0000 front 2024-04-30T23:32:02.153664+0000 (oldest deadline 2024-04-30T23:32:27.453357+0000) 2024-04-30T23:32:36.575 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6[55497]: 2024-04-30T23:32:36.360+0000 7fabc3762700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.154494+0000 front 2024-04-30T23:32:12.154355+0000 (oldest deadline 2024-04-30T23:32:36.254478+0000) 2024-04-30T23:32:36.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:36.213+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:36.576 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:36.213+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:36.576 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:36 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:36.213+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:36.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:36.506+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:36.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:36.506+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:36.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:36 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:36.506+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:36.603+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:36.603+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:36.603+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:36.772+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:36.772+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:36.772+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:37.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:36 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:36.772+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:37.428 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:37 smithi100 podman[93312]: 2024-04-30 23:32:37.14214118 +0000 UTC m=+5.612044797 container died 9b7a36869a5bf421773fe044b7d9b9a103756bca5c6b97f44955f098699f91a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD) 2024-04-30T23:32:37.428 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:37 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:37.260+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:37.428 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:37 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:37.260+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:37.428 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:37 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:37.260+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:37.538 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:37.182+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:37.538 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:37.182+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:37.538 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:37.182+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:37.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:37.537+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:37.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:37.537+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:37.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:37 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:37.537+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:37.811 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:37 smithi100 podman[93312]: 2024-04-30 23:32:37.517568047 +0000 UTC m=+5.987471698 container cleanup 9b7a36869a5bf421773fe044b7d9b9a103756bca5c6b97f44955f098699f91a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:32:37.811 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:37 smithi100 bash[93312]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:37.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:37.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:37.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:37.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:37.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:37.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:38.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:37.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:38.074 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:37 smithi100 podman[93329]: 2024-04-30 23:32:37.810525562 +0000 UTC m=+0.667653438 container remove 9b7a36869a5bf421773fe044b7d9b9a103756bca5c6b97f44955f098699f91a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:32:38.254 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.020437014 +0000 UTC m=+0.017847590 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:38.254 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.153056095 +0000 UTC m=+0.150466674 container create d7e558bab7647948e342696e27547827cd4dea9dc68198eed54ffcdf6789b42f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:32:38.254 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:38 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:38.249+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:38.254 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:38 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:38.249+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:38.255 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:38 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:38.249+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:38.255 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:38 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:38.249+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:38.518 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:38.144+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:38.519 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:38.144+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:38.519 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:38.144+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:38.692 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.397575488 +0000 UTC m=+0.394986064 container init d7e558bab7647948e342696e27547827cd4dea9dc68198eed54ffcdf6789b42f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:32:38.692 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.400877354 +0000 UTC m=+0.398287937 container start d7e558bab7647948e342696e27547827cd4dea9dc68198eed54ffcdf6789b42f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-30T23:32:38.692 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.497689406 +0000 UTC m=+0.495099996 container attach d7e558bab7647948e342696e27547827cd4dea9dc68198eed54ffcdf6789b42f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-04-30T23:32:38.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:38.517+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:38.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:38.517+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:38.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:38 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:38.517+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:38.985 INFO:journalctl@ceph.osd.6.smithi100.stdout:Apr 30 23:32:38 smithi100 podman[93420]: 2024-04-30 23:32:38.69081472 +0000 UTC m=+0.688225315 container died d7e558bab7647948e342696e27547827cd4dea9dc68198eed54ffcdf6789b42f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-30T23:32:39.047 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:38.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:38.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:38.618+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:38.786+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:38.786+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:38.786+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:39.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:38 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:38.786+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:39.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.6.service' 2024-04-30T23:32:39.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:39.309 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-30T23:32:39.309 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-30T23:32:39.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.7 2024-04-30T23:32:39.494 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:39.123+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:39.495 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:39.123+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:39.495 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:39.123+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:39.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:39.282+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:39.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:39.282+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:39.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:39.282+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:39.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:39 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:39.282+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:39.625 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 systemd[1]: Stopping Ceph osd.7 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:39.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:39.492+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:39.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:39.492+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:39.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:39 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:39.492+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:39.782+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:39.782+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:39.782+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:39.782+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.622+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.622+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.622+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.633+0000 7fdd48cd1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:40.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.633+0000 7fdd48cd1700 -1 osd.7 97 *** Got signal Terminated *** 2024-04-30T23:32:40.049 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:39 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:39.633+0000 7fdd48cd1700 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:40.463 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:40.146+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:40.463 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:40.146+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:40.463 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:40.146+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:40.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:40 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:40.283+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:40.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:40 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:40.283+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:40.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:40 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:40.283+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:40.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:40 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:40.283+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:40.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:40.461+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:40.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:40.461+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:40.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:40 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:40.461+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:40.669+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:40.669+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:40.669+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:40.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:40.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:40.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:41.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:40.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:41.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:41.134+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:41.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:41.134+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:41.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:41.134+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:41.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:41 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:41.259+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:41.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:41 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:41.259+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:41.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:41 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:41.259+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:41.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:41 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:41.259+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:41.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:41.416+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:41.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:41.416+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:41.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:41 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:41.416+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:42.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:41.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:42.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:41.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:42.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:41.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:42.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:41.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:42.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:41.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:42.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:41.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:42.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:41.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:42.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:41 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:41.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:42.492 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:42.225+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:42.492 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:42.225+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:42.492 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:42.225+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:42.492 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:42 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:42.225+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:42.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:42.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:42.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:42.370+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:42.370+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:42.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:42 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:42.370+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:43.047 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:42.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:42.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:42.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:42.681+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:15.821498+0000 front 2024-04-30T23:32:15.821473+0000 (oldest deadline 2024-04-30T23:32:41.721548+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:42.808+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:42.808+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:42.808+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:42.808+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:43.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:42 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:42.808+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:43.455 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:43.351+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:43.455 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:43.351+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:43.456 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:43.352+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:43.456 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:43.160+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:43.456 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:43.160+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:43.456 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:43 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:43.160+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:43.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:43.253+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:43.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:43.253+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:43.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:43.253+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:43.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:43 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:43.253+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:43.677+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:55.318911+0000 front 2024-04-30T23:31:55.318868+0000 (oldest deadline 2024-04-30T23:32:19.419085+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:43.677+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:01.719932+0000 front 2024-04-30T23:32:01.720060+0000 (oldest deadline 2024-04-30T23:32:27.620040+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:43.677+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:07.620675+0000 front 2024-04-30T23:32:07.620577+0000 (oldest deadline 2024-04-30T23:32:33.520589+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7[51265]: 2024-04-30T23:32:43.677+0000 7fdd4127f700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:15.821498+0000 front 2024-04-30T23:32:15.821473+0000 (oldest deadline 2024-04-30T23:32:41.721548+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:43.853+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:44.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:43.853+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:44.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:43.853+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:44.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:43.853+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:44.049 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:43 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:43.853+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:44.193+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:44.193+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:44.193+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:44.346+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:44.346+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:44.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:44 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:44.346+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:44.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:44 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:44.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:44.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:44 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:44.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:44.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:44 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:44.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:44.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:44 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:44.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:44.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:44 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:44.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:45.278 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:44 smithi104 podman[69380]: 2024-04-30 23:32:44.984100749 +0000 UTC m=+5.483553820 container died 4e8f358faa87a6af7466ef701c1f317cb35f8bcc7e1b814511ea713c2ca935c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-30T23:32:45.278 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:44.861+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:45.279 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:44.861+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:45.279 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:44.861+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:45.279 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:44.861+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:45.279 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:44.861+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:45.545 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:45 smithi104 podman[69380]: 2024-04-30 23:32:45.367541238 +0000 UTC m=+5.866994316 container cleanup 4e8f358faa87a6af7466ef701c1f317cb35f8bcc7e1b814511ea713c2ca935c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:32:45.545 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:45 smithi104 bash[69380]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:45.376+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:45.376+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:45.376+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:45.227+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:45.227+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:45.227+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:45.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:45 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:45.227+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:45.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:45 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:45.201+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:45.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:45 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:45.201+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:45.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:45 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:45.201+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:45.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:45 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:45.201+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:45.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:45 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:45.201+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:45.797 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:45 smithi104 podman[69400]: 2024-04-30 23:32:45.54402051 +0000 UTC m=+0.553687031 container remove 4e8f358faa87a6af7466ef701c1f317cb35f8bcc7e1b814511ea713c2ca935c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:45 smithi104 podman[69494]: 2024-04-30 23:32:45.881611105 +0000 UTC m=+0.018703714 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:46 smithi104 podman[69494]: 2024-04-30 23:32:46.012307247 +0000 UTC m=+0.149399883 container create 8cd7a203bcfef7c731dfc40ce71910a473ca375e15ba505f9562bc1806cbb66b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:45 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:45.854+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:45 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:45.854+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:45 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:45.854+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:45 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:45.854+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:46.137 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:45 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:45.854+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:46.548 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:46 smithi104 podman[69494]: 2024-04-30 23:32:46.272986194 +0000 UTC m=+0.410078788 container init 8cd7a203bcfef7c731dfc40ce71910a473ca375e15ba505f9562bc1806cbb66b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-30T23:32:46.548 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:46 smithi104 podman[69494]: 2024-04-30 23:32:46.275931985 +0000 UTC m=+0.413024579 container start 8cd7a203bcfef7c731dfc40ce71910a473ca375e15ba505f9562bc1806cbb66b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:32:46.548 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:46 smithi104 podman[69494]: 2024-04-30 23:32:46.373107793 +0000 UTC m=+0.510200388 container attach 8cd7a203bcfef7c731dfc40ce71910a473ca375e15ba505f9562bc1806cbb66b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:46.219+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:46.219+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:46.219+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:46.219+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:46.388+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:46.388+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:46.388+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:46.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:46 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:46.388+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:46.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:46 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:46.227+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:46.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:46 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:46.227+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:46.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:46 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:46.227+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:46.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:46 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:46.227+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:46.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:46 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:46.227+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:46.824 INFO:journalctl@ceph.osd.7.smithi104.stdout:Apr 30 23:32:46 smithi104 podman[69494]: 2024-04-30 23:32:46.566971691 +0000 UTC m=+0.704064295 container died 8cd7a203bcfef7c731dfc40ce71910a473ca375e15ba505f9562bc1806cbb66b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:32:47.113 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:46 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:46.822+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:47.113 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:46 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:46.822+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:47.114 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:46 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:46.822+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:47.114 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:46 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:46.822+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:47.114 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:46 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:46.822+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:47.136 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.7.service' 2024-04-30T23:32:47.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:47.173 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-30T23:32:47.174 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-30T23:32:47.174 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.8 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:47.191+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:47.191+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:47.191+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:47.191+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 systemd[1]: Stopping Ceph osd.8 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.380+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.380+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.380+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:47.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.380+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:47.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:47 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:47.188+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:47.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:47 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:47.188+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:47.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:47 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:47.188+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:47.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:47 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:47.188+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:47.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:47 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:47.188+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:48.053 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.731+0000 7f52822eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:48.053 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.731+0000 7f52822eb700 -1 osd.8 97 *** Got signal Terminated *** 2024-04-30T23:32:48.053 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:47 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:47.731+0000 7f52822eb700 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:48.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:47 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:47.820+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:48.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:47 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:47.821+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:48.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:47 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:47.821+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:48.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:47 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:47.821+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:48.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:47 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:47.821+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:48.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:48.348+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:48.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:48.348+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:48.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:48.348+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:48.554 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:48.348+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:48.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:48.175+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:48.554 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:48.175+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:48.555 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:48.175+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:48.555 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:48 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:48.175+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:48.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:48.146+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:48.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:48.146+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:48.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:48.146+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:48.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:48.146+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:48.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:48 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:48.146+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:49.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:48.800+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:49.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:48.800+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:49.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:48.800+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:49.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:48.800+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:49.299 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:48.800+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:49.378+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:49.378+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:49.378+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:49.378+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:49.173+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:49.173+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:49.173+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:49.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:49 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:49.173+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:49.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:49.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:49.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:49.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:49.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:49.170+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:49.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:49.170+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:49.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:49 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:49.170+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:50.199 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:49 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:49.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:50.199 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:49 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:49.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:50.200 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:49 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:49.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:50.200 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:49 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:49.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:50.200 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:49 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:49.825+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:50.401 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:50.147+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:50.401 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:50.147+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:50.402 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:50.147+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:50.402 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:50.147+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:50.402 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:50.147+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:50.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:50.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:50.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:50.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:50.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:50.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:50 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:50.220+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:50.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:50.399+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:50.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:50.399+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:50.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:50.399+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:50.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:50 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:50.399+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:51.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:50 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:50.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:51.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:50 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:50.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:51.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:50 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:50.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:51.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:50 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:50.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:51.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:50 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:50.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:51.377 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:51.374+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:51.377 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:51.374+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:51.377 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:51.374+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:51.378 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:51.374+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:51.378 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:51.124+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:51.378 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:51.124+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:51.378 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:51.124+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:51.379 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:51.124+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:51.379 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:51 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:51.124+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:51.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:51.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:51.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:51.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:51.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:51.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:51 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:51.173+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:52.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:51 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:51.791+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:52.398 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:52.102+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:52.398 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:52.102+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:52.399 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:52.102+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:52.399 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:52.102+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:52.399 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:52.102+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:52.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:52.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:52.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:52.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:52.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:52.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:52 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:52.194+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:52.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:52.396+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.861267+0000 front 2024-04-30T23:31:52.861362+0000 (oldest deadline 2024-04-30T23:32:18.761298+0000) 2024-04-30T23:32:52.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:52.396+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:04.062555+0000 front 2024-04-30T23:32:04.062490+0000 (oldest deadline 2024-04-30T23:32:29.362683+0000) 2024-04-30T23:32:52.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:52.396+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.363331+0000 front 2024-04-30T23:32:09.363318+0000 (oldest deadline 2024-04-30T23:32:34.063199+0000) 2024-04-30T23:32:52.803 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8[52230]: 2024-04-30T23:32:52.396+0000 7f527a899700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.765312+0000 front 2024-04-30T23:32:19.765368+0000 (oldest deadline 2024-04-30T23:32:45.665261+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:53.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:52 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:52.780+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:53 smithi183 podman[70734]: 2024-04-30 23:32:53.051927843 +0000 UTC m=+5.684996312 container died 5710690d7f5124ba40ad710852de150d241ad9bcc9b0b0cc7d0fcf930fdb165e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:53 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:53.113+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:53 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:53.113+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:53 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:53.113+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:53 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:53.113+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:53.352 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:53 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:53.113+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:53.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:53.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:53.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:53.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:53.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:53.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:53 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:53.172+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:53.669 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:53 smithi183 podman[70734]: 2024-04-30 23:32:53.449802345 +0000 UTC m=+6.082870801 container cleanup 5710690d7f5124ba40ad710852de150d241ad9bcc9b0b0cc7d0fcf930fdb165e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5) 2024-04-30T23:32:53.669 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:53 smithi183 bash[70734]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8 2024-04-30T23:32:54.047 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:54.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:54.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:54.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:54.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:54.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:53 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:53.777+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:54.052 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:53 smithi183 podman[70752]: 2024-04-30 23:32:53.667619117 +0000 UTC m=+0.610675838 container remove 5710690d7f5124ba40ad710852de150d241ad9bcc9b0b0cc7d0fcf930fdb165e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-30T23:32:54.330 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:53.970193541 +0000 UTC m=+0.018113228 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:32:54.331 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:54.1184549 +0000 UTC m=+0.166374573 container create fa374214cdab33fcd70d01e4c54f1cf3269a6997cd488095efc3d46a3ede774a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:32:54.331 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:54 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:54.100+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:54.331 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:54 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:54.100+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:54.331 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:54 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:54.100+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:54.332 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:54 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:54.100+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:54.332 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:54 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:54.100+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:54.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:54.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:54.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:54.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:54.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:54.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:54 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:54.179+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:54.631 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:54.329089231 +0000 UTC m=+0.377008900 container init fa374214cdab33fcd70d01e4c54f1cf3269a6997cd488095efc3d46a3ede774a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-30T23:32:54.631 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:54.332320016 +0000 UTC m=+0.380239686 container start fa374214cdab33fcd70d01e4c54f1cf3269a6997cd488095efc3d46a3ede774a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-04-30T23:32:54.631 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:54.404155434 +0000 UTC m=+0.452075120 container attach fa374214cdab33fcd70d01e4c54f1cf3269a6997cd488095efc3d46a3ede774a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-30T23:32:54.942 INFO:journalctl@ceph.osd.8.smithi183.stdout:Apr 30 23:32:54 smithi183 podman[70846]: 2024-04-30 23:32:54.629679225 +0000 UTC m=+0.677598913 container died fa374214cdab33fcd70d01e4c54f1cf3269a6997cd488095efc3d46a3ede774a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-8-deactivate, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:55.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:54 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:54.769+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:55.218 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:55 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:55.058+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:55.218 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:55 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:55.058+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:55.218 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:55 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:55.058+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:55.218 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:55 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:55.058+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:55.218 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:55 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:55.058+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:55.233 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.8.service' 2024-04-30T23:32:55.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:32:55.270 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-30T23:32:55.270 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-30T23:32:55.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.9 2024-04-30T23:32:55.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.136+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:55.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 systemd[1]: Stopping Ceph osd.9 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:56.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:55 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:55.741+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:56.074 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.594+0000 7fa7d7b7b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:32:56.074 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.594+0000 7fa7d7b7b700 -1 osd.9 97 *** Got signal Terminated *** 2024-04-30T23:32:56.075 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:55 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:55.594+0000 7fa7d7b7b700 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:32:56.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:56.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:56.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:56.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:56.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:56.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:56.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:56.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:56.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:56.030+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:56.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:56.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:56.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:56.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:56.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:56.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:56 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:56.171+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:57.047 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:57.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:57.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:57.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:57.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:57.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:56 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:56.747+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:57.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:57 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:57.064+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:57.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:57 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:57.064+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:57.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:57 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:57.064+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:57.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:57 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:57.064+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:57.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:57 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:57.064+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:57.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:57.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:57.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:57.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:57.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:57.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:57 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:57.169+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:58.048 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:57 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:57.784+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:58.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:58 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:58.096+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:32:58.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:58.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:58.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:58.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:58.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:58.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:58 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:58.195+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:32:59.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:58 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:58.823+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:32:59.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:32:59 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:32:59.060+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:32:59.574 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:32:59.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:32:59.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:32:59.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:32:59.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:32:59.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:32:59 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:32:59.236+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:00.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:32:59 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:32:59.804+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:00.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:00.037+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:43.150777+0000 front 2024-04-30T23:31:43.150953+0000 (oldest deadline 2024-04-30T23:32:11.951669+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.452776+0000 front 2024-04-30T23:31:52.452925+0000 (oldest deadline 2024-04-30T23:32:19.453465+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:31:59.454312+0000 front 2024-04-30T23:31:59.454142+0000 (oldest deadline 2024-04-30T23:32:25.354164+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.355536+0000 front 2024-04-30T23:32:12.355508+0000 (oldest deadline 2024-04-30T23:32:37.655733+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:17.656539+0000 front 2024-04-30T23:32:17.656614+0000 (oldest deadline 2024-04-30T23:32:44.056727+0000) 2024-04-30T23:33:00.575 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9[62397]: 2024-04-30T23:33:00.285+0000 7fa7d0129700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.557950+0000 front 2024-04-30T23:32:24.557809+0000 (oldest deadline 2024-04-30T23:32:49.257671+0000) 2024-04-30T23:33:01.271 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:00 smithi100 podman[93537]: 2024-04-30 23:33:00.975661478 +0000 UTC m=+5.506157506 container died d00e326ad88c7746ddd5b8450cde0bab0f6fdd2c4351d58b86b2cc07069699c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:33:01.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:01.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:00 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:00.831+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:01.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:01 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:01.081+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:01.571 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:01 smithi100 podman[93537]: 2024-04-30 23:33:01.360967934 +0000 UTC m=+5.891463967 container cleanup d00e326ad88c7746ddd5b8450cde0bab0f6fdd2c4351d58b86b2cc07069699c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:33:01.571 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:01 smithi100 bash[93537]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9 2024-04-30T23:33:01.824 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:01 smithi100 podman[93554]: 2024-04-30 23:33:01.570374742 +0000 UTC m=+0.593555485 container remove d00e326ad88c7746ddd5b8450cde0bab0f6fdd2c4351d58b86b2cc07069699c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-30T23:33:02.159 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:01 smithi100 podman[93645]: 2024-04-30 23:33:01.798697857 +0000 UTC m=+0.018095315 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:33:02.159 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:01 smithi100 podman[93645]: 2024-04-30 23:33:01.929580226 +0000 UTC m=+0.148977683 container create a607edc07c086b8621525a0c9b64855088e5d9cd26e626732aa44281c9630512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:33:02.159 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:02 smithi100 podman[93645]: 2024-04-30 23:33:02.157460638 +0000 UTC m=+0.376858106 container init a607edc07c086b8621525a0c9b64855088e5d9cd26e626732aa44281c9630512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:02.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:01 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:01.880+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:02.460 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:02 smithi100 podman[93645]: 2024-04-30 23:33:02.161233772 +0000 UTC m=+0.380631230 container start a607edc07c086b8621525a0c9b64855088e5d9cd26e626732aa44281c9630512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-30T23:33:02.460 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:02 smithi100 podman[93645]: 2024-04-30 23:33:02.2484672 +0000 UTC m=+0.467864659 container attach a607edc07c086b8621525a0c9b64855088e5d9cd26e626732aa44281c9630512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:02.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:02 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:02.130+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:02.752 INFO:journalctl@ceph.osd.9.smithi100.stdout:Apr 30 23:33:02 smithi100 podman[93645]: 2024-04-30 23:33:02.458935778 +0000 UTC m=+0.678333240 container died a607edc07c086b8621525a0c9b64855088e5d9cd26e626732aa44281c9630512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-04-30T23:33:03.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.9.service' 2024-04-30T23:33:03.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:03.080 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-30T23:33:03.080 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-30T23:33:03.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.10 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:02 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:02.902+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:03.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 systemd[1]: Stopping Ceph osd.10 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:03.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:03 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:03.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:03.797 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.396+0000 7fcd3b0a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:03.798 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.396+0000 7fcd3b0a4700 -1 osd.10 97 *** Got signal Terminated *** 2024-04-30T23:33:03.798 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.396+0000 7fcd3b0a4700 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:04.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:03 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:03.864+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:04.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:04.093+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:05.297 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:05.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:04 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:04.891+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:05.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:05 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:05.053+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:06.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:05 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:05.926+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:06.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:06 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:06.090+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:07.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:06 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:06.938+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:07.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:07 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:07.098+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:46.589186+0000 front 2024-04-30T23:31:46.589129+0000 (oldest deadline 2024-04-30T23:32:12.488993+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6804 osd.1 since back 2024-04-30T23:31:52.489319+0000 front 2024-04-30T23:31:52.489346+0000 (oldest deadline 2024-04-30T23:32:17.789448+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:02.490582+0000 front 2024-04-30T23:32:02.490501+0000 (oldest deadline 2024-04-30T23:32:28.390586+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:09.491857+0000 front 2024-04-30T23:32:09.491928+0000 (oldest deadline 2024-04-30T23:32:32.991747+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:19.393418+0000 front 2024-04-30T23:32:19.393444+0000 (oldest deadline 2024-04-30T23:32:41.093488+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:27.495163+0000 front 2024-04-30T23:32:27.495015+0000 (oldest deadline 2024-04-30T23:32:51.594890+0000) 2024-04-30T23:33:08.298 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:07 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10[57881]: 2024-04-30T23:33:07.984+0000 7fcd3765a700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:36.296204+0000 front 2024-04-30T23:32:36.296224+0000 (oldest deadline 2024-04-30T23:33:00.396117+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:08.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:08 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:08.140+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:09.223 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:08 smithi104 podman[69611]: 2024-04-30 23:33:08.923963341 +0000 UTC m=+5.648506028 container died d9cae1e9fce987b27a86236e023712e91a5dfd0e28ebc7a8dc51539d0d8e52f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-30T23:33:09.531 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:09 smithi104 podman[69611]: 2024-04-30 23:33:09.29558302 +0000 UTC m=+6.020125710 container cleanup d9cae1e9fce987b27a86236e023712e91a5dfd0e28ebc7a8dc51539d0d8e52f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-30T23:33:09.531 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:09 smithi104 bash[69611]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:09.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:09 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:09.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:09.798 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:09 smithi104 podman[69628]: 2024-04-30 23:33:09.529931976 +0000 UTC m=+0.607443009 container remove d9cae1e9fce987b27a86236e023712e91a5dfd0e28ebc7a8dc51539d0d8e52f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-30T23:33:10.176 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:09 smithi104 podman[69719]: 2024-04-30 23:33:09.764086327 +0000 UTC m=+0.018171437 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:33:10.176 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:09 smithi104 podman[69719]: 2024-04-30 23:33:09.889127303 +0000 UTC m=+0.143212447 container create e114466841a69a7cf06b559dfc0433470b219805c5cbdd86afc1bfd8a999a57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True) 2024-04-30T23:33:10.176 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:10 smithi104 podman[69719]: 2024-04-30 23:33:10.09969745 +0000 UTC m=+0.353782562 container init e114466841a69a7cf06b559dfc0433470b219805c5cbdd86afc1bfd8a999a57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:33:10.176 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:10 smithi104 podman[69719]: 2024-04-30 23:33:10.102738374 +0000 UTC m=+0.356823476 container start e114466841a69a7cf06b559dfc0433470b219805c5cbdd86afc1bfd8a999a57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:33:10.176 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:10 smithi104 podman[69719]: 2024-04-30 23:33:10.174643983 +0000 UTC m=+0.428729095 container attach e114466841a69a7cf06b559dfc0433470b219805c5cbdd86afc1bfd8a999a57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True) 2024-04-30T23:33:10.548 INFO:journalctl@ceph.osd.10.smithi104.stdout:Apr 30 23:33:10 smithi104 podman[69719]: 2024-04-30 23:33:10.398630578 +0000 UTC m=+0.652715682 container died e114466841a69a7cf06b559dfc0433470b219805c5cbdd86afc1bfd8a999a57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:10.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:10.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:10.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.10.service' 2024-04-30T23:33:10.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:10.936 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-30T23:33:10.936 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-30T23:33:10.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.11 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:10 smithi183 systemd[1]: Stopping Ceph osd.11 for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:11.245 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:11.246 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.097+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:11.246 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.242+0000 7fc5a8a5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:11.246 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.242+0000 7fc5a8a5b700 -1 osd.11 97 *** Got signal Terminated *** 2024-04-30T23:33:11.246 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:11 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:11.242+0000 7fc5a8a5b700 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:12.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:12 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:12.119+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:13.454 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:13.454 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:13.454 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:13.454 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:13.455 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:13.455 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:13.455 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:13 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:13.084+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:14.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:14 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:14.086+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:15.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:15.304 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:15.304 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:15 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:15.039+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-04-30T23:32:50.535666+0000 front 2024-04-30T23:32:50.535645+0000 (oldest deadline 2024-04-30T23:33:14.635622+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-04-30T23:31:44.522195+0000 front 2024-04-30T23:31:44.522058+0000 (oldest deadline 2024-04-30T23:32:09.222128+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-04-30T23:32:03.526438+0000 front 2024-04-30T23:32:03.526337+0000 (oldest deadline 2024-04-30T23:32:28.226434+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-04-30T23:32:12.327685+0000 front 2024-04-30T23:32:12.327716+0000 (oldest deadline 2024-04-30T23:32:33.427934+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6812 osd.4 since back 2024-04-30T23:32:20.330308+0000 front 2024-04-30T23:32:20.330373+0000 (oldest deadline 2024-04-30T23:32:44.430407+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6812 osd.5 since back 2024-04-30T23:32:24.430865+0000 front 2024-04-30T23:32:24.430929+0000 (oldest deadline 2024-04-30T23:32:49.731016+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-04-30T23:32:34.833307+0000 front 2024-04-30T23:32:34.833210+0000 (oldest deadline 2024-04-30T23:32:57.733198+0000) 2024-04-30T23:33:16.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.104:6820 osd.7 since back 2024-04-30T23:32:43.034442+0000 front 2024-04-30T23:32:43.034424+0000 (oldest deadline 2024-04-30T23:33:07.134215+0000) 2024-04-30T23:33:16.304 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11[58843]: 2024-04-30T23:33:16.029+0000 7fc5a5011700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.183:6820 osd.8 since back 2024-04-30T23:32:50.535666+0000 front 2024-04-30T23:32:50.535645+0000 (oldest deadline 2024-04-30T23:33:14.635622+0000) 2024-04-30T23:33:16.903 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:16 smithi183 podman[70951]: 2024-04-30 23:33:16.642545883 +0000 UTC m=+5.512758078 container died 768fec3ca1c6631504cc99ffc3f4dc595858acf028bcdcbe3b51d69b6b6e5f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-30T23:33:17.269 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[70951]: 2024-04-30 23:33:17.00060717 +0000 UTC m=+5.870819349 container cleanup 768fec3ca1c6631504cc99ffc3f4dc595858acf028bcdcbe3b51d69b6b6e5f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-30T23:33:17.269 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 bash[70951]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11 2024-04-30T23:33:17.553 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[70980]: 2024-04-30 23:33:17.268352814 +0000 UTC m=+0.620625170 container remove 768fec3ca1c6631504cc99ffc3f4dc595858acf028bcdcbe3b51d69b6b6e5f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-30T23:33:17.881 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[71071]: 2024-04-30 23:33:17.51838776 +0000 UTC m=+0.017957426 image pull 9433911a40181c5453f048c2b99ad206b5f2ccdd75af482628e4c7c841018dc3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd 2024-04-30T23:33:17.881 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[71071]: 2024-04-30 23:33:17.669494338 +0000 UTC m=+0.169064002 container create 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-30T23:33:17.881 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[71071]: 2024-04-30 23:33:17.88007437 +0000 UTC m=+0.379644042 container init 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-30T23:33:18.175 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[71071]: 2024-04-30 23:33:17.883180915 +0000 UTC m=+0.382750589 container start 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-30T23:33:18.175 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:17 smithi183 podman[71071]: 2024-04-30 23:33:17.954952505 +0000 UTC m=+0.454522185 container attach 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-30T23:33:18.467 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:18 smithi183 podman[71071]: 2024-04-30 23:33:18.173864637 +0000 UTC m=+0.673434310 container died 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4) 2024-04-30T23:33:18.721 INFO:journalctl@ceph.osd.11.smithi183.stdout:Apr 30 23:33:18 smithi183 podman[71097]: 2024-04-30 23:33:18.708018395 +0000 UTC m=+0.523633734 container remove 88e7fba17705d398ee8d02407860ae6313df8ecfe0c7c27bb283c8ecec7b2d81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:33:18.727 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@osd.11.service' 2024-04-30T23:33:18.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:18.767 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-30T23:33:18.767 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-30T23:33:18.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.a 2024-04-30T23:33:19.072 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:18 smithi100 systemd[1]: Stopping Ceph mds.a for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:19.324 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:19 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: 2024-04-30T23:33:19.069+0000 7fa2a09f6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:19.324 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:19 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a[69241]: 2024-04-30T23:33:19.069+0000 7fa2a09f6700 -1 mds.a *** got signal Terminated *** 2024-04-30T23:33:23.504 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:23 smithi100 podman[93765]: 2024-04-30 23:33:23.080964013 +0000 UTC m=+4.110497816 container died 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-30T23:33:23.504 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:23 smithi100 podman[93765]: 2024-04-30 23:33:23.502783074 +0000 UTC m=+4.532316868 container cleanup 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-30T23:33:23.824 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:23 smithi100 bash[93765]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a 2024-04-30T23:33:23.824 INFO:journalctl@ceph.mds.a.smithi100.stdout:Apr 30 23:33:23 smithi100 podman[93779]: 2024-04-30 23:33:23.728962058 +0000 UTC m=+0.643037061 container remove 9d5e12bbcb0a7fdb78eb4aaab6f8e4c7585a95522c2336643fedc9a317d2413e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-30T23:33:23.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.a.service' 2024-04-30T23:33:23.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:23.977 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-30T23:33:23.977 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-30T23:33:23.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.d 2024-04-30T23:33:24.283 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:24 smithi100 systemd[1]: Stopping Ceph mds.d for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:24.574 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d[68272]: 2024-04-30T23:33:24.280+0000 7fc12adef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:24.574 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:24 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d[68272]: 2024-04-30T23:33:24.280+0000 7fc12adef700 -1 mds.d *** got signal Terminated *** 2024-04-30T23:33:27.574 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:27 smithi100 podman[93887]: 2024-04-30 23:33:27.313424831 +0000 UTC m=+3.118744672 container died b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-30T23:33:27.959 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:27 smithi100 podman[93887]: 2024-04-30 23:33:27.714690024 +0000 UTC m=+3.520009864 container cleanup b2427507c239dccfa53321dd09ec53bbfc4864e92ab55cb6ecee5cd539cd0f0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-30T23:33:27.959 INFO:journalctl@ceph.mds.d.smithi100.stdout:Apr 30 23:33:27 smithi100 bash[93887]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-d 2024-04-30T23:33:28.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.d.service' 2024-04-30T23:33:28.095 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:28.095 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-30T23:33:28.095 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-30T23:33:28.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.g 2024-04-30T23:33:28.324 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:28 smithi100 systemd[1]: Stopping Ceph mds.g for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:28.824 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: 2024-04-30T23:33:28.418+0000 7ff33190b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:28.824 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:28 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g[68885]: 2024-04-30T23:33:28.418+0000 7ff33190b700 -1 mds.g *** got signal Terminated *** 2024-04-30T23:33:31.574 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:31 smithi100 podman[94008]: 2024-04-30 23:33:31.287325789 +0000 UTC m=+2.984884708 container died dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux ) 2024-04-30T23:33:31.979 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:31 smithi100 podman[94008]: 2024-04-30 23:33:31.659965733 +0000 UTC m=+3.357524647 container cleanup dd6a8bc56243d100cf353dba06b6087e5867f02df4c595db001bcea2fe0aeabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-30T23:33:31.979 INFO:journalctl@ceph.mds.g.smithi100.stdout:Apr 30 23:33:31 smithi100 bash[94008]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-g 2024-04-30T23:33:32.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.g.service' 2024-04-30T23:33:32.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:32.166 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-30T23:33:32.166 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-30T23:33:32.166 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.j 2024-04-30T23:33:32.574 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:32 smithi100 systemd[1]: Stopping Ceph mds.j for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:32.574 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j[67920]: 2024-04-30T23:33:32.471+0000 7f6ac803a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:32.574 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:32 smithi100 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j[67920]: 2024-04-30T23:33:32.471+0000 7f6ac803a700 -1 mds.j *** got signal Terminated *** 2024-04-30T23:33:36.776 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:36 smithi100 podman[94127]: 2024-04-30 23:33:36.395718898 +0000 UTC m=+4.018383972 container died 856b839bf9e893adacf4cb4c9d2199107c41dbc42bfc8f715a0b9b6d82dbe316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-30T23:33:37.074 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:36 smithi100 podman[94127]: 2024-04-30 23:33:36.857530691 +0000 UTC m=+4.480195764 container cleanup 856b839bf9e893adacf4cb4c9d2199107c41dbc42bfc8f715a0b9b6d82dbe316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-30T23:33:37.074 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:36 smithi100 bash[94127]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j 2024-04-30T23:33:37.074 INFO:journalctl@ceph.mds.j.smithi100.stdout:Apr 30 23:33:37 smithi100 podman[94141]: 2024-04-30 23:33:37.008506542 +0000 UTC m=+0.604268967 container remove 856b839bf9e893adacf4cb4c9d2199107c41dbc42bfc8f715a0b9b6d82dbe316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-30T23:33:37.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.j.service' 2024-04-30T23:33:37.252 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:37.252 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-30T23:33:37.252 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-30T23:33:37.252 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.b 2024-04-30T23:33:37.545 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:37 smithi104 systemd[1]: Stopping Ceph mds.b for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:37.797 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: 2024-04-30T23:33:37.542+0000 7f52f1b50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:37.797 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:37 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b[63249]: 2024-04-30T23:33:37.542+0000 7f52f1b50700 -1 mds.b *** got signal Terminated *** 2024-04-30T23:33:39.548 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:39 smithi104 podman[69827]: 2024-04-30 23:33:39.286478081 +0000 UTC m=+1.842492521 container died ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2) 2024-04-30T23:33:39.820 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:39 smithi104 podman[69827]: 2024-04-30 23:33:39.625600189 +0000 UTC m=+2.181614618 container cleanup ee131c2e42e3cbbd8468a1095841ccbb0e76357c053e31a2fc1695c9264c36c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:33:39.820 INFO:journalctl@ceph.mds.b.smithi104.stdout:Apr 30 23:33:39 smithi104 bash[69827]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-b 2024-04-30T23:33:40.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.b.service' 2024-04-30T23:33:40.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:40.074 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-30T23:33:40.074 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-30T23:33:40.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.e 2024-04-30T23:33:40.390 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:40 smithi104 systemd[1]: Stopping Ceph mds.e for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:40.797 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: 2024-04-30T23:33:40.387+0000 7fd2f6614700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:40.798 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:40 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e[62633]: 2024-04-30T23:33:40.387+0000 7fd2f6614700 -1 mds.e *** got signal Terminated *** 2024-04-30T23:33:43.548 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:43 smithi104 podman[69957]: 2024-04-30 23:33:43.289971446 +0000 UTC m=+2.998586917 container died b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-30T23:33:43.899 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:43 smithi104 podman[69957]: 2024-04-30 23:33:43.595712007 +0000 UTC m=+3.304327488 container cleanup b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-30T23:33:43.899 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:43 smithi104 bash[69957]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e 2024-04-30T23:33:43.899 INFO:journalctl@ceph.mds.e.smithi104.stdout:Apr 30 23:33:43 smithi104 podman[69971]: 2024-04-30 23:33:43.78839553 +0000 UTC m=+0.496552983 container remove b67f3f72762bbc3daa3dcba69c3028369ee4e30954e5710e96ef97c93f93d13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-30T23:33:43.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.e.service' 2024-04-30T23:33:43.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:43.949 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-30T23:33:43.949 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-30T23:33:43.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.h 2024-04-30T23:33:44.251 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:44 smithi104 systemd[1]: Stopping Ceph mds.h for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:44.547 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: 2024-04-30T23:33:44.248+0000 7f847e165700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:44.548 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:44 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h[62942]: 2024-04-30T23:33:44.248+0000 7f847e165700 -1 mds.h *** got signal Terminated *** 2024-04-30T23:33:47.547 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:47 smithi104 podman[70078]: 2024-04-30 23:33:47.28506277 +0000 UTC m=+3.124188170 container died 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-30T23:33:48.009 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:47 smithi104 podman[70078]: 2024-04-30 23:33:47.77361472 +0000 UTC m=+3.612740116 container cleanup 979dc61feb900d36d40df5edfced73ffb3f4ea6738894fe93c4c0a0bd7a4ed9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True) 2024-04-30T23:33:48.009 INFO:journalctl@ceph.mds.h.smithi104.stdout:Apr 30 23:33:47 smithi104 bash[70078]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-h 2024-04-30T23:33:48.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.h.service' 2024-04-30T23:33:48.187 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:48.187 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-30T23:33:48.187 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-30T23:33:48.187 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.k 2024-04-30T23:33:48.547 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:48 smithi104 systemd[1]: Stopping Ceph mds.k for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:48.548 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: 2024-04-30T23:33:48.501+0000 7ff00f105700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:48.548 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:48 smithi104 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k[62306]: 2024-04-30T23:33:48.501+0000 7ff00f105700 -1 mds.k *** got signal Terminated *** 2024-04-30T23:33:51.548 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:51 smithi104 podman[70202]: 2024-04-30 23:33:51.288535201 +0000 UTC m=+2.887207681 container died 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-30T23:33:52.187 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:51 smithi104 podman[70202]: 2024-04-30 23:33:51.943393442 +0000 UTC m=+3.542065911 container cleanup 46ee533fad2c1f3b35e15d9213c97b0a6f1f7a23f5063b1d9a8e0ef46943b87b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, ceph=True) 2024-04-30T23:33:52.187 INFO:journalctl@ceph.mds.k.smithi104.stdout:Apr 30 23:33:51 smithi104 bash[70202]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-k 2024-04-30T23:33:52.319 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.k.service' 2024-04-30T23:33:52.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:52.349 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-30T23:33:52.350 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-30T23:33:52.350 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.c 2024-04-30T23:33:52.641 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:52 smithi183 systemd[1]: Stopping Ceph mds.c for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:52.900 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: 2024-04-30T23:33:52.639+0000 7f3a798cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:52.900 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:52 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c[64262]: 2024-04-30T23:33:52.639+0000 7f3a798cb700 -1 mds.c *** got signal Terminated *** 2024-04-30T23:33:55.553 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:55 smithi183 podman[71177]: 2024-04-30 23:33:55.290923883 +0000 UTC m=+2.753298456 container died 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-04-30T23:33:56.016 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:55 smithi183 podman[71177]: 2024-04-30 23:33:55.74781835 +0000 UTC m=+3.210192930 container cleanup 75d1d6c8365120b8eb3505f4f9fe23a15b7792b28534434a988d1fa17764bc43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424) 2024-04-30T23:33:56.017 INFO:journalctl@ceph.mds.c.smithi183.stdout:Apr 30 23:33:55 smithi183 bash[71177]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-c 2024-04-30T23:33:56.167 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.c.service' 2024-04-30T23:33:56.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:33:56.201 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-30T23:33:56.201 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-30T23:33:56.201 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.f 2024-04-30T23:33:56.553 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:56 smithi183 systemd[1]: Stopping Ceph mds.f for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:33:56.553 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: 2024-04-30T23:33:56.517+0000 7fda1e0fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:33:56.553 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:56 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f[63943]: 2024-04-30T23:33:56.517+0000 7fda1e0fb700 -1 mds.f *** got signal Terminated *** 2024-04-30T23:33:59.553 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:59 smithi183 podman[71308]: 2024-04-30 23:33:59.296183052 +0000 UTC m=+2.879203575 container died 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424) 2024-04-30T23:33:59.911 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:59 smithi183 podman[71308]: 2024-04-30 23:33:59.642919522 +0000 UTC m=+3.225940044 container cleanup 09f856b0dd638a7613248acc983a06bace15c358e1423825cdb2e6d73479acf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-04-30T23:33:59.912 INFO:journalctl@ceph.mds.f.smithi183.stdout:Apr 30 23:33:59 smithi183 bash[71308]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-f 2024-04-30T23:34:00.063 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.f.service' 2024-04-30T23:34:00.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:34:00.094 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-30T23:34:00.095 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-30T23:34:00.095 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.i 2024-04-30T23:34:00.553 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:00 smithi183 systemd[1]: Stopping Ceph mds.i for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:34:00.553 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: 2024-04-30T23:34:00.412+0000 7fede2939700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:34:00.553 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:00 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i[64571]: 2024-04-30T23:34:00.412+0000 7fede2939700 -1 mds.i *** got signal Terminated *** 2024-04-30T23:34:03.553 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:03 smithi183 podman[71428]: 2024-04-30 23:34:03.282606572 +0000 UTC m=+2.978306939 container died c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-04-30T23:34:03.891 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:03 smithi183 podman[71428]: 2024-04-30 23:34:03.679536542 +0000 UTC m=+3.375236907 container cleanup c4076357639ee8001d53b698d404c3bb64e93bf3f758c4c71ba4fb64407c1f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-30T23:34:03.891 INFO:journalctl@ceph.mds.i.smithi183.stdout:Apr 30 23:34:03 smithi183 bash[71428]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-i 2024-04-30T23:34:04.046 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.i.service' 2024-04-30T23:34:04.077 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:34:04.077 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-30T23:34:04.077 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-30T23:34:04.077 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.l 2024-04-30T23:34:04.552 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:04 smithi183 systemd[1]: Stopping Ceph mds.l for a34a4a58-0745-11ef-bc93-c7b262605968... 2024-04-30T23:34:04.553 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l[63634]: 2024-04-30T23:34:04.374+0000 7f5eea1d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-30T23:34:04.553 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:04 smithi183 ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l[63634]: 2024-04-30T23:34:04.374+0000 7f5eea1d7700 -1 mds.l *** got signal Terminated *** 2024-04-30T23:34:07.553 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:07 smithi183 podman[71549]: 2024-04-30 23:34:07.295702168 +0000 UTC m=+3.010163404 container died fa9828bdea7bcfddd1aa0f027a1f12abd54f17dd9bf5da0b42baa97de7eee18c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-04-30T23:34:07.902 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:07 smithi183 podman[71549]: 2024-04-30 23:34:07.65804448 +0000 UTC m=+3.372505711 container cleanup fa9828bdea7bcfddd1aa0f027a1f12abd54f17dd9bf5da0b42baa97de7eee18c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5f0da83b3e6eb537b980531753ac503012515036d49cc6faf860791416797edd, name=ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l, RELEASE=wip-mchangir-testing-20240429.064231-main-debug-8505bf4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-04-30T23:34:07.902 INFO:journalctl@ceph.mds.l.smithi183.stdout:Apr 30 23:34:07 smithi183 bash[71549]: ceph-a34a4a58-0745-11ef-bc93-c7b262605968-mds-l 2024-04-30T23:34:08.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a34a4a58-0745-11ef-bc93-c7b262605968@mds.l.service' 2024-04-30T23:34:08.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-30T23:34:08.070 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-30T23:34:08.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-30T23:34:08.259 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:34:10.811 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-30T23:34:10.999 INFO:teuthology.orchestra.run.smithi104.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:34:13.528 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-30T23:34:13.717 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:34:16.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:34:16.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:34:16.118 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-30T23:34:16.143 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-30T23:34:16.146 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi100/crash 2024-04-30T23:34:16.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash -- . 2024-04-30T23:34:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-30T23:34:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-04-30T23:34:16.177 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi104/crash 2024-04-30T23:34:16.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash -- . 2024-04-30T23:34:16.219 INFO:teuthology.orchestra.run.smithi104.stderr:tar: /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-30T23:34:16.219 INFO:teuthology.orchestra.run.smithi104.stderr:tar: Error is not recoverable: exiting now 2024-04-30T23:34:16.221 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi183/crash 2024-04-30T23:34:16.222 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash -- . 2024-04-30T23:34:16.250 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-30T23:34:16.250 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now 2024-04-30T23:34:16.251 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-30T23:34:16.252 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-30T23:34:16.294 INFO:tasks.cephadm:Compressing logs... 2024-04-30T23:34:16.294 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-30T23:34:16.337 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-30T23:34:16.339 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-30T23:34:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-04-30T23:34:16.361 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log 2024-04-30T23:34:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-30T23:34:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-30T23:34:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-30T23:34:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-30T23:34:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-30T23:34:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.j.log: /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-30T23:34:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-30T23:34:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-30T23:34:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.a.log: 90.4% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-30T23:34:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-30T23:34:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.6.log: 89.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-30T23:34:16.368 INFO:teuthology.orchestra.run.smithi100.stderr: 94.7% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:: No such file or directory 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose --/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log: /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.z.log: 90.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-30T23:34:16.370 INFO:teuthology.orchestra.run.smithi183.stderr: 89.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:: No such file or directory 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.b.log: /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-30T23:34:16.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.10.log: 89.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr: 93.2% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-30T23:34:16.378 INFO:teuthology.orchestra.run.smithi104.stderr: 83.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr: 93.3% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr: 83.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-30T23:34:16.380 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-30T23:34:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-30T23:34:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-30T23:34:16.382 INFO:teuthology.orchestra.run.smithi100.stderr: 83.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-30T23:34:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-30T23:34:16.387 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-30T23:34:16.388 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-30T23:34:16.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-30T23:34:16.395 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-30T23:34:16.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-30T23:34:16.399 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-30T23:34:16.400 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-30T23:34:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-30T23:34:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-30T23:34:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-30T23:34:16.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-30T23:34:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-30T23:34:16.416 INFO:teuthology.orchestra.run.smithi183.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-30T23:34:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-04-30T23:34:16.428 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-30T23:34:16.443 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-04-30T23:34:16.707 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-30T23:34:16.953 INFO:teuthology.orchestra.run.smithi183.stderr: 92.1% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-30T23:34:16.979 INFO:teuthology.orchestra.run.smithi183.stderr: 95.1% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-30T23:34:17.154 INFO:teuthology.orchestra.run.smithi100.stderr: 95.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-30T23:34:17.202 INFO:teuthology.orchestra.run.smithi104.stderr: 92.1% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-30T23:34:17.510 INFO:teuthology.orchestra.run.smithi104.stderr: 95.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-30T23:34:17.918 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-30T23:34:18.386 INFO:teuthology.orchestra.run.smithi104.stderr: 95.1% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-30T23:34:19.261 INFO:teuthology.orchestra.run.smithi183.stderr: 95.4% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-30T23:34:22.209 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-30T23:34:23.038 INFO:teuthology.orchestra.run.smithi100.stderr: 92.1% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-30T23:34:23.446 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-30T23:34:23.698 INFO:teuthology.orchestra.run.smithi183.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-30T23:34:23.799 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-30T23:34:23.982 INFO:teuthology.orchestra.run.smithi104.stderr: 92.2% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-30T23:34:24.365 INFO:teuthology.orchestra.run.smithi100.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-30T23:34:24.375 INFO:teuthology.orchestra.run.smithi104.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-30T23:34:26.259 INFO:teuthology.orchestra.run.smithi183.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-30T23:34:26.348 INFO:teuthology.orchestra.run.smithi104.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-30T23:34:26.838 INFO:teuthology.orchestra.run.smithi104.stderr: 92.0% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-30T23:34:27.347 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-30T23:34:28.799 INFO:teuthology.orchestra.run.smithi183.stderr: 91.8% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-30T23:34:29.872 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-30T23:34:29.874 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-04-30T23:34:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m13.524s 2024-04-30T23:34:29.874 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m47.719s 2024-04-30T23:34:29.875 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m1.495s 2024-04-30T23:34:35.511 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-30T23:34:36.984 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-30T23:34:36.986 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-04-30T23:34:36.986 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m20.633s 2024-04-30T23:34:36.986 INFO:teuthology.orchestra.run.smithi183.stderr:user 1m4.645s 2024-04-30T23:34:36.986 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m1.951s 2024-04-30T23:34:51.643 INFO:teuthology.orchestra.run.smithi104.stderr: 93.6% -- replaced with /var/log/ceph/a34a4a58-0745-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-30T23:34:51.645 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-30T23:34:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m35.292s 2024-04-30T23:34:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:user 1m30.690s 2024-04-30T23:34:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m2.805s 2024-04-30T23:34:51.645 INFO:tasks.cephadm:Archiving logs... 2024-04-30T23:34:51.645 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi100/log 2024-04-30T23:34:51.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-30T23:34:58.424 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi104/log 2024-04-30T23:34:58.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-30T23:35:10.331 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi183/log 2024-04-30T23:35:10.332 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-30T23:35:18.257 INFO:tasks.cephadm:Removing cluster... 2024-04-30T23:35:18.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force 2024-04-30T23:35:18.448 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:35:18.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force 2024-04-30T23:35:19.022 INFO:teuthology.orchestra.run.smithi104.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:35:19.383 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a34a4a58-0745-11ef-bc93-c7b262605968 --force 2024-04-30T23:35:19.572 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: a34a4a58-0745-11ef-bc93-c7b262605968 2024-04-30T23:35:19.896 INFO:tasks.cephadm:Removing cephadm ... 2024-04-30T23:35:19.897 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-30T23:35:19.915 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-30T23:35:19.931 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-30T23:35:19.946 INFO:tasks.cephadm:Teardown complete 2024-04-30T23:35:19.946 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-30T23:35:19.957 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-30T23:35:19.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-30T23:35:19.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-30T23:35:19.973 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-30T23:35:20.067 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-30T23:35:20.077 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-30T23:35:20.077 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T23:35:20.080 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T23:35:20.082 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T23:35:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-30T23:35:20.094 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-30T23:35:20.095 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +1296us[+1299us] +/- 51ms 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -1210us[-1206us] +/- 51ms 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -330us[ -327us] +/- 69ms 2024-04-30T23:35:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +1299us[+1137us] +/- 51ms 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1199us[-1199us] +/- 51ms 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -325us[ -325us] +/- 69ms 2024-04-30T23:35:20.100 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +1288us[+1285us] +/- 51ms 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -1220us[-1223us] +/- 51ms 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -334us[ -337us] +/- 69ms 2024-04-30T23:35:20.101 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T23:35:20.101 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-30T23:35:20.111 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-30T23:35:20.111 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-30T23:35:20.121 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-30T23:35:20.219 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-30T23:35:20.283 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-30T23:35:20.346 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T23:35:20.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:20.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T23:35:20.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:20.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T23:35:20.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:20.428 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-30T23:35:20.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-30T23:35:20.449 INFO:teuthology.task.internal:Duration was 2395.847087 seconds 2024-04-30T23:35:20.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-30T23:35:20.460 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-30T23:35:20.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-30T23:35:20.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-30T23:35:20.464 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-30T23:35:20.499 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T23:35:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T23:35:20.503 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T23:35:20.860 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-30T23:35:20.860 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-04-30T23:35:20.861 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-30T23:35:20.921 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-04-30T23:35:20.921 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-30T23:35:20.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-04-30T23:35:20.947 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-30T23:35:20.976 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-30T23:35:20.976 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-30T23:35:20.978 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-30T23:35:20.989 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-30T23:35:21.040 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-30T23:35:21.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-30T23:35:21.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-30T23:35:21.055 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-30T23:35:21.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-30T23:35:21.463 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-30T23:35:21.464 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-30T23:35:21.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-30T23:35:21.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-30T23:35:21.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-30T23:35:21.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.548 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.554 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.567 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-04-30T23:35:21.574 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-04-30T23:35:21.597 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-04-30T23:35:21.617 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:21.633 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:21.650 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-30T23:35:21.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T23:35:21.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-30T23:35:21.684 INFO:teuthology.task.internal:Transferring archived files... 2024-04-30T23:35:21.685 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi100 2024-04-30T23:35:21.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-30T23:35:21.726 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi104 2024-04-30T23:35:21.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-30T23:35:21.761 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031/remote/smithi183 2024-04-30T23:35:21.761 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-30T23:35:21.795 INFO:teuthology.task.internal:Removing archive directory... 2024-04-30T23:35:21.795 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-30T23:35:21.798 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-30T23:35:21.800 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-30T23:35:21.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-30T23:35:21.857 INFO:teuthology.task.internal:Not uploading archives. 2024-04-30T23:35:21.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-30T23:35:21.869 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-30T23:35:21.869 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-30T23:35:21.871 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-30T23:35:21.874 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-30T23:35:21.883 INFO:teuthology.orchestra.run.smithi100.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 30 23:35 /home/ubuntu/cephtest 2024-04-30T23:35:21.886 INFO:teuthology.orchestra.run.smithi104.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 30 23:35 /home/ubuntu/cephtest 2024-04-30T23:35:21.899 INFO:teuthology.orchestra.run.smithi183.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 30 23:35 /home/ubuntu/cephtest 2024-04-30T23:35:21.900 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-30T23:35:21.913 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-30T23:35:21.935 INFO:teuthology.nuke:Checking targets against current locks 2024-04-30T23:35:21.962 DEBUG:teuthology.nuke:shortname: smithi100 2024-04-30T23:35:21.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T23:35:21.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.537772', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfQLgs72vvWJ3tRAdCeuQRQZwsNDZUdgu9NSxHk5JE2FcZufPbXrjUuRhejKzHsvntTYl/mB8/3PQzBd5qF42g='} 2024-04-30T23:35:21.986 DEBUG:teuthology.nuke:shortname: smithi104 2024-04-30T23:35:21.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T23:35:22.010 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.535224', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuKLalUctquPm5dFgVhaXTTQ1GlR3Ub9Zy7Z7YYWVkGC+P40zKo+Qr53k2YqfcDGQge3HdonczUCa0PD95eqtY='} 2024-04-30T23:35:22.015 DEBUG:teuthology.nuke:shortname: smithi183 2024-04-30T23:35:22.015 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T23:35:22.041 INFO:teuthology.orchestra.console.smithi100:Power off 2024-04-30T23:35:22.042 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-30T23:35:22.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-04-30_01:08:25-fs-wip-mchangir-testing-20240429.064231-main-debug-testing-default-smithi/7680031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 22:49:43.536767', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6VRe94YamuiWeIET8Hz0J0MPkv0I799W/q6xDkVb3SVpVKRIr+O65e7rFzmAC0v/PI1g4zjsBnPq0LsFT0qCo='} 2024-04-30T23:35:22.070 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-04-30T23:35:22.070 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:22.097 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-30T23:35:22.097 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-30T23:35:22.107 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-30T23:35:22.120 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-30T23:35:22.120 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:22.133 INFO:teuthology.orchestra.console.smithi183:Power off 2024-04-30T23:35:22.133 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-30T23:35:22.143 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-30T23:35:22.155 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-04-30T23:35:22.155 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:22.177 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-30T23:35:26.109 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:26.145 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:26.178 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:26.221 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-30T23:35:26.257 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-30T23:35:26.288 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-30T23:35:30.226 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:30.258 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:30.289 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:30.336 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-30T23:35:30.368 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-30T23:35:30.398 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-04-30T23:35:30.438 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-04-30T23:35:30.499 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-04-30T23:35:34.372 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T23:35:34.483 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-30T23:35:34.583 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-30T23:35:34.688 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} duration: 2395.847086906433 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default owner: scheduled_mchangir@teuthology status: fail success: false 2024-04-30T23:35:34.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-30T23:35:34.790 INFO:teuthology.run:FAIL